Hello, According to news "BigData technology is gradually growing day-by-day with ever challenging trends and technologies". Well, personally I can't feel that this is happening. Anyone here who knows about this big data or data governance? I am concerned because I graduated as an IT student and planning to take masters on this specific course. I just wanna know my future if I decided to continue my education. TY
I've worked nearly 15 years for a major enterprise software company that has now gone all in on Big Data. Big Data is more a condition rather than a "thing". It corresponds more to the nature of data (commonly called the Three Vs - Volume, Velocity and Variety) than an entity uniquely its own. Big Data centers mostly on large data volumes typically stored in Hadoop, a file based data management system that replicates data blocks for storage across commodity hardware. Big Data is manipulated or analyzed with statistical languages such as R or via MapReduce, a programming framework where calculations or analysis are sent to the Hadoop nodes (or data blocks). Within the last few years there have been emerging technologies like Spark which in large part replaces most of what MapReduce does. Also there many interfaces or methods to interact with these large data sets in a constant state of development or refine mine. I'd be remiss if I did not mention NoSQL technologies which also support larger data stores than an RDBMS (Relational Database) can store. Those use a key-value pair to index data. I "grew up" building Data Marts and Data Warehouses so Big Data is really just an evolution of that world. I think in order to be a strong Big Data practitioner you must be very capable in the Database world, I'd go so far as to say you really need to be a DBA (I am one by the way). One thing that is very interesting about Big Data is that most of the core technologies are Open Source so there is a great deal of innovation. Big Data definitely is not going anywhere so it's a very good field of study. But be prepared it can be very boring work sifting through huge stacks of data for a golden needle. There are a lot of false alarms and re-tuning of programs and procedures.
Data governance is a set of processes that ensures that important data assets are formally managed throughout the enterprise. Data governance ensures that data can be trusted and that people can be made accountable for any adverse event that happens because of low data quality. I hope this one helps. Good luck!
big data or data governance I appreciate the information you have shared @novadar. I will remember and take your advice as soon as I decided to pursue my study. Just want you to know that I feel glad to know that there are people like you who are willing to spend time answering important inquiries. TY so much @Herlinda- Ty for sharing also. I found out that there also providers that can help you manage your organization.
Also, you can look here http://www.degreeinfo.com/computer-related-degrees/51982-big-data.html and here http://www.degreeinfo.com/computer-related-degrees/52790-big-data-university.html
