703, 9th A Main Road,
Eshwara Layout Indira Nagar
9th A Main, Indiranagar, Bangalore, India- 560038. .
"For what purpose Bigdata is used?. I am dotnet trainer . Is is useful for me with microsoft technology to learn it?" in Data Science Classes
Hi Sarita Big data is more a term used in reference to processing of huge volumes of data especially unstructured data like text, audio, video etc. Over the last 20 years, SQL databases are more of a universal standard when it comes to data management practices by many firms. With big data, these databases are not sufficient either to deal with size or variety of data. There comes the new technologies like Hadoop which is widely used now to manage, process and analyze big data effectively. Considering the dotnet background, learning about big data processing would help say if you want to use that expertise in order to implement big data projects or even more in terms of upgrading your skills. Apache Hadoop is the original release whereas there are lot of Hadoop distributions out there developed by Cloudera, HortonWorks, MapR and even Microsoft. Microsoft's distribution goes with the name HDInsight and by default, Java is the core language to implement MapReduce programs in Hadoop environment. However even dotnet can be used to run these MapReduce programs with the help of Hadoop Streaming component which basically implements MapReduce implementations using any of the standard programming languages like python, c++, c# etc. Hope this helps Team Jigsaw