What is the reason Hadoop Stack is in demand, aside from unstructured data, log processing or one big fat table in append or overwrite table mode?

Asked by Last Modified  

1 Answer

Learn Hadoop

Follow 1
Answer

Please enter your answer

Gopal Raj

Big Data Architect

Forget abt general niche solution Simple Historical Data Loading with Update is not possible though with Hive 14 ACID is started but at least 2--3 years it will take . Currently of all the hypes the process is drop org table , merge with delta with some non performant sql with unions and then re-create...
read more
Forget abt general niche solution Simple Historical Data Loading with Update is not possible though with Hive 14 ACID is started but at least 2–3 years it will take . Currently of all the hypes the process is drop org table , merge with delta with some non performant sql with unions and then re-create the table . Then there is that serial surrogate key generator . so if i have say 100 TB database and just to load say 50–60 GB delta i will have to drop at least 30–40 Tb and re-create it again ( Leaving aside the Fact tables ) . Also what abt data correction ad hoc . With index and partition also it is heavy duty . for datat mining also any day any time still and near future traditional dbs will beat hadoop stack in performance as well as functionality . read less
Comments
Dislike Bookmark

Related Questions

Hi, currently I am working as php developer having 5 year of experience, I want to change the technology, so can any one suggest me which technology is better for me and in future also (hadoop or node with angular js).
Big Data is cake for data processing whereas Angular is for UI framework. I would recommend you to consider learning Big Data technologies.
Srikanth
What is the speculative execution in hadoop?
Speculative execution in Hadoop is a process of running duplicate tasks on different nodes to finish the job faster by using the result from the task that completes first.
Divya
0 0
5
Hello all, I have completed B.com, MBA fin & M and 5 yr working experience in SAP PLM 1 - Engineering documentation management 2 - Documentation management Please suggest me which type of training I should take for getting more knowledge, clear all concept in details, also help for getting job and cracking interview questions for SAP consultant. 1) Real time training 2) Online training 3) Local institute training 4) Certification training
Hi Priya, since you have B Com and MBA Finance better to go with SAP FICO. Whether online or classroom it doesn't make much difference. But the subject should be learned thoroughly. It will increase your...
Priya
A friend of mine asked me which would be better, a course on Java or a course on big data or Hadoop. All I could manage was a blank stare. Do you have any ideas?
A course is bigdata will be more better. But honestly as a freshers getting a job in big data is little difficult. So my suggestion will be do a course on both java and bigdata, apply for job and what...
Srikumar
0 0
5
Hi I am looking for Storm Trident support for my job, is this the right place to look for?
Yes
Sowjanya
0 0
9

Now ask question in any of the 1000+ Categories, and get Answers from Tutors and Trainers on UrbanPro.com

Ask a Question

Related Lessons

Bigdata hadoop training institute in pune
BigData What is BigData Characterstics of BigData Problems with BigData Handling BigData • Distributed Systems Introduction to Distributed Systems Problems with Existing Distributed...

Eknowledge

0 0
0
Python Programming or R- Programming
Most of the students usually ask me this question before they join the classes, whether to go with Python or R. Here is my short analysis on this very common topic. If you have interest/or having a job...

Jatin Miglani

2 0
0
CheckPointing Process - Hadoop
CHECK POINTING Checkpointing process is one of the vital concept/activity under Hadoop. The Name node stores the metadata information in its hard disk. We all know that metadata is the heart core...

Silvia P.

0 0
0
How To Be A Hadoop Developer?
i. Becoming a Hadoop Developer: Dice survey revealed that 9 out of 10 high paid IT jobs require big data skills. A McKinsey Research Report on Big Data highlights that by end of 2018 the demand for...

Amit Raj

1 0
0
Design Pattern
Prototype Design Pattern: Ø Prototype pattern refers to creating duplicate object while keeping performance in mind. Ø This pattern involves implementing a prototype interface which tells...

Paras Chawla

0 0
0

Recommended Articles

Some Popular IT Courses in Current Market

In the domain of Information Technology, there is always a lot to learn and implement. However, some technologies have a relatively higher demand than the rest of the others. So here are some popular IT courses for the present and upcoming future: Cloud Computing Cloud Computing is a computing technique which is used...

Read full article >

Growth and Career Prospects in Big Data

Big data is a phrase which is used to describe a very large amount of structured (or unstructured) data. This data is so “big” that it gets problematic to be handled using conventional database techniques and software.  A Big Data Scientist is a business employee who is responsible for handling and statistically evaluating...

Read full article >

Learn Hadoop and Big Data

Hadoop is a framework which has been developed for organizing and analysing big chunks of data for a business. Suppose you have a file larger than your system’s storage capacity and you can’t store it. Hadoop helps in storing bigger files than what could be stored on one particular server. You can therefore store very,...

Read full article >

Why Should you Become a Data Scientist

We have already discussed why and how “Big Data” is all set to revolutionize our lives, professions and the way we communicate. Data is growing by leaps and bounds. The Walmart database handles over 2.6 petabytes of massive data from several million customer transactions every hour. Facebook database, similarly handles...

Read full article >

Find Hadoop near you
Hadoop in Hyderabad
Hadoop in Bangalore

Looking for Hadoop ?

Learn from the Best Tutors on UrbanPro

Are you a Tutor or Training Institute?

Join UrbanPro Today to find students near you