What is Hive on Spark?

Asked by Last Modified  

Follow 2
Answer

Please enter your answer

Hi Priyanka, Spark has many Tools like Spark-Sql,Mlib.. Spark-Sql is the Tool which will work as like hive in Spark. We just need to login to the Spark-Sql Console By using 'Spark-Sql'Command on Linux box where you can run the same sql. Spark-Sql is Much much faster than Hive so, we use to go with...
read more
Hi Priyanka, Spark has many Tools like Spark-Sql,Mlib.. Spark-Sql is the Tool which will work as like hive in Spark. We just need to login to the Spark-Sql Console By using 'Spark-Sql'Command on Linux box where you can run the same sql. Spark-Sql is Much much faster than Hive so, we use to go with Spark-Sql rather than Hive. I think I have answered your question. Still you have any queries you can reach out to me directly. read less
Comments

By default, Hive queries or code gets convereted to mapreduce code. When you run hive, you can see mappers and reducers in your log. But its possible to run hive in 3 modes 1. mapreduce 2. Tez 3. Spark Instead of creating mapreduce jobs, now it runs on spark cluster and leverages in-memory computing...
read more
By default, Hive queries or code gets convereted to mapreduce code. When you run hive, you can see mappers and reducers in your log. But its possible to run hive in 3 modes 1. mapreduce 2. Tez 3. Spark Instead of creating mapreduce jobs, now it runs on spark cluster and leverages in-memory computing. read less
Comments

Related Questions

Can anyone suggest about Hadoop?
Hadoop is good but it depends on your experience. If you don't know basic java, linux, shell scripting. Hadoop is not beneficial for you.
Ajay
Should Cloudera or MapR be used for Hadoop distribution?
Cloudera is preferred as MapR is discontinued and Cloudera offers strong support and integration.
Chandra
0 0
5

Hi, currently I am working as php developer having 5 year of experience, I want to change the technology, so can any one suggest me which technology is better for me and in future also (hadoop or node with angular js).

Big Data is cake for data processing whereas Angular is for UI framework. I would recommend you to consider learning Big Data technologies.
Srikanth

Now ask question in any of the 1000+ Categories, and get Answers from Tutors and Trainers on UrbanPro.com

Ask a Question

Related Lessons

Bigdata hadoop training institute in pune
BigData What is BigData Characterstics of BigData Problems with BigData Handling BigData • Distributed Systems Introduction to Distributed Systems Problems with Existing Distributed...

Python Programming or R- Programming
Most of the students usually ask me this question before they join the classes, whether to go with Python or R. Here is my short analysis on this very common topic. If you have interest/or having a job...

HDFS And Mapreduce
1. HDFS (Hadoop Distributed File System): Makes distributed filesystem look like a regular filesystem. Breaks files down into blocks. Distributes blocks to different nodes in the cluster based on...

Solving the issue of Namenode not starting during Single Node Hadoop installation
On firing jps command, if you see that name node is not running during single node hadoop installation , then here are the steps to get Name Node running Problem: namenode not getting started Solution:...
B

Biswanath Banerjee

1 0
0

Best way to learn any software Course
Hi First conform whether you are learning from a real time consultant. Get some Case Studies from the consultant and try to complete with the help of google not with consultant. Because in real time same situation will arise. Thank you

Recommended Articles

Hadoop is a framework which has been developed for organizing and analysing big chunks of data for a business. Suppose you have a file larger than your system’s storage capacity and you can’t store it. Hadoop helps in storing bigger files than what could be stored on one particular server. You can therefore store very,...

Read full article >

Big data is a phrase which is used to describe a very large amount of structured (or unstructured) data. This data is so “big” that it gets problematic to be handled using conventional database techniques and software.  A Big Data Scientist is a business employee who is responsible for handling and statistically evaluating...

Read full article >

We have already discussed why and how “Big Data” is all set to revolutionize our lives, professions and the way we communicate. Data is growing by leaps and bounds. The Walmart database handles over 2.6 petabytes of massive data from several million customer transactions every hour. Facebook database, similarly handles...

Read full article >

In the domain of Information Technology, there is always a lot to learn and implement. However, some technologies have a relatively higher demand than the rest of the others. So here are some popular IT courses for the present and upcoming future: Cloud Computing Cloud Computing is a computing technique which is used...

Read full article >

Find Hadoop near you

Looking for Hadoop ?

Learn from the Best Tutors on UrbanPro

Are you a Tutor or Training Institute?

Join UrbanPro Today to find students near you