What is Hive on Spark?

Asked by Last Modified  

Follow 2
Answer

Please enter your answer

Hi Priyanka, Spark has many Tools like Spark-Sql,Mlib.. Spark-Sql is the Tool which will work as like hive in Spark. We just need to login to the Spark-Sql Console By using 'Spark-Sql'Command on Linux box where you can run the same sql. Spark-Sql is Much much faster than Hive so, we use to go with...
read more
Hi Priyanka, Spark has many Tools like Spark-Sql,Mlib.. Spark-Sql is the Tool which will work as like hive in Spark. We just need to login to the Spark-Sql Console By using 'Spark-Sql'Command on Linux box where you can run the same sql. Spark-Sql is Much much faster than Hive so, we use to go with Spark-Sql rather than Hive. I think I have answered your question. Still you have any queries you can reach out to me directly. read less
Comments

By default, Hive queries or code gets convereted to mapreduce code. When you run hive, you can see mappers and reducers in your log. But its possible to run hive in 3 modes 1. mapreduce 2. Tez 3. Spark Instead of creating mapreduce jobs, now it runs on spark cluster and leverages in-memory computing...
read more
By default, Hive queries or code gets convereted to mapreduce code. When you run hive, you can see mappers and reducers in your log. But its possible to run hive in 3 modes 1. mapreduce 2. Tez 3. Spark Instead of creating mapreduce jobs, now it runs on spark cluster and leverages in-memory computing. read less
Comments

Related Questions

I want a lady Hadoop Trainer.
Yes. Career bridge it services, one of the best training insitute in hyderabad. we provide lady trainer for ofline / online batches. Please call and contact @970-532-3377. So that you can get all the details about trainings and career guiidance.
Chandrika
What are the biggest pain points with Hadoop?
The biggest pain points with Hadoop are its complexity in setup and maintenance, slow processing due to disk I/O, high resource consumption, and difficulty in handling real-time data.
Anish
0 0
6
Which Hadoop course should I take?
Take apache spark and scala course . Spark is high on demand now and one of the highly efficient and heavily used bigdata tools in market.I do provide Apache spark with scala and python course . You can reach me out for more details
Srinivasan
0 0
6
Hi, currently I am working as php developer having 5 year of experience, I want to change the technology, so can any one suggest me which technology is better for me and in future also (hadoop or node with angular js).
Big Data is cake for data processing whereas Angular is for UI framework. I would recommend you to consider learning Big Data technologies.
Srikanth

Now ask question in any of the 1000+ Categories, and get Answers from Tutors and Trainers on UrbanPro.com

Ask a Question

Related Lessons

HDFS And Mapreduce
1. HDFS (Hadoop Distributed File System): Makes distributed filesystem look like a regular filesystem. Breaks files down into blocks. Distributes blocks to different nodes in the cluster based on...

CheckPointing Process - Hadoop
CHECK POINTING Checkpointing process is one of the vital concept/activity under Hadoop. The Name node stores the metadata information in its hard disk. We all know that metadata is the heart core...

Lesson: Hive Queries
Lesson: Hive Queries This lesson will cover the following topics: Simple selects ? selecting columns Simple selects – selecting rows Creating new columns Hive Functions In SQL, of which...

13 Things Every Data Scientist Must Know Today
We have spent close to a decade in data science & analytics now. Over this period, We have learnt new ways of working on data sets and creating interesting stories. However, before we could succeed,...

REDHAT
Configuring sudo Basic syntax USER MACHINE = (RUN_AS) COMMANDS Examples: %group ALL = (root) /sbin/ifconfig %wheel ALL=(ALL) ALL %admins ALL=(ALL) NOPASSWD: ALL Grant use access to commands in NETWORKING...

Recommended Articles

Hadoop is a framework which has been developed for organizing and analysing big chunks of data for a business. Suppose you have a file larger than your system’s storage capacity and you can’t store it. Hadoop helps in storing bigger files than what could be stored on one particular server. You can therefore store very,...

Read full article >

Big data is a phrase which is used to describe a very large amount of structured (or unstructured) data. This data is so “big” that it gets problematic to be handled using conventional database techniques and software.  A Big Data Scientist is a business employee who is responsible for handling and statistically evaluating...

Read full article >

We have already discussed why and how “Big Data” is all set to revolutionize our lives, professions and the way we communicate. Data is growing by leaps and bounds. The Walmart database handles over 2.6 petabytes of massive data from several million customer transactions every hour. Facebook database, similarly handles...

Read full article >

In the domain of Information Technology, there is always a lot to learn and implement. However, some technologies have a relatively higher demand than the rest of the others. So here are some popular IT courses for the present and upcoming future: Cloud Computing Cloud Computing is a computing technique which is used...

Read full article >

Looking for Hadoop ?

Learn from the Best Tutors on UrbanPro

Are you a Tutor or Training Institute?

Join UrbanPro Today to find students near you