UrbanPro
true

Spark & Scala Training

LIVE
42 Hours

Course offered by Veer Nagaraju

0 review

Prerequisite: Scala for Spark

 

Scala Basics

 

  • What is Scala?
  • Introduction to Scala REPL
  • Installing Scala IDE
  • Basic Operations
  • Type Inference
  • Block expression
  • Lazy values
  • Defining Functions
  • Defining Procedures
  • Control Structures in Scala
  • Loops â?? ForEach, For, While, Do-While, For Comprehension
  • Collections â?? Array, ArrayBuffer, Map, Tuples, Lists, ListBuffer, Sets, Sequnce,Vector
  • Conditional Operators
  • Enumerations

 

Object Oriented Programming

  • Class and Object Basics
  • Inheritance in Scala
  • Scala Constructors (Auxiliary & Primary)
  • Singletons
  • Companion Objects
  • Nested Classes
  • Case Classes
  • Packages & Visibility Rules
  • Overriding Methods
  • Traits
  • Interfaces
  • Layered Traits

 

Functional Programming

 

  • Functional programming Approach
  • Higher Order Functions
    • map
    • filter
    • reduceLeft and reduceRight
    • sortWith
    • folding and scanning etcâ?¦
  • Anonymous Functions
  • Function Currying

 

    Prerequisite: Bigdata and Hadoop Framework Overview

  • Introduction to BigData
  • Challenges with Bigdata
  • Batch Vs. Realtime processing
  • Overview- Hadoop Ecosystem
    • HDFS
    • Review of MapReduce
    • Hive
    • HBase
    • Sqoop
    • Flume
    • Kafka

 

APACHE SPARK

 

Introduction to Spark

  • What is Spark?
  • Spark Overview
  • Setting up environment
  • Build a simple Spark project with Eclipse & Maven
  • Using Spark Shell

 

Spark Basics

  • Resilient Distributed Datasets (RDDs)
  • Spark Context
  • Spark Ecosystem
  • In-Memory Computations in Spark

 

Working with RDDs

  • Creating, Loading and Saving RDD
  • Transformations on RDD
  • Actions on RDD
  • Key-Value Pair Transformation on RDDs
  • RDD Partitioning
  • RDD Persistence

 

Writing and Deploying on Cluster

  • Spark Applications vs. Spark Shell
  • Spark Runtime Architecture
    • Executors
    • Driver
    • Cluster Managers
  • Creating Spark Context
  • Building a Spark Application
  • Deploying Spark Applications using Spark-Submit

 

Spark Job Execution

  • RDD Lineage
  • Jobs, Stages and Tasks
  • Partition and Shuffles
  • Data Locality
  • Join with or without Partitioner, stages and tasks, etc
  • Spark Web UI

 

 

 

Spark SQL

  • Overview on Hive
  • Spark SQL Architecture
  • SparkSession in Spark SQL
  • Working with DataFrames
  • Integrating Spark SQL with Hive
  • Integrating Spark SQL with JDBC Sources (MySQL)
  • Integrating Spark SQL with NoSQL DB (Cassandra)
  • Handling CSV, JSON and Parquet File Formats
  • Loading and Saving Data

 

Spark Streaming

  • Spark Streaming Architecture
  • Spark Streaming Transformations
    • Stateless and Stateful Transformations
  • Rolling Window and Check pointing
  • Integrating Spark with Kafka Streaming Data
  • Integrating Spark with Twitter Streaming Data
  • Spark Streaming Performance Considerations

 

Spark MLlib

  • What is Machine Learning?
  • ML library for Spark
  • ML Concepts and Algorithms
    • Classification
    • Regression
    • Clustering
    • Collaborative Filtering
  • Typical Steps in ML Pipeline â?? Executors and Transformers
  • ML using Pipelines and DataFrames
  • Recommendation Engine â?? Practical Use Case

 

 

 

 

 Spark GraphX

 

  • Overview of GraphX
  • Components of GraphX â?? VertexRDD, EdgeRDD and Triplets
  • Develop simple application with GraphX
  • Transformations on GraphX
  • Hands on â?? PageRank, TriangleCount Algorithms
  • Common Spark Use-cases

 

Performance Tuning and Debugging

 

  • Shared Variables: Broadcast Variables
  • Shared Variables: Accumulators
  • Common Performance Issues
  • Performance Tuning Tips
  • Spark WebUI
  • Monitoring Driver and Executor Logs

 

Course Deliverables

 

  • Workshop style coaching
  • Interactive approach
  • Course material
  • POC Implementation
  • Hands on practice exercises for each topic
  • Quiz at the end of each major topic
  • Tips and techniques on Cloudera Certification Examination

Gallery (4)

About the Trainer

Veer Nagaraju picture

Avg Rating

0 Reviews

0 Students

3 Courses

Veer Nagaraju

MS(Computer Science)

20 Years of Experience

He has over 23 years of diversified IT experience in the areas of Project/Program Management, Service Management, Application Development and Maintenance, ETL & DataWarehousing and Education/Training.

He is seasoned trainer in Hadoop, .NET and Oracle technologies. He conducted many workshops on Project Management topics such as PMP certification and Microsoft Office Project. He has more than 6 �½ years of teaching experience that includes 6 years on Hadoop Development, Hadoop Administration (CDH and HDP distributions) and Spark (with Scala and Java), Kafka, Cassandra Technologies. He provides mentoring and consulting services for individuals and companies on Bigdata Analytics

Hadoop Consultant and Coach and providing Classroom, Online and Corporate trainings on bBigdata & Hadoop Development, Spark (with Scala and Java), Kafka, Cassandra and Hadoop Administration (Cloudera and Hortonworks distributions). Delivered corporate sessions in India and abroad for various MNCs like IBM, CTS Kolkata, CTS Chennai, CISCO, Scope International, American Megatrends , HP Malaysia, HP Philippines, Amdocs Philippines, NetApp Singapore, PT XL Axiata Tbk, pt bank of the Indonesia Tbk, Informatica, Capgemini, Genpact, Siemens, American Express, Deloitte, Wipro, Collabera, EA Sports, Verizon USA through Collabera, UHG-Hyderabad, Nomura Mumbai, Fidelity Chennai, FAI-Hyderabad, FactSet India, Barclays Bank Pune, and M3BI Hyderabad.

Published white papers on dealing with unstructured data in transportation sector using Solr cloud and Hadoop Ecosystems. He is providing Bigdata & Hadoop, Spark training, mentoring and consulting services to Factset and M3BI.

Visited various Engineering colleges like Gudlavelluru Enginnering College., VR Siddhartha Engg. College, DST sponsored programme at PVP Siddhartha Institute of Technology, VKR & VNB and AGK College of Engineering - Gudivada, Dhanekula Engineering college, Andhra Loyola institute of engineering and technology, Lakkireddy BalReddy College of Engineering, NRI Institute of Technology and conducted Hadoop workshops for Faculty members and Students

He handled large, medium and small size mission critical projects on various domains like Public Transportation, Finance, Banking/Credit card processing, e-Commerce, Content Management and HealthCare & Health Insurance. He served world class clients and delivered trainings and solutions on Bigdata & Hadoop, Spark (with Scala and Java), Hadoop Administration, Kafka, PHP, ASP, Oracle, SQL Server, Sybase, Mysql, ETL and Datawarehousing. Currently he is providing trainings and solutions on the following technologies: HDFS, MapReduce, YARN, Spark (with Scala and Java), PIG, Crunch, Hive, Impala, Sqoop, HBase, Oozie, Zookeeper, Mahout, Flume, Kafka, solr, Storm, Cassandra, Hadoop and Spark integrations

He worked in USA for 9 years and served for fortune 500 companies like American Express, ProgressRail Services, Indiana State Department of Health, and various medium and small size companies.

Students also enrolled in these courses

LIVE
60 Hours

Course offered by Veer Nagaraju

0 review
LIVE
50 Hours

Course offered by Veer Nagaraju

0 review
LIVE
36 Hours

Course offered by Koteswara Rao

0 review
LIVE
1 review

Course offered by Raju

1 review

Tutor has not setup batch timings yet. Book a Demo to talk to the Tutor.

Different batches available for this Course

No Reviews yet!

Reply to 's review

Enter your reply*

1500/1500

Please enter your reply

Your reply should contain a minimum of 10 characters

Your reply has been successfully submitted.

Certified

The Certified badge indicates that the Tutor has received good amount of positive feedback from Students.

Different batches available for this Course

tickYou have successfully registered

Spark & Scala Training by Veer Nagaraju

Veer Nagaraju picture
LIVE

Class
starts in

01

Hour

01

Min

01

Sec

Select One

Register Now

Do you want to Register for this Free class?

Yes, Register No, not right now

Tell us a little more about yourself

Spark & Scala Training by Veer Nagaraju

Veer Nagaraju picture
LIVE

Class
starts in

01

Hour

01

Min

01

Sec

Please enter Student name

Please enter your email address.

Please enter phone number.

Verify Your Mobile Number

Please verify your Mobile Number to book this free class.

Update

Please enter 10 digit phone number.

Please enter your phone number.

Please Enter a valid Mobile Number

This number is already in use.

Resend

Please enter OTP.

Or, give a missed call and get your number verified

080-66-0844-42

This website uses cookies

We use cookies to improve user experience. Choose what cookies you allow us to use. You can read more about our Cookie Policy in our Privacy Policy

Accept All
Decline All

UrbanPro.com is India's largest network of most trusted tutors and institutes. Over 55 lakh students rely on UrbanPro.com, to fulfill their learning requirements across 1,000+ categories. Using UrbanPro.com, parents, and students can compare multiple Tutors and Institutes and choose the one that best suits their requirements. More than 7.5 lakh verified Tutors and Institutes are helping millions of students every day and growing their tutoring business on UrbanPro.com. Whether you are looking for a tutor to learn mathematics, a German language trainer to brush up your German language skills or an institute to upgrade your IT skills, we have got the best selection of Tutors and Training Institutes for you. Read more