Nripa Pathak

Summary of Responsibilities:
Onsite - customer location -
Designed and implemented scalable platform for large amount of data ingestion , aggregation , Integration and analytic in Hadoop, including Map reduce, Spark , Hive, Pig and Hbase
Developed Kafka consumer to receive and store real time data from kafka to hdfs
Using spark sql and Spark streaming for streaming data
Involved in converting Hive queries into Spark transformation using Spark RDD and Java
Written sqoop scripts to import , export and update the data between HDFS/Hive and relational database
Worked with Oozie and zookeeper to manage the job workflow and job coordination in the cluster
Involved in converting large volume of server log using Splunk, created dashboard and reporting
Set up and build & deployment in AWS infrastructure.
POC , development and integration of third party API for performance improvement and automation. Proof of Concept/evaluation various tools in open source stack.
Guidance and support within the team like developer, product owner , scrum master for engineering best practices
Collaborated with the Internal/Client BAâ??s in understanding the requirement and understanding of data flow system.
performing unit testing using Junit ;
Involved in technical guidance to the team, Sprint planning,Daily Scrum,Sprint review,Sprint retrospective and demo session