Shubham Tripathi

I am a Data Architect and solution architect with over 13 years of IT experience specializing in Big Data, Cloud Architecture, and distributed data processing systems. Currently working with Birlasoft, I bring strong expertise in designing scalable data platforms, building robust data pipelines, and architecting cloud-native solutions on AWS.

Previously, I worked in Dubai (UAE) as a Data Architect with Abu Dhabi Commercial Bank (Innovazit), where I led architecture alignment across business, application, and infrastructure layers. I designed and implemented secure, compliant AWS cloud solutions and built large-scale data pipelines using PySpark to process structured and semi-structured data. I also contributed to advanced initiatives such as facial recognition and risk-based name screening systems.

Before that, I served as a Data Engineer Lead at BNY Mellon, where I implemented multi-tenant Spark job submission using Apache Livy, designed scalable data processing systems, and optimized AWS infrastructure for performance and cost efficiency.

My earlier experience includes working with TIAA, Synechron, Accenture, and Shift India, where I developed streaming and batch data processing solutions using Spark, Scala, Kafka, Hive, and Spring Boot-based microservices.

⸻

Core Expertise
• Big Data Technologies: Apache Spark, Hadoop, Hive, Kafka, Snowflake
• Cloud Platforms: AWS (S3, EMR, Glue, Step Functions, Athena, RDS, Aurora, Redshift)
• Programming: Python, Scala, Java (8 & 11), Spring Boot
• Data Engineering: ETL pipelines, streaming data processing, data modeling
• Architecture: Cloud-native solutions, scalable distributed systems, performance optimization
• Certifications: AWS Certified Solutions Architect – Associate and aws certified data Engineer