7 years of experience working on designing and architecting solutions, and leading a team of Engineers in multiple platforms including Data Engineering, Amazon Web Services, Big Data Analytics, Machine Learning, Cloud Computing, Reverse Engineering, and Mobile Application development. I have ample experience working with Enterprises as well as Silicon Valley startups.
- Design and develop data pipelines and application frameworks.
- Data ingestion into AWS Redshift using Sqoop and transforming data using ETLs as well as Spark (AWS Glue).
- Real-time data processing using AWS Kinesis Data Stream, AWS Kinesis Firehose, and Spark-Streaming.
- Serverless Data Lake architecture.
- Ingestion from DWH into Salesforce.
- CI/CD using AWS CodePipeline & Jenkins.
- Data Visualization using ThoughtSpot and AWS Quicksight.