Highly motivated Big Data Engineer with a strong passion for learning new technologies. Ashish doesn't like to stick to a framework or architecture just because it's popular, instead loves to explore its alternatives and tailor the architecture to best fit the business requirements. Huge fan of opensource and tries to help the community with any opensource tech already in his bucket. Believes in learning by sharing and team achievements. Ashish believes that sometimes less popular decision might be the best fit for a requirement . Recent topics of interest include Data Lake solutions like Apache Hudi, Streaming Platforms like Apache Pulsar and Kafka
- Total IT Experience: 6 years (as of Nov 12, 2021)
- Big Data Experience: ~5.5 years
- Cloud Experience: AWS Certified Solutions Architect Associate (926/1000)
Top Skills :
- Proficient in Apache Spark with both Scala and Python
- Proficient in implementing Data Lake solution using Apache Hudi
- AWS Certified Solutions Architect Associate (926/1000)
- Proficient in Apache Hive
- Experience using different storages like HDFS, S3, Azure Blob Store, ADLS v2 etc
- Experience working with workflow orchestration tools like Oozie, Airflow etc
- Sound knowledge using ADF ( Azure Data Factory )
- Kubernetes ( AWS - EKS , Azure - AKS )
- Basic Devops using Jenkins, Github Actions, Terraform etc
Programming languages :
- Python( Proficient )
- Core Java ( Intermediate )
- Scala ( Intermediate )
- Shell Scripting
Big Data :
- Apache Spark ( Proficient )
- Apache Kafka( Intermediate )
- Apache Flink ( Beginner)
- Apache Airflow and OOzie
Devops :
- Experienced using Terraform for IaC
- Experienced using Jenkins ( Beginner )
- Experienced using Github Actions
Tools and Methodologies :
- Experienced with Git
- Experienced with working in Agile Methodologies
- Experienced with JIRA , Confluence, Lucid Charts etc