I am that person who cannot rest until the problem at my hand is solved. I have 6 plus years of Software development experience. Started my career as a Mobile application developer and moved to Big Data development after a couple of months.
Here is my detailed summary of experience over the last couple of years:
- I have wide experience building Hadoop clusters, designing the data flows, Securing the cluster on-premise as well as the cloud(AWS, Azure).
- Designed/Proposed big data solutions for several projects using different technologies depending upon SLA, Budget allocated, and the ease of development.
- Hands-on experience working with multiple Hadoop technologies like Hive, Pig, Spark, Presto, Flume, Kafka, Spark Streaming, Hbase, etc.
- Also have experience in developing bash scripts, python scripts for automation, and continuous integration.
- Built Highly available Hadoop cluster using Hortonworks distribution and developed bash scripts for automated failover and switchover process for Postgresql, metadata database of the cluster
- Development experience with Traditional ETL using DataStage, SSIS, Talend, etc.
- Experience working with Orchestration, scheduling tools like Oozie, Airflow, etc.
- Trained a large group of audience (80-100 people) on Hadoop Technologies, MPP systems(Greenplum), Message brokering systems(Kafka, Kinesis), etc
- Experience working with major Hadoop distributions like Hortonworks, Cloudera, MAPR, EMR, and HDInsight