Ashish Dudeja

21
reputation
3

I am working on Big Data related Technologies from past 3 years like spark, hive, kafka, apache-nifi, atlas, livy and have worked on GCP services like BigQuery, Spanner, DataProc, Compute Engine, Composer for 1 year. I am always eager to learn new things which can ease my task to handle data in real world applications. I have experience in developing the solution which handles

Storage of structure and semi-structure data

Cleaning and Engineering them to fit business requirements

Improving the quality of data to make ETL jobs less error prone

Publishing to downstream systems.