Passionate Senior Data Engineer with around 8 years of experience. In-depth knowledge on Spark Architecture, RDDs, DataFrames and Spark SQL as well as distributed computing. Proficient in creating highly scalable and efficient data architectures using Microsoft Azure and AWS and working with large datasets.

Please feel free to contact me on LinkedIn. Additionally, it'll be great if you could endorse me if any of my answers were useful to you or, please feel free to support by sharing a small token of appreciation using this link.

Cheers!!