I am a data engineer (recovering data scientist ) interested in Big Data technologies mainly working in a AWS environment.
I work mainly in Spark using Pyspark and Scala when there is a need for it.
Also interested in data lakehouse technologies such as Apache Iceberg