Who am I?
I am a Data Engineer with a particular interest in effective(!) and robust data pipelines. My specialty lies in optimizing data flows. I strongly believe in the tenets below and apply them on a daily basis.
A Big Data Engineer by education, with over 5 years of industry experience in building data products across several domains. Examples include:
- jobs optimization on Apache Spark,
- pipeline orchestration on Foundry,
- data aggregation & analytics from APIs,
- exactly-once data lake from Apache Kafka topics,
- creation of the Databricks medallion architecture.
More details in my socials below :)
The Engineer Tenets
- keep things simple & concise
- do it right as opposed to dirty fast
- follow the KISS, DRY, and Pareto principles