Unit testing Airflow DAGs

Jan 6, 2025

How to unit test Airflow DAGs and tasks

Airflow on local machine

Dec 16, 2024

How to set up Airflow locally

Orchestration Wars - Airflow

Dec 2, 2024

What you need to know before using Airflow

Data Orchestration via Events

Oct 7, 2024

Orchestrating data pipelines across systems and teams without relying on a platform

Python Transactions

Sep 2, 2024

How to write a utility Python decorator for a transaction

How to extract a graph from your Python function

Aug 5, 2024

How to statically analyze the operations done by a Python function

Data Lineage via OpenLineage - The Easy Way

Jul 1, 2024

Data Lineage and emitting OpenLineage events via Python decorator

Highlights from PyCon DE & PyData Berlin 2024

May 6, 2024

The Engineer's Highlights from PyCon DE & PyData Berlin 2024

The Lost Art of Documentation

Apr 1, 2024

How and when to document your code

PySpark jar dependencies

Mar 18, 2024

How to add jar dependencies to pyspark

PySpark by download

Mar 4, 2024

How to set up pyspark by downloading

PySpark with Docker

Feb 19, 2024

How to set up pyspark with Docker

Spark UDFs

Feb 5, 2024

The different ways to use UDFs in pyspark

Spark and all the versions

Jan 15, 2024

Spark, Python, Java, pyarrow, which versions work together?

PySpark with pip

Jan 8, 2024

How to set up pyspark with pip

PySpark with conda

Jan 1, 2024

How to set up pyspark with conda