PySpark with conda

Prelude

You want to run something on pyspark. You want to set it up fast.

Prerequisites

• a machine
• a terminal
• a conda distribution installed, e.g. miniconda

Terminal

conda create -n pyspark-setup
conda activate pyspark-setup
conda install -c conda-forge pyspark=3.4 openjdk=8
pyspark

Addendum

But hey, I have no conda :(

See here.

What about other Spark versions?

See requirements here.