Hello All , Just started exploring Delta Lake features . using Delta 2.3.0 spark 3.3.x python 3.6.8 When installing :pip3 install delta-spark==2.3.0 Error: WARNING: Running pip install with root privileges is generally not a good idea. Try

pip3 install --user

instead. Collecting delta-spark==2.3.0 Cache entry deserialization failed, entry ignored Using cached https://files.pythonhosted.org/packages/34/9e/c06f3b701de4746defc240fe7a2cc973f7bbfaa8fa17d57e045868c16925/delta_spark-2.3.0-py3-none-any.whl Collecting pyspark<3.4.0,>=3.3.0 (from delta-spark==2.3.0) Cache entry deserialization failed, entry ignored Could not find a version that satisfies the requirement pyspark<3.4.0,>=3.3.0 (from delta-spark==2.3.0) (from versions: 2.1.2, 2.1.3, 2.2.0.post0, 2.2.1, 2.2.2, 2.2.3, 2.3.0, 2.3.1, 2.3.2, 2.3.3, 2.3.4, 2.4.0, 2.4.1, 2.4.2, 2.4.3, 2.4.4, 2.4.5, 2.4.6, 2.4.7, 2.4.8, 3.0.0, 3.0.1, 3.0.2, 3.0.3, 3.1.1, 3.1.2, 3.1.3, 3.2.0, 3.2.1, 3.2.2, 3.2.3, 3.2.4) No matching distribution found for pyspark<3.4.0,>=3.3.0 (from delta-spark==2.3.0) According to the docs .

pyspark 3.3.x requires Python >= 3.7: https://pypi.org/project/pyspark/3.3.0/

Thanks @Carl Mattsson