Alber Tadrous
03/30/2023, 2:55 PMspark.read.format("csv").load("s3://<file-path>")
but when I use Pandas it throws an errorJim Hibbard
03/30/2023, 3:46 PMtoPandas()
function to retrieve your pandas DataFrame:
df = spark.read.format('csv').load("s3://<file-path>").toPandas()