Any suggestions on this error

java.lang.ClassCastException: class org.apache.spark.sql.catalyst.plans.logical.DeleteFromTable cannot be cast to class org.apache.spark.sql.delta.commands.DeleteCommand (org.apache.spark.sql.catalyst.plans.logical.DeleteFromTable and org.apache.spark.sql.delta.commands.DeleteCommand are in unnamed module of loader 'app')

The code that cause this exception is something along the lines of

df.write.format('delta').mode('overwrite').option("mergeSchema", false).option("overwriteSchema", false)\
                    .partitionBy("date").option("replaceWhere", "date BETWEEN '2023-01-01' AND '2023-01-02' AND vertical like '%xyz%' ").save("s3://")

running on Spark 3.3.1 Hadoop 3.4.4 and ``delta-core_2.12-2.1.1.jar` and ``delta-storage-2.1.1.jar`

--conf "spark.sql.extensions=io.delta.sql.DeltaSparkSessionExtension" --conf "spark.sql.catalog.spark_catalog=org.apache.spark.sql.delta.catalog.DeltaCatalog"

could you check if you set these two configs?

let me cross check