Hi alI, I have tried to split the checkpoint file on several parts without sucess .I attempted to adjust configuration options such as spark.databricks.delta.checkpoint.partSize and spark.databricks.delta.snapshotPartitions, however I have been unsuccessful in achieving parallelization.Would you be able to offer me some guidance on how to set up the value of these options? I found the documentation to be somewhat limited. I use pyspark on Azure Snypase

as those properties have

.databricks.

in there name I would guess they are specific to Databricks and do not work with Azure Synapse

I see your point and you make me doubt , but I revised the enviroment of Spark Pool inside Azure Synapse and some properties with

.databrics.

are included by default to it shouldn`t be a problem.