Hi All, I have a use case where I need to write the data into same delta-lake location Parallely. When I try to do this using pyspark,I got the concurrency error is there any way to handle this issue?

I dont have any experience with this but there are some tips in the docs. For example sticking to inserts or using partitions. https://docs.delta.io/latest/concurrency-control.html

@Lennart Skogmo I am unable to open this link.

Its because the certificate expired i guess. But its the offical site.

Ok, now I am able to access it. Also I think I found the solution in stack overflow for my exact use case. When I read concurrency control page asking to create partition for the delta table which will not help for my usecase 🙂 Thanks for your help!