Hi Delta community how to write concurrently using delta rs

Question

Hi Delta community how to write concurrently using delta rs library in python do we have some existing support for using some logstore like dynamodb

Nick Karpov · Answer

check this post section under Environment Variables and DynamoDB Multi Writer Support sections you can ignore the Lambda parts if you re not using it <https delta io blog 2023 04 06 deltalake aws lambda wrangler pandas >

Nick Karpov · Answer

this is noted in the blog but in case someone here is reading only the thread this concurrent write support is only for multiple delta rs writers it is not compatible with writers that use the S3DynamoDBLogStore spark standalone

udit ujagar · Answer

Got it thanks for the response really helpful