https://delta.io logo
r

rtyler

05/26/2023, 7:11 PM
Heads up, I just spoke more with @John Darrington about the need for an alternative lock client. He is going to explore making dynamodb_lock into "distributed_lock" and put dynamodb behind a feature so that postgres can also sit behind a feature.. That way our use of
LockClient
in the S3 storage layer can remain generic and we can start to support alternative locking implementations
šŸ‘ 1
w

Will Jones

05/26/2023, 7:37 PM
Is this a separate effort from https://github.com/delta-io/delta-rs/issues/1333 ?
Oh nvm looks like they are coordinating in a different thread.
Just want to make sure we don't have a concurrent writers conflict on PRs šŸ™‚
šŸ˜ 1
r

rtyler

05/26/2023, 7:42 PM
@Will Jones I haven't been paying too much attention to what @Nick Karpov has proposed across client mechanisms. To me what @John Darrington is working towards is more about making the dynamodb_lock crate more versatile and not necessarily changing any locking semantics in the
deltalake
crate itself
j

John Darrington

05/26/2023, 7:59 PM
Correct. Iā€™m not saying planning on touching anything but that crate