Hey folks, I saw recently update was added to the rust API under operations mod. Awesome! Also it looks like this implements conflict checking during commit to raise errors if for example the same parquet file was modified by another transaction. Is this accurate?
07/27/2023, 7:51 PM
Yes our commit code path includes conflict resolution. I haven't looked at the code for a bit, but it's probably somewhat strict right now. For example, it might not allow compatible updates to distinct partitions at the moment.
Implementing that requires a bit of work to prove which conflicts can be resolved.