Ryan Johnson

05/25/2023, 6:15 PM
Hi folks, Delta v2 checkpoint design is up for review -- comments and suggestions very welcome! tl;dr: It tightens up the failure atomicity story for multi-file checkpoints, which allows to remove the constraints on data layout (e.g. can partition, sort, etc however we want after this)
👍 2
delta io 2