https://delta.io logo
f

Fijurrahman Amanulla

09/05/2023, 3:40 PM
Hey team, quick question: If I run the
VACUUM
command on a Delta table that's stored on S3 and our S3 bucket policy restricts file deletions, will the command fail or just proceed without deleting any files? Also, in case files get deleted, is there a way to rollback the operation? @Dominique Brezinski
d

Dominique Brezinski

09/05/2023, 3:44 PM
I expect it will fail when the S3 delete is forbidden, but I am not sure. I believe you can only recover deleted objects in S3 if you have versioning enabled. https://docs.aws.amazon.com/AmazonS3/latest/userguide/RestoringPreviousVersions.html
There is no command to do this in Delta that I am aware of. You would have to see if the log has history prior to the retention window used in vacuum, then construct an object list for the prior version, and use that to restore the S3 objects that are now deleted.
f

Fijurrahman Amanulla

09/05/2023, 3:59 PM
Thank you @Dominique Brezinski Let me check.