https://delta.io logo
j

Jackson Newhouse

08/24/2023, 5:56 PM
Does delta-rs support adding an existing parquet file on S3 to a delta lake table?
r

rtyler

08/24/2023, 6:12 PM
it certainly does 🙂
j

Jackson Newhouse

08/24/2023, 6:13 PM
deltalake::operations::transaction
?
r

rtyler

08/24/2023, 6:17 PM
yeah, you should just need an Add action, the parquet filkes added in the transaction log are URIs as designed by the protocol. This code does probably something like what you're looking to do, and it was written by some idiot, but you might be able to make sense of it https://github.com/buoyant-data/oxbow/tree/main
😂 1