Does delta-rs support adding an existing parquet file on S3 to a delta lake table?
r
rtyler
08/24/2023, 6:12 PM
it certainly does 🙂
j
Jackson Newhouse
08/24/2023, 6:13 PM
deltalake::operations::transaction
?
r
rtyler
08/24/2023, 6:17 PM
yeah, you should just need an Add action, the parquet filkes added in the transaction log are URIs as designed by the protocol.
This code does probably something like what you're looking to do, and it was written by some idiot, but you might be able to make sense of it https://github.com/buoyant-data/oxbow/tree/main