Does delta-rs support adding an existing parquet file on S3 to a delta lake table?
08/24/2023, 6:12 PM
it certainly does 🙂
08/24/2023, 6:13 PM
08/24/2023, 6:17 PM
yeah, you should just need an Add action, the parquet filkes added in the transaction log are URIs as designed by the protocol.
This code does probably something like what you're looking to do, and it was written by some idiot, but you might be able to make sense of it https://github.com/buoyant-data/oxbow/tree/main