https://delta.io logo
j

João Pinto

03/03/2023, 3:51 PM
Hi everyone! I'm playing with Python Delta-RS library to build a mechanism to iterate over N partitions and perform some cleanup tasks (Ex. Deal with deduplication and drop columns fulfilled with null values) but I'm stuck with the way that write_deltalake() method handles the overwrite mode. Instead of overwriting only specific partition, is overwriting the entire table. Does anyone know any workaround or a "config" to deal with this problem? Thanks in advance!
w

Will Jones

03/03/2023, 4:00 PM
We don’t support overwriting a single partition, but will in the next version. I don’t believe there is any workaround for this in Python.
j

João Pinto

03/03/2023, 4:15 PM
Thanks @Will Jones! It will be available for booth Python/Rust languages? Thanks!
w

Will Jones

03/03/2023, 4:15 PM
I’m not sure it will be available in Rust, I think just Python
j

João Pinto

03/03/2023, 4:16 PM
Great! Thanks!
2 Views