https://delta.io logo
j

John Darrington

05/29/2023, 5:13 PM
Does
delta-rs
support replacing tables? I might just be missing it in the docs, or not sure how I would accomplish it with the current setup https://docs.delta.io/latest/best-practices.html#replace-the-content-or-schema-of-a-table
r

rtyler

05/29/2023, 5:15 PM
I think it depends on how you mean "replace". What I think of what "replace" means is where a lot of people will use a hive catalog (e.g. AWS Glue). Basically creating a new version of a table in S3, and then updating the catalog's location to point to it
j

John Darrington

05/29/2023, 5:16 PM
well I guess what I'm really asking is about updating a table's schema. That article indicates it's possible using the replace function and you'd still get timetravel to the old schema
and it might be that I'm just not understanding something fundamental to deltalake, I'm still very new to it
I guess it's just overwrite mode on the same table
c

Chitral Verma

05/30/2023, 6:07 AM
if you set mode="overwrite" and overwrite_schema=True then you can write a new version of the delta table with different schema and contents