Chitral Verma
05/14/2023, 9:21 AMwrite_deltalake('/tmp/write-delta-test', df, mode='append', overwrite_schema=True)
line 180, in write_deltalake
raise ValueError(
ValueError: Schema of data does not match table schema
write_deltalake('/tmp/write-delta-test', df, mode='overwrite', overwrite_schema=True)
This works but it creates a version only with the new columns.
I am trying to replicate the functionality with the mergeSchema
option that's available on spark connector