https://delta.io logo
s

Sujith Kumar.S

06/02/2023, 6:50 AM
Can we use the delta table parquet files directly for loading the data as a parquet file in other system ? Is that compatible ?
r

rtyler

06/02/2023, 6:51 AM
They're all just standard parquet files, so if I'm understanding your question, yes
k

Kees Duvekot

06/02/2023, 7:01 AM
But please please please don't do it ...
Because only by going through the logs you know which files are currently used for the current state of the table
So you might pick up data that should no longer be used . Or that has been altered already etc etc
s

Sujith Kumar.S

06/02/2023, 7:06 AM
okay 😞
k

Kees Duvekot

06/02/2023, 7:29 AM
Why were you thinking about this route?
j

JosephK (exDatabricks)

06/02/2023, 11:24 AM
If reading parquet files worked, why would delta even exist?
s

Sujith Kumar.S

06/02/2023, 11:24 AM
Just asking
I need to port delta table to another system , that only support parquet, Avro, orc
k

Kees Duvekot

06/02/2023, 11:25 AM
One off?
j

JosephK (exDatabricks)

06/02/2023, 11:26 AM
It's going to be a big headache, but if you do a optimize and vacuum 0 hours that will be only parquet files you need. Then you can delete the log or ignore it for the other system. Def not recommended and won't be a good solution
s

Sujith Kumar.S

06/02/2023, 3:51 PM
Okay
I’m not going to use it, I will read delta and generate parquet from it for my usage then.
Thank you evening for the suggestions
2 Views