https://delta.io logo
k

Kesav Kolla

06/08/2023, 7:41 PM
I see Python library has ability to get fragments from DeltaTable by taking filters. Is there anything similar in rust version? It would help if we can get fragments of filenames in rust DeltaTable also.
w

Will Jones

06/08/2023, 7:42 PM
What do you mean by "fragments of filenames"?
We have functions to get the active filenames and add actions by a filter here: https://docs.rs/deltalake/0.12.0/deltalake/delta/struct.DeltaTable.html
But nothing higher-level than that right now
k

Kesav Kolla

06/08/2023, 7:49 PM
I was referring to https://github.com/delta-io/delta-rs/blob/main/python/deltalake/table.py#L515 Looks like python has something FileSystemDataset in arrow. I was wondering is there something similar to that in rust
w

Will Jones

06/08/2023, 7:50 PM
Doesn't have a dataset notion yet, no. But we'll likely implement one later this year