Channels
delta-social
h2g2-streaming
roapi
delta-oss
dais-2023
random
delta-rs
general
jobs
kafka-delta-ingest
deltalake-questions
events
lakefs
delta-cycling
deltalake-databricks-dbsql
delta-community
azuredatabricks
deltalake-on-aws
delta-sharing
flink-delta-connector
graph-delta-lake
dat
delta-sharing-rs
Powered by
#delta-rs
Title
k
Kesav Kolla
06/08/2023, 7:41 PM
I see Python library has ability to get fragments from DeltaTable by taking filters. Is there anything similar in rust version? It would help if we can get fragments of filenames in rust DeltaTable also.
w
Will Jones
06/08/2023, 7:42 PM
What do you mean by "fragments of filenames"?
We have functions to get the active filenames and add actions by a filter here:
https://docs.rs/deltalake/0.12.0/deltalake/delta/struct.DeltaTable.html
But nothing higher-level than that right now
k
Kesav Kolla
06/08/2023, 7:49 PM
I was referring to
https://github.com/delta-io/delta-rs/blob/main/python/deltalake/table.py#L515
Looks like python has something FileSystemDataset in arrow. I was wondering is there something similar to that in rust
w
Will Jones
06/08/2023, 7:50 PM
Doesn't have a dataset notion yet, no. But we'll likely implement one later this year
Post