Channels
delta-social
h2g2-streaming
roapi
delta-oss
dais-2023
random
delta-rs
general
jobs
kafka-delta-ingest
deltalake-questions
events
lakefs
delta-cycling
deltalake-databricks-dbsql
delta-community
azuredatabricks
deltalake-on-aws
delta-sharing
flink-delta-connector
graph-delta-lake
dat
delta-sharing-rs
Powered by
#delta-rs
Title
m
Michael Shtelma
04/17/2023, 2:00 PM
Hi everyone! Is there a way to calculate the length of the Delta table using delta-rs effectively?
r
Robert
04/17/2023, 2:40 PM
the file meta data contains number of rows. so using that should be quite efficient…
m
Michael Shtelma
04/17/2023, 2:41 PM
Is there an API for that in rust? Or should it be implemented first?
r
Robert
04/17/2023, 2:43 PM
https://docs.rs/deltalake/0.9.0/deltalake/delta/struct.DeltaTable.html#method.get_file_uris_by_partitions
https://docs.rs/deltalake/0.9.0/deltalake/delta/struct.DeltaTable.html#method.get_stats
❤️ 1
👍 1
m
Michael Shtelma
04/17/2023, 2:45 PM
Or got it, thanks!
r
Robert
04/17/2023, 2:45 PM
the second one …
m
Michael Shtelma
04/17/2023, 2:45 PM
yep, get_stats looks even better! Thanks!
r
rtyler
04/18/2023, 3:10 PM
rows
that's what was meant by "length". I've not thought about a table having a length before 😛
4 Views
Post