https://delta.io logo
m

Matthew Powers

06/20/2023, 8:30 PM
Does this code just use
filters
to perform file skipping or does it also apply the filters to the Parquet row groups to skip those as well:
Copy code
(DeltaTable(f"{Path.home()}/data/deltalake_baseline_G1_1e9_1e2_0_0", version=0)
    .to_pandas(filters=[("id1", "==", "id016")], columns=["id1", "id2", "v1"]))
👀 1
w

Will Jones

06/20/2023, 8:33 PM
row groups
👍 1