Matthew Powers
06/20/2023, 8:30 PMfilters
to perform file skipping or does it also apply the filters to the Parquet row groups to skip those as well:
(DeltaTable(f"{Path.home()}/data/deltalake_baseline_G1_1e9_1e2_0_0", version=0)
.to_pandas(filters=[("id1", "==", "id016")], columns=["id1", "id2", "v1"]))
Will Jones
06/20/2023, 8:33 PM