Does anyone know if there is some threshold before `PruningS delta-lake #delta-rs

Title

c

Cole MacKenzie

05/19/2023, 10:45 PM

Does anyone know if there is some threshold before

PruningStatistics

for

Datafusion

are used?

I'm also confused as to why

PruningStatistics

is implemented twice. https://github.com/delta-io/delta-rs/blob/dde2f7ebecb7c662653a04f20704faedc0c02794/rust/src/operations/transaction/state.rs#L284 https://github.com/delta-io/delta-rs/blob/dde2f7ebecb7c662653a04f20704faedc0c02794/rust/src/delta_datafusion.rs#L284

2 Views