https://delta.io logo
r

rtyler

04/08/2023, 6:31 AM
Working through the datafusion-upgrade branch, I'm still wrapping my head around this change and how we might change
files_matching_predicate
https://github.com/apache/arrow-datafusion/issues/4695
👍 1
r

Robert

04/08/2023, 7:30 AM
Could you explain the underlying issue a bit? My hope would have been that we can just convert one into the other. There is another issue on top of this though. Right now there seems to be something broken with the DF parser we use the create the logical expressions - i.e. it does not honor the passed data types from the schema.
r

rtyler

04/08/2023, 6:52 PM
They just appear to be different APIs to me. I think the way we create pruning predicates probably just needs to use PhysicalPlans
👍 1
4 Views