Looks like I'll have to figure out the datafusion upgrade in order to get the arrow upgrade in 😆 😿

I’d be happy to support on the datafusion related updates, if that helps… I guess the main question that is particularly related to the json parser changes is how to go forward with the writers. There is a separate writer implementation in the operations module. I kept that separate not to break things in kafka-delta-ingest while experimenting. But we are getting to a place where we should consolidate these implementations?

I think we can consolidate for sure @Robert, kafka-delta-ingest is pinned to older delta-rs revisions anyways