https://delta.io logo
r

rtyler

04/25/2023, 4:41 PM
thankfully datafusion 23 is released which relies on arrow 37, so I'm going to prepare an upgrade in my
arrow-37
topic branch 🤞
👍 3
j

Jim Hibbard

04/25/2023, 4:43 PM
Good luck! 😄
r

rtyler

04/25/2023, 5:56 PM
@Will Jones @Robert curious on your opinion on whether a datafusion/arrow upgrade should be a 0.9.x or a 0.x.0 release
r

Robert

04/25/2023, 6:25 PM
ultimately i would hope that this would constitute a patch. Right now I think we are not there yet an there are breaking changes especially in the operations module very frequently. For it to be a patch we would also likely want to make it clear to use the re-exports. Then again, if datafusioin / arrow is major, maybe we need to follow suit….
r

rtyler

04/25/2023, 6:36 PM
everything they do is major, with every bloody release 😒
r

Robert

04/25/2023, 6:36 PM
😄
I am waitning for the day they do a minor/patch as well 🙂
r

rtyler

04/25/2023, 6:38 PM
I guessed by your highly optimistic use of "36.0.0" in Cargo.toml
🤣 1
r

Robert

04/25/2023, 6:38 PM
I seem to remember @Will Jones telling us that there are cargo tools out there that allow you test compatibility against a number of version and then spcify a range as compatible…
r

rtyler

04/25/2023, 6:40 PM
well, it's easy with arrow/datafusion, anything other than exact majors are not compatible 🙂
r

Robert

04/25/2023, 6:40 PM
we may have a chance in termos of the APIs we care consuming. but yes. arrow/datafusion will likely be coupled for the foreseeable future.
w

Will Jones

04/25/2023, 6:41 PM
Yeah and I don’t expect stability for a while, given the arrow2 / arrow merge.
I would say dependency upgrade is a minor version bump (0.X.0), unless the dependency bump is also just a patch number bump. I think only bugfixes are patch releases.
3 Views