https://delta.io logo
r

rtyler

05/03/2023, 12:13 AM
I was thinking about this last night, I kind of want to ask the arrow-rs folks to slow down. They keep making major releases and major API changes every two weeks which is just killing me. I feel like all my delta io time is consumed just trying to keep up ๐Ÿ™€ It looks like 38 removes the deprecated
Decoder
which means I need to get #1226 done in order to be able to accommodate the upgrade, whenever the next datafusion release pulls it in of course
w

Will Jones

05/03/2023, 4:29 AM
Or maybe ask them to write a migration guide for all the breaking changes? How much of the time is taken up figuring out how to adapt vs actually writing the code?
r

Robert

05/03/2023, 6:43 AM
yes they are pushing pretty hard ๐Ÿ˜„. On top of the breaking changes htere are actually also features being added (especially in datafusion) that are sometimes hard to catch. for instance i recently realized, that you can implement
insert_into
on
TableProvider
โ€™s - in this casse I am quite eagerly awaiting the next df release, and happy about the short release cycles ๐Ÿ˜„
๐Ÿ˜† 1