Daniel Kilcoyne

05/18/2023, 6:03 PM
Is anyone here using Delta Lake 2.3 on Spark 3.4? I have a non-production (yet) project and I'd love to start using 3.4 features. Any breaking issues I may run into? I'm willing to accept some oddities if 3.4 support is around the corner.

Ken Dallmeyer

05/18/2023, 7:05 PM
I've heard from my team that open source Spark 3.4 does't work at all with Delta at the moment.
👍 2

Dave Whitehead

05/18/2023, 11:59 PM
Would be great to have a delta update for spark 3.4 by the time data summit comes around next month, no pressure ;)

Matthew Powers

05/19/2023, 12:11 AM