Pedro Salgado
07/05/2023, 9:40 PMCanonicalPathFunction
incompatible class issue, is this happening to anyone else?
So, just tried to bundle a vanilla spark 3.4.1 image with delta 3.0.0rc1 jars and got java.io.InvalidClassException: org.apache.spark.sql.delta.DeltaLog$CanonicalPathFunction; local class incompatible
it seems to be related to this issue maybe...
I expected those two versions to be easily integrated (we have the same setup for spark 3.3 and delta 2.4), unfortunately with those new version is not working... any ideia?
Thanks