Example commitInfo timestamp 1684837794183 operation WRITE o

Question

Example commitInfo timestamp 1684837794183 operation WRITE operationParameters mode Overwrite partitionBy readVersion 4 isBlindAppend false operationMetrics numFiles 4 numOutputBytes 47035915 numOutputRows 517737 add path part 00000 0e4aaf3e 3471 42e9 9977 7f248c5f9931 c000 snappy parquet partitionValues size 12591124 modificationTime 1684837792436 dataChange true add path part 00001 2ec1bbf3 57a4 4159 b780 119c66fb62bf c000 snappy parquet partitionValues size 12587807 modificationTime 1684837793642 dataChange true add path part 00002 d332fb7f e6ed 4d95 a004 2dfa6de480e0 c000 snappy parquet partitionValues size 12385161 modificationTime 1684837792518 dataChange true add path part 00003 9eb30dbe e3a4 45e5 a39d 8aaefe1f6a68 c000 snappy parquet partitionValues size 9471823 modificationTime 1684837793003 dataChange true remove path part 00000 db74addd 8ca9 475f b9c3 361f289b87f7 c000 snappy parquet deletionTimestamp 1684837794183 dataChange true extendedFileMetadata true partitionValues size 2342

TD · Answer

What version of Delta did you use to generate this

TD · Answer

Column stats generation was added to Delta on Spark in Delta 1 2 so if you used an older Delta to write to the table then column stats will be missing

Al Nick Ortiz · Answer

Thanks