https://delta.io logo
s

Starkadur Hrobjartsson

03/23/2023, 10:06 AM
Hi all, I configured a table to use named column mapping mode and bumped the min reader and writer version as follows:
ALTER TABLE <table> SET TBLPROPERTIES (
'delta.minReaderVersion' = '2',
'delta.minWriterVersion' = '5',
'delta.columnMapping.mode' = 'name'
)
This resulted in new files written to the storage account to be placed into directories named with random two letter names e.g. 'pi', 'Wo', '32', etc. instead of the configured partition directories as before the change. My question is, why does this happen and is this something I need to care about?
g

Gerhard Brueckl

03/23/2023, 10:11 AM
the names of the partition folders do not matter but only whats in the delta log previously it was just aligned with traditional Hive partitions but this folder layout was never mandatory with minReaderVersion=2 you can change the name of columns - even the partitioning columns - so using a fixed name would not make sense
👍 2
2 Views