https://delta.io logo
r

Rajath Chandregowda

02/28/2023, 10:04 AM
Hello Team, Why distincts are not part stats in delta table ? Is there any way we can populate distinct stats in open source delta versions?
j

JosephK (exDatabricks)

02/28/2023, 12:32 PM
How would you use distinct stats in file skipping?
r

Rajath Chandregowda

02/28/2023, 12:35 PM
It would help with query planning. Optimizer
j

JosephK (exDatabricks)

02/28/2023, 12:37 PM
Most engines already collect runtime stats so they don’t need the file based ones. The file based stats are useful for file skipping.
r

Rajath Chandregowda

02/28/2023, 2:45 PM
So there’s no possible of getting district stats from delta tables ?
j

JosephK (exDatabricks)

02/28/2023, 3:22 PM
You’ve failed to make a case for it so far.
3 Views