Hi Everyone, Just want to confirm my understanding, does table level gets stored anywhere for each or current version of Delta Table? Or is it derived from file level stats that's gets stored in transaction logs?

AFAIK, it has to be explicitly built using

ANALYZE TABLE

command and it lives in the metastore completely external to transaction log folder.

Yeah. Usually if the table is registered that should be the case. Table table stats goes in Metastore. But what if we try to access directly via Path then what would happen?

In that case, I’d say catalyst will not have enough global stats about the table itself to come up with the best plan. Nothing is impacted severely but table-level stats can be useful in some cases like picking the right type of join strategy.