😕 I just noticed that we implement

Deserialize

and

Serialize

on the

DeltaTable

struct. What is serializing that struct useful for? 😧

IIRC that was added by some ballista folks who wanted to send the table across workers ... I guess once we no longer hold all state in memory, its not so bad ...

oh my, we gotta stop accepting changes without tests and documentation 😆 This results in an

ObjectStore

serialization which is kind of baffling to me

serialization of object store was actually also for some reason required by polars ... as a consequence we started to improve the configuration system for object store quite a bit. by now it should be sufficient to serialize the config for object store and always recover from there ...

that's not a bad idea, the configuration is reasonable to pass around