@Robert random question that popped into my head, does Datafusion give us a path to support DML type commands? I'm wondering what if anything it would take for a delta-rs based project to support CREATE TABLE, etc type stuff

absultuely - in fact I already wrote a little extension to sql.parser-rs to also handle delta specific keywords 🙂 I wanted to ask a more general question in that context as well ... should we think about carving out a few things into separate crates? specifically introduce logical planning, and parsing sql etc .. also talked to Shingo the other day oaroung carving out an http client for use in catalog integrations as well as sharing clients. ..

I think that's a compelling idea