I created a library called mack that exposes some helper functions delta-spark helper functions that users commonly need: https://github.com/MrPowers/mack. The library has gotten a lot of traction in a short period of time. We might want to build some of these features directly into delta-rs eventually. Deduplicating a Delta table is a great example. Lots of users want to perform this function and we could provide them with a performant out-of-the-box implementation. Thoughts?

i think this is a great idea. With ADBC and commits taking shape we may be in a prime position to provide a very nice experience around this.

Yep, figured as much @Robert 😉