🌮 🌮 to @Florian Valeye for this very interesting and promising pull request: https://github.com/delta-io/delta-rs/pull/1315

Hey @rtyler 👋, It's already working on my laptop (good sentence when there is an incident in production), I built and loaded the DeltaTableAsync asynchronously using Python. So it will depend on the reviews (and I will also add documentation on how to use the

DeltaTableAsync

in an async context). I limited the read operations before attacking the writer (except

update_incremental

), which will be created in a future PR. We could also improve the builder and other writing operations to refactor the codebase and avoid duplication. One last point, I was forced to create its own struct because of

pyo3-asyncio

implementation, but I was wondering if a Rust expert could help me to do a kind of reflection wrapper to call the

RawDeltaTable

by default if the method is not found in

RawDeltaTableAsync

(but it's a tradeoff between code readability and Rust accessibility. My goal is to provide full asynchronous capabilities in the Python binding to be aligned with the Tokyo async features in Rust. Also, I'm thinking of a lot of use cases where the async method would be nice (for instance a web application using FastAPI for example). Besides, we could also decide to split the build and the load phase when creating the synchronous

DeltaTable

as well. FYI @Denny Lee and @Matthew Powers it could be a nice blog post "Async Python binding available"

Yea, will definitely be happy to blog about this!!

YAYYYYY!!!!

This is awesome! Great work 😄

Here is an improved version by making the integration of asynchronous more user-friendly by suffixing the methods with

_async

😄 I kept the capability of lazily loading the DeltaTable (

lazy val

of Scala, I miss this feature) It's ready for reviews 🚀 cc @Will Jones @rtyler

I’d like to release 0.10.0 today, but happy to release another version soon once this is ready.

Sure 👍