Hello everyone, Use Case: 1. producer is writing data in deltaLake using delta-rs library. 2. Consumer is reading the data it run some transformation to the data and saving into the deltaLake in different table space. 3. Consumer needs to consume only the incremental data between last run and current run, is there any way to solve this problem? 4. The consumer is reading the data using python wrapper of delta-rs Any solution to read this incremental data ?

There are two answers to this - one applies now, and one applies soon-ish. Right now using the stack you mentioned you would have to load the latest and previous versions of the table (or use the added / deleted files only) and figure out the change manually. There are some scenarios where this is easier - i.e. in append only scenarios, each transaction will only create new files, and you can use low level APIs to get add actions from the latest version.