https://delta.io logo
a

Antoine Huret

08/21/2023, 3:06 PM
Hello team 👋 I'm looking at a way to get the last table version consumed by a client, the one that is somehow stored in checkpoints. Is there a proper API to do it ? I found this information is accessible in
/$mycheckpointslocation/offsets/$highestOffset
in
reservoirVersion
but I better use an API. Thank you by advance !
n

Nick Karpov

08/22/2023, 5:12 PM
i think this is more of a streaming question than delta, check your options here: https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#managing-streaming-queries
a

Antoine Huret

08/25/2023, 2:44 PM
thank you for your answer ! I will check it out 🙂