Denny Lee
04/14/2023, 6:08 PMIn particular, there are three open and competing table formats that bring an ACID layer to data lakes, one of which will likely become the de-facto industry standard eventually. Besides Delta Lake, there are also Apache Iceberg and Apache Hudi, and while they all offer a variety of advanced features and open-source implementations, we've found that the most mature Rust implementation is that of Delta via the delta-rs project. It also has an active and welcoming community of maintainers, so we finally decided to replace our custom storage layer with delta-rs instead.
Matthew Powers
04/14/2023, 8:32 PMJim Hibbard
04/17/2023, 4:53 PM