The increasing demand for data with low latency at Coinbase has required them to renovate their data ingestion and replication framework. SOON (Spark cOntinuOus iNgestion) is designed to ingest the incremental changes (appends, updates, and deletes) to an existing table on Delta Lake. Take a look at the overall architecture for SOON and learn how Coinbase leverages Delta Lake’s change data feed (CDF) feature. ✅ SOON for near real-time data at Coinbase - Part 1 ➡️ https://lnkd.in/eqn-t_D8