Hi everyone, I am used to work woth architectures where I use adf to ingest data(database, sftp, s3, etc.) and databricks to process data. Is there an existing architecture where databricks is used for ingestion and process and can somebody share a link or picture?

auto loader?

I thought auto loader is for processing fikes that are already ingested

I think this depends on your definitions of things.. what do you mean by ingested? I’m now thinking you actually mean written to cloud storage.. this isn’t really a delta question btw

Yeah indeed, after it is ingested to a blon storage for instance.