#deltalake-questions
Title
s
Shubham Goyal
04/14/2023, 8:18 AMHi Folks , I am getting XML data from source converting it into delta format. Afterwards I need to create a azure SQL Tableau on top of that delta table. How do I keep the azure SQL Table updated with the incremental changes in delta table ?
j
JosephK (exDatabricks)
04/14/2023, 11:25 AMare you using structured streaming?
s
Shubham Goyal
04/14/2023, 11:26 AMNo ,it will be a batch job
j
JosephK (exDatabricks)
04/14/2023, 11:37 AMYou can refresh tableau each time the batch job finishes?
s
Shubham Goyal
04/14/2023, 11:42 AMSorry , I meant SQL table .. autocorrect converted it into tableau for some reason.
So apart from the actual table I am planning to create a tmp table in SQL DB where I will be storing the incremental data . The incremental data will be merged into the actual table and will delete the record from the tmp table afterwards. Let me know if this approach is right ? Or is there any better way to do it
j
JosephK (exDatabricks)
04/14/2023, 11:58 AMYou can probably just have 2 delta tables and use change data capture
👍 1
10 Views