Hello team I have a question for delta lake table I use SPAR

Question

Hello team I have a question for delta lake table I use SPARK SQL run MERGE query query have insert and update only not contain delete statement Operation metric is in image After check log between before delta version and after delta version by COUNT query I see that some records had been removed 4314 records removed it is match with numSourceRows metrics Why it is happen

Thanhtan Le · Answer

Total records new version `6459` lower than older version `6458` Difference `MERGE INSERT UPDATE ` between two versions

Paddy · Answer

Could you paste the query you ran and a screenshot of the entire row of history of version 6459

Thanhtan Le · Answer

This is query I run

Paddy · Answer

And the entire row of version 6459

Thanhtan Le · Answer

IMG 9444 jpg IMG 9445 jpg IMG 9443 jpg

Paddy · Answer

This is suspicious I see you use DBR not <http Delta io|Delta io> Could you contact your Databricks support to investigate The reason is DBR has its own MERGE algorithm

Thanhtan Le · Answer

perfectly I will contact to DBR team to check that