Hi I have some delta format files need to optimize regularly. According to this doc write-conflicts-on-databricks,

OPTIMIZE

explicitly can cause conflicts in some cases like

UPDATE

. Meanwhile, with the latest Delta functionality, we can set the table properties:

delta.autoOptimize.autoCompact

and

delta.autoOptimize.optimizeWrite

which will enable the auto optimization. My questions are -- 1. Does the "auto optimize" will resolve the writing conflicts at the backend (especially for update)? 2. Is there any performance downgrade after enabling "auto optimize"? 3. In which case should I still use

OPTIMIZE

explicitly?