Hi, we're working on an upgrade to Delta 2.4.0 (Spark 3.4.0) from 2.0.2 and are seeing some odd behaviour in scripts that reference tables in

database.table_name

format. Spark seems to try to find a table in the

default

db with a name of

database.table_name

- so ignoring the db table separator - and gets an AccessDeniedException from Glue Catalog since the table doesn't exist in

default

. Does anyone have any suggestions? It seems like it could be related to the V2 catalog changes but testing in a simple docker setup can't replicate it with the same product versions.