#deltalake-questions
Title
p
Parthiban Jaganathan
04/12/2023, 7:02 PMAnyone has successfully read/write iceberg table in databricks environment using glue as catalog? I was able to successfull read iceberg tables but when I try to write Databricks is failing "NoSuchCatalogException: Catalog 'my_catalog' not found" my catalog is virtual catalog for iceberg
spark.conf.set(f"spark.sql.catalog.my_catalog.glue.id", "XXXXXXXX")
spark.conf.set("spark.sql.catalog.my_catalog.catalog-impl", "org.apache.iceberg.aws.glue.GlueCatalog");
spark.conf.set("spark.sql.catalog.my_catalog", "org.apache.iceberg.spark.SparkCatalog");
spark.conf.set("spark.sql.catalog.my_catalog.warehouse", "s3://s3_name/iceberg")
spark.conf.set("spark.sql.catalog.my_catalog.io-impl", "org.apache.iceberg.aws.s3.S3FileIO")
formatted_data.writeTo("my_catalog.<db_name>.<table_name>").using("iceberg").create()
c
chris fish
04/12/2023, 7:18 PMyou’ll have to reach out to a databricks SA or support team
j
JosephK (exDatabricks)
04/12/2023, 7:34 PMNot delta io related
✅ 1
32 Views