Ian
01/31/2023, 10:26 AMdelta_table_loc = "<s3a://test-bucket/test-table>
storage_options = {"AWS_ACCESS_KEY_ID": "<accesskey>", "AWS_SECRET_ACCESS_KEY": "<secretkey>",
"AWS_ENDPOINT_URL": "<https://0.0.0.0:9001>"}
write_deltalake(table_or_uri=delta_table_loc, data=df, mode='append', schema=SA_data_schema, partition_by=["asset_id"],
storage_options=storage_options)
when not using AWS_DEFAULT_REGION throws region missing but when used it throws “Failed to load checkpoint: Failed to read checkpoint content: Generic S3 error: Error performing get request”