https://delta.io logo
i

Ian

01/31/2023, 10:26 AM
Hi Folks having trouble creating delta tables on a local minio bucket running on 9001
Copy code
delta_table_loc = "<s3a://test-bucket/test-table>
storage_options = {"AWS_ACCESS_KEY_ID": "<accesskey>", "AWS_SECRET_ACCESS_KEY": "<secretkey>",
                   "AWS_ENDPOINT_URL": "<https://0.0.0.0:9001>"}
write_deltalake(table_or_uri=delta_table_loc, data=df, mode='append', schema=SA_data_schema, partition_by=["asset_id"],
                storage_options=storage_options)
when not using AWS_DEFAULT_REGION throws region missing but when used it throws “Failed to load checkpoint: Failed to read checkpoint content: Generic S3 error: Error performing get request”
5 Views