Ketki Bukkawar
08/16/2023, 5:12 AMConfiguration conf = new Configuration();
conf.set('fs.abfss.impl', org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.class.getName());
conf.set('fs.azure.account.auth.type.{storage-account-name}.<http://dfs.core.windows.net|dfs.core.windows.net>','OAuth');
conf.set('fs.azure.account.oauth.provider.type.{storage-account-name}.<http://dfs.core.windows.net|dfs.core.windows.net>','org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider'); conf.set('fs.azure.account.oauth2.client.id.{storage-account-name}.<http://dfs.core.windows.net|dfs.core.windows.net>', {clientId}); conf.set('fs.azure.account.oauth2.client.secret.{storage-account-name}.<http://dfs.core.windows.net|dfs.core.windows.net>', {secretValue});
conf.set('fs.azure.account.oauth2.client.endpoint.{storage-account-name}.<http://dfs.core.windows.net|dfs.core.windows.net>','<https://login.microsoftonline.com/{tenant-id}/oauth2/token>');
DeltaLog log = DeltaLog.forTable(configuration, {delta-table-path});
It works when the account is not using private endpoint, otherwise the process times out or fails with UnknownHostException. Can someone please help me understand how we can initiate a connection in case private endpoint connection is enabled for a storage account?Randy Sims
08/21/2023, 3:53 PM