https://delta.io logo
k

Ketki Bukkawar

08/16/2023, 5:12 AM
Hi team, We connect to an ADLS gen2 account and get the deltaLog of a delta table using the below jave code:
Copy code
Configuration conf = new Configuration(); 
conf.set('fs.abfss.impl', org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.class.getName()); 
conf.set('fs.azure.account.auth.type.{storage-account-name}.<http://dfs.core.windows.net|dfs.core.windows.net>','OAuth'); 
conf.set('fs.azure.account.oauth.provider.type.{storage-account-name}.<http://dfs.core.windows.net|dfs.core.windows.net>','org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider'); conf.set('fs.azure.account.oauth2.client.id.{storage-account-name}.<http://dfs.core.windows.net|dfs.core.windows.net>', {clientId}); conf.set('fs.azure.account.oauth2.client.secret.{storage-account-name}.<http://dfs.core.windows.net|dfs.core.windows.net>', {secretValue}); 
conf.set('fs.azure.account.oauth2.client.endpoint.{storage-account-name}.<http://dfs.core.windows.net|dfs.core.windows.net>','<https://login.microsoftonline.com/{tenant-id}/oauth2/token>');

DeltaLog log = DeltaLog.forTable(configuration, {delta-table-path});
It works when the account is not using private endpoint, otherwise the process times out or fails with UnknownHostException. Can someone please help me understand how we can initiate a connection in case private endpoint connection is enabled for a storage account?
Hey team, any thoughts here?
r

Randy Sims

08/21/2023, 3:53 PM
Could it be a firewall stopping you since it's a private endpoint?