Ketki Bukkawar

08/16/2023, 5:12 AM
Hi team, We connect to an ADLS gen2 account and get the deltaLog of a delta table using the below jave code:
Copy code
Configuration conf = new Configuration(); 
conf.set('fs.abfss.impl', org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.class.getName()); 
conf.set('{storage-account-name}.<|>','org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider'); conf.set('{storage-account-name}.<|>', {clientId}); conf.set('{storage-account-name}.<|>', {secretValue}); 

DeltaLog log = DeltaLog.forTable(configuration, {delta-table-path});
It works when the account is not using private endpoint, otherwise the process times out or fails with UnknownHostException. Can someone please help me understand how we can initiate a connection in case private endpoint connection is enabled for a storage account?
Hey team, any thoughts here?

Randy Sims

08/21/2023, 3:53 PM
Could it be a firewall stopping you since it's a private endpoint?