https://delta.io logo
r

Rahul Sharma

06/06/2023, 6:42 AM
Hello Team, i am using Delta Sharing server . i have lot’s of table in which have around minimum 10 gb of data can anyone tell me where to deploy delta sharing server that can balance the load of data
s

shingo

06/06/2023, 7:43 AM
The Delta Sharing server is merely a control plane responsible for authentication and authorization for data access. The actual data transfer takes place through the backend cloud storage systems. Therefore, I'm afraid to say that the location of the Delta Sharing server may not assist you in balancing the data load.
r

Rahul Sharma

06/06/2023, 7:44 AM
but the data is access via Delta-sharing api right ?
s

shingo

06/06/2023, 7:48 AM
The Delta Sharing server solely grants access to the data through token-based authentication. The actual data transfer occurs directly through the backend cloud storage systems using short-lived signed URLs.
r

Rahul Sharma

06/06/2023, 7:48 AM
oh ok
thanks a lot
s

shingo

06/06/2023, 7:49 AM
No problem at all 🙂
r

Rahul Sharma

06/06/2023, 7:50 AM
can we also add row level or column level security
s

shingo

06/06/2023, 8:04 AM
Row-level and/or column-level data governance are not included as part of the Delta Sharing protocol. If I were in your position, I would recommend architecting the data lake house using a medallion architecture approach and preparing a designated gold layer specifically for Delta Sharing.
In this approach, you can publish only the columns and rows that can be shared without any issues.