https://delta.io logo
y

Yuya Ebihara

05/08/2023, 9:45 AM
I have a question about
storageType
in deletion vectors. When I tried this feature in Databricks, it always return
u
. When do they use other types (
i
&
p
)? cc: @Marius Grama @Vikash Kumar @Slawomir Pajak
@venki @Allison Portis @Scott Sandre (Delta Lake) Can you answer this question?
I could get
p
by cloning the table. I'm still wondering when
i
(inlined deletion vector) is used.
v

venki

05/15/2023, 9:19 PM
Apologies, just saw this message. Not sure if there is a way to force produce the inline DV. The delta-spark OSS implementation tried to test the inline DVs using the unit tests and protocol details. Let me know if this doesn't help.
I am assuming you need a table with inline DV for tests in Trino?
y

Yuya Ebihara

05/15/2023, 9:59 PM
Yes, the purpose is Delta Lake connector in Trino. I knew the test, but I want to test using query level.
v

venki

05/16/2023, 3:21 PM
It looks like the inline DVs are not used as of now, but in future they may be used.
y

Yuya Ebihara

05/16/2023, 9:48 PM
I see, thanks for your confirmation!