Channels
delta-social
h2g2-streaming
roapi
delta-oss
dais-2023
random
delta-rs
general
jobs
kafka-delta-ingest
deltalake-questions
events
lakefs
delta-cycling
deltalake-databricks-dbsql
delta-community
azuredatabricks
deltalake-on-aws
delta-sharing
flink-delta-connector
graph-delta-lake
dat
delta-sharing-rs
Powered by
#delta-rs
Title
c
Cole MacKenzie
07/10/2023, 8:48 PM
Is
T
ever not
&str
?
https://github.com/delta-io/delta-rs/blob/main/rust/src/partitions.rs#L12
k
KyJah Keys
07/10/2023, 9:01 PM
Theoretically, it could be any valid column value in the schema.
However, I think you're right since the only thing it is ever compared against is
&str
since
DeltaTablePartition
only has
&str
values.
c
Cole MacKenzie
07/10/2023, 9:49 PM
Yeah, that is true. There is also
this function
which indicates it does a literal type comparison, but I am unsure of the actual need for it?
Based on
https://github.com/delta-io/delta/blob/master/PROTOCOL.md#partition-value-serialization
, I guess the native type comparison would be needed to compare times and numbers as since as a string numbers can't be compared
I guess times can be string compared as well though since they are zero-padded. So only numeric types need that parsing step
3 Views
Post