https://delta.io logo
a

Alex Wilcoxson

03/16/2023, 3:27 PM
Hey folks, could anyone chime in on this discussion https://github.com/delta-io/delta-rs/discussions/1178 Wondering if there is a way to work with spark-written delta tables with array<T> columns via delta-rs. thanks!
w

Will Jones

03/16/2023, 3:38 PM
Is this from Rust or Python?
a

Alex Wilcoxson

03/16/2023, 3:38 PM
Rust
w

Will Jones

03/16/2023, 3:41 PM
Got it. We’ll need to investigate more what we need to do here.
We might be able to switch that field name back
Or we might make Arrow not care so much what name it has
a

Alex Wilcoxson

03/16/2023, 3:44 PM
👍 I can update the discussion thread with an example and explore changing it locally, from there we can log an issue in delta-rs or arrow once decided?
w

Will Jones

03/16/2023, 3:45 PM
If you can provide an example where it fails, that would be much appreciated
r

rtyler

03/16/2023, 3:48 PM
I'm scared to click on this link 😆
🤣 2
a

Alex Wilcoxson

03/16/2023, 5:06 PM
@Will Jones updated the discussion with test and data to reproduce
👍 1
3 Views