#delta-rs
Title
d
Denny Lee
05/07/2023, 5:05 PMCurrently updating the Delta Lake docker to the latest
deltalake versionpip install deltalake==0.9.00.8.1r
Robert
05/07/2023, 5:40 PMI don’t think this was on purpose. IIRC, there were some issues releasing the wheels due to some config errors o.a. so maybe the wheels for that OS somehow got lost?
What OS are we using in the docker container?
d
Denny Lee
05/07/2023, 6:22 PMWe’re using the Spark base image which based on Ubuntu. In the same base image - when I tried to install 0.9.0 it complained about needing Rust first. Installing 0.8.1 worked fine even without Rust installed first.
r
Robert
05/07/2023, 6:30 PMhmm .. would it be possible that the container is building for arm64? I seems like there is one less wheel in the 0.9 release - the manylinux one for arm64 …
if that is the case, then it would make sense, since the pip isntall would try to build the package in lieu of using a wheel ..
at least the spark images are availble for x86 and and aarch64 …
d
Denny Lee
05/07/2023, 6:33 PMAhh good call - let me check. I’m probably building the M1 first which is arm64 - let me retry building for amd64
gotcha, this works fine for the 0.9.0 on amd64 but looks like I have to install Rust first for amd64. I'll just rebuild the docker file so it installs Rust first anyways.
r
Robert
05/07/2023, 6:43 PMwell … in theory we should publish these wheels too.
not sure what happened, but there was a small hickup somehwere in the last release. But not entirely sure, I’ll check our github workflows.
Maybe @Will Jones or @Florian Valeye know directly where to look?
f
Florian Valeye
05/07/2023, 7:17 PMOh, it rings a bell. I received two e-mails explaining PyPi files were deleted for
deltalake 0.9.0,w
Will Jones
05/07/2023, 8:53 PMI’ll look in a minute. Is the aarch64 wheel missing
I had to build them manually since the CI jobs weren’t working
I thought I uploaded them both
Yeah I’ll upload that one when I get home
r
rtyler
05/07/2023, 9:21 PM@Will Jones I know we had challenges with releasing a crate from GitHub Actions, do you think the release process for python is automateable?
w
Will Jones
05/07/2023, 9:36 PMWell the issue I had was I needed to increment the build-number so I could re-release the Linux wheels with the corrected build parameters. I could probably make it automatically do that.
🤔 2
✅ aarch64 wheel uploaded
🎉 4
d
Denny Lee
05/07/2023, 10:51 PMawesomesauce!
quick update - looks like we're good to go again - I'm uploading the latest docker image with
deltalake 0.9.0