Would anyone like to collaborate with @Florian Valeye and I on a blog post on how to read Delta tables in AWS Lambda functions using aws-sdk-pandas? We’ll need to build the AWS Lambda “layer” (prebuild layers don’t include the optional dependencies unfortunately) and then read the data. If someone can help with the instructions on how to build the layer / the code snippets, I can do the writing. Here’s an example of a release with the prebuilt layers. We might want to provide the community with prebuilt layers cause they’re actually annoying to build.
01/12/2023, 4:41 PM
I can help build the layers 👍
01/12/2023, 5:38 PM
fwiw I've been building Lambdas with Rust for a while to do Delta Things ™️
01/12/2023, 8:15 PM
@rtyler - would be awesome to expose some prebuilt Rust Lambda layers and some content on how to use them. Would be awesome to create some content showing people how to use Polars in an AWS Lambda function for example.