https://delta.io logo
#dat
Title
m

Matthew Powers

01/12/2023, 1:34 PM
@Will Jones - how do you recommend I integrate the DAT reference tables into deltadask? I just manually copied them over in this directory for now. I think it’s good for the DAT reference tables to get checked into deltadask source control so Dask developers don’t need to think about DAT. You think I should just run the download / unpack instructions here and check in the tables to source control? cc: @Jim Hibbard as this will probably help you with the Ray connector tests 🤓
w

Will Jones

01/12/2023, 4:19 PM
I think downloading is fine as long as there is an easy command to do that. Checking in will add a lot of files, and when you upgrade there will be similar issues with large change sets
which is how other setup commands are done.
I’d also recommend adding a CI job that downloads and runs those tests.
Then they can’t be ignored 🙂
👍 1
14 Views