(Py)Spark community on Slack Hi, I really enjoy this kind of Delta Lake community on Slack that we have right here. I was wondering if there is something similar for (Py)Spark users. Perhaps someone has a tip for me? The official page states that there is a Mailing List and Stack Overflow but I had not much luck addressing my questions there - and I like the communication over slack more. 😄

I was looking for the same actually, but unfortunately not able to find something similar.

You can ask questions on https://community.databricks.com/s/

I tried that but I found it was not very helpful. I've the impression that the Databricks forum is mainly used by people who participated in a Databricks training to ask when they will get their certificate 🤣

We’re trying to make it more helpful, but yes there are some simple questions on there.

I guess its possible to create a pyspark user initiated slack. I would join 😛

I’d love this too!

I’d be happy to answer questions on there (and use it to try to recruit people for a referral bonus)

Good idea Martin! I'd definitely enjoy a slack group for PySpark too.

this would be very nice!

If such a PySpark community is created, i'll would join ! Great idea !

I know this sounds funny but if you’re up a PySpark (or Spark) Slack, could you pose the question on the Spark User DL (i.e. the email list ala user@spark.apache.org)? I think there is interest to create one its been an on/off thing. If someone to pose the question, I’d gladly volunteer to even create it - it’s just that we need to start the conversation there so we can get the PMCs approval for its creation.

just to give a quick update: I have posted the question concerning Spark slack to the mailing list. There's vivid discussion: 😅 https://lists.apache.org/thread/zm5tr21tgn10j6bqlzgsv3rh9fof2gdq

This is a life changing moment for me, can’t wait! 🤩 👑

This is awesome! Great idea and thanks for getting the ball rolling 🎉