Hello Team, i am not able to import below package

from pyspark.sql.streaming import StreamingQueryListener

getting ImportError: cannot import name ‘StreamingQueryListener’ from ‘pyspark.sql.streaming’ (/usr/lib/spark/python/pyspark/sql/streaming.py)

Are you using databricks?

nope ,i am using EMR

I think this only works in the databricks runtime, normally StreamingQueryListener isn't importable through pyspark.

is there any way @Jon Stockham

I'm not familiar with one, but quick google and I found this: https://medium.com/myheritage-engineering/guide-to-streamingquerylistener-in-pyspark-streaming-f3bbfe56a774

what version of spark are you using?

I am using spark 3.1.1

looks like it’ll be part of OSS 3.4.0, which will be cut on monday