Hi All, I need to add new fields in the existing delta table. I know how to add new fields in the existing hive table (using ‘alter cascade’) but not sure how to do it in delta table using pyspark. Can anyone please help me on this? Thanks in advance!

another option would be to simply use schema evolution and write/append the new dataframe with the additional columns to the existing delta lake table by using

.option("mergeSchema", "true")

here are the official docs: https://docs.databricks.com/delta/update-schema.html (most if not all should also apply to Delta OSS)