Hi Everyone!! I have a huge table which has some key data in three columns.. data type, column name and value.. I have data as is in raw/Bronze layer.. now I have DLT pipeline where I need to Apply Pivot to get all this information at column level.. DLT does not simply support Pivoting for streaming data I need to apply transformation using UDF and Foreachbatch… which seems complicated and unnecessary.. just wanted to see should I just apply pivoting at raw layer or using above foreachbatch.. any views or anyone has done same in past.. appreciate help