krishna prasad
09/14/2023, 9:50 AMlet mut config = DeltaOps(table).create().with_columns(schema.get_fields().clone());
I use datafusion a dataframe by `let df = self.ctx.sql(sql).await.unwrap()`; . When I try to write the reecordbatch from this dataframe by `record_batch_writer.write(batch).await?`; I see that the recordbatchs schema has a change. I see that the timestamp is data_type: Timestamp(Nanosecond, None)
but the table schema has data_type: Timestamp(Microsecond, None)
. Is there a config to fix this behaviour.
Any help is appreciated.Matthew Powers
09/14/2023, 7:37 PMkrishna prasad
09/15/2023, 6:55 AM