#delta-rs
Title
u
udit ujagar
05/09/2023, 10:29 AMHello team , while writing to delta table via delta-rs python binding , I am getting
deltalake.PyDeltaTableError: Schema error: Invalid data type for Delta Lake: Null
for None cols , how best this can be handled , want to keep null in delta table.
m
Matthew Powers
05/09/2023, 12:29 PMCan you please provide a minimal example of the code that you’re running? That will make it easier to debug, thanks!
gratitude thank you 1
u
udit ujagar
05/09/2023, 12:32 PM Copy code
def read_write_delta_rs:
dt = DeltaTable(input_file)
pyarrow_table = dt.to_pyarrow_table()
op = pyarrow_table.to_pandas()
write_deltalake(table_or_uri="<S3 path>", data=op, partition_by=["col_name"], mode="append", storage_options=storage_options)If the read col data has None values where i get this error
m
Matthew Powers
05/09/2023, 12:34 PMCan you please provide a complete minimal example including the values you are invoking the function with?
u
udit ujagar
05/24/2023, 2:03 PMI will respond on this.
4 Views