https://delta.io logo
k

keshav

06/12/2023, 5:56 AM
Hi team, I get below warning, while ingesting and fetching the data from delta table. i use pyspark 3.3.4 and deltadelta core 2.122.2.0 to ingest data and facing below warnings
Copy code
23/06/12 04:57:04 WARN DeltaHistoryManager: Found Delta commit 12687 with a timestamp 1686481866687 which is greater than the next commit timestamp 1686306634000.
23/06/12 04:57:04 WARN DeltaHistoryManager: Found Delta commit 12688 with a timestamp 1686481866688 which is greater than the next commit timestamp 1686306757000.
23/06/12 04:57:04 WARN DeltaHistoryManager: Found Delta commit 12689 with a timestamp 1686481866689 which is greater than the next commit timestamp 1686306881000.
1686481866689 - GMT: Sunday, 11 June 2023 111106.689 1686306881000 - GMT: Friday, 9 June 2023 103441 any suggestions how i can resolve these warnings.?
3 Views