Description
1. If a column contains only dates, it should be of “date” type in the inferred schema
- If the date format and the timestamp format are identical (e.g. both are yyyy/mm/dd), entries will default to being interpreted as Date
2. If a column contains dates and timestamps, it should be of “timestamp” type in the inferred schema
A similar issue was opened in the past but was reverted due to the lack of strict pattern matching.
Attachments
Issue Links
- is cloned by
-
SPARK-40649 Infer date type for Json schema inference
-
- Resolved
-
- links to
