Description
Currently, CSV datasource uses FastDateFormat from Apache Commons for parsing values of TimestampType and DateType. The result of parsing is an instance of java.util.Date which represents a specific instant in time, with millisecond precision. The tickets aims to switching on Java 8 API - java.time which allow parsing with nanoseconds precision.
Attachments
Issue Links
- relates to
-
SPARK-19228 inferSchema function processed csv date column as string and "dateFormat" DataSource option is ignored
-
- Resolved
-
- links to
