Description
HiveResult.toHiveString has to convert incoming Java date/timestamps types to days/microseconds because existing API of DateFormatter/TimestampFormatter don't accept java.sql.Timestamp/java.util.Date and java.time.Instant/java.time.LocalDate. Internally, the formatters perform conversions to Java types again. This badly impacts on the performance. The ticket aims to add new APIs to DateFormatter and TimestampFormatter that should accept Java types.
Attachments
Issue Links
- is cloned by
-
SPARK-31802 Format Java date-time types in Row.jsonValue directly
-
- Resolved
-
- links to
