Details
-
Bug
-
Status: Closed
-
Critical
-
Resolution: Fixed
-
2.4.0, 3.0.0
-
None
Description
In a specific case where a schema contains array<struct> with timestamp and date fields (array size >10000). Any access to this column very very expensive in terms of CPU as most of the time is serialization of timestamp and date. Refer attached profiles. >70% time spent in serialization + tostring conversions.
Attachments
Attachments
Issue Links
- is duplicated by
-
HIVE-17998 Use FastDateFormat instead of SimpleDateFormat for TimestampWritable
- Resolved