[HIVE-375] LazySimpleSerDe to directly serialize (append) int/long/byte/short etc to UTF-8 buffer

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.3.0
• Fix Version/s: 0.4.0
• Hadoop Flags: Reviewed
• Assignee: Zheng Shao
• Reporter: Zheng Shao
• Created: 27/Mar/09 00:38
• Updated: 17/Dec/11 00:07
• Resolved: 31/Mar/09 21:16

Description

LazySimpleSerDe currently serialize all data into a StringBuilder, and then convert it to String and then Text.
Even if the data is of type int/long/byte/short, we still do that unnecessary conversion.

We should directly serialize/append int/long/byte/short to a UTF-8 buffer.

This is a very simple change, but it is expected to save 2-3% of the time of a typical mapper (on a group-by query with some int/long columns), and this blocks HIVE-266.

Issue Links

• blocks: HIVE-266 Improve SerDe performance by using Text instead of String