[HIVE-270] Add a lazy-deserialized SerDe for space and cpu efficient serialization of rows with primitive types

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.3.0
• Component/s: Serializers/Deserializers
• Hadoop Flags: Reviewed

Release Note

HIVE-270. Add a lazy-deserialized SerDe for efficient deserialization of rows with primitive types. (zshao)

• Assignee: Zheng Shao
• Reporter: Zheng Shao
• Created: 04/Feb/09 06:11
• Updated: 07/Sep/13 13:51
• Resolved: 17/Feb/09 19:40

Description

We want to add a lazy-deserialized SerDe for space and cpu efficient serialization of rows with primitive types.
This SerDe will share the same format as MetadataTypedColumnsetSerDe/TCTLSeparatedProtocol to be backward compatible.

This SerDe will be used to replace the default table SerDe, and the SerDe used to communicate with user scripts.

For simplicity, we don't plan to support nested structure with this SerDe.

Issue Links

• blocks: HIVE-337 LazySimpleSerDe should support multi-level nested array, map, struct types
• is depended upon by: HIVE-292 Use LazySimpleSerDe to replace MetadataTypedColumnsetSerde
• is depended upon by: HIVE-298 Make branch 0.2 forward compatible with tables created with LazySimpleSerDe
• relates to: HIVE-136 SerDe should escape some special characters
• relates to: HIVE-266 Improve SerDe performance by using Text instead of String