[HIVE-336] TBinaryProtocol blow up the data size between map-reduce boundary

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.3.0, 0.6.0
• Fix Version/s: 0.3.0
• Component/s: Serializers/Deserializers
• Hadoop Flags: Reviewed
• Assignee: Zheng Shao
• Reporter: Zheng Shao
• Created: 10/Mar/09 23:19
• Updated: 17/Dec/11 00:09
• Resolved: 24/Mar/09 23:49

Description

TBinaryProtocol is very space-inefficient. We've seen the data blown up several times between the map-reduce boundary because of it.

We should change it to simple delimited format (backed by LazySimpleSerDe).

Issue Links

• is blocked by: HIVE-337 LazySimpleSerDe should support multi-level nested array, map, struct types