[HIVE-669] SELECT TRANSFORM / MAP / REDUCE to support optional ROW FORMAT

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Component/s: Serializers/Deserializers
• Assignee: Unassigned
• Reporter: Zheng Shao
• Created: 21/Jul/09 21:30
• Updated: 24/Aug/09 17:54
• Resolved: 29/Jul/09 21:07

Description

We should allow TRANSFORM / MAP/ REDUCE to accept optional ROW FORMAT:

SELECT TRANSFORM(a, b, c)
ROW FORMAT DELIMITED FIELDS TERMINATED BY '\001'
USING 'mypython.py'
AS (d STRING, e INT, f DOUBLE)
ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t'

Also, we should allow optional type information in the "AS" clause.

Issue Links

• blocks: HIVE-411 Interaction of AS clause (from a TRANSFORM-USING-AS) with non-column formatted output
• duplicates: HIVE-708 Add TypedBytes SerDe for transform
• duplicates: HIVE-743 let user specify serde for custom scripts
• is related to: HIVE-634 ctrl-A is the only output delimiter used, regardless of the Hive table structure
• relates to: HIVE-51 Generate and accept JSON as the input-output format from mappers and reducers