[HIVE-629] concat files needed for map-reduce jobs also

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.4.0
• Fix Version/s: 0.4.0
• Component/s: Query Processor
• Hadoop Flags: Reviewed
• Release Note: HIVE-629. Concat files for map-reduce jobs. (Namit Jain via zshao)
• Assignee: Namit Jain
• Reporter: Namit Jain
• Created: 13/Jul/09 18:01
• Updated: 17/Dec/11 00:07
• Resolved: 16/Jul/09 00:37

Description

Currently, hive concatenates files only if the job under consideration is a map-only job.

I got some requests from some users, where they want this behavior for map-reduce jobs also - it may not be a good idea to turn it on by default.
But, we should provide an option to the user where the concatenation can happen even for map-reduce jobs.