[HIVE-2296] bad compressed file names from insert into

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0
• Fix Version/s: 0.8.0
• Assignee: Franklin Hu
• Reporter: Franklin Hu
• Created: 20/Jul/11 23:13
• Updated: 16/Dec/11 23:56
• Resolved: 22/Jul/11 20:21

Description

When INSERT INTO is run on a table with compressed output (hive.exec.compress.output=true) and existing files in the table, it may copy the new files in bad file names:

Before INSERT INTO:
000000_0.gz

After INSERT INTO:
000000_0.gz
000000_0.gz_copy_1

This causes corrupted output when doing a SELECT * on the table.
Correct behavior should be to pick a valid filename such as:
000000_0_copy_1.gz