[HADOOP-4169] 'compressed' keyword in DDL syntax misleading and does not compress

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.19.0
• Hadoop Flags: Reviewed
• Assignee: Joydeep Sen Sarma
• Reporter: Joydeep Sen Sarma
• Created: 14/Sep/08 07:41
• Updated: 08/Jul/09 17:06
• Resolved: 20/Sep/08 00:20

Description

Hive produces two types of data files - flat files and sequencefiles. Syntax should reflect this. Currently the 'compressed' keyword is used to choose sequencefile format - but does not actually compress the files. this is misleading. In addition - flat files can also be compressed.

Proposal is to replace 'compressed' with 'sequencefile'. And compression options should be applied from standard hadoop way of specifying whether output should be compressed (''mapred.output.compress') - ie. session options. (session options will also define codec etc.). default file format and compression options can be specified in conf file.