[HIVE-479] Change RCFileOutputFormat's generic signatute to be <WritableComparable, ..>

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.4.0
• Hadoop Flags: Reviewed

Release Note

HIVE-479. Change RCFileOutputFormat's generic signatute. (Yongqiang He via zshao)

• Assignee: He Yongqiang
• Reporter: He Yongqiang
• Created: 12/May/09 05:19
• Updated: 17/Dec/11 00:07
• Resolved: 03/Jun/09 21:33

Description

In one test for hive-477, i found that the below command can not sucessfully pass:

$HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/contrib/streaming/hadoop-0.19.0-streaming.jar -input /user/hive/warehouse/tablerc1 -output testHiveWriter -inputformat org.apache.hadoop.hive.ql.io.RCFileInputFormat -outputformat org.apache.hadoop.hive.ql.io.RCFileOutputFormat -mapper org.apache.hadoop.mapred.lib.IdentityMapper -jobconf mapred.work.output.dir=. -jobconf hive.io.rcfile.column.number.conf=32 -jobconf mapred.output.compress=true -numReduceTasks 0

It is caused by the assumption that RCFileOutputFormat thinks the key's class of passes in records is Void.