[SQOOP-844] Sqoop2: HdfsExportPartitioner is not always respecting maximal number of partitions

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.99.1
• Fix Version/s: 1.99.2
• Assignee: Vasanth kumar RJ
• Reporter: Jarek Jarcec Cecho
• Created: 23/Jan/13 17:59
• Updated: 13/Apr/13 23:55
• Resolved: 13/Apr/13 18:41

Description

It seems that HdfsExportPartitioner is not always respecting maximal number of partitions that should be created. I was able for example able to intercept following exception:

Stack trace: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0025:Retrieved invalid number of partitions from Partitioner - Got 11, max was 10
        at org.apache.sqoop.job.mr.SqoopInputFormat.getSplits(SqoopInputFormat.java:79)
        at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:1014)
        at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1031)

Issue Links

• links to: Review board