[HBASE-1287] Partitioner class not used in TableMapReduceUtil.initTableReduceJob()

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.19.2, 0.20.0
• Assignee: Billy Pearson
• Reporter: Lars George
• Created: 25/Mar/09 12:12
• Updated: 20/Sep/12 22:10
• Resolved: 24/Apr/09 22:45

Description

Upon checking the available utility methods in TableMapReduceUtil I came across this code

  public static void initTableReduceJob(String table,
    Class<? extends TableReduce> reducer, JobConf job, Class partitioner)
  throws IOException {
    job.setOutputFormat(TableOutputFormat.class);
    job.setReducerClass(reducer);
    job.set(TableOutputFormat.OUTPUT_TABLE, table);
    job.setOutputKeyClass(ImmutableBytesWritable.class);
    job.setOutputValueClass(BatchUpdate.class);
    if (partitioner != null) {
      job.setPartitionerClass(HRegionPartitioner.class);
      HTable outputTable = new HTable(new HBaseConfiguration(job), table);
      int regions = outputTable.getRegionsInfo().size();
      if (job.getNumReduceTasks() > regions){
    	job.setNumReduceTasks(outputTable.getRegionsInfo().size());
      }
    }
  }

It seems though as it should be

    if (partitioner != null) {
      job.setPartitionerClass(partitioner);

and the provided HRegionPartitioner can be handed in to that call or a custom one can be provided.