Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-735

ArrayIndexOutOfBoundsException is thrown by KeyFieldBasedPartitioner

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.1
    • Fix Version/s: 0.20.1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Tags:
      ygridqa

      Description

      KeyFieldBasedPartitioner throws "KeyFieldBasedPartitioner" when some part of the specified key is missing.
      Scenario :
      =======
      when value of num.key.fields.for.partition is greater than the separators provided in the input.
      Command:
      ========
      hadoop jar streaming.jar -Dmapred.reduce.tasks=3 -Dnum.key.fields.for.partition=5 -input <input-dir> -output <output-dir> -mapper org.apache.hadoop.mapred.lib.IdentityMapper -reducer org.apache.hadoop.mapred.lib.IdentityReducer -inputformat org.apache.hadoop.mapred.KeyValueTextInputFormat -partitioner org.apache.hadoop.mapred.lib.KeyFieldBasedPartitioner

      1. MAPREDUCE-735-v3.2-branch-0.20.patch
        25 kB
        Amar Kamat
      2. MAPREDUCE-735-v3.2.patch
        25 kB
        Amar Kamat
      3. MAPREDUCE-735-v3.1.patch
        25 kB
        Amar Kamat
      4. MAPREDUCE-735-v2.1.patch
        24 kB
        Amar Kamat
      5. MAPREDUCE-735-v1.5.patch
        19 kB
        Amar Kamat
      6. MAPREDUCE-735-v1.4-branch-0.20.patch
        18 kB
        Amar Kamat
      7. MAPREDUCE-735-v1.4.patch
        18 kB
        Amar Kamat
      8. MAPREDUCE-735-v1.2.patch
        17 kB
        Amar Kamat
      9. HADOOP-6130-v1.0.patch
        2 kB
        Amar Kamat

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Amar Kamat
              Reporter:
              Suman Sehgal
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development