Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-735

ArrayIndexOutOfBoundsException is thrown by KeyFieldBasedPartitioner

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.1
    • Fix Version/s: 0.20.1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Tags:
      ygridqa

      Description

      KeyFieldBasedPartitioner throws "KeyFieldBasedPartitioner" when some part of the specified key is missing.
      Scenario :
      =======
      when value of num.key.fields.for.partition is greater than the separators provided in the input.
      Command:
      ========
      hadoop jar streaming.jar -Dmapred.reduce.tasks=3 -Dnum.key.fields.for.partition=5 -input <input-dir> -output <output-dir> -mapper org.apache.hadoop.mapred.lib.IdentityMapper -reducer org.apache.hadoop.mapred.lib.IdentityReducer -inputformat org.apache.hadoop.mapred.KeyValueTextInputFormat -partitioner org.apache.hadoop.mapred.lib.KeyFieldBasedPartitioner

        Attachments

        1. MAPREDUCE-735-v3.2-branch-0.20.patch
          25 kB
          Amar Kamat
        2. MAPREDUCE-735-v3.2.patch
          25 kB
          Amar Kamat
        3. MAPREDUCE-735-v3.1.patch
          25 kB
          Amar Kamat
        4. MAPREDUCE-735-v2.1.patch
          24 kB
          Amar Kamat
        5. MAPREDUCE-735-v1.5.patch
          19 kB
          Amar Kamat
        6. MAPREDUCE-735-v1.4-branch-0.20.patch
          18 kB
          Amar Kamat
        7. MAPREDUCE-735-v1.4.patch
          18 kB
          Amar Kamat
        8. MAPREDUCE-735-v1.2.patch
          17 kB
          Amar Kamat
        9. HADOOP-6130-v1.0.patch
          2 kB
          Amar Kamat

          Issue Links

            Activity

              People

              • Assignee:
                amar_kamat Amar Kamat
                Reporter:
                sumanshg Suman Sehgal
              • Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: