Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-735

ArrayIndexOutOfBoundsException is thrown by KeyFieldBasedPartitioner

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.1
    • Fix Version/s: 0.20.1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Tags:
      ygridqa

      Description

      KeyFieldBasedPartitioner throws "KeyFieldBasedPartitioner" when some part of the specified key is missing.
      Scenario :
      =======
      when value of num.key.fields.for.partition is greater than the separators provided in the input.
      Command:
      ========
      hadoop jar streaming.jar -Dmapred.reduce.tasks=3 -Dnum.key.fields.for.partition=5 -input <input-dir> -output <output-dir> -mapper org.apache.hadoop.mapred.lib.IdentityMapper -reducer org.apache.hadoop.mapred.lib.IdentityReducer -inputformat org.apache.hadoop.mapred.KeyValueTextInputFormat -partitioner org.apache.hadoop.mapred.lib.KeyFieldBasedPartitioner

      1. HADOOP-6130-v1.0.patch
        2 kB
        Amar Kamat
      2. MAPREDUCE-735-v1.2.patch
        17 kB
        Amar Kamat
      3. MAPREDUCE-735-v1.4.patch
        18 kB
        Amar Kamat
      4. MAPREDUCE-735-v1.4-branch-0.20.patch
        18 kB
        Amar Kamat
      5. MAPREDUCE-735-v1.5.patch
        19 kB
        Amar Kamat
      6. MAPREDUCE-735-v2.1.patch
        24 kB
        Amar Kamat
      7. MAPREDUCE-735-v3.1.patch
        25 kB
        Amar Kamat
      8. MAPREDUCE-735-v3.2.patch
        25 kB
        Amar Kamat
      9. MAPREDUCE-735-v3.2-branch-0.20.patch
        25 kB
        Amar Kamat

        Issue Links

          Activity

          Suman Sehgal created issue -
          Suman Sehgal made changes -
          Field Original Value New Value
          Link This issue blocks MAPREDUCE-2 [ MAPREDUCE-2 ]
          Devaraj Das made changes -
          Assignee Amar Kamat [ amar_kamat ]
          Priority Critical [ 2 ] Major [ 3 ]
          Amar Kamat made changes -
          Attachment HADOOP-6130-v1.0.patch [ 12412860 ]
          Lee Tucker made changes -
          Affects Version/s 0.20.1 [ 12314047 ]
          Affects Version/s 0.20.0 [ 12313438 ]
          Project Hadoop Common [ 12310240 ] Hadoop Map/Reduce [ 12310941 ]
          Key HADOOP-6130 MAPREDUCE-735
          Component/s tasktracker [ 12312906 ]
          Component/s mapred [ 12310690 ]
          Lee Tucker made changes -
          Component/s tasktracker [ 12312906 ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-735-v1.2.patch [ 12413088 ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-735-v1.4.patch [ 12413111 ]
          Attachment MAPREDUCE-735-v1.4-branch-0.20.patch [ 12413112 ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-735-v1.5.patch [ 12413282 ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-735-v2.1.patch [ 12413809 ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-735-v3.1.patch [ 12414002 ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-735-v3.2.patch [ 12414095 ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-735-v3.2-branch-0.20.patch [ 12414214 ]
          Devaraj Das made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Fix Version/s 0.20.1 [ 12314047 ]
          Resolution Fixed [ 1 ]

            People

            • Assignee:
              Amar Kamat
              Reporter:
              Suman Sehgal
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development