Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2

ArrayOutOfIndex error in KeyFieldBasedPartitioner on empty key

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.20.1
    • None
    • None
    • Reviewed
    • KeyFieldBasedPartitioner throws ArrayOutOfIndex when passed an empty key. This patch hashes empty key to 0 hashcode.

    Description

      When using KeyFieldBasedPartitioner, if the record doesn't contain the specified field, the endChar would equal with array.length, which throw ArrayOutOfIndex exception, losing that record!

      Attachments

        1. HADOOP-6052-v1.0.patch
          3 kB
          Amar Kamat
        2. HADOOP-6052-v1.0-branch0.20.patch
          3 kB
          Amar Kamat
        3. HADOOP-6052-v1.1.patch
          3 kB
          Amar Kamat
        4. MAPREDUCE-2-v1.0.patch
          3 kB
          Amar Kamat
        5. MAPREDUCE-2-v1.1.patch
          3 kB
          Amar Kamat
        6. MAPREDUCE-2-v1.1-branch-0.20.patch
          3 kB
          Amar Kamat

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-735 ArrayIndexOutOfBoundsException is thrown by KeyFieldBasedPartitioner

          • Major - Major loss of function.
          • Resolved
          is part of

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-52 KeyFieldBasedPartitioner would lost data if specifed field not exist, and it should encode free not only support utf8

          • Major - Major loss of function.
          • Open

          Activity

            People

              amar_kamat Amar Kamat
              amar_kamat Amar Kamat
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: