Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4273

Make CombineFileInputFormat split result JDK independent

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 1.0.3
    • None
    • client

    Description

      The split result of CombineFileInputFormat depends on the iteration order of nodeToBlocks and rackToBlocks hash maps, which makes the result HashMap implementation hence JDK dependent.

      This is manifested as TestCombineFileInputFormat failures on alternative JDKs.

      Attachments

        1. mapreduce-4273-branch-1.patch
          62 kB
          Yu Gao
        2. mapreduce-4273-branch-2.patch
          38 kB
          Yu Gao
        3. mapreduce-4273.patch
          38 kB
          Yu Gao
        4. MAPREDUCE-4273-branch1-v2.patch
          71 kB
          Amir F Sanjar

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-8192 Fix unit test failures with IBM's JDK

          • Major - Major loss of function.
          • Open

          Activity

            People

              crystal_gaoyu Yu Gao
              vicaya Luke Lu
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: