Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7108

TestFileOutputCommitter fails on Windows

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.1.0, 2.9.1
    • 2.10.0, 3.2.0, 3.1.1, 2.9.2
    • test

    Description

      TestFileOutputCommitter.java fails on Windows.

      Reason:

      This is because in testMapFileOutputCommitterInternal, after executing MapFileOutputFormat.getReaders(outDir, conf), the readers are not properly closed. So other apis that attempt to delete the existing file fails due to the file handler already being used.

       

      Solution:

      Close all readers after call MapFileOutputFormat.getReaders(outDir, conf);

      Attachments

        1. MAPREDUCE-7108.000.patch
          1 kB
          Zuoming Zhang
        2. MAPREDUCE-7108.001.patch
          2 kB
          Zuoming Zhang
        3. MAPREDUCE-7108.002.patch
          2 kB
          Zuoming Zhang
        4. MAPREDUCE-7108.003.patch
          2 kB
          Gera Shegalov
        5. MAPREDUCE-7108-TestFileOutputCommitter-Report.000.txt
          3 kB
          Zuoming Zhang
        6. MAPREDUCE-7108-TestFileOutputCommitter-Report.001.txt
          3 kB
          Zuoming Zhang
        7. MAPREDUCE-7108-TestFileOutputCommitter-Report.002.txt
          6 kB
          Zuoming Zhang

        Issue Links

          Activity

            People

              zuzhan Zuoming Zhang
              zuzhan Zuoming Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 24h
                  24h
                  Remaining:
                  Remaining Estimate - 24h
                  24h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified