Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2398

MRBench: setting the baseDir parameter has no effect

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.3.0
    • 2.9.0, 3.0.0-alpha1
    • benchmarks
    • None
    • Reviewed

    Description

      The optional -baseDir parameter lets user specify the base DFS path for output/input of MRBench.

      However, the two private variables INPUT_DIR and OUTPUT_DIR (MRBench.java) are not updated in the case that the default value of -baseDir is actually overwritten by the user. Hence any input and output is always written to the default locations (/benchmarks/MRBench/...), even though the user-supplied location for -baseDir is created (and eventually deleted again) on HDFS.

      The bug affects at least Hadoop 0.20.2 and the current trunk (r1082703) as of March 21, 2011.

      Attachments

        1. MAPREDUCE-2398_0.20.2.patch
          0.7 kB
          Michael G. Noll
        2. MAPREDUCE-2398-trunk.patch
          0.7 kB
          Michael G. Noll
        3. MAPREDUCE-2398_v2-0.20.203.0.patch
          2 kB
          Michael G. Noll
        4. MAPREDUCE-2398_v2-trunk.patch
          2 kB
          Michael G. Noll
        5. MAPREDUCE-2398.2.patch
          3 kB
          wilfreds#1

        Activity

          People

            wilfreds Wilfred Spiegelenburg
            miguno Michael G. Noll
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: