Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7067

MR job submission fails if staging dir not on fs.defaultFS

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 2.7.1, 3.0.0-alpha4
    • Fix Version/s: None
    • Component/s: applicationmaster, client
    • Labels:
      None

      Description

      if staging directory (yarn.app.mapreduce.am.staging-dir) not on fs.defaultFS.
      mr job submission fails.

      No reason staging dir should be on fs.defaultFS.

      getting filesystem code related staging dir should change from FileSystem.get(conf) to stagingDir.getFileSystem(conf) 

       

        Attachments

        1. MAPREDUCE-7067.branch-2.7.002.patch
          23 kB
          KWON BYUNGCHANG
        2. MAPREDUCE-7067.branch-2.7.001.patch
          16 kB
          KWON BYUNGCHANG

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              magnum KWON BYUNGCHANG
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: