Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7067

MR job submission fails if staging dir not on fs.defaultFS

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Minor
    • Resolution: Unresolved
    • 2.7.1, 3.0.0-alpha4
    • None
    • applicationmaster, client
    • None

    Description

      if staging directory (yarn.app.mapreduce.am.staging-dir) not on fs.defaultFS.
      mr job submission fails.

      No reason staging dir should be on fs.defaultFS.

      getting filesystem code related staging dir should change from FileSystem.get(conf) to stagingDir.getFileSystem(conf) 

       

      Attachments

        1. MAPREDUCE-7067.branch-2.7.001.patch
          16 kB
          KWON BYUNGCHANG
        2. MAPREDUCE-7067.branch-2.7.002.patch
          23 kB
          KWON BYUNGCHANG

        Activity

          People

            Unassigned Unassigned
            magnum KWON BYUNGCHANG
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: