Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7067

MR job submission fails if staging dir not on fs.defaultFS

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Minor
    • Resolution: Unresolved
    • 2.7.1, 3.0.0-alpha4
    • None
    • applicationmaster, client
    • None

    Description

      if staging directory (yarn.app.mapreduce.am.staging-dir) not on fs.defaultFS.
      mr job submission fails.

      No reason staging dir should be on fs.defaultFS.

      getting filesystem code related staging dir should change from FileSystem.get(conf) to stagingDir.getFileSystem(conf) 

       

      Attachments

        1. MAPREDUCE-7067.branch-2.7.002.patch
          23 kB
          KWON BYUNGCHANG
        2. MAPREDUCE-7067.branch-2.7.001.patch
          16 kB
          KWON BYUNGCHANG

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            magnum KWON BYUNGCHANG

            Dates

              Created:
              Updated:

              Slack

                Issue deployment