Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4603

Allow JobClient to retry job-submission when JT is in safemode

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: None
    • Labels:
      None

      Description

      Similar to HDFS-3504, it would be useful to allow JobClient to retry job-submission when JT is in safemode (via MAPREDUCE-4328).

      This way applications like Pig/Hive don't bork midway when the NN/JT are not operational.

        Issue Links

          Activity

          Hide
          Arun C Murthy added a comment -

          Straight-fwd patch after HADOOP-8748 - all I had to do was throw a new SafeModeException from JobTracker and let ipc retry deal with it.

          Show
          Arun C Murthy added a comment - Straight-fwd patch after HADOOP-8748 - all I had to do was throw a new SafeModeException from JobTracker and let ipc retry deal with it.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12546524/MAPREDUCE-4603.patch
          against trunk revision .

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2876//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12546524/MAPREDUCE-4603.patch against trunk revision . -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2876//console This message is automatically generated.
          Hide
          Arun C Murthy added a comment -

          Hey Nic, can you pls take a quick look since you've done a lot of work with IPC retries etc.? Thanks!

          Show
          Arun C Murthy added a comment - Hey Nic, can you pls take a quick look since you've done a lot of work with IPC retries etc.? Thanks!
          Hide
          Tsz Wo Nicholas Sze added a comment -

          +1 patch looks good.

          Show
          Tsz Wo Nicholas Sze added a comment - +1 patch looks good.
          Hide
          Arun C Murthy added a comment -

          Thanks for the review Nic. I've just committed this.

          Show
          Arun C Murthy added a comment - Thanks for the review Nic. I've just committed this.
          Hide
          Matt Foley added a comment -

          Closed upon release of Hadoop-1.1.0.

          Show
          Matt Foley added a comment - Closed upon release of Hadoop-1.1.0.

            People

            • Assignee:
              Arun C Murthy
              Reporter:
              Arun C Murthy
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development