Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4603

Allow JobClient to retry job-submission when JT is in safemode

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: None
    • Labels:
      None

      Description

      Similar to HDFS-3504, it would be useful to allow JobClient to retry job-submission when JT is in safemode (via MAPREDUCE-4328).

      This way applications like Pig/Hive don't bork midway when the NN/JT are not operational.

        Issue Links

          Activity

          Arun C Murthy created issue -
          Arun C Murthy made changes -
          Field Original Value New Value
          Link This issue is blocked by HDFS-3871 [ HDFS-3871 ]
          Arun C Murthy made changes -
          Link This issue is blocked by HADOOP-8748 [ HADOOP-8748 ]
          Hide
          Arun C Murthy added a comment -

          Straight-fwd patch after HADOOP-8748 - all I had to do was throw a new SafeModeException from JobTracker and let ipc retry deal with it.

          Show
          Arun C Murthy added a comment - Straight-fwd patch after HADOOP-8748 - all I had to do was throw a new SafeModeException from JobTracker and let ipc retry deal with it.
          Arun C Murthy made changes -
          Attachment MAPREDUCE-4603.patch [ 12546524 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12546524/MAPREDUCE-4603.patch
          against trunk revision .

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2876//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12546524/MAPREDUCE-4603.patch against trunk revision . -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2876//console This message is automatically generated.
          Hide
          Arun C Murthy added a comment -

          Hey Nic, can you pls take a quick look since you've done a lot of work with IPC retries etc.? Thanks!

          Show
          Arun C Murthy added a comment - Hey Nic, can you pls take a quick look since you've done a lot of work with IPC retries etc.? Thanks!
          Hide
          Tsz Wo Nicholas Sze added a comment -

          +1 patch looks good.

          Show
          Tsz Wo Nicholas Sze added a comment - +1 patch looks good.
          Hide
          Arun C Murthy added a comment -

          Thanks for the review Nic. I've just committed this.

          Show
          Arun C Murthy added a comment - Thanks for the review Nic. I've just committed this.
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 1.1.0 [ 12317960 ]
          Resolution Fixed [ 1 ]
          Hide
          Matt Foley added a comment -

          Closed upon release of Hadoop-1.1.0.

          Show
          Matt Foley added a comment - Closed upon release of Hadoop-1.1.0.
          Matt Foley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Patch Available Patch Available
          26d 22h 25m 1 Arun C Murthy 25/Sep/12 15:55
          Patch Available Patch Available Resolved Resolved
          3h 31m 1 Arun C Murthy 25/Sep/12 19:27
          Resolved Resolved Closed Closed
          22d 1 Matt Foley 17/Oct/12 19:27

            People

            • Assignee:
              Arun C Murthy
              Reporter:
              Arun C Murthy
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development