Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5718

MR job will fail after commit fail

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.6.0
    • None
    • mr-am
    • None

    Description

      when any of this happens:

      • While testing RM HA, if the RM fails over while an MR AM is in the middle of a commit,
      • When testing preempting, if the MR AM fails over during the middle of a commit

      the subsequent AM gets spawned but dies with a diagnostic message - "We crashed durring a commit".

      Attachments

        1. mr-5718-0.patch
          2 kB
          Karthik Kambatla
        2. MAPREDUCE-5718.v2.patch
          2 kB
          Yang Hao

        Issue Links

        is duplicated by

        Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5795 Job should be marked as Failed if it is recovered from commit.

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            yanghaogn Yang Hao
            kasha Karthik Kambatla
            Votes:
            1 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:

              Slack

                Issue deployment