Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3559

MR AM can change to SUCCESS state but crash and fail to write JobHistory

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.23.0
    • Fix Version/s: None
    • Component/s: mr-am, mrv2
    • Labels:
      None

      Description

      In such corner cases, clients can see that the job has become successful but they cannot get any information from JobHistoryServer. And there is no means of figuring out what happened in the system except from the AM logs.

      Ideally we should set the JobState to become SUCCESS as the last step, once everything else is done. The code changes may be a bit complicated to achieve this, but we can investigate and see.

        Activity

        Vinod Kumar Vavilapalli created issue -

          People

          • Assignee:
            Unassigned
            Reporter:
            Vinod Kumar Vavilapalli
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:

              Development