Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7042

Killed MR job data does not move to mapreduce.jobhistory.done-dir when ATS v2 is enabled

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 2.10.0, 3.2.0, 3.0.3, 3.1.1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Steps:
      1) Start a mapreduce job

      hadoop jar /usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-751-tests.jar sleep "-Dmapreduce.job.user.name=hrt_qa"   -m 10 -r 1 -mt 1000  -rt 1000

      2) kill job
      3) Validate job is present at mapreduce.jobhistory.done-dir

      mapreduce.jobhistory.done-dir dir does not have job_1516776025831_0048 entry.

        Attachments

        1. MAPREDUCE-7042.1.patch
          7 kB
          Xuan Gong
        2. MAPREDUCE-7042.2.patch
          5 kB
          Xuan Gong
        3. MAPREDUCE-7042.3.patch
          5 kB
          Xuan Gong
        4. MAPREDUCE-7042.4.patch
          11 kB
          Rohith Sharma K S

          Activity

            People

            • Assignee:
              xgong Xuan Gong
              Reporter:
              yeshavora Yesha Vora
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: