Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7042

Killed MR job data does not move to mapreduce.jobhistory.done-dir when ATS v2 is enabled

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 2.10.0, 3.2.0, 3.0.3, 3.1.1
    • None
    • None
    • Reviewed

    Description

      Steps:
      1) Start a mapreduce job

      hadoop jar /usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-751-tests.jar sleep "-Dmapreduce.job.user.name=hrt_qa"   -m 10 -r 1 -mt 1000  -rt 1000

      2) kill job
      3) Validate job is present at mapreduce.jobhistory.done-dir

      mapreduce.jobhistory.done-dir dir does not have job_1516776025831_0048 entry.

      Attachments

        1. MAPREDUCE-7042.1.patch
          7 kB
          Xuan Gong
        2. MAPREDUCE-7042.2.patch
          5 kB
          Xuan Gong
        3. MAPREDUCE-7042.3.patch
          5 kB
          Xuan Gong
        4. MAPREDUCE-7042.4.patch
          11 kB
          Rohith Sharma K S

        Activity

          People

            xgong Xuan Gong
            yeshavora Yesha Vora
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: