Hadoop YARN
  1. Hadoop YARN
  2. YARN-2251

Avoid negative elapsed time in JHS/MRAM web UI and services

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.6.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Recently we observed a rare bug that an elapsed time of a reducer is going to be negative on JHS web UI and via REST APIs. While the real reason for this bug seems to be clock asynchronization on different hosts, the web frontend should have masked the negative values. However, in the current code, org.apache.hadoop.mapreduce.v2.app.webapp.dao.* only check whether the elapsed time is -1 or not.

      1. MAPREDUCE-5940.1.patch
        5 kB
        Zhijie Shen
      2. MAPREDUCE-5940.2.patch
        3 kB
        Zhijie Shen

        Issue Links

          Activity

          Zhijie Shen created issue -
          Zhijie Shen made changes -
          Field Original Value New Value
          Attachment MAPREDUCE-5940.1.patch [ 12652340 ]
          Zhijie Shen made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Zhijie Shen made changes -
          Attachment MAPREDUCE-5940.2.patch [ 12653860 ]
          Junping Du made changes -
          Project Hadoop Map/Reduce [ 12310941 ] Hadoop YARN [ 12313722 ]
          Key MAPREDUCE-5940 YARN-2251
          Component/s mr-am [ 12315342 ]
          Component/s jobhistoryserver [ 12315343 ]
          Component/s webapps [ 12316700 ]
          Junping Du made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 2.6.0 [ 12327197 ]
          Resolution Fixed [ 1 ]
          Zhijie Shen made changes -
          Link This issue is related to HADOOP-10794 [ HADOOP-10794 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Zhijie Shen
              Reporter:
              Zhijie Shen
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development