Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3686

history server web ui - job counter values for map/reduce not shown properly

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.2
    • Component/s: mrv2
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Fixed two bugs in Counters because of which web app displays zero counter values for framework counters.

      Description

      Looking at the job counters page on the history server for a finished job, it shows 3 columns for each counter - map, reduce, total. The total appears correct, but map and reduce columns are always zero. If you click on a particular column it does show you the map/reduce task and the value of each one.

      Going to attach screenshots shortly.

      1. jobcounter1.png
        99 kB
        Thomas Graves
      2. jobcounter2.png
        23 kB
        Thomas Graves
      3. MAPREDUCE-3686.patch
        5 kB
        Bhallamudi Venkata Siva Kamesh
      4. jobcounter3.png
        131 kB
        Bhallamudi Venkata Siva Kamesh
      5. MAPREDUCE-3686.patch
        5 kB
        Mahadev konar
      6. MAPREDUCE-3686-1.path
        4 kB
        Bhallamudi Venkata Siva Kamesh

        Activity

        Thomas Graves created issue -
        Thomas Graves made changes -
        Field Original Value New Value
        Attachment jobcounter1.png [ 12511006 ]
        Attachment jobcounter2.png [ 12511007 ]
        Bhallamudi Venkata Siva Kamesh made changes -
        Attachment MAPREDUCE-3686.patch [ 12512924 ]
        Bhallamudi Venkata Siva Kamesh made changes -
        Attachment jobcounter3.png [ 12512925 ]
        Bhallamudi Venkata Siva Kamesh made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Mahadev konar made changes -
        Attachment MAPREDUCE-3686.patch [ 12513072 ]
        Mahadev konar made changes -
        Assignee Bhallamudi Venkata Siva Kamesh [ kamesh ]
        Bhallamudi Venkata Siva Kamesh made changes -
        Attachment MAPREDUCE-3686-1.path [ 12513954 ]
        Vinod Kumar Vavilapalli made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Release Note Fixed two bugs in Counters because of which web app displays zero counter values for framework counters.
        Target Version/s 0.23.1 [ 12318883 ]
        Fix Version/s 0.23.2 [ 12319851 ]
        Resolution Fixed [ 1 ]

          People

          • Assignee:
            Bhallamudi Venkata Siva Kamesh
            Reporter:
            Thomas Graves
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development