Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4102

job counters not available in Jobhistory webui for killed jobs

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.2, 2.0.0-alpha
    • Fix Version/s: 0.23.3, 2.0.2-alpha
    • Component/s: webapps
    • Labels:
      None

      Description

      Run a simple wordcount or sleep, and kill the job before it finishes. Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".

      The job history log has:

      Caused by: com.google.inject.ProvisionException: Guice provision errors:

      2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
      java.lang.reflect.InvocationTargetException
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      ...
      ..
      ...

      1) Error injecting constructor, java.lang.NullPointerException
      at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
      while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
      ...
      ..
      ...
      Caused by: java.lang.NullPointerException at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
      at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
      at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
      at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

      There are task counters available if you drill down into successful tasks though.

      1. MAPREDUCE-4102-3.patch
        12 kB
        Bhallamudi Venkata Siva Kamesh
      2. MAPREDUCE-4102.patch
        7 kB
        Bhallamudi Venkata Siva Kamesh
      3. MAPREDUCE-4102-1.patch
        7 kB
        Bhallamudi Venkata Siva Kamesh
      4. MAPREDUCE-4102.patch
        4 kB
        Bhallamudi Venkata Siva Kamesh

        Issue Links

          Activity

          Thomas Graves created issue -
          Bhallamudi Venkata Siva Kamesh made changes -
          Field Original Value New Value
          Attachment MAPREDUCE-4102.patch [ 12522540 ]
          Bhallamudi Venkata Siva Kamesh made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Affects Version/s 2.0.0 [ 12320354 ]
          Bhallamudi Venkata Siva Kamesh made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Bhallamudi Venkata Siva Kamesh made changes -
          Attachment MAPREDUCE-4102-1.patch [ 12522573 ]
          Bhallamudi Venkata Siva Kamesh made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Thomas Graves made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Bhallamudi Venkata Siva Kamesh made changes -
          Attachment MAPREDUCE-4102.patch [ 12525828 ]
          Bhallamudi Venkata Siva Kamesh made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Thomas Graves made changes -
          Assignee Bhallamudi Venkata Siva Kamesh [ kamesh ]
          Bhallamudi Venkata Siva Kamesh made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Bhallamudi Venkata Siva Kamesh made changes -
          Attachment MAPREDUCE-4102-3.patch [ 12526186 ]
          Bhallamudi Venkata Siva Kamesh made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Thomas Graves made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.23.3 [ 12320060 ]
          Resolution Fixed [ 1 ]
          Arun C Murthy made changes -
          Fix Version/s 2.0.2-alpha [ 12322471 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Ravi Prakash made changes -
          Link This issue is related to MAPREDUCE-5023 [ MAPREDUCE-5023 ]

            People

            • Assignee:
              Bhallamudi Venkata Siva Kamesh
              Reporter:
              Thomas Graves
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development