Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4102

job counters not available in Jobhistory webui for killed jobs

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.2, 2.0.0-alpha
    • Fix Version/s: 0.23.3, 2.0.2-alpha
    • Component/s: webapps
    • Labels:
      None

      Description

      Run a simple wordcount or sleep, and kill the job before it finishes. Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".

      The job history log has:

      Caused by: com.google.inject.ProvisionException: Guice provision errors:

      2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
      java.lang.reflect.InvocationTargetException
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      ...
      ..
      ...

      1) Error injecting constructor, java.lang.NullPointerException
      at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
      while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
      ...
      ..
      ...
      Caused by: java.lang.NullPointerException at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
      at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
      at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
      at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

      There are task counters available if you drill down into successful tasks though.

        Attachments

        1. MAPREDUCE-4102.patch
          7 kB
          Bhallamudi Venkata Siva Kamesh
        2. MAPREDUCE-4102.patch
          4 kB
          Bhallamudi Venkata Siva Kamesh
        3. MAPREDUCE-4102-1.patch
          7 kB
          Bhallamudi Venkata Siva Kamesh
        4. MAPREDUCE-4102-3.patch
          12 kB
          Bhallamudi Venkata Siva Kamesh

          Issue Links

            Activity

              People

              • Assignee:
                kamesh Bhallamudi Venkata Siva Kamesh
                Reporter:
                tgraves Thomas Graves
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: