Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4102

job counters not available in Jobhistory webui for killed jobs

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.23.2, 2.0.0-alpha
    • 0.23.3, 2.0.2-alpha
    • webapps
    • None

    Description

      Run a simple wordcount or sleep, and kill the job before it finishes. Go to the job history web ui and click the "Counters" link for that job. It displays "500 error".

      The job history log has:

      Caused by: com.google.inject.ProvisionException: Guice provision errors:

      2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling URI: /jobhistory/jobcounters/job_1333482028750_0001
      java.lang.reflect.InvocationTargetException
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      ...
      ..
      ...

      1) Error injecting constructor, java.lang.NullPointerException
      at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
      while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
      ...
      ..
      ...
      Caused by: java.lang.NullPointerException at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
      at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
      at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
      at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

      There are task counters available if you drill down into successful tasks though.

      Attachments

        1. MAPREDUCE-4102-3.patch
          12 kB
          Bhallamudi Venkata Siva Kamesh
        2. MAPREDUCE-4102.patch
          7 kB
          Bhallamudi Venkata Siva Kamesh
        3. MAPREDUCE-4102-1.patch
          7 kB
          Bhallamudi Venkata Siva Kamesh
        4. MAPREDUCE-4102.patch
          4 kB
          Bhallamudi Venkata Siva Kamesh

        Issue Links

          Activity

            People

              kamesh Bhallamudi Venkata Siva Kamesh
              tgraves Thomas Graves
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: