Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2901

Add errors and warning metrics page to RM, NM web UI

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      It would be really useful to have statistics on the number of errors and warnings in the RM and NM web UI. I'm thinking about -
      1. The number of errors and warnings in the past 5 min/1 hour/12 hours/day
      2. The top 'n'(20?) most common exceptions in the past 5 min/1 hour/12 hours/day

      By errors and warnings I'm referring to the log level.

      I suspect we can probably achieve this by writing a custom appender?(I'm open to suggestions on alternate mechanisms for implementing this).

      Attachments

        1. Screen Shot 2015-03-19 at 7.40.02 PM.png
          508 kB
          Varun Vasudev
        2. apache-yarn-2901.0.patch
          51 kB
          Varun Vasudev
        3. Exception collapsed.png
          340 kB
          Varun Vasudev
        4. Exception expanded.jpg
          337 kB
          Varun Vasudev
        5. apache-yarn-2901.1.patch
          52 kB
          Varun Vasudev
        6. apache-yarn-2901.2.patch
          53 kB
          Varun Vasudev
        7. apache-yarn-2901.3.patch
          52 kB
          Varun Vasudev
        8. apache-yarn-2901.4.patch
          52 kB
          Varun Vasudev
        9. apache-yarn-2901.5.patch
          52 kB
          Varun Vasudev
        10. YARN-2901.addendem.1.patch
          0.8 kB
          Wangda Tan

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. YARN-3459 Fix failiure of TestLog4jWarningErrorMetricsAppender

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          duplicates

          Bug - A problem which impairs or prevents the functions of the product. YARN-3447 Dodgy code Warnings in org.apache.hadoop.yarn.util.Log4jWarningErrorMetricsAppender

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. YARN-6915 Support slf4j API for YARN-2901

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              vvasudev Varun Vasudev
              vvasudev Varun Vasudev
              Votes:
              1 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: