Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3619

ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.7.0
    • 2.8.0, 2.7.2, 3.0.0-alpha1
    • nodemanager
    • None
    • Reviewed

    Description

      ContainerMetrics is able to unregister itself during the getMetrics method, but that method can be called by MetricsSystemImpl.sampleMetrics which is trying to iterate the sources. This leads to a ConcurrentModificationException log like this:

      2015-05-11 14:00:20,360 [Timer for 'NodeManager' metrics system] WARN impl.MetricsSystemImpl: java.util.ConcurrentModificationException

      Attachments

        1. test.patch
          3 kB
          Zhihai Xu
        2. YARN-3619.000.patch
          14 kB
          Zhihai Xu
        3. YARN-3619.001.patch
          14 kB
          Zhihai Xu
        4. YARN-3619.alt.patch
          16 kB
          Zhihai Xu
        5. YARN-3619.branch-2.7.patch
          15 kB
          Zhihai Xu

        Issue Links

          contains

          Bug - A problem which impairs or prevents the functions of the product. YARN-4563 ContainerMetrics deadlocks

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          is broken by

          Sub-task - The sub-task of the issue YARN-2984 Metrics for container's actual memory usage

          • Major - Major loss of function.
          • Closed

          Activity

            People

              zxu Zhihai Xu
              jlowe Jason Darrell Lowe
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: