Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3619

ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.0
    • Fix Version/s: 2.8.0, 2.7.2, 3.0.0-alpha1
    • Component/s: nodemanager
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      ContainerMetrics is able to unregister itself during the getMetrics method, but that method can be called by MetricsSystemImpl.sampleMetrics which is trying to iterate the sources. This leads to a ConcurrentModificationException log like this:

      2015-05-11 14:00:20,360 [Timer for 'NodeManager' metrics system] WARN impl.MetricsSystemImpl: java.util.ConcurrentModificationException

        Attachments

        1. YARN-3619.branch-2.7.patch
          15 kB
          Zhihai Xu
        2. YARN-3619.alt.patch
          16 kB
          Zhihai Xu
        3. YARN-3619.001.patch
          14 kB
          Zhihai Xu
        4. YARN-3619.000.patch
          14 kB
          Zhihai Xu
        5. test.patch
          3 kB
          Zhihai Xu

          Issue Links

          contains

          Bug - A problem which impairs or prevents the functions of the product. YARN-4563 ContainerMetrics deadlocks

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          is broken by

          Sub-task - The sub-task of the issue YARN-2984 Metrics for container's actual memory usage

          • Major - Major loss of function.
          • Closed

            Activity

              People

              • Assignee:
                zxu Zhihai Xu
                Reporter:
                jlowe Jason Darrell Lowe
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: