Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3619

ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException

          Details

          • Type: Bug
          • Status: Closed
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: 2.7.0
          • Fix Version/s: 2.8.0, 2.7.2, 3.0.0-alpha1
          • Component/s: nodemanager
          • Labels:
            None
          • Target Version/s:
          • Hadoop Flags:
            Reviewed

            Description

            ContainerMetrics is able to unregister itself during the getMetrics method, but that method can be called by MetricsSystemImpl.sampleMetrics which is trying to iterate the sources. This leads to a ConcurrentModificationException log like this:

            2015-05-11 14:00:20,360 [Timer for 'NodeManager' metrics system] WARN impl.MetricsSystemImpl: java.util.ConcurrentModificationException

              Attachments

              1. test.patch
                3 kB
                zhihai xu
              2. YARN-3619.000.patch
                14 kB
                zhihai xu
              3. YARN-3619.001.patch
                14 kB
                zhihai xu
              4. YARN-3619.alt.patch
                16 kB
                zhihai xu
              5. YARN-3619.branch-2.7.patch
                15 kB
                zhihai xu

                Issue Links

                contains

                Bug - A problem which impairs or prevents the functions of the product. YARN-4563 ContainerMetrics deadlocks

                • Blocker - Blocks development and/or testing work, production could not run
                • Resolved
                is broken by

                Sub-task - The sub-task of the issue YARN-2984 Metrics for container's actual memory usage

                • Major - Major loss of function.
                • Closed

                  Activity

                    People

                    • Assignee:
                      zxu zhihai xu
                      Reporter:
                      jlowe Jason Lowe
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      8 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: