[HADOOP-15411] AuthenticationFilter should use Configuration.getPropsWithPrefix instead of iterator

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 3.2.0, 3.1.1, 3.0.3
• Target Version/s: 3.2.0, 3.1.1, 3.0.3
• Hadoop Flags: Reviewed
• Assignee: Suma Shivaprasad
• Reporter: Suma Shivaprasad
• Created: 24/Apr/18 23:18
• Updated: 19/Oct/18 00:20
• Resolved: 26/Apr/18 05:47

Description

Node manager start up fails with the following stack trace

2018-04-19 13:08:30,638 ERROR nodemanager.NodeManager (NodeManager.java:initAndStartNodeManager(921)) - Error starting NodeManager
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: NMWebapps failed to start.
 at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer.serviceStart(WebServer.java:117)
 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
 at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:121)
 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:919)
 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:979)
Caused by: org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server
 at org.apache.hadoop.yarn.webapp.WebApps$Builder.build(WebApps.java:377)
 at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:424)
 at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:420)
 at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer.serviceStart(WebServer.java:112)
 ... 5 more
Caused by: java.io.IOException: java.util.ConcurrentModificationException
 at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:532)
 at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:117)
 at org.apache.hadoop.http.HttpServer2$Builder.build(HttpServer2.java:421)
 at org.apache.hadoop.yarn.webapp.WebApps$Builder.build(WebApps.java:333)
 ... 8 more
Caused by: java.util.ConcurrentModificationException
 at java.util.Hashtable$Enumerator.next(Hashtable.java:1383)
 at org.apache.hadoop.conf.Configuration.iterator(Configuration.java:2853)
 at org.apache.hadoop.security.AuthenticationFilterInitializer.getFilterConfigMap(AuthenticationFilterInitializer.java:73)
 at org.apache.hadoop.http.HttpServer2.getFilterProperties(HttpServer2.java:647)
 at org.apache.hadoop.http.HttpServer2.constructSecretProvider(HttpServer2.java:637)
 at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:525)
 ... 11 more
2018-04-19 13:08:30,639 INFO timeline.HadoopTimelineMetricsSink (AbstractTimelineMetricsSink.java:getCurrentCollectorHost(291)) - No live collector to send metrics to. Metrics to be sent will be discarded. This message will be skipped for the next 20 times.

Issue Links

• is related to: HADOOP-15418 Hadoop KMSAuthenticationFilter needs to use getPropsByPrefix instead of iterator to avoid ConcurrentModificationException
• relates to: HADOOP-13556 Change Configuration.getPropsWithPrefix to use getProps instead of iterator
• relates to: YARN-8217 RmAuthenticationFilterInitializer /TimelineAuthenticationFilterInitializer should use Configuration.getPropsWithPrefix instead of iterator