Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15411

AuthenticationFilter should use Configuration.getPropsWithPrefix instead of iterator

VotersStop watchingWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 3.2.0, 3.1.1, 3.0.3
    • None
    • None

    Description

      Node manager start up fails with the following stack trace

      2018-04-19 13:08:30,638 ERROR nodemanager.NodeManager (NodeManager.java:initAndStartNodeManager(921)) - Error starting NodeManager
      org.apache.hadoop.yarn.exceptions.YarnRuntimeException: NMWebapps failed to start.
       at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer.serviceStart(WebServer.java:117)
       at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
       at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:121)
       at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
       at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:919)
       at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:979)
      Caused by: org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server
       at org.apache.hadoop.yarn.webapp.WebApps$Builder.build(WebApps.java:377)
       at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:424)
       at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:420)
       at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer.serviceStart(WebServer.java:112)
       ... 5 more
      Caused by: java.io.IOException: java.util.ConcurrentModificationException
       at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:532)
       at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:117)
       at org.apache.hadoop.http.HttpServer2$Builder.build(HttpServer2.java:421)
       at org.apache.hadoop.yarn.webapp.WebApps$Builder.build(WebApps.java:333)
       ... 8 more
      Caused by: java.util.ConcurrentModificationException
       at java.util.Hashtable$Enumerator.next(Hashtable.java:1383)
       at org.apache.hadoop.conf.Configuration.iterator(Configuration.java:2853)
       at org.apache.hadoop.security.AuthenticationFilterInitializer.getFilterConfigMap(AuthenticationFilterInitializer.java:73)
       at org.apache.hadoop.http.HttpServer2.getFilterProperties(HttpServer2.java:647)
       at org.apache.hadoop.http.HttpServer2.constructSecretProvider(HttpServer2.java:637)
       at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:525)
       ... 11 more
      2018-04-19 13:08:30,639 INFO timeline.HadoopTimelineMetricsSink (AbstractTimelineMetricsSink.java:getCurrentCollectorHost(291)) - No live collector to send metrics to. Metrics to be sent will be discarded. This message will be skipped for the next 20 times.
      

      Attachments

        1. HADOOP-15411.1.patch
          1 kB
          Suma Shivaprasad

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            suma.shivaprasad Suma Shivaprasad
            suma.shivaprasad Suma Shivaprasad
            Votes:
            0 Vote for this issue
            Watchers:
            3 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment