Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-17273

With Atlas HA enabled, atlas instance fails to come up with "Unable to find IDs matching any local host and port binding among id1"

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None

    Description

      Atlas fails to come up with below error. This is because if ID information for all atlas instances is not generated and updated in atlas-application.properties.

      2016-06-14 10:48:23,249 WARN  - [main:] ~ Failed startup of context o.e.j.w.WebAppContext@2ad31d76{/,file:/grid/0/hdp/2.5.0.0-723/atlas/server/webapp/atlas/,STARTING}{/usr/hdp/current/atlas-server/server/webapp/atlas} (WebAppContext:514)
      java.lang.RuntimeException: org.apache.atlas.AtlasException: Could not find server id for this instance. Unable to find IDs matching any local host and port binding among id1
              at org.apache.atlas.service.Services.start(Services.java:48)
              at org.apache.atlas.web.listeners.GuiceServletConfig.startServices(GuiceServletConfig.java:142)
              at org.apache.atlas.web.listeners.GuiceServletConfig.contextInitialized(GuiceServletConfig.java:136)
              at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:800)
              at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:444)
              at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:791)
              at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:294)
              at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)
              at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)
              at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)
              at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)
              at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
              at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
              at org.eclipse.jetty.server.Server.start(Server.java:387)
              at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
              at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
              at org.eclipse.jetty.server.Server.doStart(Server.java:354)
              at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
              at org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:93)
              at org.apache.atlas.Atlas.main(Atlas.java:113)
      Caused by: org.apache.atlas.AtlasException: Could not find server id for this instance. Unable to find IDs matching any local host and port binding among id1
              at org.apache.atlas.ha.AtlasServerIdSelector.selectServerId(AtlasServerIdSelector.java:77)
              at org.apache.atlas.web.service.ActiveInstanceElectorService.start(ActiveInstanceElectorService.java:105)
              at org.apache.atlas.service.Services.start(Services.java:45)
              ... 19 more
      2016-06-14 10:48:23,284 INFO  - [main:] ~ Started ServerConnector@255af999{HTTP/1.1}{0.0.0.0:21000} (ServerConnector:266)
      

      Atlas-application.properties not updated with all other instance information leading to atlas startup failure

      [root@ayubTesting-3 ~]# cat /etc/atlas/conf/atlas-application.properties
      # Generated by Apache Ambari. Tue Jun 14 10:47:47 2016
      
      atlas.audit.hbase.tablename=ATLAS_ENTITY_AUDIT_EVENTS
      atlas.audit.hbase.zookeeper.quorum=ayubtesting-2.openstacklocal,ayubtesting-3.openstacklocal
      atlas.audit.zookeeper.session.timeout.ms=1000
      atlas.auth.policy.file=/etc/atlas/conf/policy-store.txt
      atlas.authentication.keytab=/etc/security/keytabs/atlas.service.keytab
      atlas.authentication.method=simple
      atlas.authentication.method.file=true
      atlas.authentication.method.file.filename=/etc/atlas/conf/users-credentials.properties
      atlas.authentication.method.kerberos=false
      atlas.authentication.method.ldap=false
      atlas.authentication.method.ldap.type=ldap
      atlas.authentication.method.ldap.url=
      atlas.authentication.principal=atlas
      atlas.authorizer.impl=simple
      atlas.cluster.name=cl1
      atlas.enableTLS=false
      atlas.graph.index.search.backend=solr5
      atlas.graph.index.search.directory=/var/lib/atlas/data/es
      atlas.graph.index.search.elasticsearch.client-only=false
      atlas.graph.index.search.elasticsearch.local-mode=true
      atlas.graph.index.search.solr.mode=cloud
      atlas.graph.index.search.solr.zookeeper-url=ayubtesting-3.openstacklocal:2181/ambari-solr,ayubtesting-2.openstacklocal:2181/ambari-solr
      atlas.graph.storage.backend=hbase
      atlas.graph.storage.directory=/var/lib/atlas/data/berkeley
      atlas.graph.storage.hbase.table=atlas_titan
      atlas.graph.storage.hostname=ayubtesting-2.openstacklocal,ayubtesting-3.openstacklocal
      atlas.hook.falcon.keepAliveTime=10
      atlas.hook.falcon.maxThreads=5
      atlas.hook.falcon.minThreads=5
      atlas.hook.falcon.numRetries=3
      atlas.hook.falcon.queueSize=1000
      atlas.hook.falcon.synchronous=false
      atlas.http.authentication.enabled=false
      atlas.http.authentication.kerberos.keytab=/etc/security/keytabs/spnego.service.keytab
      atlas.http.authentication.kerberos.name.rules=DEFAULT
      atlas.http.authentication.kerberos.principal=HTTP/_HOST@EXAMPLE.COM
      atlas.http.authentication.type=simple
      atlas.kafka.auto.commit.enable=false
      atlas.kafka.bootstrap.servers=ayubtesting-2.openstacklocal:6667
      atlas.kafka.data=/usr/hdp/current/atlas-server/data/kafka
      atlas.kafka.entities.group.id=entities
      atlas.kafka.hook.group.id=atlas
      atlas.kafka.zookeeper.connect=ayubtesting-2.openstacklocal:2181,ayubtesting-3.openstacklocal:2181
      atlas.lineage.schema.query.hive_table=hive_table where __guid='%s'\, columns
      atlas.lineage.schema.query.Table=Table where __guid='%s'\, columns
      atlas.notification.embedded=false
      atlas.server.address.id1=ayubtesting-2.openstacklocal:21000
      atlas.server.bind.address=ayubtesting-3.openstacklocal
      atlas.server.ha.enabled=true
      atlas.server.http.port=21000
      atlas.server.https.port=21443
      atlas.server.ids=id1
          [root@ayubTesting-3 ~]#
      

      This is a regression issue.

      Attachments

        1. AMBARI-17273.patch
          5 kB
          Jayush Luniya

        Issue Links

          Activity

            People

              tbeerbower Tom Beerbower
              tbeerbower Tom Beerbower
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: