[AMBARI-23511] Format ZKFC fails while adding new HDFS namespace through UI in secure environment

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.7.0
• Labels: pull-request-available
• Assignee: Andrew Onischuk
• Reporter: Andrew Onischuk
• Created: 07/Apr/18 15:26
• Updated: 18/Apr/18 11:12
• Resolved: 18/Apr/18 11:12

Description

Tried to add new HDFS namespace with latest available build from yesterday
evening #262
Format ZKFC is failing with below error

18/04/05 16:30:10 INFO zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-202626-01-000006.hwx.site/172.27.29.151:2181, sessionid = 0x26293f2ead15e74, negotiated timeout = 9000
18/04/05 16:30:10 INFO ha.ActiveStandbyElector: Session connected.
18/04/05 16:30:10 ERROR ha.ZKFailoverController: The failover controller encounters runtime error
java.io.IOException: Couldn't create /hadoop-ha/ns1
at org.apache.hadoop.ha.ActiveStandbyElector.ensureParentZNode(ActiveStandbyElector.java:358)
at org.apache.hadoop.ha.ZKFailoverController.formatZK(ZKFailoverController.java:286)
at org.apache.hadoop.ha.ZKFailoverController.doRun(ZKFailoverController.java:216)
at org.apache.hadoop.ha.ZKFailoverController.access$000(ZKFailoverController.java:60)
at org.apache.hadoop.ha.ZKFailoverController$1.run(ZKFailoverController.java:175)
at org.apache.hadoop.ha.ZKFailoverController$1.run(ZKFailoverController.java:171)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662)
at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:480)
at org.apache.hadoop.ha.ZKFailoverController.run(ZKFailoverController.java:171)
at org.apache.hadoop.hdfs.tools.DFSZKFailoverController.main(DFSZKFailoverController.java:195)
Caused by: org.apache.zookeeper.KeeperException$NoAuthException: KeeperErrorCode = NoAuth for /hadoop-ha/ns1
at org.apache.zookeeper.KeeperException.create(KeeperException.java:113)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.hadoop.ha.ActiveStandbyElector$3.run(ActiveStandbyElector.java:1033)
at org.apache.hadoop.ha.ActiveStandbyElector$3.run(ActiveStandbyElector.java:1030)
at org.apache.hadoop.ha.ActiveStandbyElector.zkDoWithRetries(ActiveStandbyElector.java:1095)
at org.apache.hadoop.ha.ActiveStandbyElector.zkDoWithRetries(ActiveStandbyElector.java:1087)
at org.apache.hadoop.ha.ActiveStandbyElector.createWithRetries(ActiveStandbyElector.java:1030)
at org.apache.hadoop.ha.ActiveStandbyElector.ensureParentZNode(ActiveStandbyElector.java:347)
... 11 more
18/04/05 16:30:11 INFO zookeeper.ZooKeeper: Session: 0x26293f2ead15e74 closed
18/04/05 16:30:11 FATAL tools.DFSZKFailoverController: DFSZKFailOverController exiting due to earlier exception java.io.IOException: Couldn't create /hadoop-ha/ns1
18/04/05 16:30:11 INFO zookeeper.ClientCnxn: EventThread shut down
18/04/05 16:30:11 INFO util.ExitUtil: Exiting with status 1: java.io.IOException: Couldn't create /hadoop-ha/ns1
18/04/05 16:30:11 INFO tools.DFSZKFailoverController: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DFSZKFailoverController at ctr-e138-1518143905142-202626-01-000005.hwx.site/172.27.26.14
************************************************************/

Issue Links

• links to: GitHub Pull Request #934