[HDFS-4154] BKJM: Two namenodes usng bkjm can race to create the version znode

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 2.0.3-alpha, 3.0.0-alpha1
• Component/s: ha
• Assignee: Rakesh Radhakrishnan
• Reporter: Ivan Kelly
• Created: 06/Nov/12 11:54
• Updated: 12/May/16 18:17
• Resolved: 18/Feb/15 04:14

Description

nd one will get the following error.

2012-11-06 10:04:00,200 INFO hidden.bkjournal.org.apache.zookeeper.ClientCnxn: Session establishment complete on server 109-231-69-172.flexiscale.com/109.231.69.172:2181, sessionid = 0x13ad528fcfe0005, negotiated timeout = 4000
2012-11-06 10:04:00,710 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join
java.lang.IllegalArgumentException: Unable to construct journal, bookkeeper://109.231.69.172:2181;109.231.69.173:2181;109.231.69.174:2181/hdfsjournal
at org.apache.hadoop.hdfs.server.namenode.FSEditLog.createJournal(FSEditLog.java:1251)
at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initJournals(FSEditLog.java:226)
at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initSharedJournalsForRead(FSEditLog.java:206)
at org.apache.hadoop.hdfs.server.namenode.FSImage.initEditLog(FSImage.java:657)
at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:590)
at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:259)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:544)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:423)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:385)
at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:401)
at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:435)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:611)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:592)
at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1135)
at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1201)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at org.apache.hadoop.hdfs.server.namenode.FSEditLog.createJournal(FSEditLog.java:1249)
... 14 more
Caused by: java.io.IOException: Error initializing zk
at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.<init>(BookKeeperJournalManager.java:233)
... 19 more
Caused by: hidden.bkjournal.org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /hdfsjournal/version
at hidden.bkjournal.org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at hidden.bkjournal.org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at hidden.bkjournal.org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:778)
at org.apache.hadoop.contrib.bkjournal.BookKeeperJournalManager.<init>(BookKeeperJournalManager.java:222)
... 19 more