[HDFS-7395] BlockIdManager#clear() bails out when resetting the GenerationStampV1Limit

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.7.0
• Component/s: namenode
• Hadoop Flags: Reviewed
• Assignee: Haohui Mai
• Reporter: Yongjun Zhang
• Created: 13/Nov/14 17:50
• Updated: 24/Apr/15 23:22
• Resolved: 13/Nov/14 22:44

Description

In latest jenkins job

https://builds.apache.org/job/Hadoop-Hdfs-trunk/1932/
https://builds.apache.org/job/Hadoop-Hdfs-trunk/1931/
but not
https://builds.apache.org/job/Hadoop-Hdfs-trunk/1930/

The following test failed the same way:

Failed

org.apache.hadoop.hdfs.TestDFSUpgradeFromImage.testUpgradeFromCorruptRel22Image

Failing for the past 2 builds (Since Failed#1931 )
Took 0.54 sec.
Stacktrace

java.lang.IllegalStateException: null
	at com.google.common.base.Preconditions.checkState(Preconditions.java:129)
	at org.apache.hadoop.hdfs.server.blockmanagement.BlockIdManager.setGenerationStampV1Limit(BlockIdManager.java:85)
	at org.apache.hadoop.hdfs.server.blockmanagement.BlockIdManager.clear(BlockIdManager.java:206)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.clear(FSNamesystem.java:622)
	at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:667)
	at org.apache.hadoop.hdfs.server.namenode.FSImage.doUpgrade(FSImage.java:376)
	at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:268)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:991)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:714)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:537)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:596)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:763)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:747)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1443)
	at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1104)
	at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:975)
	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:804)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:465)
	at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:424)
	at org.apache.hadoop.hdfs.TestDFSUpgradeFromImage.upgradeAndVerify(TestDFSUpgradeFromImage.java:582)
	at org.apache.hadoop.hdfs.TestDFSUpgradeFromImage.testUpgradeFromCorruptRel22Image(TestDFSUpgradeFromImage.java:318)

Issue Links

• is broken by: HDFS-7381 Decouple the management of block id and gen stamps from FSNamesystem