[HDFS-9660] TestBlockScanner.testScanRateLimit fails intermittently

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: datanode
• Assignee: Unassigned
• Reporter: Yongjun Zhang
• Created: 19/Jan/16 07:00
• Updated: 19/Jan/16 07:02

Description

Regression

org.apache.hadoop.hdfs.server.datanode.TestBlockScanner.testScanRateLimit fails with the following error.

Seeing the same error in several builds:
https://builds.apache.org/job/PreCommit-HDFS-Build/14153/testReport/org.apache.hadoop.hdfs.server.datanode/TestBlockScanner/testScanRateLimit/

http://mail-archives.apache.org/mod_mbox/hadoop-hdfs-dev/201512.mbox/%3C2106732189.1429.1450359106291.JavaMail.jenkins@crius%3E

http://mail-archives.apache.org/mod_mbox/hadoop-hdfs-dev/201512.mbox/%3C1561861624.1283.1451521640509.JavaMail.jenkins@crius%3E

Failing for the past 1 build (Since Unstable#14153 )
Took 0.37 sec.
Error Message

Cannot remove data directory: /testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/2/dfs/datapath '/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/2/dfs/data': 
 absolute:/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/2/dfs/data
 permissions: drwx
path '/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/2/dfs': 
 absolute:/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/2/dfs
 permissions: drwx
path '/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/2': 
 absolute:/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/2
 permissions: drwx
path '/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data': 
 absolute:/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data
 permissions: drwx
path '/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test': 
 absolute:/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test
 permissions: drwx
path '/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target': 
 absolute:/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target
 permissions: drwx
path '/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs': 
 absolute:/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs
 permissions: drwx
path '/testptch/hadoop/hadoop-hdfs-project': 
 absolute:/testptch/hadoop/hadoop-hdfs-project
 permissions: drwx
path '/testptch/hadoop': 
 absolute:/testptch/hadoop
 permissions: drwx
path '/testptch': 
 absolute:/testptch
 permissions: dr-x
path '/': 
 absolute:/
 permissions: dr-x

The stack trace:

at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:834)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:482)
	at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:441)
	at org.apache.hadoop.hdfs.server.datanode.TestBlockScanner$TestContext.<init>(TestBlockScanner.java:96)
	at org.apache.hadoop.hdfs.server.datanode.TestBlockScanner.testScanRateLimit(TestBlockScanner.java:439)