[HADOOP-15454] TestRollingFileSystemSinkWithLocal fails on Windows

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.10.0, 3.2.0, 3.1.1, 2.9.2, 3.0.3
• Component/s: test
• Labels: windows
• Hadoop Flags: Reviewed
• Assignee: Xiao Liang
• Reporter: Xiao Liang
• Created: 10/May/18 09:38
• Updated: 25/May/18 16:17
• Resolved: 10/May/18 16:44

Description

org.apache.hadoop.metrics2.sink.TestRollingFileSystemSinkWithLocal fails on Windows,

Error message:

Illegal character in opaque part at index 2: D:_work\8\s\hadoop-common-project\hadoop-common\target\test\data\4\RollingFileSystemSinkTest\testSilentExistingWrite

Stack trace:

java.io.IOException: All datanodes [DatanodeInfoWithStorage[127.0.0.1:53235,DS-4d6119ac-31cc-4f48-8a5b-7f35b36a1c55,DISK]] are bad. Aborting... at org.apache.hadoop.hdfs.DataStreamer.handleBadDatanode(DataStreamer.java:1538) at org.apache.hadoop.hdfs.DataStreamer.setupPipelineForAppendOrRecovery(DataStreamer.java:1472) at org.apache.hadoop.hdfs.DataStreamer.processDatanodeError(DataStreamer.java:1244) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:663)

Drive letter in absolute path in Windows will fail the underlying URI check.

Another issue is that for the failed write test case java.io.File#setWritable(boolean, boolean) is used, which does not work as expected on Windows and should be replaced by org.apache.hadoop.fs.FileUtil#setWritable.

Issue Links

• is related to: HADOOP-15475 Fix broken unit tests on Windows