[MAPREDUCE-6672] TestTeraSort fails on Windows

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.8.0, 3.0.0-alpha1
• Fix Version/s: 2.8.0, 3.0.0-alpha1
• Component/s: test

Environment

OS: Windows Server 2012
JDK: Oracle 1.7.0_79

• Hadoop Flags: Reviewed
• Assignee: Tibor Kiss
• Reporter: Tibor Kiss
• Created: 10/Apr/16 09:24
• Updated: 25/Oct/19 20:26
• Resolved: 29/Apr/16 18:40

Description

TestTeraSort testcase fails on Windows.

The test case uses the build directory as test working directory.
Under Windows the build directory starts with a drive definition ( "C:" ),
which is interpreted as (an invalid) URI scheme.

The fix is trivial: Add URI scheme to the beginning of the working directory.

Error message:

Running org.apache.hadoop.examples.terasort.TestTeraSort
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 3.647 sec <<< FAILURE! - in org.apache.hadoop.examples.terasort.TestTeraSort
testTeraSort(org.apache.hadoop.examples.terasort.TestTeraSort)  Time elapsed: 3.359 sec  <<< ERROR!
java.io.IOException: No FileSystem for scheme: C
        at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2787)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2798)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:99)
        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2837)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2819)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:381)
        at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:223)
        at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestamps(ClientDistributedCacheManager.java:93)
        at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestampsAndCacheVisibilities(ClientDistributedCacheManager.java:57)
        at org.apache.hadoop.mapreduce.JobResourceUploader.uploadFiles(JobResourceUploader.java:179)
        at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:98)
        at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:193)
        at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1341)
        at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1338)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1742)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1338)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1359)
        at org.apache.hadoop.examples.terasort.TeraSort.run(TeraSort.java:331)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
        at org.apache.hadoop.examples.terasort.TestTeraSort.runTeraSort(TestTeraSort.java:75)
        at org.apache.hadoop.examples.terasort.TestTeraSort.testTeraSort(TestTeraSort.java:101)


Results :

Tests in error:
  TestTeraSort.testTeraSort:101->runTeraSort:75 ╗ IO No FileSystem for scheme: C

Tests run: 2, Failures: 0, Errors: 1, Skipped: 0

Issue Links

• is part of: YARN-4932 [Umbrella] YARN/MR test failures on Windows