[MAPREDUCE-6747] TestMapReduceJobControl#testJobControlWithKillJob times out in trunk

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Chris Trezzo
• Created: 05/Aug/16 20:11
• Updated: 05/Aug/16 23:10

Description

TestMapReduceJobControl#testJobControlWithKillJob seems to time out while waiting for all jobs to complete. This seems to only happen if the test is run with the other tests in the class (specifically testJobControlWithFailJob). If testJobControlWithKillJob is run by itself, the test passes.

Looking into the test logs, when run with another test from the class, the test runs into an issue while setting permissions on the local file system:

2016-08-05 11:40:32,101 WARN  [Thread-100] util.Shell (Shell.java:joinThread(1023)) - Interrupted while joining on: Thread[Thread-105,5,main]
java.lang.InterruptedException
        at java.lang.Object.wait(Native Method)
        at java.lang.Thread.join(Thread.java:1245)
        at java.lang.Thread.join(Thread.java:1319)
        at org.apache.hadoop.util.Shell.joinThread(Shell.java:1020)
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:969)
        at org.apache.hadoop.util.Shell.run(Shell.java:878)
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1172)
        at org.apache.hadoop.util.Shell.execCommand(Shell.java:1266)
        at org.apache.hadoop.util.Shell.execCommand(Shell.java:1248)
        at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:781)
        at org.apache.hadoop.fs.RawLocalFileSystem.mkOneDirWithMode(RawLocalFileSystem.java:526)
        at org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:566)
        at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:538)
        at org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:565)
        at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:538)
        at org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:565)
        at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:538)
        at org.apache.hadoop.fs.ChecksumFileSystem.mkdirs(ChecksumFileSystem.java:696)
        at org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.setupJob(FileOutputCommitter.java:343)
        at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:541)

Conversely, when the test is run by itself, this issue is not hit.