This appears to have been broken by MAPREDUCE-6238. The test is using a hardcoded "hdfs://testcluster" default fs path which is going to try to do a lookup on a bogus hostname.

zhihai xu can you take a look?

Hi Jason Lowe, thanks for reporting this issue. I did a little bit of study, I find out this test is broken by YARN-3835.
Because this test depends on the configuration "hadoop.security.token.service.use_ip" which is set at core-site.xml

  <property>
    <name>hadoop.security.token.service.use_ip</name>
    <value>false</value>
  </property>

I can think of two ways to fix this issue:

1. Use MiniDFSCluster instead of a dummy unknown cluster (hdfs://testcluster)
2. Set "hadoop.security.token.service.use_ip" configuration to false or call SecurityUtil.setTokenServiceUseIp(false);
   Option 1 seems better to me, because we can remove the dependency on "hadoop.security.token.service.use_ip" configuration.

I uploaded a patch MAPREDUCE-6413.000.patch, which uses the first approach.

-1 overall

This message was automatically generated.

Thanks for picking this up, zhihai xu.

Do we even need to bother with HDFS? MiniDFSCluster makes every test it's a part of noticeably slower, and I'm not seeing why we need it here. I got the impression "hdfs://testcluster" was just some bogus input anyway, so can we just use something "file:///" instead? This is the default, and we're already relying on other defaults like mapreduce.framework.name=local.

As an aside, I'd personally prefer we explicitly set the values we expect to be using in unit tests, even if they're the default, for two reasons: 1) document the setup/reqs of the test and 2) protect the test from custom confs appearing in HADOOP_CONF_DIR when the test is run.

Jason Lowe, thanks for the review. That is a good suggestion, instead of using "file:///", I use "hdfs://localhost:9000" because using "file:///" can't verify MAPREDUCE-6238.

As an aside,......

agreed.
I uploaded a new patch MAPREDUCE-6413.001.patch, Please review it.

-1 overall

This message was automatically generated.

I think using localhost can work. If you agree we shouldn't rely on implicit defaults to test what we think we're testing, could you also update the test to explicitly set mapreduce.framework.name to local?

Yes, I uploaded a new patch MAPREDUCE-6413.002.patch, which addressed your comment. Please review it, thanks for the thorough review!

+1 pending Jenkins.

+1 overall

This message was automatically generated.

Thanks zhihai xu! I committed this to trunk and branch-2.

thanks Jason Lowe for the review and committing the patch!

FAILURE: Integrated in Hadoop-trunk-Commit #8069 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8069/)
MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu (jlowe: rev aa5b15b03be61ebb76a226e0de485d5228c8e3d0)

• hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestLocalJobSubmission.java
• hadoop-mapreduce-project/CHANGES.txt

FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #240 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/240/)
MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu (jlowe: rev aa5b15b03be61ebb76a226e0de485d5228c8e3d0)

• hadoop-mapreduce-project/CHANGES.txt
• hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestLocalJobSubmission.java

SUCCESS: Integrated in Hadoop-Yarn-trunk #970 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/970/)
MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu (jlowe: rev aa5b15b03be61ebb76a226e0de485d5228c8e3d0)

• hadoop-mapreduce-project/CHANGES.txt
• hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestLocalJobSubmission.java

FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #229 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/229/)
MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu (jlowe: rev aa5b15b03be61ebb76a226e0de485d5228c8e3d0)

• hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestLocalJobSubmission.java
• hadoop-mapreduce-project/CHANGES.txt

FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #238 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/238/)
MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu (jlowe: rev aa5b15b03be61ebb76a226e0de485d5228c8e3d0)

• hadoop-mapreduce-project/CHANGES.txt
• hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestLocalJobSubmission.java

SUCCESS: Integrated in Hadoop-Hdfs-trunk #2168 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2168/)
MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu (jlowe: rev aa5b15b03be61ebb76a226e0de485d5228c8e3d0)

• hadoop-mapreduce-project/CHANGES.txt
• hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestLocalJobSubmission.java

FAILURE: Integrated in Hadoop-Mapreduce-trunk #2186 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2186/)
MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu (jlowe: rev aa5b15b03be61ebb76a226e0de485d5228c8e3d0)

• hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestLocalJobSubmission.java
• hadoop-mapreduce-project/CHANGES.txt

I committed this to branch-2.7 and branch-2.6 since MAPREDUCE-6238 was also brought into those branches.

Closing the JIRA as part of 2.7.3 release.