[HBASE-6601] TestImportExport on Hadoop 2 must copy YARN configuration vars - ASF JIRA

Voters

Watch issue

Watchers

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.95.0
Component/s: hadoop2, mapreduce
Labels:
None

Hadoop Flags:

Reviewed

Description

TestImportExport.testSimpleCase is failing with the following exception:
java.lang.reflect.UndeclaredThrowableException
at org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl.unwrapAndThrowException(YarnRemoteExceptionPBImpl.java:135)
at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getNewApplication(ClientRMProtocolPBClientImpl.java:134)
at org.apache.hadoop.mapred.ResourceMgrDelegate.getNewJobID(ResourceMgrDelegate.java:181)
at org.apache.hadoop.mapred.YARNRunner.getNewJobID(YARNRunner.java:214)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:337)
at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1216)
at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1213)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1213)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1234)
at org.apache.hadoop.hbase.mapreduce.TestImportExport.testSimpleCase(TestImportExport.java:114)
....
Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From asurus.iridiant.net/50.23.172.109 to 0.0.0.0:8032 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
============================================================================
The problem is that a connection to the YARN resource manager is being made at the default address (0.0.0.0:8032) instead of the actual address that it is listening on.

This test creates two miniclusters, one for map reduce and one for hbase, and each minicluster has its own Configuration. The Configuration for the map reduce minicluster has the correct resource manager address, while the Configuration for the hbase minicluster has the default resource manager address. Since the test is using only the Configuration from the hbase minicluster, it sees the default address for the resource manager, instead of the actual address.