Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-6891 Hadoop 2 unit test failures
  3. HBASE-6601

TestImportExport on Hadoop 2 must copy YARN configuration vars

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.95.0
    • hadoop2, mapreduce
    • None
    • Reviewed

    Description

      TestImportExport.testSimpleCase is failing with the following exception:
      java.lang.reflect.UndeclaredThrowableException
      at org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl.unwrapAndThrowException(YarnRemoteExceptionPBImpl.java:135)
      at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getNewApplication(ClientRMProtocolPBClientImpl.java:134)
      at org.apache.hadoop.mapred.ResourceMgrDelegate.getNewJobID(ResourceMgrDelegate.java:181)
      at org.apache.hadoop.mapred.YARNRunner.getNewJobID(YARNRunner.java:214)
      at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:337)
      at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1216)
      at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1213)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
      at org.apache.hadoop.mapreduce.Job.submit(Job.java:1213)
      at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1234)
      at org.apache.hadoop.hbase.mapreduce.TestImportExport.testSimpleCase(TestImportExport.java:114)
      ....
      Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From asurus.iridiant.net/50.23.172.109 to 0.0.0.0:8032 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
      ============================================================================
      The problem is that a connection to the YARN resource manager is being made at the default address (0.0.0.0:8032) instead of the actual address that it is listening on.

      This test creates two miniclusters, one for map reduce and one for hbase, and each minicluster has its own Configuration. The Configuration for the map reduce minicluster has the correct resource manager address, while the Configuration for the hbase minicluster has the default resource manager address. Since the test is using only the Configuration from the hbase minicluster, it sees the default address for the resource manager, instead of the actual address.

      Attachments

        1. HBASE-6601-0.94.patch
          4 kB
          Scott Forman
        2. HBASE-6601-0.94.patch
          3 kB
          Scott Forman
        3. HBASE-6601-0.94-changeFunctSign.patch
          3 kB
          Scott Forman
        4. HBASE-6601-trunk.patch
          4 kB
          Michael Stack
        5. HBASE-6601-trunk.patch
          4 kB
          Michael Stack
        6. HBASE-6601-trunk.patch
          4 kB
          Scott Forman
        7. HBASE-6601-trunk.patch
          3 kB
          Michael Stack
        8. HBASE-6601-trunk-changeFunctSign.patch
          3 kB
          Scott Forman
        9. HBASE-6601-trunk-changeFunctSign.patch
          3 kB
          Scott Forman

        Issue Links

          Activity

            People

              Unassigned Unassigned
              scott4man Scott Forman
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: