Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-6891 Hadoop 2 unit test failures
  3. HBASE-6601

TestImportExport on Hadoop 2 must copy YARN configuration vars

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.95.0
    • Component/s: hadoop2, mapreduce
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      TestImportExport.testSimpleCase is failing with the following exception:
      java.lang.reflect.UndeclaredThrowableException
      at org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl.unwrapAndThrowException(YarnRemoteExceptionPBImpl.java:135)
      at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getNewApplication(ClientRMProtocolPBClientImpl.java:134)
      at org.apache.hadoop.mapred.ResourceMgrDelegate.getNewJobID(ResourceMgrDelegate.java:181)
      at org.apache.hadoop.mapred.YARNRunner.getNewJobID(YARNRunner.java:214)
      at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:337)
      at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1216)
      at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1213)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
      at org.apache.hadoop.mapreduce.Job.submit(Job.java:1213)
      at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1234)
      at org.apache.hadoop.hbase.mapreduce.TestImportExport.testSimpleCase(TestImportExport.java:114)
      ....
      Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From asurus.iridiant.net/50.23.172.109 to 0.0.0.0:8032 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
      ============================================================================
      The problem is that a connection to the YARN resource manager is being made at the default address (0.0.0.0:8032) instead of the actual address that it is listening on.

      This test creates two miniclusters, one for map reduce and one for hbase, and each minicluster has its own Configuration. The Configuration for the map reduce minicluster has the correct resource manager address, while the Configuration for the hbase minicluster has the default resource manager address. Since the test is using only the Configuration from the hbase minicluster, it sees the default address for the resource manager, instead of the actual address.

        Attachments

        1. HBASE-6601-trunk.patch
          4 kB
          stack
        2. HBASE-6601-trunk.patch
          4 kB
          stack
        3. HBASE-6601-0.94.patch
          4 kB
          Scott Forman
        4. HBASE-6601-trunk.patch
          4 kB
          Scott Forman
        5. HBASE-6601-trunk-changeFunctSign.patch
          3 kB
          Scott Forman
        6. HBASE-6601-trunk-changeFunctSign.patch
          3 kB
          Scott Forman
        7. HBASE-6601-0.94-changeFunctSign.patch
          3 kB
          Scott Forman
        8. HBASE-6601-trunk.patch
          3 kB
          stack
        9. HBASE-6601-0.94.patch
          3 kB
          Scott Forman

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                scott4man Scott Forman
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: