Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3715

Oozie jobs are failed with IllegalArgumentException: Does not contain a valid host:port authority: maprfs:/// (configuration property 'yarn.resourcemanager.address') on secure cluster with RM HA

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Invalid
    • 2.7.0
    • None
    • None
    • None

    Description

      2015-05-21 16:06:55,887 WARN ActionStartXCommand:544 -
      SERVER[centos6.localdomain] USER[mapr] GROUP[-] TOKEN[] APP[Hive]
      JOB[0000001-150521123655733-oozie-mapr-W]
      ACTION[0000001-150521123655733-oozie-mapr-W@Hive] Error starting action [Hive].
      ErrorType [ERROR], ErrorCode [IllegalArgumentException], Message
      [IllegalArgumentException: Does not contain a valid host:port authority:
      maprfs:/// (configuration property 'yarn.resourcemanager.address')]
      org.apache.oozie.action.ActionExecutorException: IllegalArgumentException: Does
      not contain a valid host:port authority: maprfs:/// (configuration property
      'yarn.resourcemanager.address')
      at
      org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:401)
      at
      org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:979)
      at
      org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1134)
      at
      org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:228)
      at
      org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:63)
      at org.apache.oozie.command.XCommand.call(XCommand.java:281)
      at
      org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:323)
      at
      org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:252)
      at
      org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174)
      at
      java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      at
      java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      at java.lang.Thread.run(Thread.java:745)
      Caused by: java.lang.IllegalArgumentException: Does not contain a valid
      host:port authority: maprfs:/// (configuration property
      'yarn.resourcemanager.address')
      at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:211)
      at
      org.apache.hadoop.conf.Configuration.getSocketAddr(Configuration.java:1788)
      at org.apache.hadoop.mapred.Master.getMasterAddress(Master.java:58)
      at org.apache.hadoop.mapred.Master.getMasterPrincipal(Master.java:67)
      at
      org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:114)
      at
      org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:100)
      at
      org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80)
      at
      org.apache.hadoop.mapred.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:127)
      at
      org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:460)
      at
      org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:343)
      at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
      at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:415)
      at
      org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1566)
      at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
      at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:562)
      at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:557)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:415)
      at
      org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1566)
      at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:557)
      at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:548)
      at
      org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:964)
      ... 10 more
      2015-05-21 16:06:55,889 WARN ActionStartXCommand:544 -
      SERVER[centos6.localdomain] USER[mapr] GROUP[-] TOKEN[] APP[Hive]
      JOB[0000001-150521123655733-oozie-mapr-W]
      ACTION[0000001-150521123655733-oozie-mapr-W@Hive] Setting Action Status to
      [DONE]

      Attachments

        Activity

          People

            Unassigned Unassigned
            Svinarchuk Sergey Svinarchuk
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: