Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Won't Fix
-
None
-
None
-
None
-
None
Description
I copied hadoop direcotry to a host which is not in cluster, and ran a streaming job on it. I encountered following error:
15/08/25 18:48:07 INFO impl.YarnClientImpl: Submitted application application_1440039112410_1578 15/08/25 18:48:07 INFO mapreduce.JobSubmitter: JobID:job_1440039112410_1578 ClientSubmitJob time:692 15/08/25 18:48:07 INFO mapreduce.Job: The url to track the job: http://10.222.7.210:8080/proxy/application_1440039112410_1578/ 15/08/25 18:48:07 INFO mapreduce.Job: Running job: job_1440039112410_1578 15/08/25 18:48:13 INFO mapred.ClientServiceDelegate: Connecting to szsk-ad-serving-10-222-7-204:41486 15/08/25 18:48:13 INFO mapred.ClientServiceDelegate: Failed to contact AM/History for job job_1440039112410_1578 retrying.. java.net.UnknownHostException: Invalid host name: local host is: (unknown); destination host is: "szsk-ad-serving-10-222-7-204":41486; java.net.UnknownHostException; For more details see: http://wiki.apache.org/hadoop/UnknownHost at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783) at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:742) at org.apache.hadoop.ipc.Client$Connection.<init>(Client.java:400) at org.apache.hadoop.ipc.Client.getConnection(Client.java:1452) at org.apache.hadoop.ipc.Client.call(Client.java:1381) at org.apache.hadoop.ipc.Client.call(Client.java:1363) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206) at com.sun.proxy.$Proxy16.getJobReport(Unknown Source) at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getJobReport(MRClientProtocolPBClientImpl.java:133) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:350) at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:517) at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:536) at org.apache.hadoop.mapreduce.Job$1.run(Job.java:318) at org.apache.hadoop.mapreduce.Job$1.run(Job.java:315) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1667) at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:315) at org.apache.hadoop.mapreduce.Job.isComplete(Job.java:604) at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1337) at org.apache.hadoop.mapred.JobClient$NetworkedJob.monitorAndPrintJob(JobClient.java:409) at org.apache.hadoop.mapred.JobClient.monitorAndPrintJob(JobClient.java:858) at org.apache.hadoop.streaming.StreamJob.submitAndMonitorJob(StreamJob.java:1018) at org.apache.hadoop.streaming.StreamJob.run(StreamJob.java:135) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) at org.apache.hadoop.streaming.HadoopStreaming.main(HadoopStreaming.java:50) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.net.UnknownHostException ... 34 more
The exception is because AM register RM with hostname 'szsk-ad-serving-10-222-7-204' and client could not resolve it.