[HIVE-1579] showJobFailDebugInfo fails job if tasktracker does not respond

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Query Processor
• Assignee: Paul Yang
• Reporter: Joydeep Sen Sarma
• Created: 21/Aug/10 07:17
• Updated: 19/Apr/12 17:26

Description

here's the stack trace:

java.lang.RuntimeException: Error while reading from task log url
at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:130)
at org.apache.hadoop.hive.ql.exec.ExecDriver.showJobFailDebugInfo(ExecDriver.java:844)
at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:624)
at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:120)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:609)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:478)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:356)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:140)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:199)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:316)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: java.io.FileNotFoundException: http://hadoop0062.snc3.facebook.com.:50060/tasklog?taskid=attempt_201008191557_26566\
_m_000001_3&all=true
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1239)
at java.net.URL.openStream(URL.java:1009)
at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:120)
... 16 more
Ended Job = job_201008191557_26566 with exception 'java.lang.RuntimeException(Error while reading from task log url)'
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask

this failed a multi hour script.

Issue Links

• is related to: HIVE-2804 Task log retrieval fails on Hadoop 0.23