Details
-
Bug
-
Status: Resolved
-
Blocker
-
Resolution: Fixed
-
1.4.0
-
None
-
None
Description
The httpcore and httpclient dependency jars are not included into the binary distribution. This means MR/YARN jobs will fail if launched from the binary tarball as distributed, including those running in "local mode", e.g. ITBLL:
2017-12-08 22:40:36,134 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local936234315_0001_m_000003_0 2017-12-08 22:40:36,134 INFO [Thread-23] mapred.LocalJobRunner: map task executor complete. 2017-12-08 22:40:36,147 WARN [Thread-23] mapred.LocalJobRunner: job_local936234315_0001 java.lang.NoClassDefFoundError: org/apache/http/client/methods/HttpUriRequest at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:546) Caused by: java.lang.ClassNotFoundException: org.apache.http.client.methods.HttpUriRequest at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 1 more Exception in thread "Thread-23" java.lang.NoClassDefFoundError: org/apache/http/client/methods/HttpUriRequest at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:562) Caused by: java.lang.ClassNotFoundException: org.apache.http.client.methods.HttpUriRequest at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 1 more 2017-12-08 22:40:37,078 INFO [main] mapreduce.Job: Job job_local936234315_0001 failed with state FAILED due to: NA