Description
Checking a built of Oozie using Hadoop 1 I've noticed the sharelib for distcp brings a lot of unwanted JARs:
-rw-r--r-- 0 tucu staff 1034049 Jun 20 09:26 share/lib/distcp/ant-1.6.5.jar -rw-r--r-- 0 tucu staff 188671 Jun 20 09:26 share/lib/distcp/commons-beanutils-1.7.0.jar -rw-r--r-- 0 tucu staff 206035 Jun 20 09:26 share/lib/distcp/commons-beanutils-core-1.8.0.jar -rw-r--r-- 0 tucu staff 41123 Jun 20 09:26 share/lib/distcp/commons-cli-1.2.jar -rw-r--r-- 0 tucu staff 58160 Jun 20 09:26 share/lib/distcp/commons-codec-1.4.jar -rw-r--r-- 0 tucu staff 575389 Jun 20 09:26 share/lib/distcp/commons-collections-3.2.1.jar -rw-r--r-- 0 tucu staff 298829 Jun 20 09:26 share/lib/distcp/commons-configuration-1.6.jar -rw-r--r-- 0 tucu staff 143602 Jun 20 09:26 share/lib/distcp/commons-digester-1.8.jar -rw-r--r-- 0 tucu staff 112341 Jun 20 09:26 share/lib/distcp/commons-el-1.0.jar -rw-r--r-- 0 tucu staff 279781 Jun 20 09:26 share/lib/distcp/commons-httpclient-3.0.1.jar -rw-r--r-- 0 tucu staff 261809 Jun 20 09:26 share/lib/distcp/commons-lang-2.4.jar -rw-r--r-- 0 tucu staff 52915 Jun 20 09:26 share/lib/distcp/commons-logging-1.1.jar -rw-r--r-- 0 tucu staff 832410 Jun 20 09:26 share/lib/distcp/commons-math-2.1.jar -rw-r--r-- 0 tucu staff 180792 Jun 20 09:26 share/lib/distcp/commons-net-1.4.1.jar -rw-r--r-- 0 tucu staff 3566844 Jun 20 09:26 share/lib/distcp/core-3.1.1.jar -rw-r--r-- 0 tucu staff 3909356 Jun 20 09:26 share/lib/distcp/hadoop-core-1.0.1.jar -rw-r--r-- 0 tucu staff 76643 Jun 20 09:26 share/lib/distcp/hamcrest-core-1.1.jar -rw-r--r-- 0 tucu staff 643727 Jun 20 09:26 share/lib/distcp/hsqldb-1.8.0.7.jar -rw-r--r-- 0 tucu staff 136059 Jun 20 09:26 share/lib/distcp/jackson-core-asl-1.0.1.jar -rw-r--r-- 0 tucu staff 270781 Jun 20 09:26 share/lib/distcp/jackson-mapper-asl-1.0.1.jar -rw-r--r-- 0 tucu staff 405086 Jun 20 09:26 share/lib/distcp/jasper-compiler-5.5.12.jar -rw-r--r-- 0 tucu staff 76698 Jun 20 09:26 share/lib/distcp/jasper-runtime-5.5.12.jar -rw-r--r-- 0 tucu staff 377780 Jun 20 09:26 share/lib/distcp/jets3t-0.7.1.jar -rw-r--r-- 0 tucu staff 516429 Jun 20 09:26 share/lib/distcp/jetty-6.1.14.jar -rw-r--r-- 0 tucu staff 177131 Jun 20 09:26 share/lib/distcp/jetty-util-6.1.26.jar -rw-r--r-- 0 tucu staff 1024680 Jun 20 09:26 share/lib/distcp/jsp-2.1-6.1.14.jar -rw-r--r-- 0 tucu staff 134910 Jun 20 09:26 share/lib/distcp/jsp-api-2.1-6.1.14.jar -rw-r--r-- 0 tucu staff 253160 Jun 20 09:26 share/lib/distcp/junit-4.10.jar -rw-r--r-- 0 tucu staff 11981 Jun 20 09:26 share/lib/distcp/kfs-0.3.jar -rw-r--r-- 0 tucu staff 481535 Jun 20 09:26 share/lib/distcp/log4j-1.2.16.jar -rw-r--r-- 0 tucu staff 2139 Jun 20 09:26 share/lib/distcp/oozie-hadoop-distcp-1.0.1.oozie-3.3.0-SNAPSHOT.jar -rw-r--r-- 0 tucu staff 65261 Jun 20 09:26 share/lib/distcp/oro-2.0.8.jar -rw-r--r-- 0 tucu staff 132368 Jun 20 09:26 share/lib/distcp/servlet-api-2.5-6.1.14.jar -rw-r--r-- 0 tucu staff 15010 Jun 20 09:26 share/lib/distcp/xmlenc-0.52.jar
We should get the hadoop-distcp-1 POM to exclude all those. Hadoop2 does not have this problem (POMs from Hadoop are proper)