[OOZIE-3220] oozie sharelib pig fails when compiled with hadoop 3

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 5.0.0

Environment

Oozie 5.0 release

Apache Maven 3.5.3 (3383c37e1f9e9b3bc3df5050c29c8aff9f295297; 2018-02-24T19:49:05Z)
Maven home: /opt/maven/apache-maven-3.5.3
Java version: 1.8.0_161, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "3.10.0-693.21.1.el7.x86_64", arch: "amd64", family: "unix"

• Assignee: Artem Ervits
• Reporter: Artem Ervits
• Created: 13/Apr/18 16:23
• Updated: 07/May/18 10:05
• Resolved: 07/May/18 10:05

Description

mvn clean install -DskipTests -Dhadoop.version=3.1.0

[ERROR] COMPILATION ERROR :
[INFO] -------------------------------------------------------------
[ERROR] /tmp/oozie-5.0.0/sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java:[30,30] package org.apache.hadoop.conf does not exist
[ERROR] /tmp/oozie-5.0.0/sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java:[31,28] cannot find symbol
symbol: class Path
location: package org.apache.hadoop.fs
[ERROR] /tmp/oozie-5.0.0/sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/OoziePigStats.java:[142,37] cannot access org.apache.hadoop.io.Writable
class file for org.apache.hadoop.io.Writable not found
[ERROR] /tmp/oozie-5.0.0/sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java:[87,9] cannot find symbol
symbol: class Configuration
location: class org.apache.oozie.action.hadoop.PigMain
[ERROR] /tmp/oozie-5.0.0/sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java:[87,40] cannot find symbol
symbol: class Configuration
location: class org.apache.oozie.action.hadoop.PigMain
[ERROR] /tmp/oozie-5.0.0/sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java:[98,36] cannot find symbol
symbol: class Path
location: class org.apache.oozie.action.hadoop.PigMain
[INFO] 6 errors
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Oozie Main 5.0.0 ............................ SUCCESS [ 5.637 s]
[INFO] Apache Oozie Client ................................ SUCCESS [ 35.895 s]
[INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [ 24.548 s]
[INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [ 13.107 s]
[INFO] Apache Oozie Share Lib Distcp ...................... SUCCESS [ 9.785 s]
[INFO] Apache Oozie Core .................................. SUCCESS [03:03 min]
[INFO] Apache Oozie Share Lib Streaming ................... SUCCESS [ 14.031 s]
[INFO] Apache Oozie Share Lib Pig ......................... FAILURE [ 18.706 s]
[INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
[INFO] Apache Oozie Share Lib Hive 2 ...................... SKIPPED
[INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
[INFO] Apache Oozie Examples .............................. SKIPPED
[INFO] Apache Oozie Share Lib Spark ....................... SKIPPED
[INFO] Apache Oozie Share Lib ............................. SKIPPED
[INFO] Apache Oozie Docs .................................. SKIPPED
[INFO] Apache Oozie WebApp ................................ SKIPPED
[INFO] Apache Oozie Tools ................................. SKIPPED
[INFO] Apache Oozie MiniOozie ............................. SKIPPED
[INFO] Apache Oozie Server ................................ SKIPPED
[INFO] Apache Oozie Distro ................................ SKIPPED
[INFO] Apache Oozie ZooKeeper Security Tests 5.0.0 ........ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 05:07 min
[INFO] Finished at: 2018-04-13T16:03:09Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.7.0:compile (default-compile) on project oozie-sharelib-pig: Compilation failure: Compilation failure:
[ERROR] /tmp/oozie-5.0.0/sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java:[30,30] package org.apache.hadoop.conf does not exist
[ERROR] /tmp/oozie-5.0.0/sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java:[31,28] cannot find symbol
[ERROR] symbol: class Path
[ERROR] location: package org.apache.hadoop.fs
[ERROR] /tmp/oozie-5.0.0/sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/OoziePigStats.java:[142,37] cannot access org.apache.hadoop.io.Writable
[ERROR] class file for org.apache.hadoop.io.Writable not found
[ERROR] /tmp/oozie-5.0.0/sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java:[87,9] cannot find symbol
[ERROR] symbol: class Configuration
[ERROR] location: class org.apache.oozie.action.hadoop.PigMain
[ERROR] /tmp/oozie-5.0.0/sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java:[87,40] cannot find symbol
[ERROR] symbol: class Configuration
[ERROR] location: class org.apache.oozie.action.hadoop.PigMain
[ERROR] /tmp/oozie-5.0.0/sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java:[98,36] cannot find symbol
[ERROR] symbol: class Path
[ERROR] location: class org.apache.oozie.action.hadoop.PigMain
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :oozie-sharelib-pig