[APEXCORE-679] Build fails with hadoop 2.7.x dependency

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Chinmay Kolhatkar
• Created: 23/Mar/17 14:31
• Updated: 24/Mar/17 16:57

Description

1. I downloaded apache-apex-core-3.5.0-source-release.tar.gz
2. Extracted the tar
3. Ran following command to build apex core:
mvn clean package -DskipTests -Dhadoop.version=2.7.3
(NOTE: I have overridden hadoop version to 2.7.3)

I get following compilation error:
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.3:compile (default-compile) on project apex-engine: Compilation failure: Compilation failure:
[ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/java/com/datatorrent/stram/plan/logical/LogicalPlan.java:[159,87] cannot find symbol
[ERROR] symbol: variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
[ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
[ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/java/com/datatorrent/stram/client/StramAppLauncher.java:[586,120] cannot find symbol
[ERROR] symbol: variable DELEGATION_TOKEN_MAX_LIFETIME_KEY
[ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
[ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/java/com/datatorrent/stram/client/StramAppLauncher.java:[586,173] cannot find symbol
[ERROR] symbol: variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
[ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
[ERROR] -> [Help 1]

It should compile with 2.7.x version of hadoop.

Issue Links

• is broken by: YARN-2861 Timeline DT secret manager should not reuse the RM's configs.
• is related to: BIGTOP-2706 Apex package does not run successfully after installation