[SPARK-8819] Spark doesn't compile with maven 3.3.x

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.3.2, 1.4.0, 1.5.0
• Fix Version/s: 1.3.2, 1.4.1, 1.5.0
• Component/s: Build
• Target Version/s: 1.3.2, 1.4.1, 1.5.0
• Assignee: Andrew Or
• Reporter: Andrew Or
• Created: 04/Jul/15 03:37
• Updated: 15/Mar/16 19:38
• Resolved: 09/Jul/15 11:39

Description

Simple reproduction: Install maven 3.3.3 and run "build/mvn clean package -DskipTests"

This works just fine for maven 3.2.1 but not for 3.3.x. The result is an infinite loop caused by MSHADE-148:

[INFO] Replacing /Users/andrew/Documents/dev/spark/andrew-spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT.jar with /Users/andrew/Documents/dev/spark/andrew-spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT-shaded.jar
[INFO] Dependency-reduced POM written at: /Users/andrew/Documents/dev/spark/andrew-spark/bagel/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /Users/andrew/Documents/dev/spark/andrew-spark/bagel/dependency-reduced-pom.xml
...

This is ultimately caused by SPARK-7558 (master 9eb222c13991c2b4a22db485710dc2e27ccf06dd) but is recently revealed through SPARK-8781 (master 82cf3315e690f4ac15b50edea6a3d673aa5be4c0).

Issue Links

• is related to: HTRACE-234 Add workaround to prevent htrace-hbase from getting in an infinite loop while creating the dependency-reduced pom
• is related to: SPARK-9507 Remove dependency reduced POM hack now that shade plugin is updated
• links to: [Github] Pull Request #7219 (andrewor14)