[SPARK-6205] UISeleniumSuite fails for Hadoop 2.x test with NoClassDefFoundError

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.3.0
• Fix Version/s: 1.3.2, 1.4.0
• Component/s: Tests
• Target Version/s: 1.4.0
• Assignee: Sean R. Owen
• Reporter: Sean R. Owen
• Created: 06/Mar/15 16:29
• Updated: 06/Apr/15 14:45
• Resolved: 08/Mar/15 14:09

Description

mvn -DskipTests -Pyarn -Phive -Phadoop-2.4 -Dhadoop.version=2.6.0 clean install
mvn -Pyarn -Phive -Phadoop-2.4 -Dhadoop.version=2.6.0 test -DwildcardSuites=org.apache.spark.ui.UISeleniumSuite -Dtest=none -pl core/ 

will produce:

UISeleniumSuite:
*** RUN ABORTED ***
  java.lang.NoClassDefFoundError: org/w3c/dom/ElementTraversal
  ...

It doesn't seem to happen without the various profiles set above.

The fix is simple, although sounds weird; Selenium's dependency on xml-apis:xml-apis must be manually included in core's test dependencies. This probably has something to do with Hadoop 2 vs 1 dependency changes and the fact that Maven test deps aren't transitive, AFAIK.

PR coming...

Issue Links

• links to: [Github] Pull Request #4933 (srowen)