[SPARK-1949] Servlet 2.5 vs 3.0 conflict in SBT build

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 1.0.0
• Component/s: Build
• Assignee: Unassigned
• Reporter: Sean R. Owen
• Created: 28/May/14 16:28
• Updated: 13/Jul/14 17:08
• Resolved: 13/Jul/14 17:08

Description

kayousterhout mentioned that:

I had some trouble compiling an application (Shark) against Spark 1.0,
where Shark had a runtime exception (at the bottom of this message) because
it couldn't find the javax.servlet classes. SBT seemed to have trouble
downloading the servlet APIs that are dependencies of Jetty (used by the
Spark web UI), so I had to manually add them to the application's build
file:

libraryDependencies += "org.mortbay.jetty" % "servlet-api" % "3.0.20100224"

Not exactly sure why this happens but thought it might be useful in case
others run into the same problem.

This is a symptom of Servlet API conflict which we battled in the Maven build. The resolution is to nix Servlet 2.5 and odd old Jetty / Netty 3.x dependencies. It looks like the Hive part of the assembly in the SBT build doesn't exclude all these entirely.

I'll open a suggested PR to band-aid the SBT build.