[SPARK-4819] Remove Guava's "Optional" from public API

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.2.0
• Fix Version/s: 2.0.0
• Component/s: Spark Core
• Target Version/s: 2.0.0
• Assignee: Sean R. Owen
• Reporter: Marcelo Masiero Vanzin
• Created: 10/Dec/14 21:53
• Updated: 10/Jan/16 10:43
• Resolved: 08/Jan/16 21:39

Description

Filing this mostly so this isn't forgotten. Spark currently exposes Guava types in its public API (the Optional class is used in the Java bindings). This makes it hard to properly hide Guava from user applications, and makes mixing different Guava versions with Spark a little sketchy (even if things should work, since those classes are pretty simple in general).

Since this changes the public API, it has to be done in a release that allows such breakages. But it would be nice to at least have a transition plan for deprecating the affected APIs.

Issue Links

• is duplicated by: SPARK-12548 Add more exceptions to Guava relocation
• is related to: SPARK-12736 Standalone Master cannot be started due to NoClassDefFoundError: org/spark-project/guava/collect/Maps
• links to: [Github] Pull Request #10512 (rxin)
• links to: [Github] Pull Request #10513 (srowen)