[MAHOUT-1951] Drivers don't run with remote Spark

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.13.0
• Fix Version/s: 0.13.0
• Component/s: classic

Environment

The command line drivers spark-itemsimilarity and spark-naivebayes using a remote or pseudo-clustered Spark

• Sprint: 0.14.0 Release
• Assignee: Pat Ferrel
• Reporter: Pat Ferrel
• Created: 06/Mar/17 16:32
• Updated: 31/Jan/24 22:14
• Resolved: 01/Nov/17 01:31

Description

Missing classes when running these jobs because the dependencies-reduced jar, passed to Spark for serialization purposes, does not contain all needed classes.

Found by a user.

Issue Links

• is related to: MAHOUT-1762 Pick up $SPARK_HOME/conf/spark-defaults.conf on startup