[MAHOUT-1544] make Mahout DSL shell depend dynamically on Spark

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Fix Version/s: 0.10.0
• Assignee: Dmitriy Lyubimov
• Reporter: Anand Avati
• Created: 04/May/14 22:50
• Updated: 13/Apr/15 10:21
• Resolved: 20/May/14 00:42

Description

Today the Mahout's scala shell depends on spark.

Create a cleaner separation between the shell and Spark. For e.g, the in core scalabindings and operators do not need Spark. So make Spark a runtime "addon" to the shell. Similarly in the future new distributed backend engines can transparently (dynamically) be available through the DSL shell.

The new shell works, looks and feels exactly like the shell before, but has a cleaner modular architecture.