[MAHOUT-1643] CLI arguments are not being processed in spark-shell

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 0.10.0
• Fix Version/s: 0.11.0
• Component/s: CLI, spark
• Labels: DSL scala spark spark-shell

Environment

spark spark-shell

• Assignee: Unassigned
• Reporter: Andrew Palumbo
• Created: 05/Mar/15 23:33
• Updated: 11/Aug/15 23:59
• Resolved: 18/Jun/15 19:44

Description

The CLI arguments are not being processed in spark-shell. Most importantly the spark options are not being passed to the spark configuration via:

$ mahout spark-shell -D:k=n

The arguments are preserved it through

$ bin/mahout

There should be a relatively easy fix either by using the MahoutOptionParser, Scopt or by simply parsing the args array.

Issue Links

• duplicates: MAHOUT-1714 Add MAHOUT_OPTS environment when running Spark shell