[SPARK-12347] Write script to run all MLlib examples for testing

• Type: Test
• Status: Resolved
• Priority: Critical
• Resolution: Incomplete
• Component/s: ML, MLlib, PySpark, SparkR, Tests
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Joseph K. Bradley
• Shepherd: Felix Cheung
• Created: 15/Dec/15 22:58
• Updated: 21/May/19 04:14
• Resolved: 21/May/19 04:14

Description

It would facilitate testing to have a script which runs all MLlib examples for all languages.

Design sketch to ensure all examples are run:

• Generate a list of examples to run programmatically (not from a fixed list).
• Use a list of special examples to handle examples which require command line arguments.
• Make sure data, etc. used are small to keep the tests quick.

This could be broken into subtasks for each language, though it would be nice to provide a single script.

Not sure where the script should live; perhaps in bin/?

Issue Links

• links to: [Github] Pull Request #15279 (ethanluoyc)

Sub-Tasks

• Write a script to run all PySpark MLlib examples for testing: Resolved