[BIGTOP-2844] zeppelin charm: spark config should match zeppelin spark config

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.2.0, 1.2.1
• Fix Version/s: 1.3.0
• Component/s: deployment
• Assignee: Kevin Monroe
• Reporter: Kevin Monroe
• Created: 14/Jul/17 17:35
• Updated: 03/Aug/17 14:53
• Resolved: 03/Aug/17 14:53

Description

The Zeppelin charm deploys spark-client and zeppelin-server roles.

When zeppelin-server spark config is updated (e.g. we configure it in 'yarn' mode), the spark-client config is not updated. This is fine for jobs submitted through Zeppelin, but if a user attempted to spark-submit on the deployed machine, they may send their job to the wrong master.

Also, the zeppelin-spark test might stomp on top of a pre-deployed spark charm. Fix this by deploying a test-only copy of the spark charm, run the test, then remove the charm.

Issue Links

• links to: GitHub Pull Request #257