Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-2844

zeppelin charm: spark config should match zeppelin spark config

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.2.0, 1.2.1
    • Fix Version/s: 1.3.0
    • Component/s: deployment
    • Labels:
      None

      Description

      The Zeppelin charm deploys spark-client and zeppelin-server roles.

      When zeppelin-server spark config is updated (e.g. we configure it in 'yarn' mode), the spark-client config is not updated. This is fine for jobs submitted through Zeppelin, but if a user attempted to spark-submit on the deployed machine, they may send their job to the wrong master.

      Also, the zeppelin-spark test might stomp on top of a pre-deployed spark charm. Fix this by deploying a test-only copy of the spark charm, run the test, then remove the charm.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                kwmonroe Kevin W Monroe
                Reporter:
                kwmonroe Kevin W Monroe
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: