Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-2844

zeppelin charm: spark config should match zeppelin spark config

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.2.0, 1.2.1
    • 1.3.0
    • deployment
    • None

    Description

      The Zeppelin charm deploys spark-client and zeppelin-server roles.

      When zeppelin-server spark config is updated (e.g. we configure it in 'yarn' mode), the spark-client config is not updated. This is fine for jobs submitted through Zeppelin, but if a user attempted to spark-submit on the deployed machine, they may send their job to the wrong master.

      Also, the zeppelin-spark test might stomp on top of a pre-deployed spark charm. Fix this by deploying a test-only copy of the spark charm, run the test, then remove the charm.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            kwmonroe Kevin Monroe
            kwmonroe Kevin Monroe
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment