Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-2765

fix roles logic for spark/zeppelin charms

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.2.0
    • Fix Version/s: 1.2.1
    • Component/s: deployment
    • Labels:
      None

      Description

      The spark charm always includes the spark-worker role and also includes spark-master on the leader unit. This is not valid when spark is in yarn-* mode. There is no need for master/worker processes to be running when spark is in yarn mode.

      The zeppelin charm needs spark-datanucleus because the included spark bits are tightly coupled to hive. We manually apt install this package, but we should be using an appropriate role to leverage bigtop puppet just like we do for the spark charm. This only affects deployments without a separate spark unit, but that is a valid use case and we should have a nice UX for people that only deploy zeppelin.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                kwmonroe Kevin W Monroe
                Reporter:
                kwmonroe Kevin W Monroe
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 2h
                  2h
                  Remaining:
                  Remaining Estimate - 2h
                  2h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified