Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-1259

spark-worker service should be started after spark-master if ran on the same node

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.0
    • Fix Version/s: 0.8.0
    • Component/s: deployment
    • Labels:
      None

      Description

      When master and worker components are deployed to the same node it is important to guarantee the sequence of startup events: e.g worker will fail if master isn't present. Currently, this is a limitation of the Spark implementation where a worker doesn't wait for master to start up and fails immediately.

      Also, the master service only has to be started on the master node.

      1. BIGTOP-1259.patch
        1 kB
        Konstantin Boudnik

        Issue Links

          Activity

          Hide
          mgrover Mark Grover added a comment -

          +1. FWIW, we renamed the spark package to be called spark-core so the puppet manifests need to be updated to reflect. If you could please create a JIRA for that and target it for 0.8, that'd be much appreciated!

          Show
          mgrover Mark Grover added a comment - +1. FWIW, we renamed the spark package to be called spark-core so the puppet manifests need to be updated to reflect. If you could please create a JIRA for that and target it for 0.8, that'd be much appreciated!
          Hide
          cos Konstantin Boudnik added a comment - - edited

          I will. BTW, the package renaming shouldn't been committed without parallel update to the deployment code, IMO.

          Show
          cos Konstantin Boudnik added a comment - - edited I will. BTW, the package renaming shouldn't been committed without parallel update to the deployment code, IMO.
          Hide
          cos Konstantin Boudnik added a comment -

          Committed to the master.

          Show
          cos Konstantin Boudnik added a comment - Committed to the master.

            People

            • Assignee:
              cos Konstantin Boudnik
              Reporter:
              cos Konstantin Boudnik
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development