Bigtop
  1. Bigtop
  2. BIGTOP-1106

update our puppet deployment topology

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.0
    • Fix Version/s: 0.7.0
    • Component/s: deployment
    • Labels:
      None

      Description

      Currently, our puppet deployment topology is putting a log of services on the hadoop_head_node. This puts unnecessary resource stress on it. I propose we start deploying a few services onto the gateway node itself.

        Activity

        Roman Shaposhnik created issue -
        Hide
        Konstantin Boudnik added a comment -

        I think there's another issue with ZK quorum for HBase, which is configured to be on the head node. Normally though you'd expect to find it on slaves.

        Show
        Konstantin Boudnik added a comment - I think there's another issue with ZK quorum for HBase, which is configured to be on the head node. Normally though you'd expect to find it on slaves.
        Hide
        Roman Shaposhnik added a comment -

        Konstantin Boudnik agreed. Ideally we'd want to run 3 ZK quorum so that our tests deployments are close to what's running in production. Unfortunately, our puppet code is not sophisticated enough to let one easily implement that type of topology.

        That said, I really think that for the type of testing we do – running one ZK on a head node is more than enough.

        Show
        Roman Shaposhnik added a comment - Konstantin Boudnik agreed. Ideally we'd want to run 3 ZK quorum so that our tests deployments are close to what's running in production. Unfortunately, our puppet code is not sophisticated enough to let one easily implement that type of topology. That said, I really think that for the type of testing we do – running one ZK on a head node is more than enough.
        Roman Shaposhnik made changes -
        Field Original Value New Value
        Attachment 0003-BIGTOP-1106.-update-our-puppet-deployment-topology.patch [ 12606819 ]
        Roman Shaposhnik made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Anatoli Fomenko added a comment -

        +1

        Show
        Anatoli Fomenko added a comment - +1
        Roman Shaposhnik made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Roman Shaposhnik made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        15h 39m 1 Roman Shaposhnik 04/Oct/13 17:29
        Patch Available Patch Available Resolved Resolved
        4h 2m 1 Roman Shaposhnik 04/Oct/13 21:32
        Resolved Resolved Closed Closed
        31d 52m 1 Roman Shaposhnik 04/Nov/13 21:24

          People

          • Assignee:
            Roman Shaposhnik
            Reporter:
            Roman Shaposhnik
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development