Uploaded image for project: 'Giraph (Retired)'
  1. Giraph (Retired)
  2. GIRAPH-479

Factor creation of job-local ZooKeeper instances out of ZKManager to enable YARN instantiation, etc.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Minor
    • Resolution: Unresolved
    • 1.0.0
    • None
    • zookeeper
    • None

    Description

      When the user does not specify a ZooKeeper quorum to run Giraph on, the ZooKeeperManager creates one. This factors out the boilerplate that handles this additional process and its lifecycle so that various pluggable versions of this process instantiation can be implemented and fed to the ZKManager via a factory depending on the nature of the underlying cluster.

      By implementing the ZooKeeperProcessBuilder interface, one will now be able to implement the creation/mangement of a new, job-local ZK instance using any underlying resourcing mechanism one chooses (including, I hope, YARN.)

      Passes mvn verify, etc.

      Review board link:
      https://reviews.apache.org/r/8948/

      Attachments

        1. GIRAPH-479-1.patch
          26 kB
          Eli Reisman
        2. GIRAPH-479-2.patch
          29 kB
          Eli Reisman
        3. GIRAPH-479-3.patch
          29 kB
          Eli Reisman
        4. GIRAPH-479-4.patch
          29 kB
          Eli Reisman

        Activity

          People

            initialcontext Eli Reisman
            initialcontext Eli Reisman
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: