Uploaded image for project: 'Giraph (Retired)'
  1. Giraph (Retired)
  2. GIRAPH-273

Aggregators shouldn't use Zookeeper

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None

    Description

      We use Zookeeper znodes to transfer aggregated values from workers to master and back. Zookeeper is supposed to be used for coordination, and it also has a memory limit which prevents users from having aggregators with large value objects. These are the reasons why we should implement aggregators gathering and distribution in a different way.

      Attachments

        1. GIRAPH-273.diff
          142 kB
          Maja Kabiljo

        Issue Links

          depends upon

          Improvement - An improvement or enhancement to an existing feature or task. GIRAPH-313 Open Netty client and server on master

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. GIRAPH-372 Write worker addresses to Zookeeper; move addresses and resolution to NettyClient

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. GIRAPH-293 Should aggregators be checkpointed?

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              majakabiljo Maja Kabiljo
              majakabiljo Maja Kabiljo
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: