Uploaded image for project: 'Hama'
  1. Hama
  2. HAMA-380

Send messages in batches to reduce RPC overhead.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.3.0
    • 0.3.0
    • bsp core
    • None

    Description

      When profiling graph computations running on HAMA it turned out that huge amount of time is spent in RPC calls.
      To reduce this overhead I propose extending the GroomServer's API with a put(BSPMessageBundle) method so that a group of messages can be transferred from the caller to the callee at once. Also, the sync() operation should be improved by sending messages in batches rather than one-by-one.

      Using BSPMessageBundle makes it easier to add support for compression of messages later.

      Attachments

        1. bspmsgbundle.patch
          7 kB
          Miklos Erdelyi
        2. bspmsgbundle.v2.patch
          11 kB
          Miklos Erdelyi
        3. HAMA-380-v2.patch
          5 kB
          Thomas Jungblut

        Activity

          People

            miklos Miklos Erdelyi
            miklos Miklos Erdelyi
            Votes:
            1 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 4h
                4h
                Remaining:
                Remaining Estimate - 4h
                4h
                Logged:
                Time Spent - Not Specified
                Not Specified