Uploaded image for project: 'Giraph (Retired)'
  1. Giraph (Retired)
  2. GIRAPH-45

Improve the way to keep outgoing messages

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • bsp
    • None

    Description

      As discussed in GIRAPH-12(http://goo.gl/CE32U), I think that there is a potential problem to cause out of memory when the rate of message generation is higher than the rate of message flush (or network bandwidth).

      To overcome this problem, we need more eager strategy for message flushing or some approach to spill messages into disk.

      The below link is Dmitriy's suggestion.
      https://issues.apache.org/jira/browse/GIRAPH-12?focusedCommentId=13116253&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13116253

      Attachments

        1. GIRAPH-45.diff
          139 kB
          Claudio Martella
        2. GIRAPH-45-1.patch
          115 kB
          Maja Kabiljo
        3. GIRAPH-45-2.patch
          111 kB
          Maja Kabiljo
        4. GIRAPH-45-3.patch
          112 kB
          Maja Kabiljo

        Issue Links

          Activity

            People

              majakabiljo Maja Kabiljo
              hyunsik.choi Hyunsik Choi
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: