Uploaded image for project: 'Giraph (Retired)'
  1. Giraph (Retired)
  2. GIRAPH-45

Improve the way to keep outgoing messages

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • bsp
    • None

    Description

      As discussed in GIRAPH-12(http://goo.gl/CE32U), I think that there is a potential problem to cause out of memory when the rate of message generation is higher than the rate of message flush (or network bandwidth).

      To overcome this problem, we need more eager strategy for message flushing or some approach to spill messages into disk.

      The below link is Dmitriy's suggestion.
      https://issues.apache.org/jira/browse/GIRAPH-12?focusedCommentId=13116253&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13116253

      Attachments

        1. GIRAPH-45-3.patch
          112 kB
          Maja Kabiljo
        2. GIRAPH-45-2.patch
          111 kB
          Maja Kabiljo
        3. GIRAPH-45-1.patch
          115 kB
          Maja Kabiljo
        4. GIRAPH-45.diff
          139 kB
          Claudio Martella

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. GIRAPH-185 Improve concurrency of putMsg / putMsgList

          • Major - Major loss of function.
          • Resolved
          relates to

          New Feature - A new feature of the product, which has yet to be developed. GIRAPH-153 HBase/Accumulo Input and Output formats

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. GIRAPH-78 Be smarter about multiple instances of the same vertex

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. GIRAPH-249 Move part of the graph out-of-core when memory is low

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. GIRAPH-12 Investigate communication improvements

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              majakabiljo Maja Kabiljo
              hyunsik.choi Hyunsik Choi
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: