Uploaded image for project: 'Giraph'
  1. Giraph
  2. GIRAPH-895

Trim the edges in Giraph

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.1.0
    • Fix Version/s: 1.1.0
    • Component/s: graph
    • Labels:
      None

      Description

      In many Giraph applications, graphs are immutable, but edges are never trimmed to the proper size, after input phase. This means that on average we often use 1.5x memory for storing them. Considering we are often memory bounded, adding an option to trim the edges after the input phase will help reduce this excess memory usage. For mutable graphs, we can also provide an option for the same method to be called after each superstep.

      Review request: https://reviews.apache.org/r/21119/

        Attachments

        1. GIRAPH-895.patch
          17 kB
          Sergey Edunov

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              edunov Sergey Edunov
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 24h
                24h
                Remaining:
                Remaining Estimate - 24h
                24h
                Logged:
                Time Spent - Not Specified
                Not Specified