Uploaded image for project: 'Giraph'
  1. Giraph
  2. GIRAPH-1023

Adding out-of-core messages to the newly added adaptive out-of-core mechanism

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.2.0
    • Component/s: graph
    • Labels:
      None

      Description

      GIRAPH-1022 implements an adaptive mechanism for out-of-core capable of handling graph data structure (in input/output and compute superstep). This diff, adds capability of handling out-of-core messages as well. This is useful specially in the case where message combiner is not used and large amount of messages may cause the job to either fail due to OOM (or its related exceptions), or run with a very low performance due to extensive GC calls.

        Attachments

          Activity

            People

            • Assignee:
              heslami Hassan Eslami
              Reporter:
              heslami Hassan Eslami
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: