Uploaded image for project: 'Giraph'
  1. Giraph
  2. GIRAPH-1072

Improve metrics reported in out-of-core computation

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.2.0
    • Component/s: None
    • Labels:
      None

      Description

      Currently, out-of-core infrastructure reports some metrics as part of master/worker log, and also as part of Hadoop job counters. There is a need to show, for a specific out-of-core policy, how much of the graph were kept in memory at the worst (i.e. memory heaviest) moment in the execution. Particularly, a user would be interested in knowing how many more machines the job should be run on, so that the entire execution fits in memory.

        Attachments

          Activity

            People

            • Assignee:
              heslami Hassan Eslami
              Reporter:
              heslami Hassan Eslami
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: