[HAMA-897] Performance improvement of graph processing using background threads

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.6.4
• Component/s: graph
• Assignee: Unassigned
• Reporter: Edward J. Yoon
• Created: 08/Apr/14 08:13
• Updated: 24/Mar/15 01:19

Description

Each GraphJobRunner (BSPTask) calls vertex.compute() method sequentially in a while loop:

    while (iterator.hasNext(
        currentMessage == null ? null : (V) currentMessage.getVertexId(),
        Strategy.ALL)) {

      vertex = iterator.next();
      if (currentMessage != null) {
        iterable = iterate(currentMessage, (V) currentMessage.getVertexId(),
            vertex, peer);
      }

      if (iterable != null && vertex.isHalted()) {
        vertex.setActive();
      }

      if (!vertex.isHalted()) {
        if (iterable == null) {
          vertex.compute(Collections.<M> emptyList());
        } else {
          vertex.compute(iterable);
          currentMessage = iterable.getOverflowMessage();
        }
        activeVertices++;
      }

      // note that we even need to rewrite the vertex if it is halted for
      // consistency reasons
      vertices.finishVertexComputation(vertex);
    }

I might be wrong but I'm sure we can improve the performance using the background threads.