Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-18568

vertex attributes in the edge triplet not getting updated in super steps for Pregel API

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • 2.0.2
    • None
    • GraphX
    • None

    Description

      When running the Pregel API with vertex attribute as complex objects. The vertex attributes are not getting updated in the triplet view. For example if the vertex attributes changes in first superstep for vertex"a" the triplet src attributes in the send msg program for the first super step gets the latest attributes of the vertex "a" but on 2nd super step if the vertex attributes changes in the vprog the edge triplets are not updated with this new state of the vertex for all the edge triplets having the vertex "a" as src or destination. if I re-create the graph using g = Graph(g.vertices, g.edges) in the while loop before the next super step then its getting updated. But this fix is not good performance wise. A detailed description of the bug along with the code to recreate it is in the attached URL.

      Attachments

        Activity

          People

            Unassigned Unassigned
            rohit13k Rohit
            Votes:
            3 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: