Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-5534

EdgeRDD, VertexRDD getStorageLevel return bad values

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.3.0
    • 1.3.0
    • GraphX
    • None

    Description

      After caching a graph, its edge and vertex RDDs still return StorageLevel.None.

      Reproduce error:

      import org.apache.spark.graphx.{Edge, Graph}
      val edges = Seq(
        Edge[Double](0, 1, 0),
        Edge[Double](1, 2, 0),
        Edge[Double](2, 3, 0),
        Edge[Double](3, 4, 0))
      val g = Graph.fromEdges[Double,Double](sc.parallelize(edges), 0)
      g.vertices.getStorageLevel  // returns value for StorageLevel.None
      g.edges.getStorageLevel  // returns value for StorageLevel.None
      g.cache()
      g.vertices.count()
      g.edges.count()
      g.vertices.getStorageLevel  // returns value for StorageLevel.None
      g.edges.getStorageLevel  // returns value for StorageLevel.None
      

      Attachments

        Activity

          People

            josephkb Joseph K. Bradley
            josephkb Joseph K. Bradley
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: