Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-4600

org.apache.spark.graphx.VertexRDD.diff does not work

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.4.0
    • Documentation, GraphX
    • scala 2.10.4
      spark 1.1.0

    Description

      VertexRDD.diff doesn't work.

      For example :

      val setA: VertexRDD[Int] = VertexRDD(sc.parallelize(0L until 2L).map(id => (id, id.toInt)))
      setA.collect.foreach(println(_))
      // (0,0)
      // (1,1)

      val setB: VertexRDD[Int] = VertexRDD(sc.parallelize(1L until 3L).map(id => (id, id.toInt)))
      setB.collect.foreach(println(_))
      // (1,1)
      // (2,2)

      val diff = setA.diff(setB)
      diff.collect.foreach(println(_))
      // printed none

      Attachments

        Activity

          People

            boyork Brennon York
            teppei_tosa Teppei Tosa
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: