Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
None
-
scala 2.10.4
spark 1.1.0
Description
VertexRDD.diff doesn't work.
For example :
val setA: VertexRDD[Int] = VertexRDD(sc.parallelize(0L until 2L).map(id => (id, id.toInt)))
setA.collect.foreach(println(_))
// (0,0)
// (1,1)
val setB: VertexRDD[Int] = VertexRDD(sc.parallelize(1L until 3L).map(id => (id, id.toInt)))
setB.collect.foreach(println(_))
// (1,1)
// (2,2)
val diff = setA.diff(setB)
diff.collect.foreach(println(_))
// printed none