[SPARK-1040] Collect as Map throws a casting exception when run on a JavaPairRDD object

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 0.9.1
• Component/s: Java API
• Assignee: Josh Rosen
• Reporter: Kevin Mader
• Created: 23/Jan/14 02:03
• Updated: 23/Sep/15 14:29
• Resolved: 26/Jan/14 00:24

Description

The error that arises

Exception in thread "main" java.lang.ClassCastException: [Ljava.lang.Object; cannot be cast to [Lscala.Tuple2;
	at org.apache.spark.rdd.PairRDDFunctions.collectAsMap(PairRDDFunctions.scala:427)
	at org.apache.spark.api.java.JavaPairRDD.collectAsMap(JavaPairRDD.scala:409)

The code being executed

public static String ImageSummary(final JavaPairRDD<Integer,int[]> inImg) {
		final Set<Integer> keyList=inImg.collectAsMap().keySet();
		for(Integer cVal: keyList) outString+=cVal+",";
		return outString;
	}

The line 426-427 from PairRDDFunctions.scala

 def collectAsMap(): Map[K, V] = {
    val data = self.toArray()

Issue Links

• is related to: SPARK-4489 JavaPairRDD.collectAsMap from checkpoint RDD may fail with ClassCastException