[SPARK-987] Cannot start workers successfully with hadoop 2.2.0

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Not A Problem
• Affects Version/s: 0.8.0
• Component/s: Spark Core
• Labels: 2.2.0 hadoop
• Assignee: Unassigned
• Reporter: 刘旭
• Created: 07/Dec/13 18:51
• Updated: 08/Nov/14 09:51
• Resolved: 08/Nov/14 09:51

Description

Cannot start workers successfully with hadoop 2.2.0.
I build with:
$make-distribution.sh -hadoop 2.2.0

P.S.
Can work well with hadoop 2.0.5-alpha.

But cannot connect the hadoop 2.2.0 successfully with this exception :

scala> var lines = sc.textFile("hdfs://localhost:9000/user/hadoop/hadoop/hadoop-hadoop-jobtracker-master.log")
lines: org.apache.spark.rdd.RDD[String] = MappedRDD[3] at textFile at <console>:12

scala> lines.count
java.io.IOException: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Message missing required fields: callId, status; Host Details : local host is: "master/192.168.3.103"; destination host is: "localhost":9000;