Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Won't Fix
-
0.16.0
-
None
-
None
Description
If you deploy Mesos 0.16.0 on a Hadoop 2.x cluster with Spark 0.9.0+ you will start getting stack-dumps similar to dump.log
Without going into much detail the hadoop-client.jar for 2.x now requires
Protobuf 2.5.0 and therefore Spark will require the same protobuf
version. Due this you will need to run Spark on Mesos with support of
Protobuf 2.5.0.
If you want to use Mesos 0.16.0, which is the latest stable release, you will need support of Protobufs 2.5.0 on Mesos 0.16.0.