[SPARK-12832] Mesos cluster mode should handle constraints

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 1.6.0
• Component/s: Mesos
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: astralidea
• Created: 15/Jan/16 06:57
• Updated: 21/May/19 04:12
• Resolved: 21/May/19 04:12

Description

on mesos some machine use for spark others use for e.g.ELK cluster.but if driver does not have spark runtime.when deploy a spark job.driver will fail because it run on no spark runtime machine.CoarseMesosSchedulerBackend have constraints feature but dispacher deploy use MesosClusterScheduler, it is different method.

Issue Links

• duplicates: SPARK-19606 Support constraints in spark-dispatcher
• links to: [Github] Pull Request #10768 (Astralidea)
• links to: [Github] Pull Request #10949 (atongen)