Details
-
Task
-
Status: Resolved
-
Major
-
Resolution: Duplicate
-
None
-
None
-
None
Description
Main JIRA for tracking the issues with `spark-submit` in different deploy modes.
For deploy modes, `client` means running driver on the client side (outside the cluster), while `cluster` means running driver inside the cluster. Ideally, we want to have `spark-submit` support all deploy modes in a unified way, which include
- documented
- local client
- standalone client
- standalone cluster
- yarn client
- yarn cluster
- mesos client
- undocumented (for testing only)
- local cluster
- not supported
- mesos cluster
In each deploy mode, we also need to test launching python jobs.
Attachments
Issue Links
- duplicates
-
SPARK-1652 Fixes and improvements for spark-submit/configs
- Resolved