[SPARK-3445] Deprecate and later remove YARN alpha support

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Component/s: YARN
• Target Version/s: 1.3.0
• Assignee: Sandy Ryza
• Reporter: Patrick Wendell
• Created: 08/Sep/14 19:56
• Updated: 01/May/15 13:52
• Resolved: 24/Jan/15 18:15

Description

This will depend a bit on both user demand and the commitment level of maintainers, but I'd like to propose the following timeline for yarn-alpha support.

Spark 1.2: Deprecate YARN-alpha
Spark 1.3: Remove YARN-alpha (i.e. require YARN-stable)

Since YARN-alpha is clearly identified as an alpha API, it seems reasonable to drop support for it in a minor release. However, it does depend a bit whether anyone uses this outside of Yahoo!, and that I'm not sure of. In the past this API has been used and maintained by Yahoo, but they'll be migrating soon to the stable API's.

Issue Links

• is related to: SPARK-7302 SPARK building documentation still mentions building for yarn 0.23

Sub-Tasks

• Deprecate YARN alpha support in Spark 1.2: Resolved
• Remove yarn-alpha support: Closed