[SPARK-31235] Separates different categories of applications

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.1.0
• Component/s: Spark Core, YARN
• Assignee: wang-zhun
• Reporter: wang-zhun
• Created: 24/Mar/20 14:01
• Updated: 17/May/20 18:13
• Resolved: 05/May/20 13:44

Description

The current application defaults to the SPARK type.
In fact, different types of applications have different characteristics and are suitable for different scenarios.For example: SPAKR-SQL, SPARK-STREAMING.
I recommend distinguishing them by the parameter `spark.yarn.applicationType` so that we can more easily manage and maintain different types of applications.

Issue Links

• links to: [Github] Pull Request #28456 (wang-zhun)
• links to: [Github] Pull Request #28456 (wang-zhun)
• links to: [Github] Pull Request #28550 (dongjoon-hyun)
• links to: [Github] Pull Request #28550 (dongjoon-hyun)
• links to: [Github] Pull Request #28552 (dongjoon-hyun)
• links to: GitHub Pull Request #28009