[SPARK-27284] Spark Standalone aggregated logs in 1 file per appid (ala yarn -logs -applicationId)

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Invalid
• Affects Version/s: 2.3.3, 2.4.0
• Component/s: Scheduler, Spark Core
• Assignee: Unassigned
• Reporter: t oo
• Created: 26/Mar/19 13:26
• Updated: 17/May/20 17:47
• Resolved: 29/Mar/19 19:05

Description

Feature: Spark Standalone aggregated logs in 1 file per appid (ala  yarn -logs -applicationId)

 

This would be 1 single file per appid with contents of ALL the executors logs

https://stackoverflow.com/questions/46004528/how-can-i-see-the-aggregated-logs-for-a-spark-standalone-cluster