[SPARK-9779] HTTP500 revisit when open web-UI in yarn-cluster yarn-client mode (1.2-1.3)

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.2.0, 1.2.1, 1.2.2, 1.3.0
• Component/s: Web UI

Environment

hadoop2.5.0-cdh5.3.2

• Assignee: Unassigned
• Reporter: hujiayin
• Created: 10/Aug/15 08:06
• Updated: 10/Aug/15 08:16
• Resolved: 10/Aug/15 08:16

Description

When I try to open the web-UI from AM in yarn-cluster mode, I meet the HTTP500 error as described in https://issues.apache.org/jira/browse/SPARK-5837 I want to collect stage logs of a feature in Spark1.2 for a performance problem.

The error doesn't happen in the latest spark build and only happens in Spark1.2-1.3. The hadoop yarn related configuration are the same between the different Spark versions.

Issue Links

• duplicates: SPARK-5837 HTTP 500 if try to access Spark UI in yarn-cluster or yarn-client mode