Details
-
Improvement
-
Status: Closed
-
Minor
-
Resolution: Not A Problem
-
2.1.0
-
None
-
None
Description
Spark uses rewrites of query parameters to paths (http://<fqdn>:4040/jobs/job?id=0 --> http://<fqdn>:4040/jobs/job/?id=0). This works fine in local or standalone mode, but does not work on Yarn (with the org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter filter), where the query parameter is dropped.
The repro steps are:
- Start up the spark-shell and run a job
- Try to access the job details through http://<fqdn>:4040/jobs/job?id=0
- A HTTP ERROR 400 is thrown (requirement failed: missing id parameter)
Going directly through the RM proxy works (does not cause query parameters to be dropped).
Attachments
Issue Links
- breaks
-
ZEPPELIN-2221 Spark jobs UI from the paragraph is broken in YARN
- Closed
- is related to
-
SPARK-24120 Show `Jobs` page when `jobId` is missing
- Resolved