[YARN-6615] AmIpFilter drops query parameters on redirect - ASF JIRA

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 2.8.0, 2.7.3, 2.6.5, 3.0.0-alpha2
Fix Version/s: 2.9.0, 2.7.4, 2.6.6, 3.0.0-alpha4, 2.8.2
Component/s: None
Labels:
None

Target Version/s:

2.7.4, 2.8.1
Hadoop Flags:

Reviewed

Description

When an AM web request is redirected to the RM the query parameters are dropped from the web request.

This happens for Spark as described in ~~SPARK-20772~~.
The repro steps are:

Start up the spark-shell in yarn mode and run a job
Try to access the job details through http://<fqdn>:4040/jobs/job?id=0
A HTTP ERROR 400 is thrown (requirement failed: missing id parameter)

This works fine in local or standalone mode, but does not work on Yarn where the query parameter is dropped. If the UI filter org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter is removed from the config which shows that the problem is in the filter