[SPARK-24209] 0 configuration Knox gateway support in SHS

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 2.4.0
• Component/s: Web UI
• Labels: usability
• Assignee: Marco Gaido
• Reporter: Marco Gaido
• Created: 08/May/18 15:39
• Updated: 28/May/20 16:31
• Resolved: 22/May/18 04:17

Description

SHS supports Knox gateway by setting spark.ui.proxyBase to the proper value. The main problem with this approach is that when spark.ui.proxyBase is set, SHS is not accessible anymore through direct access.

Since Knox provides in the header X-Forwarded-Context the base URL to use (there is a patch available in KNOX-1295), we can leverage it in order to dynamically retrieve the right proxy base, instead of relying on a fixed config. In this way, both access via Knox proxy and via direct URL can work properly.

Issue Links

• is related to: KNOX-1610 Support the Livy UI in the Livy service definition
• links to: [Github] Pull Request #21268 (mgaido91)