[SPARK-8523] Spark streaming static files not found when running web ui under virtual host

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Incomplete
• Affects Version/s: 1.4.0
• Component/s: Web UI
• Labels: bulk-closed streaming visualization web-ui
• Assignee: Unassigned
• Reporter: Ho Tien Vu
• Created: 22/Jun/15 09:52
• Updated: 21/May/19 04:32
• Resolved: 21/May/19 04:32

Description

I'm currently running Spark Standalone cluster on an environment where one security enforcement requires that only one port 80 is open. Therefore any web ui needs to run under virtual hosts of the node where port 80 is open.
In the machine where httpd runs:
/etc/httpd/conf.d /spark-master.conf: /spark-master -> spark-master-ip:18080

Before 1.4.0 all static files resides under spark-core ui and served from /static/. So I just need to set spark.ui.proxyBase to /spark-master and the path will be correct. However in 1.4.0, some files are located in /static/streaming therefore are not found. Since I can't use two different proxyBase, the only workaround now is to copy all static files in streaming to core.