[SPARK-2100] Allow users to disable Jetty Spark UI in local mode

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Assignee: Unassigned
• Reporter: DB Tsai
• Created: 10/Jun/14 22:00
• Updated: 08/Jan/15 23:10
• Resolved: 08/Jan/15 23:10

Description

Since we want to use Spark hadoop APIs in local mode for design time to explore the first couple hundred lines of data in HDFS. Also, we want to use Spark in our tomcat application, so starting a jetty UI will make our tomcat unhappy. In those scenarios, Spark UI is not necessary, and wasting resource.

As a result, for local mode, it's desirable that users are able to disable the spark UI.

Couple places I found where the jetty will be started.

In SparkEnv.scala
1) val broadcastManager = new BroadcastManager(isDriver, conf, securityManager)
2) val httpFileServer = new HttpFileServer(securityManager)
httpFileServer.initialize()

I don't know if broadcastManager is needed in local mode tho.

Issue Links

• duplicates: SPARK-1047 Ability to disable the spark ui server (unit tests)
• is related to: SPARK-1047 Ability to disable the spark ui server (unit tests)