[SPARK-21346] Spark does not use SSL for HTTP File Server and Broadcast Server

• Type: Question
• Status: Resolved
• Priority: Minor
• Resolution: Incomplete
• Affects Version/s: 2.1.1
• Component/s: Documentation, Spark Core
• Labels: bulk-closed documentation
• Assignee: Unassigned
• Reporter: John
• Created: 07/Jul/17 22:34
• Updated: 21/May/19 04:14
• Resolved: 21/May/19 04:14

Description

SecurityManager states that SSL is used to secure HTTP communication for the broadcast and file server. However, the SSLOptions from the SecurityManager only seem to be used by the SparkUI, the WebUI, and the HistoryServer. According to Spark-11140 and Spark-12588, neither the file server nor broadcast use HTTP anymore. It seems that the documentation is inaccurate and that Spark actually uses SASL on the RPC endpoints to secure the file server and broadcast communications.