[SPARK-22630] Consolidate all configuration properties into one page

• Type: Documentation
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.2.0
• Component/s: Documentation
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Andreas Maier
• Created: 28/Nov/17 12:23
• Updated: 12/Dec/22 18:10
• Resolved: 21/May/19 04:11

Description

The page https://spark.apache.org/docs/2.2.0/configuration.html gives the impression as if all configuration properties of Spark are described on this page. Unfortunately this is not true. The description of important properties is spread through the documentation. The following pages list properties, which are not described on the configuration page:

https://spark.apache.org/docs/2.2.0/sql-programming-guide.html#performance-tuning
https://spark.apache.org/docs/2.2.0/monitoring.html#spark-configuration-options
https://spark.apache.org/docs/2.2.0/security.html#ssl-configuration
https://spark.apache.org/docs/2.2.0/sparkr.html#starting-up-from-rstudio
https://spark.apache.org/docs/2.2.0/running-on-yarn.html#spark-properties
https://spark.apache.org/docs/2.2.0/running-on-mesos.html#configuration
https://spark.apache.org/docs/2.2.0/spark-standalone.html#cluster-launch-scripts

As a reader of the documentation I would like to have single central webpage describing all Spark configuration properties. Alternatively it would be nice to at least add links from the configuration page to the other pages of the documentation, where configuration properties are described.

Issue Links

• is related to: SPARK-22631 Consolidate all configuration properties into one page