[SPARK-22428] Document spark properties for configuring the ContextCleaner

• Type: Documentation
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.2.0
• Fix Version/s: 2.3.0
• Component/s: Documentation
• Assignee: Gabor Somogyi
• Reporter: Andreas Maier
• Created: 02/Nov/17 11:03
• Updated: 01/Dec/17 01:21
• Resolved: 01/Dec/17 01:20

Description

The spark properties for configuring the ContextCleaner as described on https://jaceklaskowski.gitbooks.io/mastering-apache-spark/spark-service-contextcleaner.html are not documented in the official documentation at https://spark.apache.org/docs/latest/configuration.html#available-properties .

As a user I would like to have the following spark properties documented in the official documentation:

spark.cleaner.periodicGC.interval
spark.cleaner.referenceTracking	
spark.cleaner.referenceTracking.blocking	
spark.cleaner.referenceTracking.blocking.shuffle	
spark.cleaner.referenceTracking.cleanCheckpoints

Issue Links

• links to: [Github] Pull Request #19826 (gaborgsomogyi)