Details
-
Documentation
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
2.2.0
-
None
Description
The spark properties for configuring the ContextCleaner as described on https://jaceklaskowski.gitbooks.io/mastering-apache-spark/spark-service-contextcleaner.html are not documented in the official documentation at https://spark.apache.org/docs/latest/configuration.html#available-properties .
As a user I would like to have the following spark properties documented in the official documentation:
spark.cleaner.periodicGC.interval spark.cleaner.referenceTracking spark.cleaner.referenceTracking.blocking spark.cleaner.referenceTracking.blocking.shuffle spark.cleaner.referenceTracking.cleanCheckpoints