Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22428

Document spark properties for configuring the ContextCleaner

    Details

    • Type: Documentation
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.2.0
    • Fix Version/s: 2.3.0
    • Component/s: Documentation
    • Labels:
      None

      Description

      The spark properties for configuring the ContextCleaner as described on https://jaceklaskowski.gitbooks.io/mastering-apache-spark/spark-service-contextcleaner.html are not documented in the official documentation at https://spark.apache.org/docs/latest/configuration.html#available-properties .

      As a user I would like to have the following spark properties documented in the official documentation:

      spark.cleaner.periodicGC.interval
      spark.cleaner.referenceTracking	
      spark.cleaner.referenceTracking.blocking	
      spark.cleaner.referenceTracking.blocking.shuffle	
      spark.cleaner.referenceTracking.cleanCheckpoints
      

        Attachments

          Activity

            People

            • Assignee:
              gsomogyi Gabor Somogyi
              Reporter:
              asmaier Andreas Maier
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: