Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-17010

[MINOR]Wrong description in memory management document

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • 2.0.0
    • 2.0.1, 2.1.0
    • Documentation
    • None

    Description

      The value of spark.memory.fraction is changed to 0.6 from 0.75, but the remain percent in document is unchanged.

      spark.memory.fraction expresses the size of M as a fraction of the (JVM heap space - 300MB) (default 0.6). The rest of the space `(25%)` is reserved for user data structures, internal metadata in Spark, and safeguarding against OOM errors in the case of sparse and unusually large records.

      Attachments

        Activity

          People

            WangTao Tao Wang
            WangTao Tao Wang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: