Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-9010

Improve the Spark Configuration document about `spark.kryoserializer.buffer`

    Details

      Description

      The meaning of spark.kryoserializer.buffer should be "Initial size of Kryo's serialization buffer. Note that there will be one buffer per core on each worker. This buffer will grow up to spark.kryoserializer.buffer.max if needed.".

      The spark.kryoserializer.buffer.max.mb is out-of-date in spark 1.4.

        Attachments

          Activity

            People

            • Assignee:
              stanzhai StanZhai
              Reporter:
              stanzhai StanZhai
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: