Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-2999

Compress all the serialized data

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.4.0
    • PySpark
    • None

    Description

      LZ4 is so fast that we can have performance benefit for all network/disk IO.

      Attachments

        Issue Links

          Is contained by

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-3074 support groupByKey() with hot keys in PySpark

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              davies Davies Liu
              davies Davies Liu
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: