Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-5633

pyspark saveAsTextFile support for compression codec

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.2.0
    • 1.3.0
    • PySpark
    • None

    Description

      Scala and Java API allows to provide compression codec with saveAsTextFile(path, codec)
      PySpark saveAsTextFile API does not support passing codec class.

      This story is about adding saveAsTextFile(path, codec) support into pyspark.

      Attachments

        Activity

          People

            vvladymyrov Vladimir Vladimirov
            vvladymyrov Vladimir Vladimirov
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: