Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-1522

SortedKeyValueFile Writer should support compression codecs

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.7.6
    • 1.7.7
    • java
    • None

    Description

      There's no option to set the compression codec on a SortedKeyValueFile.Writer. And since the Writer creates the output file in the constructor and it provides no public access to the underlying DataFileWriter anyway, the user can't set a codec themselves.

      I have a patch that will add this functionality through the SortedKeyValueFile.Writer.Options class. But we might want to consider if it also makes sense to delay creating the data and index DataFileWriters until a create() method is called, and allow public access to these writers so a consumer of the API can modify settings of the underlying writers themselves.

      Attachments

        1. AVRO-1522.patch
          6 kB
          Steven Willis

        Activity

          People

            stevenwillis Steven Willis
            stevenwillis Steven Willis
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: