Avro
  1. Avro
  2. AVRO-1522

SortedKeyValueFile Writer should support compression codecs

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.7.6
    • Fix Version/s: 1.7.7
    • Component/s: java
    • Labels:
      None

      Description

      There's no option to set the compression codec on a SortedKeyValueFile.Writer. And since the Writer creates the output file in the constructor and it provides no public access to the underlying DataFileWriter anyway, the user can't set a codec themselves.

      I have a patch that will add this functionality through the SortedKeyValueFile.Writer.Options class. But we might want to consider if it also makes sense to delay creating the data and index DataFileWriters until a create() method is called, and allow public access to these writers so a consumer of the API can modify settings of the underlying writers themselves.

      1. AVRO-1522.patch
        6 kB
        Steven Willis

        Activity

        Steven Willis created issue -
        Steven Willis made changes -
        Field Original Value New Value
        Attachment AVRO-1522.patch [ 12647694 ]
        Steven Willis made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Steven Willis made changes -
        Component/s java [ 12312780 ]
        Doug Cutting made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Assignee Steven Willis [ stevenwillis ]
        Fix Version/s 1.7.7 [ 12326041 ]
        Resolution Fixed [ 1 ]
        Doug Cutting made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Steven Willis
            Reporter:
            Steven Willis
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development