Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-250

Allow compression in Avro output formats

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.9.4
    • Sinks+Sources
    • None

    Description

      The current AvroDataFileOutputFormat and AvroJsonOutputFormat don't support compression of output. It'd be good to have a compression option, ideally with a configurable compression level.

      Indeed, per FLUME-97 the avrojson output format isn't an Avro file format at all yet, but when it is it'd be good to support this for it too.

      Attachments

        Issue Links

          is blocked by

          New Feature - A new feature of the product, which has yet to be developed. FLUME-133 Add support for Avro Native output files.

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              brucem Bruce Mitchener
              flume_rbodkin Disabled imported user
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: