Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2401

Optionally Compress Backup Checkpoint

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.4.0, 1.5.0
    • 1.6.0
    • File Channel
    • None

    Description

      File Channels with a large capacity create big checkpoint files. If the channel is mostly empty when the backup checkpoint is written the file will be large but mostly '0'. It would be nice to be able to optionally compress the checkpoint to reduce disk utilization for the backup checkpoint.

      See: http://mail-archives.apache.org/mod_mbox/flume-user/201406.mbox/%3C8B094F7E897248E89C8E55526178FD65%40cloudera.com%3E

      Attachments

        1. compress_backup_checkpoint.patch
          26 kB
          Abraham Fine
        2. compress_backup_checkpoint_new_tests.patch
          29 kB
          Abraham Fine
        3. compress_backup_checkpoint_final.patch
          29 kB
          Abraham Fine

        Activity

          People

            abrahamfine Abraham Fine
            abrahamfine Abraham Fine
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: