Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-1835

Support compression of the WAL

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.3.0
    • Component/s: log, perf
    • Labels:
      None
    • Target Version/s:

      Description

      In some workloads, particularly those which get good compression rates of the underlying data (eg via dictionary coding), the WAL becomes a big bottleneck for write performance. In addition, the large size of WALs can often mean that old WALs get GCed rapidly and cause lagging replicas to get evicted after only a temporary bout of slowness. Making WALs smaller would mean that we can retain more history without the cost of disk space.

        Attachments

          Activity

            People

            • Assignee:
              tlipcon Todd Lipcon
              Reporter:
              tlipcon Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: