HBase
  1. HBase
  2. HBASE-3732

New configuration option for client-side compression

    Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      We have a case here where we have to store very fat cells (arrays of integers) which can amount into the hundreds of KBs that we need to read often, concurrently, and possibly keep in cache. Compressing the values on the client using java.util.zip's Deflater before sending them to HBase proved to be in our case almost an order of magnitude faster.

      There reasons are evident: less data sent to hbase, memstore contains compressed data, block cache contains compressed data too, etc.

      I was thinking that it might be something useful to add to a family schema, so that Put/Result do the conversion for you. The actual compression algo should also be configurable.

      1. compressed_streams.jar
        2 kB
        Karthick Sankarachary

        Issue Links

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Jean-Daniel Cryans
            • Votes:
              2 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development