Details
-
New Feature
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
(note: related to HADOOP-4874)
As per Doug's earlier comments, LZF does indeed look like a good compressor candidate for fast compression/decompression, good enough compression rate.
From my testing it seems at least twice as fast at compression, and somewhat faster for decompressing than gzip.
Code from http://h2database.googlecode.com/svn/trunk/h2/src/main/org/h2/compress/ is applicable, and I have tested it with json data.
I hope to have more to spend on this in near future, but if someone else gets to this first that'd be good too.
Attachments
Issue Links
- is related to
-
HBASE-2404 native fast compression codec
- Closed
- relates to
-
HBASE-3485 implement a Compressor based on LZF
- Closed
-
HADOOP-6349 Implement FastLZCodec for fastlz/lzo algorithm
- Resolved