Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
At present, the default file output operator (AbstractFileOutputOperator) supports compression by setting the FilterStreamProvider. However, Malhar presently only includes two FilterStreamProvider - one to Cipher data, and one for Gzip.
Snappy offers substantially improved performance over Gzip in terms of compression and decompression speed at the expense of compression ratio. In certain applications this is useful. Thus, it would be helpful to add a Snappy FilterStreamProvider.
