Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-850

Add Writable implementations for variable-length integer types.

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.10.0
    • Fix Version/s: 0.10.0
    • Component/s: io
    • Labels:
      None

      Description

      Currently Hadoop supports only three basic integer-like types: ByteWritable, IntWritable and LongWritable. They provide a fixed tradeoff between their value range and on-disk space consumption. But it is sometimes useful to be able to store integer values with broader allowed range, but less space consumption when possible.

      This is especially useful when storing very long series of values, combined with delta encoding.

      Lucene already implements variable-length encoding for positive int and long. I propose to add similar Writable implementations, which use the same encoding methods.

        Attachments

        1. variable-ints.patch
          5 kB
          Andrzej Bialecki

          Activity

            People

            • Assignee:
              ab Andrzej Bialecki
              Reporter:
              ab Andrzej Bialecki
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: