Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-1259

improve Trevni encoding of sparse fields

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.7.5
    • trevni
    • None

    Description

      If in most records a field is null, Trevni writes a null byte (zero length) for that record in that column. This might be optimized by instead using a run-length encoding for lengths. The length is signed, so negative lengths might be used to indicate the number of zero-lengths before the next non-zero value. This could thus be back-compatible.

      Attachments

        1. AVRO-1259.patch
          7 kB
          Doug Cutting
        2. AVRO-1259.patch
          5 kB
          Doug Cutting
        3. AVRO-1259.patch
          4 kB
          Doug Cutting

        Activity

          People

            cutting Doug Cutting
            cutting Doug Cutting
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: