• Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0-ALPHA
    • Component/s: core/store
    • Labels:
    • Lucene Fields:


      Some codecs might be interested in using PackedInts.


      to read and write fixed-size values efficiently.

      The problem is that the serialization format is self contained, and always writes the name of the codec, its version, its number of bits per value and its format. For example, if you want to use packed ints to store your postings list, this is a lot of overhead (at least ~60 bytes per term, in case you only use one Writer per term, more otherwise).

      Users should be able to externalize the storage of metadata to save space. For example, to use PackedInts to store a postings list, one should be able to store the codec name, its version and the number of bits per doc in the header of the terms+postings list instead of having to write it once (or more!) per term.

      1. LUCENE-4161.patch
        533 kB
        Adrien Grand
      2. LUCENE-4161.patch
        513 kB
        Adrien Grand

        Issue Links


          Uwe Schindler made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Gavin made changes -
          Link This issue is related to LUCENE-3892 [ LUCENE-3892 ]
          Gavin made changes -
          Link This issue is related to LUCENE-3892 [ LUCENE-3892 ]
          Han Jiang made changes -
          Link This issue is related too LUCENE-3892 [ LUCENE-3892 ]
          Adrien Grand made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Fix Version/s 4.0 [ 12314025 ]
          Resolution Fixed [ 1 ]
          Adrien Grand made changes -
          Attachment LUCENE-4161.patch [ 12535005 ]
          Adrien Grand made changes -
          Field Original Value New Value
          Attachment LUCENE-4161.patch [ 12533344 ]
          Adrien Grand created issue -


            • Assignee:
              Adrien Grand
              Adrien Grand
            • Votes:
              0 Vote for this issue
              3 Start watching this issue


              • Created: