Lucene - Core
  1. Lucene - Core
  2. LUCENE-5342

CompressingStoredFieldsFormat's bulk merge should be disabled when reader and writer don't have the same chunk size

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 4.5, 4.5.1
    • Fix Version/s: 4.6
    • Component/s: None
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      LUCENE-5188 changed the way data is compressed when single documents exceed the chunk size, meaning that it is not legal anymore to bulk merge if writer and reader have different chunk sizes.

      This bug only happens when mixing two instances of CompressingStoredFieldsFormat that have the same compression mode but different chunk sizes, and when there are documents that exceed any of the chunk sizes. So the default codec is not impacted since it has always had the same chunk size (16KB).

        Activity

        Hide
        Adrien Grand added a comment -

        Here is a patch. Will commit soon...

        Show
        Adrien Grand added a comment - Here is a patch. Will commit soon...
        Hide
        ASF subversion and git services added a comment -

        Commit 1542309 from Adrien Grand in branch 'dev/branches/branch_4x'
        [ https://svn.apache.org/r1542309 ]

        LUCENE-5342: Fixed bulk-merge issue in CompressingStoredFieldsFormat

        Show
        ASF subversion and git services added a comment - Commit 1542309 from Adrien Grand in branch 'dev/branches/branch_4x' [ https://svn.apache.org/r1542309 ] LUCENE-5342 : Fixed bulk-merge issue in CompressingStoredFieldsFormat
        Hide
        ASF subversion and git services added a comment -

        Commit 1542310 from Adrien Grand in branch 'dev/branches/lucene_solr_4_6'
        [ https://svn.apache.org/r1542310 ]

        LUCENE-5342: Fixed bulk-merge issue in CompressingStoredFieldsFormat

        Show
        ASF subversion and git services added a comment - Commit 1542310 from Adrien Grand in branch 'dev/branches/lucene_solr_4_6' [ https://svn.apache.org/r1542310 ] LUCENE-5342 : Fixed bulk-merge issue in CompressingStoredFieldsFormat
        Hide
        ASF subversion and git services added a comment -

        Commit 1542311 from Adrien Grand in branch 'dev/trunk'
        [ https://svn.apache.org/r1542311 ]

        LUCENE-5342: Fixed bulk-merge issue in CompressingStoredFieldsFormat

        Show
        ASF subversion and git services added a comment - Commit 1542311 from Adrien Grand in branch 'dev/trunk' [ https://svn.apache.org/r1542311 ] LUCENE-5342 : Fixed bulk-merge issue in CompressingStoredFieldsFormat

          People

          • Assignee:
            Adrien Grand
            Reporter:
            Adrien Grand
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development