Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-5342

CompressingStoredFieldsFormat's bulk merge should be disabled when reader and writer don't have the same chunk size

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 4.5, 4.5.1
    • Fix Version/s: 4.6
    • Component/s: None
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      LUCENE-5188 changed the way data is compressed when single documents exceed the chunk size, meaning that it is not legal anymore to bulk merge if writer and reader have different chunk sizes.

      This bug only happens when mixing two instances of CompressingStoredFieldsFormat that have the same compression mode but different chunk sizes, and when there are documents that exceed any of the chunk sizes. So the default codec is not impacted since it has always had the same chunk size (16KB).

        Activity

        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 1542311 from Adrien Grand in branch 'dev/trunk'
        [ https://svn.apache.org/r1542311 ]

        LUCENE-5342: Fixed bulk-merge issue in CompressingStoredFieldsFormat

        Show
        jira-bot ASF subversion and git services added a comment - Commit 1542311 from Adrien Grand in branch 'dev/trunk' [ https://svn.apache.org/r1542311 ] LUCENE-5342 : Fixed bulk-merge issue in CompressingStoredFieldsFormat
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 1542310 from Adrien Grand in branch 'dev/branches/lucene_solr_4_6'
        [ https://svn.apache.org/r1542310 ]

        LUCENE-5342: Fixed bulk-merge issue in CompressingStoredFieldsFormat

        Show
        jira-bot ASF subversion and git services added a comment - Commit 1542310 from Adrien Grand in branch 'dev/branches/lucene_solr_4_6' [ https://svn.apache.org/r1542310 ] LUCENE-5342 : Fixed bulk-merge issue in CompressingStoredFieldsFormat
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 1542309 from Adrien Grand in branch 'dev/branches/branch_4x'
        [ https://svn.apache.org/r1542309 ]

        LUCENE-5342: Fixed bulk-merge issue in CompressingStoredFieldsFormat

        Show
        jira-bot ASF subversion and git services added a comment - Commit 1542309 from Adrien Grand in branch 'dev/branches/branch_4x' [ https://svn.apache.org/r1542309 ] LUCENE-5342 : Fixed bulk-merge issue in CompressingStoredFieldsFormat
        Hide
        jpountz Adrien Grand added a comment -

        Here is a patch. Will commit soon...

        Show
        jpountz Adrien Grand added a comment - Here is a patch. Will commit soon...

          People

          • Assignee:
            jpountz Adrien Grand
            Reporter:
            jpountz Adrien Grand
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development