Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.1
    • Component/s: core/index
    • Labels:
      None
    • Environment:

      Operating System: Linux
      Platform: PC

      Description

      Hello,
      I can not find out, why (and what) it is happening all the time. I got an
      exception:
      java.lang.IllegalStateException: docs out of order
      at
      org.apache.lucene.index.SegmentMerger.appendPostings(SegmentMerger.java:219)
      at
      org.apache.lucene.index.SegmentMerger.mergeTermInfo(SegmentMerger.java:191)
      at
      org.apache.lucene.index.SegmentMerger.mergeTermInfos(SegmentMerger.java:172)
      at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:135)
      at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:88)
      at org.apache.lucene.index.IndexWriter.mergeSegments(IndexWriter.java:341)
      at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:250)
      at Optimize.main(Optimize.java:29)

      It happens either in 1.2 and 1.3rc1 (anyway what happened to it? I can not find
      it neither in download nor in version list in this form). Everything seems OK. I
      can search through index, but I can not optimize it. Even worse after this
      exception every time I add new documents and close IndexWriter new segments is
      created! I think it has all documents added before, because of its size.

      My index is quite big: 500.000 docs, about 5gb of index directory.

      It is repeatable. I drop index, reindex everything. Afterwards I add a few
      docs, try to optimize and receive above exception.

      My documents' structure is:
      static Document indexIt(String id_strony, Reader reader, String data_wydania,
      String id_wydania, String id_gazety, String data_wstawienia)
      {
      Document doc = new Document();

      doc.add(Field.Keyword("id", id_strony ));
      doc.add(Field.Keyword("data_wydania", data_wydania));
      doc.add(Field.Keyword("id_wydania", id_wydania));
      doc.add(Field.Text("id_gazety", id_gazety));
      doc.add(Field.Keyword("data_wstawienia", data_wstawienia));
      doc.add(Field.Text("tresc", reader));

      return doc;
      }

      Sincerely,
      legez

      1. indexing-failure.log
        2.75 MB
        Jed Wesley-Smith
      2. LUCENE-140-2007-01-09-instrumentation.patch
        6 kB
        Michael McCandless
      3. corrupted.part2.rar
        3.35 MB
        Jarrod Cuzens
      4. corrupted.part1.rar
        9.00 MB
        Jarrod Cuzens
      5. ASF.LICENSE.NOT.GRANTED--bug23650.txt
        2 kB
        Arvind Srinivasan

        Activity

        legez created issue -
        Jeff Turner made changes -
        Field Original Value New Value
        issue.field.bugzillaimportkey 23650 12314290
        Jarrod Cuzens made changes -
        Attachment corrupted.part1.rar [ 12322202 ]
        Jarrod Cuzens made changes -
        Attachment corrupted.part2.rar [ 12322203 ]
        Michael McCandless made changes -
        Assignee Lucene Developers [ java-dev@lucene.apache.org ] Michael McCandless [ mikemccand ]
        Michael McCandless made changes -
        Jed Wesley-Smith made changes -
        Attachment indexing-failure.log [ 12348606 ]
        Michael McCandless made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Fix Version/s 2.1 [ 12310854 ]
        Resolution Fixed [ 1 ]
        Michael McCandless made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Mark Thomas made changes -
        Workflow jira [ 12324295 ] Default workflow, editable Closed status [ 12564395 ]
        Mark Thomas made changes -
        Workflow Default workflow, editable Closed status [ 12564395 ] jira [ 12585686 ]
        Steve Rowe made changes -
        Affects Version/s unspecified [ 12310280 ]

          People

          • Assignee:
            Michael McCandless
            Reporter:
            legez
          • Votes:
            5 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development