Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: master (8.0)
    • Component/s: core/index
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      Subtask of LUCENE-4100.

      Thats an example of something similar to impact indexing (though, his implementation currently stores a max for the entire term, the problem is the same).

      We can imagine other similar algorithms too: I think the codec API should be able to support these.

      Currently it really doesnt: Stefan worked around the problem by providing a tool to 'rewrite' your index, he passes the IndexReader and Similarity to it. But it would be better if we fixed the codec API.

      One problem is that the Postings writer needs to have access to the Similarity. Another problem is that it needs access to the term and collection statistics up front, rather than after the fact.

      This might have some cost (hopefully minimal), so I'm thinking to experiment in a branch with these changes and see if we can make it work well.

        Attachments

        1. TestSimpleTextPostingsFormat.asf.nightly.master.1466.consoleText.excerpt.txt
          108 kB
          Steve Rowe
        2. TestSimpleTextPostingsFormat.sarowe.jenkins.nightly.master.681.consoleText.excerpt.txt
          108 kB
          Steve Rowe
        3. LUCENE-4198.patch
          181 kB
          Adrien Grand
        4. LUCENE-4198-BMW.patch
          65 kB
          Adrien Grand
        5. LUCENE-4198.patch
          180 kB
          Adrien Grand
        6. LUCENE-4198.patch
          143 kB
          Adrien Grand
        7. LUCENE-4198.patch
          101 kB
          Adrien Grand
        8. LUCENE-4198.patch
          252 kB
          Adrien Grand
        9. LUCENE-4198_flush.patch
          11 kB
          Robert Muir

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                rcmuir Robert Muir
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: