[LUCENE-2664] Add SimpleText codec

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0-ALPHA
• Component/s: core/index
• Lucene Fields: New
• Assignee: Michael McCandless
• Reporter: Michael McCandless
• Created: 23/Sep/10 19:33
• Updated: 28/Aug/22 12:33
• Resolved: 06/Oct/10 08:56

Description

Inspired by Sahin Buyrukbilen's question here:

http://www.lucidimagination.com/search/document/b68846e383824653/how_to_export_lucene_index_to_a_simple_text_file#b68846e383824653

I made a simple read/write codec that stores all postings data into a
single text file (_X.pst), looking like this:

field contents
  term file
    doc 0
      pos 5
  term is
    doc 0
      pos 1
  term second
    doc 0
      pos 3
  term test
    doc 0
      pos 4
  term the
    doc 0
      pos 2
  term this
    doc 0
      pos 0
END

The codec is fully funtional – all Lucene & Solr tests pass with
-Dtests.codec=SimpleText – but, its performance is obviously poor.

However, it should be useful for debugging, transparency,
understanding just what Lucene stores in its index, etc. And it's a
quick way to gain some understanding on how a codec works...