[LUCENE-4178] FieldType.setTokenized shoudl be true by default

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0-ALPHA
• Fix Version/s: 4.0-BETA, 6.0
• Lucene Fields: New
• Assignee: Unassigned
• Reporter: Robert Muir
• Created: 28/Jun/12 12:57
• Updated: 28/Aug/22 13:20
• Resolved: 29/Jun/12 11:21

Description

This is really confusing, see LUCENE-4176 where a user hit this.

The example code from the user there reads:

FieldType fieldType = new FieldType();
fieldType.setIndexed(true);
fieldType.setStored(true);

Its really trappy that this does not invoke the analyzer: because historically we did this unless you specified NOT_ANALYZED.

So i think fieldType.setTokenized(true) should be the default: things like StringField can turn it off.