[#LUCENE-1151] Fix StandardAnalyzer to not mis-identify HOST as ACRONYM by default

Lucene - Java

Fix StandardAnalyzer to not mis-identify HOST as ACRONYM by default

Created: 25/Jan/08 11:02 AM Updated: 11/Oct/08 12:49 PM

Return to search

Component/s:

Analysis

Affects Version/s:

None

Fix Version/s:

2.4

Time Tracking:

Not Specified

File Attachments:

	File Name	Date Attached	Attached By	Size
	LUCENE-1151.patch	2008-01-29 01:29 PM	Michael McCandless	6 kB

Issue Links:

Reference

This issue is related to:

~~LUCENE-1373~~ Most of the contributed Analyzers suffer from invalid recognition of acronyms.

~~LUCENE-1068~~ Invalid behavior of StandardTokenizerImpl

Lucene Fields:	New
Resolution Date:	03/Feb/08 03:33 PM

Description

« Hide

Coming out of the discussion around back compatibility, it seems best to default StandardAnalyzer to properly fix ~~LUCENE-1068~~, while preserving the ability to get the back-compatible behavior in the rare event that it's desired.

This just means changing the replaceInvalidAcronym = false with = true, and, adding a clear entry to CHANGES.txt that this very slight non back compatible change took place.

Spinoff from here:

http://www.gossamer-threads.com/lists/lucene/java-dev/57517#57517

I'll commit that change in a day or two.

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

Repository	Revision	Date	User	Message
ASF	#618001	Sun Feb 03 15:33:16 UTC 2008	mikemccand	~~LUCENE-1151~~: don't mis-identify HOST as ACRONYM, but, provide static method/property to revert to backwards-compatible but buggy behavior
				Files Changed
				MODIFY /lucene/java/trunk/src/test/org/apache/lucene/analysis/TestStandardAnalyzer.java MODIFY /lucene/java/trunk/CHANGES.txt MODIFY /lucene/java/trunk/src/java/org/apache/lucene/analysis/standard/StandardAnalyzer.java

Repository	Revision	Date	User	Message
ASF	#692634	Sat Sep 06 10:58:33 UTC 2008	mikemccand	~~LUCENE-1151~~: fix misleading javadoc comment and testcase for StandardAnalyzer
				Files Changed
				MODIFY /lucene/java/trunk/src/test/org/apache/lucene/analysis/TestStandardAnalyzer.java MODIFY /lucene/java/trunk/src/java/org/apache/lucene/analysis/standard/StandardAnalyzer.java