[ACCUMULO-374] wikisearch-ingest stop list should be removed

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.0
• Assignee: Adam Fuchs
• Reporter: Adam Fuchs
• Created: 06/Feb/12 19:35
• Updated: 08/Feb/12 03:04
• Resolved: 08/Feb/12 03:04

Description

Wikisearch-ingest's WikipediaMapper has a list of stop words that presumably are supposed to be ignored (not indexed). This feature should be removed because:
1. The StopFilter code does not work. Stop words are indexed anyway. Not sure why.
2. Stop lists are not a significant performance concern with this type of indexing. It's better for cross-language search, phrase search, and for overall search efficiency not to use a stop list.