[LUCENE-3071] PathHierarchyTokenizer adaptation for urls: splits reversed

• Type: New Feature
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 3.5, 4.0-ALPHA
• Component/s: modules/analysis
• Assignee: Ryan McKinley
• Reporter: Olivier Favre
• Created: 04/May/11 16:10
• Updated: 28/Aug/22 12:45
• Resolved: 12/Nov/11 21:14

Description

PathHierarchyTokenizer should be usable to split urls the a "reversed" way (useful for faceted search against urls):
www.site.com -> www.site.com, site.com, com

Moreover, it should be able to skip a given number of first (or last, if reversed) tokens:
/usr/share/doc/somesoftware/INTERESTING/PART
Should give with 4 tokens skipped:
INTERESTING
INTERESTING/PART