[SOLR-4412] LanguageIdentifier lcmap for language field

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.1
• Fix Version/s: 4.4, 6.0
• Component/s: contrib - LangId
• Assignee: Jan Høydahl
• Reporter: Jan Høydahl
• Created: 07/Feb/13 09:18
• Updated: 09/May/16 18:55
• Resolved: 02/Jul/13 14:56

Description

For some languages, the detector will detect sub-languages, such as LangDetect detecting zh-tw or zh-cn for Chinese. Tika detector only detects zh. Today you can use lcmap to map these two into one code, e.g. langid.map.lcmap=zh-cn:zh zh-tw:zh. But the langField output is not changed.

We need an option for langField as well.