[TIKA-3200] wrong language ("tr" instead of "ru") is assigned for recognized charset "windows-1251"

• Type: Bug
• Status: Open
• Priority: Trivial
• Resolution: Unresolved
• Component/s: parser
• Flags: Patch
• Assignee: Unassigned
• Reporter: Alexey Lukashov
• Created: 19/Sep/20 15:54
• Updated: 22/Sep/20 03:36

Description

CharsetDetector is detecting windows_1251 using detector  org.apache.tika.parser.txt.CharsetRecog_windows_1251

 

This detector is creating CharsetMatch with language "tr", but should be "ru".

 

static class CharsetRecog_windows_1251 extends CharsetRecog_sbcs {
 
  ...

  public String getLanguage() {
    return "ru";
  }

  public CharsetMatch match(CharsetDetector det) {
  int confidence = match(det, ngrams, byteMap);
    return confidence == 0 ? null : new CharsetMatch(det, this, confidence, getName(),   "tr");
  }
}