[LUCENE-4310] NormalizeCharMap.build creates utf32-keyed automaton and uses it with utf16 keys

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0, 6.0
• Lucene Fields: New
• Assignee: Michael McCandless
• Reporter: Dawid Weiss
• Created: 17/Aug/12 11:34
• Updated: 28/Aug/22 13:24
• Resolved: 17/Aug/12 18:19

Description

NormalizeCharMap#build method is inconsistent with later use in MappingCharFilter

        final org.apache.lucene.util.fst.Builder<CharsRef> builder = new org.apache.lucene.util.fst.Builder<CharsRef>(FST.INPUT_TYPE.BYTE2, outputs);
        final IntsRef scratch = new IntsRef();
        for(Map.Entry<String,String> ent : pendingPairs.entrySet()) {
          builder.add(Util.toUTF32(ent.getKey(), scratch),
                      new CharsRef(ent.getValue()));

(note BYTE2 vs. toUTF32 later on).