[HIVE-2722] GenericUDFUtils.findText use CharBuffer other than ByteBuffer will be better

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.8.0, 0.9.0
• Component/s: UDF
• Labels: udf

Environment

Linux zongren-VirtualBox 3.0.0-14-generic #23-Ubuntu SMP Mon Nov 21 20:34:47 UTC 2011 i686 i686 i386 GNU/Linux

java version "1.6.0_25"

hadoop-0.20.2-cdh3u0

hive-0.7.0-cdh3u0

• Hadoop Flags: Reviewed
• Release Note: change ByteBuffer to CharBuffer in GenericUDFUtil.findText
• Assignee: Mani M
• Reporter: caofangkun
• Created: 17/Jan/12 02:22
• Updated: 04/Feb/19 10:46
• Resolved: 04/Feb/19 10:46

Description

select instr("中文字符测试-第一行","-") from testTable limit 1;
result:19 (one Chinese Character was considered as 3 Unicode bits)

select substr("中文字符测试-第一行",1,2) from testTable limit 1;
result: "中文" (one Chinese Character was considered as 1 Unicode Unit )

instr should considered one chinese character as one Unicode Unit too.