[DRILL-6717] lower and upper functions not works with national charactes

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.14.0
• Fix Version/s: 1.15.0
• Labels: ready-to-commit
• Assignee: Oleg Zinoviev
• Reporter: Oleg Zinoviev
• Reviewer: Paul Rogers
• Created: 28/Aug/18 17:28
• Updated: 10/Nov/18 05:32
• Resolved: 10/Nov/18 05:32

Description

upper() and lower() functions works only with a ascii characters.

sample dataset: sample.json
query:

select 
  upper(ascii_l) as upper_ascii, 
  upper(national_l) as upper_national, 
  lower(ascii_u) as lower_ascii, 
  lower(national_u) as lower_national 
from dfs.`sample.json`

drill response: result.csv

Issue Links

• duplicates: DRILL-3226 Upper and lower casing doesn't work correctly on non-ASCII characters
• is part of: DRILL-5477 String functions (lower, upper, initcap) should work for UTF-8
• links to: GitHub Pull Request #1450