[DRILL-5772] Enable UTF-8 support in query string by default

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.11.0
• Fix Version/s: 1.12.0
• Labels: doc-impacting ready-to-commit
• Assignee: Arina Ielchiieva
• Reporter: Arina Ielchiieva
• Reviewer: Paul Rogers
• Created: 07/Sep/17 13:56
• Updated: 29/Dec/17 10:44
• Resolved: 30/Oct/17 20:01

Description

Now saffron.propertries file will be added into Drill conf directory which will define default encoding used to parse query string.
Content:

saffron.default.charset=UTF-16LE
saffron.default.nationalcharset=UTF-16LE
saffron.default.collation.name=UTF-16LE$en_US 

Another option to override saffron properties is to set them as system options. This will take higher priority then saffron.properties file.
Add to drill-env.sh:

DRILL_JAVA_OPTS="$DRILL_JAVA_OPTS -Dsaffron.default.charset=ISO-8859-1 -Dsaffron.default.nationalcharset=ISO-8859-1 -Dsaffron.default.collation.name=ISO-8859-1\$en_US"

NB!: the symbols $en_US must be preceded by \ character if one inserts the properties' row to drill-env.sh file, otherwise drill will stuck -> -Dsaffron.default.collation.name=ISO-8859-1\$en_US

This information should be also documented, probably in https://drill.apache.org/docs/data-type-conversion/.

Issue Links

• links to: GitHub Pull Request #936