[DRILL-2071] Better documentation for JSON reader all_text_mode option

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.7.0
• Component/s: Documentation
• Assignee: Kris Hahn
• Reporter: Jason Altekruse
• Created: 26/Jan/15 19:00
• Updated: 11/Sep/15 18:35
• Resolved: 01/Mar/15 20:21

Description

Currently Drill will fail by default to read JSON files with changes in schema, or with several different data types in a list. These files can however be read if the store.json.all_text_mode option is set to true. This option will read all data from the JSON files as varchar and from here the data can be casted to an appropriate type (or filtered out in the case where a cast to numeric is desired but some of the data in the column is a string or boolean type). This is only mentioned on the wiki in this page, but does not really describe all of the use cases of the feature. https://cwiki.apache.org/confluence/display/DRILL/Analyzing+Yelp+JSON+Data+with+Apache+Drill