[DRILL-2062] Drill only appears to work with small compressed JSON

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0
• Fix Version/s: 0.8.0
• Component/s: Storage - JSON
• Assignee: Jason Altekruse
• Reporter: Paul Pearcy
• Created: 23/Jan/15 19:10
• Updated: 07/May/15 23:43
• Resolved: 28/Jan/15 02:25

Description

Before DRILL-1871 things wouldn't work at all. Now, things fail part way through the file. Attached a sample to reproduce.

Do a simple select all from this file:
select * from dfs.`/opt/drill/data/rawgzjson/browserlog`;

Ends up giving this exception in logs:

org.apache.drill.common.exceptions.DrillRuntimeException: Error parsing JSON. - Parser was at record: 1 column: 8
at org.apache.drill.exec.store.easy.json.JSONRecordReader.handleAndRaise(JSONRecordReader.java:101) ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.store.easy.json.JSONRecordReader.next(JSONRecordReader.java:148) ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
gunzip the file and the whole contents can be queried via select *