[DRILL-4006] As json reader reads a field with empty lists, IOOB could happen

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Component/s: Storage - JSON
• Assignee: Sean Hsuan-Yi Chu
• Reporter: Sean Hsuan-Yi Chu
• Reviewer: Khurram Faraaz
• Created: 02/Nov/15 18:51
• Updated: 21/Mar/16 05:10
• Resolved: 05/Nov/15 06:01

Description

If a field in a json file has many empty lists before a non-empty list, there could be an IOOB exception.

Running the following query on the folder with files in the attachment can reproduce the observation:

select a from`folder`

Exception:
org.apache.drill.common.exceptions.UserRemoteException: DATA_READ ERROR: index: 4448, length: 4