[DRILL-5769] IndexOutOfBoundsException when querying JSON files

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.10.0
• Fix Version/s: Future
• Component/s: Server, Storage - JSON

Environment

jdk_8u45_x64

single drillbit running on zookeeper

Following options set to TRUE:
drill.exec.functions.cast_empty_string_to_null
store.json.all_text_mode
store.parquet.enable_dictionary_encoding
store.parquet.use_new_reader

• Assignee: Jinfeng Ni
• Reporter: David Lee
• Created: 05/Sep/17 23:14
• Updated: 24/Jan/20 21:22

Description

*Running the following SQL on these three JSON files fail: *
001.json 100.json 111.json

select t.id
from dfs.`/tmp/???.json` t
where t.assetData.debt.couponPaymentFeature.interestBasis = '5'

Error:
org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: IndexOutOfBoundsException: index: 1024, length: 1 (expected: range(0, 1024)) Fragment 0:0 [Error Id: xxxx.xxxx...

However running the same SQL on two out of three files works:

select t.id
from dfs.`/tmp/1??.json` t
where t.assetData.debt.couponPaymentFeature.interestBasis = '5'

select t.id
from dfs.`/tmp/?1?.json` t
where t.assetData.debt.couponPaymentFeature.interestBasis = '5'

select t.id
from dfs.`/tmp/??1.json` t
where t.assetData.debt.couponPaymentFeature.interestBasis = '5'

Changing the selected column from t.id to t. also works: *

select *
from dfs.`/tmp/???.json` t
where t.assetData.debt.couponPaymentFeature.interestBasis = '5'