[DRILL-8486] ParquetDecodingException: could not read bytes at offset

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.21.1
• Fix Version/s: 1.21.2
• Component/s: Storage - Parquet
• Assignee: Maksym Rymar
• Reporter: Maksym Rymar
• Created: 28/Mar/24 18:24
• Updated: 14/Apr/24 11:31
• Resolved: 14/Apr/24 11:31

Description

Drill fails to read a parquet file with the following exception:

 

Caused by: org.apache.parquet.io.ParquetDecodingException: could not read bytes at offset 591804
	at org.apache.parquet.column.values.plain.BinaryPlainValuesReader.readBytes(BinaryPlainValuesReader.java:42)
	at org.apache.drill.exec.store.parquet.columnreaders.VarLenColumnBulkInput$ValuesReaderWrapper.getNextEntry(VarLenColumnBulkInput.java:754)
	... 43 common frames omitted
Caused by: java.io.EOFException: null
	at org.apache.parquet.bytes.SingleBufferInputStream.read(SingleBufferInputStream.java:52)
	at org.apache.parquet.bytes.BytesUtils.readIntLittleEndian(BytesUtils.java:83)
	at org.apache.parquet.column.values.plain.BinaryPlainValuesReader.readBytes(BinaryPlainValuesReader.java:39)
	... 44 common frames omitted 

 

 

This issue only affects queries with store.parquet.flat.reader.bulk set to true(by default).

Attaching the parquet file for the reproduce: test.parquet.

Query: select log, app_name from dfs.tmp.`test.parquet`