[PARQUET-1122] [C++] Support 2-level list encoding in Arrow decoding

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Implemented
• Fix Version/s: cpp-4.0.0
• Component/s: parquet-cpp

Environment

centos 7.3, Anaconda 4.4.0 python 3.6.1

• Assignee: Unassigned
• Reporter: Luke Higgins
• Created: 05/Oct/17 15:06
• Updated: 03/Apr/21 03:40
• Resolved: 03/Apr/21 03:40

Description

While trying to read a parquetfile (written by nifi) I am getting an error.

code:

import pyarrow.parquet as pq
t = pq.read_table('test.parq')

error:
Traceback (most recent call last):
File "parquet_reader.py", line 2, in <module>
t = pq.read_table('test.parq')
File "/opt/anaconda3/lib/python3.6/site-packages/pyarrow/parquet.py", line 823, in read_table
use_pandas_metadata=use_pandas_metadata)
File "/opt/anaconda3/lib/python3.6/site-packages/pyarrow/parquet.py", line 119, in read
nthreads=nthreads)
File "pyarrow/_parquet.pyx", line 466, in pyarrow._parquet.ParquetReader.read_all (/arrow/python/build/temp.linux-x86_64-3.6/_parquet.cxx:9181)
File "pyarrow/error.pxi", line 85, in pyarrow.lib.check_status (/arrow/python/build/temp.linux-x86_64-3.6/lib.cxx:8115)
pyarrow.lib.ArrowNotImplementedError: No support for reading columns of type list<array: string not null>