Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Implemented
-
None
-
None
-
centos 7.3, Anaconda 4.4.0 python 3.6.1
Description
While trying to read a parquetfile (written by nifi) I am getting an error.
code:
import pyarrow.parquet as pq
t = pq.read_table('test.parq')
error:
Traceback (most recent call last):
File "parquet_reader.py", line 2, in <module>
t = pq.read_table('test.parq')
File "/opt/anaconda3/lib/python3.6/site-packages/pyarrow/parquet.py", line 823, in read_table
use_pandas_metadata=use_pandas_metadata)
File "/opt/anaconda3/lib/python3.6/site-packages/pyarrow/parquet.py", line 119, in read
nthreads=nthreads)
File "pyarrow/_parquet.pyx", line 466, in pyarrow._parquet.ParquetReader.read_all (/arrow/python/build/temp.linux-x86_64-3.6/_parquet.cxx:9181)
File "pyarrow/error.pxi", line 85, in pyarrow.lib.check_status (/arrow/python/build/temp.linux-x86_64-3.6/lib.cxx:8115)
pyarrow.lib.ArrowNotImplementedError: No support for reading columns of type list<array: string not null>