Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
6.0.1
Description
`read_parquet` returns error `NotImplemented: Support for codec 'snappy' not built`:
> library(arrow) See arrow_info() for available features Attaching package: ‘arrow’ The following object is masked from ‘package:utils’: timestamp > read_parquet("data.parquet") Error: NotImplemented: Support for codec 'snappy' not built In order to read this file, you will need to reinstall arrow with additional features enabled. Set one of these environment variables before installing: * LIBARROW_MINIMAL=false (for all optional features, including 'snappy') * ARROW_WITH_SNAPPY=ON (for just 'snappy') See https://arrow.apache.org/docs/r/articles/install.html for details
Package info:
> arrow_info() Arrow package version: 6.0.1 Capabilities: dataset TRUE parquet TRUE json TRUE s3 FALSE utf8proc TRUE re2 TRUE snappy FALSE gzip FALSE brotli FALSE zstd FALSE lz4 FALSE lz4_frame FALSE lzo FALSE bz2 FALSE jemalloc FALSE mimalloc FALSE To reinstall with more optional capabilities enabled, see https://arrow.apache.org/docs/r/articles/install.html Memory: Allocator system Current 0 bytes Max 0 bytes Runtime: SIMD Level avx512 Detected SIMD Level avx512 Build: C++ Library Version 6.0.1 C++ Compiler GNU C++ Compiler Version 11.1.0
Build log:
> install.packages("arrow") Installing package into ‘/home/gkobeaga/R/x86_64-pc-linux-gnu-library/4.1’ trying URL 'https://ftp.cixug.es/CRAN/src/contrib/arrow_6.0.1.tar.gz' Content type 'application/x-gzip' length 4774511 bytes (4.6 MB) ================================================== downloaded 4.6 MB * installing *source* package ‘arrow’ ... ** package ‘arrow’ successfully unpacked and MD5 sums checked ** using staged installation *** Found local C++ source: 'tools/cpp' *** Building C++ libraries **** arrow PKG_CFLAGS=-I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/libarrow/arrow-6.0.1/include -DARR OW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_JSON PKG_LIBS=-L/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/libarrow/arrow-6.0.1/lib -larrow_data set -lparquet -larrow -larrow -larrow_bundled_dependencies -larrow_dataset -lparquet ** libs g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c RTasks.cpp -o RTasks.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c altrep.cpp -o altrep.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c array.cpp -o array.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c array_to_vector.cpp -o array_to_vector.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c arraydata.cpp -o arraydata.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c arrowExports.cpp -o arrowExports.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c buffer.cpp -o buffer.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c chunkedarray.cpp -o chunkedarray.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c compression.cpp -o compression.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c compute-exec.cpp -o compute-exec.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c compute.cpp -o compute.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c config.cpp -o config.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c csv.cpp -o csv.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c dataset.cpp -o dataset.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c datatype.cpp -o datatype.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c expression.cpp -o expression.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c feather.cpp -o feather.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c field.cpp -o field.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c filesystem.cpp -o filesystem.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c imports.cpp -o imports.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c io.cpp -o io.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c json.cpp -o json.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c memorypool.cpp -o memorypool.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c message.cpp -o message.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c parquet.cpp -o parquet.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c py-to-r.cpp -o py-to-r.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c r_to_arrow.cpp -o r_to_arrow.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c recordbatch.cpp -o recordbatch.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c recordbatchreader.cpp -o recordbatchreader.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c recordbatchwriter.cpp -o recordbatchwriter.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c scalar.cpp -o scalar.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c schema.cpp -o schema.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c symbols.cpp -o symbols.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c table.cpp -o table.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c threadpool.cpp -o threadpool.o g++ -std=gnu++11 -I"/usr/include/R/" -DNDEBUG -I/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arrow/ libarrow/arrow-6.0.1/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATA SET -DARROW_R_WITH_JSON -I../inst/include/ -D_FORTIFY_SOURCE=2 -fpic -march=x86-64 -mtune =generic -O2 -pipe -fno-plt -c type_infer.cpp -o type_infer.o g++ -std=gnu++11 -shared -L/usr/lib64/R/lib -Wl,-O1,--sort-common,--as-needed,-z,relro,-z,now -o arrow.so RTasks.o altrep.o array.o array_to_vector.o arraydata.o arrowExports.o buffer.o chunkedarray.o compression.o compute-exec.o compute.o config.o csv.o dataset.o datatype.o exp ression.o feather.o field.o filesystem.o imports.o io.o json.o memorypool.o message.o parquet .o py-to-r.o r_to_arrow.o recordbatch.o recordbatchreader.o recordbatchwriter.o scalar.o sche ma.o symbols.o table.o threadpool.o type_infer.o -L/tmp/Rtmp8RvB3e/R.INSTALL18bab269ad532/arr ow/libarrow/arrow-6.0.1/lib -larrow_dataset -lparquet -larrow -larrow -larrow_bundled_depende ncies -larrow_dataset -lparquet -L/usr/lib64/R/lib -lR installing to /home/gkobeaga/R/x86_64-pc-linux-gnu-library/4.1/00LOCK-arrow/00new/arrow/libs ** R ** inst ** byte-compile and prepare package for lazy loading ** help *** installing help indices ** building package indices ** installing vignettes ** testing if installed package can be loaded from temporary location ** checking absolute paths in shared objects and dynamic libraries ** testing if installed package can be loaded from final location ** testing if installed package keeps a record of temporary installation path * DONE (arrow) The downloaded source packages are in ‘/tmp/RtmpeuZcdE/downloaded_packages’
Attachments
Issue Links
- links to