Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
Description
Collecting from `sparklyr` decimal types through:
devtools::install_github("apache/arrow", subdir = "r") devtools::install_github("rstudio/sparklyr", ref = "feature/arrow") library(sparklyr) library(arrow) sc <- spark_connect(master = "local") sdf_len(sc, 3) %>% dplyr::mutate(new = 1) %>% dplyr::collect()
causes,
Error in RecordBatch__to_dataframe(x) : cannot handle Array of type decimal