[ARROW-10773] [R] parallel as.data.frame.Table hangs indefinitely on Windows

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 6.0.0
• Component/s: C++, R
• External issue URL: https://github.com/apache/arrow/issues/26715
• Assignee: Neal Richardson
• Reporter: Bruno Tremblay
• Created: 30/Nov/20 08:03
• Updated: 11/Jan/23 08:15
• Resolved: 29/Sep/21 18:45

Description

On Windows only

Tested on 2 machines, mingw. 

Reprex

install.packages("arrow", repos = "https://arrow-r-nightly.s3.amazonaws.com")
remotes::install_github("meztez/bigrquerystorage", INSTALL_opts = "--no-multiarch")

library(bigrquerystorage)
Sys.info()
sessionInfo()
Sys.setenv("BIGQUERY_TEST_PROJECT"="labo-brunotremblay-253317")
con <- bigrquery::dbConnect(
  bigrquery::bigquery(),
  project = "bigquery-public-data",
  dataset = "usa_names",
  billing = bigrquery:::bq_test_project(),
  quiet = FALSE)

# Does not hang
options(arrow.use_threads = FALSE)
dt <- bigrquerystorage::dbReadTable(con, "bigquery-public-data.usa_names.usa_1910_current")

# Hangs
options(arrow.use_threads = TRUE)
dt <- bigrquerystorage::dbReadTable(con, "bigquery-public-data.usa_names.usa_1910_current")

 

Session details

 

> Sys.info()
       sysname        release        version       nodename        machine          login           user effective_user 
     "Windows"       "10 x64"  "build 19042"   "C000055787"       "x86-64"     "gen01914"     "gen01914"     "gen01914" 
> sessionInfo()
R version 4.0.3 (2020-10-10)
Platform: x86_64-w64-mingw32/x64 (64-bit)
Running under: Windows 10 x64 (build 19042)

Matrix products: default

locale:
[1] LC_COLLATE=English_United States.1252  LC_CTYPE=English_United States.1252    LC_MONETARY=English_United States.1252
[4] LC_NUMERIC=C                           LC_TIME=English_United States.1252    

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base     other attached packages:
[1] bigrquery_1.3.2.9001

loaded via a namespace (and not attached):
 [1] Rcpp_1.0.5           rstudioapi_0.13      magrittr_1.5         tidyselect_1.1.0     bit_4.0.4            R6_2.5.0            
 [7] rlang_0.4.8          dplyr_1.0.2          httr_1.4.2           tools_4.0.3          arrow_2.0.0.20201130 DBI_1.1.0           
[13] dbplyr_2.0.0         ellipsis_0.3.1       remotes_2.2.0        bit64_4.0.5          assertthat_0.2.1     gargle_0.5.0        
[19] tibble_3.0.4         lifecycle_0.2.0      crayon_1.3.4         purrr_0.3.4          fs_1.5.0             vctrs_0.3.4         
[25] glue_1.4.2           compiler_4.0.3       pillar_1.4.6         generics_0.1.0       jsonlite_1.7.1       pkgconfig_2.0.3  

 

```

Issue Links

• relates to: ARROW-8379 [R] Investigate/fix thread safety issues (esp. Windows)