Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-13038

[Dev] r_valgrind image doesn't use full parallelism

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Developer Tools, R
    • Labels:
      None

      Description

      I have a 12-core 24-thread CPU,  but the ubuntu_r_valgrind Docker image only seems to be using 4 threads when I build Arrow:

           35 pts/0    S+     0:00 /bin/sh /usr/local/RDvalgrind/lib/R/bin/INSTALL /arrow/r
           39 pts/0    S+     0:00  \_ /usr/local/RDvalgrind/lib/R/bin/exec/R --no-save --no-restore --no-restore --no-echo --args nextArg/arrow/r
           55 pts/0    S+     0:00      \_ sh -c _R_SHLIB_BUILD_OBJECTS_SYMBOL_TABLES_=false  ./configure 
           56 pts/0    S+     0:00          \_ /bin/sh ./configure
           86 pts/0    S+     0:00              \_ /usr/local/RDvalgrind/lib/R/bin/exec/R --no-save --no-restore --no-echo --no-restore --file=tools/nixlibs.R --args 4.0.1.900
          205 pts/0    S+     0:00                  \_ sh -c SOURCE_DIR="../cpp" BUILD_DIR="/tmp/Rtmpz9DiSI/file561e1b1cec" DEST_DIR="libarrow/arrow-4.0.1.9000" CMAKE="/tmp/Rt
          206 pts/0    S+     0:00                      \_ /bin/bash inst/build_arrow_static.sh
          388 pts/0    S+     0:00                          \_ /tmp/Rtmpz9DiSI/file565b17078b/cmake-3.19.2-Linux-x86_64/bin/cmake --build . --target install
          389 pts/0    S+     0:00                              \_ /bin/make install
          392 pts/0    S+     0:00                                  \_ make -s -f CMakeFiles/Makefile2 all
         2571 pts/0    S+     0:00                                      \_ make -s -f src/arrow/CMakeFiles/arrow_objlib.dir/build.make src/arrow/CMakeFiles/arrow_objlib.dir/bu
         2622 pts/0    S+     0:00                                          \_ /bin/sh -c cd /tmp/Rtmpz9DiSI/file561e1b1cec/src/arrow && /bin/g++  -std=gnu++11 -DARROW_EXPORTI
         2623 pts/0    S+     0:00                                          |   \_ /bin/g++ -std=gnu++11 -DARROW_EXPORTING -DARROW_HAVE_RUNTIME_AVX2 -DARROW_HAVE_RUNTIME_BMI2 
         2624 pts/0    R+     0:28                                          |       \_ /usr/lib/gcc/x86_64-linux-gnu/10/cc1plus -quiet -I /tmp/Rtmpz9DiSI/file561e1b1cec/src -I
         2628 pts/0    S+     0:00                                          \_ /bin/sh -c cd /tmp/Rtmpz9DiSI/file561e1b1cec/src/arrow && /bin/g++  -std=gnu++11 -DARROW_EXPORTI
         2629 pts/0    S+     0:00                                          |   \_ /bin/g++ -std=gnu++11 -DARROW_EXPORTING -DARROW_HAVE_RUNTIME_AVX2 -DARROW_HAVE_RUNTIME_BMI2 
         2646 pts/0    R+     0:00                                          |       \_ as -I /tmp/Rtmpz9DiSI/file561e1b1cec/src -I /arrow/cpp/src -I /arrow/cpp/src/generated -
         2635 pts/0    S+     0:00                                          \_ /bin/sh -c cd /tmp/Rtmpz9DiSI/file561e1b1cec/src/arrow && /bin/g++  -std=gnu++11 -DARROW_EXPORTI
         2636 pts/0    S+     0:00                                          |   \_ /bin/g++ -std=gnu++11 -DARROW_EXPORTING -DARROW_HAVE_RUNTIME_AVX2 -DARROW_HAVE_RUNTIME_BMI2 
         2637 pts/0    R+     0:07                                          |       \_ /usr/lib/gcc/x86_64-linux-gnu/10/cc1plus -quiet -I /tmp/Rtmpz9DiSI/file561e1b1cec/src -I
         2642 pts/0    S+     0:00                                          \_ /bin/sh -c cd /tmp/Rtmpz9DiSI/file561e1b1cec/src/arrow && /bin/g++  -std=gnu++11 -DARROW_EXPORTI
         2643 pts/0    S+     0:00                                              \_ /bin/g++ -std=gnu++11 -DARROW_EXPORTING -DARROW_HAVE_RUNTIME_AVX2 -DARROW_HAVE_RUNTIME_BMI2 
         2644 pts/0    R+     0:02                                                  \_ /usr/lib/gcc/x86_64-linux-gnu/10/cc1plus -quiet -I /tmp/Rtmpz9DiSI/file561e1b1cec/src -I
      

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              apitrou Antoine Pitrou
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: