Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-12395

[C++]: Create RunInSerialExecutor benchmark

    XMLWordPrintableJSON

Details

    Description

      It should be pretty comparable to the other task schedulers.  I've drafted something already and it seems to be somewhere between the spawn/serial task group benchmarks (which are pretty optimized) and the submit benchmark (which is pretty slow)

       

      Example output

      -----------------------------------------------------------------------------------------------------------------
      Benchmark                                                       Time             CPU   Iterations UserCounters...
      -----------------------------------------------------------------------------------------------------------------
      ReferenceWorkloadCost/task_cost:1000/real_time                693 ns          692 ns       940807 items_per_second=1.4437M/s
      ReferenceWorkloadCost/task_cost:10000/real_time              6930 ns         6929 ns        95882 items_per_second=144.297k/s
      ReferenceWorkloadCost/task_cost:100000/real_time            69740 ns        69724 ns         9719 items_per_second=14.3391k/s
      SerialTaskGroup/task_cost:1000/real_time                  6969856 ns      6968315 ns          105 items_per_second=1.43489M/s
      SerialTaskGroup/task_cost:10000/real_time                 6510709 ns      6509131 ns           96 items_per_second=153.747k/s
      SerialTaskGroup/task_cost:100000/real_time                6599298 ns      6597857 ns           95 items_per_second=15.3047k/s
      RunInSerialExecutor/task_cost:1000/real_time                 1221 ns         1221 ns       563428 items_per_second=818.804k/s
      RunInSerialExecutor/task_cost:10000/real_time                7768 ns         7766 ns        88250 items_per_second=128.735k/s
      RunInSerialExecutor/task_cost:100000/real_time              72916 ns        72898 ns         9395 items_per_second=13.7145k/s
      ThreadPoolSpawn/threads:1/task_cost:1000/real_time      199102152 ns     78682656 ns            4 items_per_second=1004.51k/s
      ThreadPoolSpawn/threads:1/task_cost:10000/real_time     148326220 ns      5915479 ns            5 items_per_second=134.845k/s
      ThreadPoolSpawn/threads:1/task_cost:100000/real_time    144870312 ns       805224 ns            5 items_per_second=13.8124k/s
      ThreadedTaskGroup/threads:1/task_cost:1000/real_time      9177560 ns        18874 ns           73 items_per_second=1089.72k/s
      ThreadedTaskGroup/threads:1/task_cost:10000/real_time     6899864 ns        21636 ns           90 items_per_second=145.075k/s
      ThreadedTaskGroup/threads:1/task_cost:100000/real_time    7307121 ns        24868 ns           95 items_per_second=13.8221k/s
      ThreadPoolSubmit/threads:1/task_cost:1000/real_time      33442213 ns     21155761 ns           20 items_per_second=299.053k/s
      ThreadPoolSubmit/threads:1/task_cost:10000/real_time     11966838 ns      1763623 ns           56 items_per_second=83.6478k/s
      ThreadPoolSubmit/threads:1/task_cost:100000/real_time    10652720 ns       244028 ns           59 items_per_second=9.48115k/s
      
      

       

       

      Attachments

        Issue Links

          Activity

            People

              westonpace Weston Pace
              westonpace Weston Pace
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m