Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-16755

[C++] Improve array expression and kernel evaluation performance on small inputs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • C
    • None

    Description

      This is an umbrella issue for a variety of follow-up Jiras to refactor and improve the array kernels / function machinery to have less overhead and work more efficiently for parallel processing as well as small inputs (down to ~1000 elements per kernel invocation)

      Attachments

        Issue Links

          is a parent of

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-16758 [C++] Rewrite ExecuteScalarExpression to not use ScalarExecutor

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-16756 [C++] Introduce initial ArraySpan, ExecSpan non-owning / shared_ptr-free data structures for kernel execution, refactor scalar kernels

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-16824 [C++] Migrate VectorKernel implementations to use ExecSpan, ArraySpan

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-16852 [C++] Migrate SCALAR_AGGREGATE, HASH_AGGREGATE functions to use ExecSpan

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-16929 [C++] Remove ExecBatchIterator and usages thereof

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue ARROW-16161 [C++] Overhead of std::shared_ptr<DataType> copies is causing thread contention

          • Major - Major loss of function.
          • Open

          Sub-task - The sub-task of the issue ARROW-16562 [C++] Avoid slicing array inputs in ExecBatchIterator that would result in one slice

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. ARROW-16837 [C++] Investigate performance regressions observed in Unique, VisitArraySpanInline

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. ARROW-16845 [C++] ArraySpan::IsNull/IsValid implementations are incorrect for union types

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-8898 [C++] Determine desirable maximum length for ExecBatch in pipelined and parallel execution of kernels

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-13121 [C++][Compute] Extract preallocation logic from KernelExecutor

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-16289 [C++] (eventually) abandon scalar columns of an ExecBatch in favor of RLE encoded arrays

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-16827 [C++] Refactor internal array sorting code to use ArraySpan

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-17129 [C++][Compute] Improve memory efficiency in Grouper

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-9285 [C++] Detect unauthorized memory allocations in function kernels

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-16757 [C++] Remove "scalar" output modality from array kernels

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-16819 [C++] arrow::compute::CallFunction needs a batch length for nullary functions

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. ARROW-10026 [C++] Improve kernel performance on small batches

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              wesm Wes McKinney
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: