Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-11791

[Rust][DataFusion] RepartitionExec Blocking

    XMLWordPrintableJSON

    Details

      Description

      After https://github.com/apache/arrow/pull/9523 RepartitionExec is pulling all data into memory before starting the stream which crashes on large sets.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                MikeSeddonAU Mike Seddon
                Reporter:
                MikeSeddonAU Mike Seddon
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 10m
                  1h 10m