Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-9464 [Rust] [DataFusion] Physical plan refactor to support optimization rules and more efficient use of threads
  3. ARROW-9708

[Rust] [DataFusion] Remove use of threads and channels from ParquetScanExec

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Invalid
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Rust, Rust - DataFusion
    • Labels:
      None

      Description

      At the time I implemented the parquet scan exec I thought it was necessary to run in a thread and use channels to communicate but this can be avoided in conjunction with other changes in the parent issue.

        Attachments

          Activity

            People

            • Assignee:
              andygrove Andy Grove
              Reporter:
              andygrove Andy Grove
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: