Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-12254

[Rust][DataFusion] Limit keeps polling input after limit is reached

    XMLWordPrintableJSON

Details

    Description

      Once the number of rows needed for a limit query has been produced, any further work done to read values from its input is wasted.

      The current implementation of LimitStream will keep polling its input for the next value, and returning Poll::Ready(None) , even once the limit has been reached

      This is wasteful

      Attachments

        Issue Links

          Activity

            People

              alamb Andrew Lamb
              alamb Andrew Lamb
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 4h
                  4h