Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-1370

Improve fragment staging

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • Future
    • Execution - Flow
    • None

    Description

      Drill optimistically executes all major fragments of a query. In some situations, this greedy behavior is too optimistic, which causes portions of the query to swamp the IO path too early, starving earlier phases of the query. Our RPC backpressure should help manage this. However, with a high level of parallelization, the back pressure is too lenient.

      Attachments

        1. DRILL-1370.patch
          14 kB
          Steven Phillips

        Activity

          People

            Unassigned Unassigned
            jnadeau Jacques Nadeau
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: