Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8302

Data stream senders should buffer limited amount of data when receivers block

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 3.2.0
    • None
    • Backend, Distributed Exec
    • None
    • ghx-label-6

    Description

      Exchanges into blocking nodes (e.g. sort nodes during run formation) can block the whole execution if a single node blocks. Data stream senders should buffer a limited amount of data to allow more sort nodes to start sorting their data. Possible options would be a fixed amount of buffer size, or a size relative to the sort node run size.

      Attachments

        Issue Links

          is duplicated by

          Sub-task - The sub-task of the issue IMPALA-6692 When partition exchange is followed by sort each sort node becomes a synchronization point across the cluster

          • Critical - Crashes, loss of data, severe memory leak.
          • Reopened

          Activity

            People

              Unassigned Unassigned
              lv Lars Volker
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: