Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3569

Improve buffer handling in PipelinedSorter after encountering initial spill condition

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      With large number of buffers, there is a possibility that these buffers are not used effecitively and could end up spilling more often (after encountering first spill condition). Will debug more and share more details here.

      Attachments

        1. TEZ-3569.1.patch
          2 kB
          Rajesh Balamohan

        Activity

          People

            Unassigned Unassigned
            rajesh.balamohan Rajesh Balamohan
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: