Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-562

ExternalSortExec should aware of available memory of container

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: Physical Operator
    • Labels:
      None

      Description

      ExternalSortExec spills intermediate data into disks when the number of tuples exceeds some threshold. This way does not consider the available memory of container, and it cannot utilize available memory well.

      The objective of this issue is to improve ExternalSortExec to be aware of available memory and spill intermediate data into disks when the allocated memory is full.

        Activity

        Hide
        hyunsik Hyunsik Choi added a comment -

        In TAJO-36, ExternalSortExec was refactored to be work depending on a configured sort buffer size. I close this issue as 'Won't fix'.

        Show
        hyunsik Hyunsik Choi added a comment - In TAJO-36 , ExternalSortExec was refactored to be work depending on a configured sort buffer size. I close this issue as 'Won't fix'.

          People

          • Assignee:
            Unassigned
            Reporter:
            hyunsik Hyunsik Choi
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development