Uploaded image for project: 'Mesos'
  1. Mesos
  2. MESOS-7390

Evaluate and optimize sorter performance

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: allocation
    • Labels:

      Description

      After the introduction of hierarchical roles, the sorter will re-sort the entire role tree whenever the sort order might have changed. There are a number of ways in which this might be optimized. For example:

      1. When the allocation of a single client is changed, we can update that client's position in the sort order incrementally (via binary search + vector erase/insert), rather than re-sorting the entire tree.
      2. When the share of a part of the tree changes (e.g., weight), we can avoid re-sorting or re-calculating the share of tree nodes in an unrelated part of the tree.

      Before making either of these changes, we should do some experimental work to better understand the current bottlenecks in sorter/allocator performance for real-world workloads.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                neilc Neil Conway
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: