Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-14187

FLIP-56 Dynamic Slot Allocation

    XMLWordPrintableJSON

Details

    Description

      This is the umbrella issue for 'FLIP-56: Dynamic Slot Allocation'.

      Attachments

        Issue Links

          contains

          Sub-task - The sub-task of the issue FLINK-12766 Dynamically allocate TaskExecutor’s managed memory to slots.

          • Major - Major loss of function.
          • Closed
          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-14106 Make SlotManager pluggable

          • Major - Major loss of function.
          • Closed
          is duplicated by

          New Feature - A new feature of the product, which has yet to be developed. FLINK-10640 Enable Slot Resource Profile for Resource Management

          • Major - Major loss of function.
          • Closed
          links to

          Web Link FLIP-56: Dynamic Slot Allocation

          mentioned in

          Page Loading...

          1.
          		 TaskExecutor derive and register with default slot resource profile Sub-task Closed Xintong Song
          2.
          		 Extend TaskExecutor to support dynamic slot allocation Sub-task Closed Xintong Song
          3.
          		 Extend SlotManager to support dynamic slot allocation on registered TaskExecutors. Sub-task Closed Unassigned  
          4.
          		 Extend SlotManager to support dynamic slot allocation on pending task executors Sub-task Closed Unassigned  
          5.
          		 Enable the dynamic slot allocation feature. Sub-task Closed Unassigned  
          6.
          		 Refactor dynamic SlotID Sub-task Closed Yangze Guo  
          7.
          		 Register TaskManager with total and default slot resource profile in SlotManager Sub-task Closed Yangze Guo  
          8.
          		 Apply exact matching rules in fulfilling resource requirement with slot resource Sub-task Closed Yangze Guo  
          9.
          		 Implement FineGrainedSlotManager Sub-task Closed Yangze Guo  
          10.
          		 Unset process/flink memory size from configuration once dynamic worker resource is activated. Sub-task Closed Xintong Song  
          11.
          		 Force an extended resource to be null if it's value is 0 Sub-task Closed Xintong Song  
          12.
          		 Default slot resource is calculated inconsistently for pending / registered TMs Sub-task Closed Xintong Song  
          13.
          		 Provide read-only interface of TaskManagerTracker to ResourceAllocationStrategy Sub-task Closed Yangze Guo  
          14.
          		 Reduce frequency of global re-allocate resources Sub-task Closed Yangze Guo  
          15.
          		 Index pending task managers in TaskManagerTracker Sub-task Closed Yangze Guo  
          16.
          		 Introduce the counterpart of slotmanager.number-of-slots.max in fine-grained resource management Sub-task Closed Xintong Song  
          17.
          		 Respect external resources from resource requirements Sub-task Closed Yangze Guo  

          Activity

            People

              xtsong Xintong Song
              xtsong Xintong Song
              Votes:
              0 Vote for this issue
              Watchers:
              22 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m