Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-14106 Make SlotManager pluggable
  3. FLINK-16440

Extend SlotManager metrics and status for dynamic slot allocation.

    XMLWordPrintableJSON

    Details

      Description

      • Create a slotManagerMetricGroup in resourceManagerMetricGroup, pass it into SM and register slot related metrics there.
        • This allows registering different metrics for different SM implementation.
        • For backwards compatibility, the slotManagerMetricGroup should have the same path as the resourceManagerMetricGroup.
      • Extend ResourceOverview and TaskManagerInfo to contain TM total / free / allocated resources.
        • Need to add methods to SM for getting TM resource status.
        • For SlotManagerImpl,
          • The existing methods for getting number of registered / free slots need no changes.
          • TM resource status can be computed from TaskExecutorProcessSpec, slot profiles and number of free slots.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                xintongsong Xintong Song
                Reporter:
                xintongsong Xintong Song
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 10m
                  10m