Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-10653 Introduce Pluggable Shuffle Service Architecture
  3. FLINK-12555

Introduce an encapsulated metric group layout for shuffle API and deprecate old one

    XMLWordPrintableJSON

    Details

    • Release Note:
      Hide
      Several IO/network metrics have had their scope changed.

      These metrics will additionally still be available under their old scope in 1.9, but this may no longer be the case in later versions.

      See the 1.9 metrics documentation for which metrics are affected.
      Show
      Several IO/network metrics have had their scope changed. These metrics will additionally still be available under their old scope in 1.9, but this may no longer be the case in later versions. See the 1.9 metrics documentation for which metrics are affected.

      Description

      At the moment, partition/gate create methods in NetworkEnvironment have a lot of metrics arguments to maintain original layout for metric groups. This approach is not quite encapsulated and clean for shuffle API. We can have just one parent group for shuffle metrics. The old layout can be still maintained in parallel and deprecated. At the moment we can do it with a couple of casts (if shuffle implementation is NetworkEnvironment) and adding an additional legacy metric registration which can be removed later.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                azagrebin Andrey Zagrebin
                Reporter:
                azagrebin Andrey Zagrebin
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m