Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-10653 Introduce Pluggable Shuffle Service Architecture
  3. FLINK-12555

Introduce an encapsulated metric group layout for shuffle API and deprecate old one

    XMLWordPrintableJSON

Details

    • Hide
      Several IO/network metrics have had their scope changed.

      These metrics will additionally still be available under their old scope in 1.9, but this may no longer be the case in later versions.

      See the 1.9 metrics documentation for which metrics are affected.
      Show
      Several IO/network metrics have had their scope changed. These metrics will additionally still be available under their old scope in 1.9, but this may no longer be the case in later versions. See the 1.9 metrics documentation for which metrics are affected.

    Description

      At the moment, partition/gate create methods in NetworkEnvironment have a lot of metrics arguments to maintain original layout for metric groups. This approach is not quite encapsulated and clean for shuffle API. We can have just one parent group for shuffle metrics. The old layout can be still maintained in parallel and deprecated. At the moment we can do it with a couple of casts (if shuffle implementation is NetworkEnvironment) and adding an additional legacy metric registration which can be removed later.

      Attachments

        Issue Links

          Activity

            People

              azagrebin Andrey Zagrebin
              azagrebin Andrey Zagrebin
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m