Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-10653 Introduce Pluggable Shuffle Service Architecture
  3. FLINK-12555

Introduce an encapsulated metric group layout for shuffle API and deprecate old one

Attach filesAttach ScreenshotVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Release Note:
      Hide
      Several IO/network metrics have had their scope changed.

      These metrics will additionally still be available under their old scope in 1.9, but this may no longer be the case in later versions.

      See the 1.9 metrics documentation for which metrics are affected.
      Show
      Several IO/network metrics have had their scope changed. These metrics will additionally still be available under their old scope in 1.9, but this may no longer be the case in later versions. See the 1.9 metrics documentation for which metrics are affected.

      Description

      At the moment, partition/gate create methods in NetworkEnvironment have a lot of metrics arguments to maintain original layout for metric groups. This approach is not quite encapsulated and clean for shuffle API. We can have just one parent group for shuffle metrics. The old layout can be still maintained in parallel and deprecated. At the moment we can do it with a couple of casts (if shuffle implementation is NetworkEnvironment) and adding an additional legacy metric registration which can be removed later.

        Attachments

          Activity

            People

            • Assignee:
              azagrebin Andrey Zagrebin
              Reporter:
              azagrebin Andrey Zagrebin

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20m
                20m

                  Issue deployment