Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-13732

Enhance JobManagerMetricGroup with FLIP-6 architecture

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Runtime / Metrics
    • Labels:
      None

      Description

      There is a requirement from user mailing list [1]. I think it's reasonable enough to support.

      The scenario is that when deploying a Flink cluster on Yarn, there might be several JM(RM) s running on the same host. IMO that's quite a general scenario. However we can't distinguish the metrics from different JobManagerMetricGroup, because there is only one variable "hostname" we can use.

      I think there are some problems of current implementation of JobManagerMetricGroup. It's still non-FLIP-6 style. We should split the metric group into RM and Dispatcher to match the FLIP-6 architecture. And there should be an identification variable supported, just like tm_id.

      CC [~StephanEwen], [~till.rohrmann], [~Zentol]

      1. http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-metrics-scope-for-YARN-single-job-td29389.html

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                SleePy Biao Liu
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: