Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-13418

Avoid InfluxdbReporter to report unnecessary tags

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 1.11.0
    • Component/s: Runtime / Metrics
    • Labels:
      None

      Description

      Currently, when building measurement info within InfluxdbReporter, it would involve all variables as tags (please see code here). However, user could adjust their own scope format to abort unnecessary scope, while InfluxdbReporter could report all the scopes as tags to InfluxDB.

      This is due to current MetricGroup lacks of any method to get necessary scopes but only #getScopeComponents() or #getAllVariables(). In other words, InfluxDB need tag-key and tag-value to compose as its tags while we could only get all variables (without any filter acording to scope format) or only scopeComponents (could be treated as tag-value). I think that's why previous implementation have to report all tags.

      From our experience on InfluxDB, as the size of tags contribute to the overall series in InfluxDB, it would never be a good idea to contain too many tags, not to mention the default value of series per database is only one million.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                yunta Yun Tang
              • Votes:
                1 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated: