Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-31557

Metric viewUpdater and reporter task in a SingleThreadScheduledExecutor lead to inaccurate PerSecond related metrics

    XMLWordPrintableJSON

Details

    Description

      Currently, metric viewUpdater and reporterTask share the same SingleThreadScheduledExecutor, and customized reporters may have unpredictable logic, such as unreasonable network timeout settings, which can affect viewUpdater's calculation of PerSecond related metrics. For example, a real online problem we encountered, the network timeout of the reporter is set to 10 seconds, and the reporting interval is 15 seconds. When the server is unavailable, the thread is blocked for 10s, resulting in 66.7% (5/3x) higher PerSecond related metrics.

      Is it possible to optimize here, such as whether it can be changed to a ScheduledThreadPool executor?

      Attachments

        Issue Links

          Activity

            People

              huwh !huwh
              LiuZeshan LiuZeshan
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: