Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-29132

SubtaskMetricStore causes memory leak.

    XMLWordPrintableJSON

Details

    Description

      In FLINK-28588, MetricStore supports multiple attempts of a subtask. However, `SubtaskMetricStore` doesn't have a clean mechanism.  In failover scenario, `attempts` pile up and cause OOM.

      Attachments

        1. image-2022-08-30-11-56-34-608.png
          0.3 kB
          Yue Ma
        2. image-2022-08-30-11-57-59-325.png
          0.3 kB
          Yue Ma
        3. dump-metricStore.png
          400 kB
          Sitan Pang
        4. dump-attempts.png
          578 kB
          Sitan Pang

        Issue Links

          is caused by

          Sub-task - The sub-task of the issue FLINK-28588 Enhance REST API for Speculative Execution

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #20733

          Activity

            People

              pltbkd Gen Luo
              nagist Sitan Pang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: