Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-33856

Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

    XMLWordPrintableJSON

Details

    Description

      When Flink makes a checkpoint, the interaction performance with the external file system has a great impact on the overall time-consuming. Therefore, it is easy to observe the bottleneck point by adding performance indicators when the task interacts with the external file storage system. These include: the rate of file write , the latency to write the file, the latency to close the file.

      In flink side add the above metrics has the following advantages: convenient statistical different task E2E time-consuming; do not need to distinguish the type of external storage system, can be unified in the FsCheckpointStreamFactory.

      Attachments

        Issue Links

          Activity

            People

              hejufang001 Jufang He
              hejufang001 Jufang He
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated: