Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-31685

Checkpoint job folder not deleted after job is cancelled

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.16.1
    • None
    • Runtime / Checkpointing
    • None

    Description

      When flink job is being checkpointed, and after the job is cancelled, the checkpoint is indeed deleted (as per execution.checkpointing.externalized-checkpoint-retention: DELETE_ON_CANCELLATION), but the job-id folder still remains:
       
      [sergio@flink-cluster-54f7fc7c6-k6km8 JobCheckpoints]$ ls
      01eff17aa2910484b5aeb644bc531172  3a59309ef018541fc0c20856d0d89855  78ff2344dd7ef89f9fbcc9789fc0cd79  a6fd7cec89c0af78c3353d4a46a7d273  dbc957868c08ebeb100d708bbd057593
      04ff0abb9e860fc85f0e39d722367c3c  3e09166341615b1b4786efd6745a05d6  79efc000aa29522f0a9598661f485f67  a8c42bfe158abd78ebcb4adb135de61f  dc8e04b02c9d8a1bc04b21d2c8f21f74
      05f48019475de40230900230c63cfe89  3f9fb467c9af91ef41d527fe92f9b590  7a6ad7407d7120eda635d71cd843916a  a8db748c1d329407405387ac82040be4  dfb2df1c25056e920d41c94b659dcdab
      09d30bc0aaaaff786994a6a3bb06abd3  455525b76a1c6826b6eaebd5649c5b6b  7b1458424496baaf3d020e9fece525a4  aa2ef9587b2e9c123744e8940a66a287

      All folders in the above list, like 01eff17aa2910484b5aeb644bc531172  , are empty ~

       

      Expected behaviour:

      The job folder id should also be deleted.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. FLINK-5009 FS checkpoints leave empty directory

          • Not a Priority -
          • Open

          Bug - A problem which impairs or prevents the functions of the product. FLINK-10346 MemoryStateBackend does not clean up checkpoint directory

          • Not a Priority -
          • Open

          Bug - A problem which impairs or prevents the functions of the product. FLINK-11789 Checkpoint directories are not cleaned up after job termination

          • Not a Priority -
          • Open

          Bug - A problem which impairs or prevents the functions of the product. FLINK-3094 FileStateBackend does not clean up job-id checkpoint directory

          • Not a Priority -
          • Reopened

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-15012 Checkpoint directory not cleaned up

          • Not a Priority -
          • In Progress

          Activity

            People

              Unassigned Unassigned
              sergiosp Sergio Sainz
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: