Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-20671

Partition doesn't commit until the end of partition

    XMLWordPrintableJSON

    Details

      Description

      According to DOC https://ci.apache.org/projects/flink/flink-docs-master/dev/table/connectors/filesystem.html#partition-commit

      the partition can be commited multiple times.
      Actually, the partition is commited until the end of partition.For example hourly partition, the 10th partition will be commited at 11 clock, even the `sink.partition-commit.delay` is 0s.

      In theory,if delay is 0s the partition should be commited on every checkpoint.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                ZhuShang zhuxiaoshang
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: