Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-6127

Flink Hudi Support Commit on empty batch

    XMLWordPrintableJSON

Details

    Description

      In flink multi-writer scenario, if one of the writers has no data, it will keep its inflight instant in the timeline. But incremental clean and archive will be blocked by the oldest inflight commit in the timeline.

      So to make clean and archive can move forward  we should upport starting a new instant even when there is no data in the last batch. 

      Attachments

        Issue Links

          Activity

            People

              Qijun Fu Qijun Fu
              Qijun Fu Qijun Fu
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: