Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-1521 [UMBRELLA] RFC-24 HUDI Flink writer proposal
  3. HUDI-1637

Avoid to rename for bucket update when there is only one flush action during a checkpoint

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.8.0
    • flink

    Description

      Currently, the FlinkMergeHandle rename files no matter how flush actions it executes, we can promote it to avoid rename if there are only one mini-batch (say the input data flow throughput is small enough).

      Attachments

        Issue Links

          Activity

            People

              danny0405 Danny Chan
              danny0405 Danny Chan
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: