Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-1465

Optimize InstantGenerateOperator of Flink's integration on HUDI

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 0.9.0
    • None
    • performance
    • None

    Description

      In the hudi integration based on flink，it uses single concurrent InstantGenerateOperator which make it difficult to use in a production environment. Since Flink checkpointId is monotonically increasing, it can be considered to implement this using checkpointId

      Attachments

        Issue Links

          is related to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. HUDI-909 [UMBRELLA]Integrate hudi with flink engine

          • Major - Major loss of function.
          • Closed

          Activity

            People

              lichang LiChang
              lichang LiChang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: