Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-2749

Improve the streaming read for hudi

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Epic
    • Status: Open
    • Blocker
    • Resolution: Unresolved
    • None
    • 1.0.0
    • Common Core
    • None
    • 0
    • Streaming Read

    Description

      Hudi has been widely used as streaming storage for our flink users. While generally speaking, the streaming computing friendly feature has become a killer differentiation. 

      With this umbrella issue, i propose to improve the integration with streaming engine for both semantics and performance.

      Attachments

        HUDI-2750 Improve the incremental data files metadata more efficiently for streaming source Task In Progress Lin Liu
        Actions
         
        		 HUDI-1127 Handling late arriving Deletes Improvement Closed Unassigned
        Actions
         
        		 HUDI-2752 The MOR DELETE block breaks the event time sequence of CDC Bug Closed Danny Chen
        Actions
         
        		 HUDI-2751 To avoid the duplicates for streaming read MOR table Improvement Closed sivabalan narayanan
        Actions
        HUDI-2762 Ensure hive can query insert only logs in MOR Improvement Reopened Alexey Kudinkin
        Actions
        HUDI-7209 Add configuration to skip not exists file in streaming read Improvement Open Unassigned
        Actions

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            danny0405 Danny Chen
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:

              Slack

                Issue deployment