Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-8544 Fix RLI and SI MDT record generation to be consistent w/ spark task retries
  3. HUDI-8542

Fix RLI to do on-demand lookup of data files to generate RLI records for MDT

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Patch Available
    • Blocker
    • Resolution: Unresolved
    • None
    • 1.0.0
    • metadata
    • 8

    Description

      Lets remove the reliance on RDD<WriteStatus> to generate RLI MDT records. 

      we can do on-demand data file lookup to generate MDT RLI records. 

       

      Attachments

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            shivnarayan sivabalan narayanan
            shivnarayan sivabalan narayanan
            Danny Chen, Vinoth Chandar
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - 8m
                8m
                Remaining:
                Remaining Estimate - 8m
                8m
                Logged:
                Time Spent - Not Specified
                Not Specified

                Agile

                  Active Sprint:
                  Hudi 1.0 Blockers+Bugs Sprint ends 19/Nov/24
                  View on Board

                  Slack

                    Issue deployment