Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-8544 Fix RLI and SI MDT record generation to be consistent w/ spark task retries
  3. HUDI-8543

Fix SI record generation to do on-demand lookup instead of relying on RDD<WriteStatus>

    XMLWordPrintableJSON

Details

    • 8

    Description

      Secondary Index also relies on RLI which in turn relies on RDD<WriteStatus> 

      We wanted to remove the dependency on RDD<WriteStatus> and generate SI records on the fly to ensure consistent behavior. 

       

      Attachments

        Activity

          People

            shivnarayan sivabalan narayanan
            shivnarayan sivabalan narayanan
            Danny Chen, Vinoth Chandar
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - 8m
                8m
                Remaining:
                Remaining Estimate - 8m
                8m
                Logged:
                Time Spent - Not Specified
                Not Specified