Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-6372

IndexingCatchupTask cannot sync a commit to MDT if record index is enabled

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • 1.1.0
    • None

    Description

      Record index requires WriteStatus which cannot be read from the HoodieCommitMetadata. So if the original commit has not been written to the MDT then we cannot sync that commit within IndexingCatchupTask::run
       
      We need to implement code to read the keys from the added files and commit mappings to record index.

      Attachments

        Activity

          People

            Unassigned Unassigned
            pwason Prashant Wason
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: