Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-5944

Added the ability to fix partitiion missing in hudi synctool

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • None
    • None
    • meta-sync

    Description

      When occ is enabled, hivesynctool causes partiton metadata to be lost. We added some repair logic.

       

      hms partition metadata info:

      hudi hdfs partition info:

      Attachments

        1. clipboard_image_1678936464376.png
          168 kB
          weiming
        2. clipboard_image_1678936408619.png
          700 kB
          weiming

        Issue Links

          Activity

            People

              weiming weiming
              weiming weiming
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: