Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-3898

Mor table hive synchronization supports _ro or _rt table type selection and _rt table suffix skip configuration items

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Won't Do
    • None
    • 0.12.0
    • hive, meta-sync
    • None

    Description

      Related links :https://github.com/apache/hudi/issues/5327

      1. The current mor table hive synchronization only supports the suffix skipping of the _ro table. Can it also support the suffix skipping configuration item of the _rt table? Because for some business scenarios, especially non-partitioned tables, in order to be consistent with the table names of existing businesses, some businesses only need the _ro table to skip the suffix, and some businesses only need the _rt table to skip the suffix, so do you consider adding configuration items? _rt table suffix.
      2. The current mor table hive synchronization synchronizes the _ro table and the _rt table at the same time, which cannot be changed, but for some non-partitioned business scenarios, some only need to synchronize the _ro table or the _rt table to meet the requirements. If all are synchronized, it will bring extra cost, so consider adding configuration items to be more flexible to choose.

      Attachments

        Activity

          People

            Unassigned Unassigned
            jasonlee1017 Chuang Lee
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: