Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-2240

Validate table properties

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Writer Core
    • Labels:
      None

      Description

      Some properties for a given hudi table may not change overtime. As of now, hudi does not enforce any such constraints, but incompatible changes might result in errors. 

      So, creating this ticket to fix that. 

      • Index type. 
        • Once simple is enabled, users can't switch back to regular bloom. Other way round is feasible. 
        • Once regular bloom is set, users can't switch to global. But other way round should be doable. 
      • Key Generators
        • Incompatible changes are not allowed. For eg, switching from simple to timestamp based will run into issues as record keys won't match for merging. 
      • PreCombine 
      • Virtual keys:
        • All 3 properties, (record key, partition path and key gen) cannot change once the table is created with some values. 

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              shivnarayan sivabalan narayanan
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: