Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-3981 Flink engine support for comprehensive schema evolution
  3. HUDI-5244

Fix bugs in schema evolution client with lost operation field and not found schema

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 0.12.2
    • None

    Description

      Currently, BaseHoodieWriteClient contains schema evolution methods such as

      • addColumn
      • deleteColumns
      • renameColumn
      • updateColumnNullability
      • updateColumnType
      • updateColumnComment
      • reOrderColPosition

      These methods are not covered with tests and contain two issues:

      1. Lost operation field in avro schema
      2. Not found schema for table
        org.apache.hudi.exception.HoodieException: cannot find schema for current table: /tmp/hudi
        	at org.apache.hudi.client.BaseHoodieWriteClient.getInternalSchemaAndMetaClient(BaseHoodieWriteClient.java:1767)
        	at org.apache.hudi.client.BaseHoodieWriteClient.addColumn(BaseHoodieWriteClient.java:1673)
        	at org.apache.hudi.sink.TestWriteCopyOnWrite.test(TestWriteCopyOnWrite.java:454)
        

      Attachments

        Issue Links

          Activity

            People

              trushev Alexander Trushev
              trushev Alexander Trushev
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: