Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-279

Regression in Schema Evolution due to PR-755

    XMLWordPrintableJSON

Details

    Description

      Reported by Alex:

      https://github.com/apache/incubator-hudi/blob/master/hudi-client/src/main/java/org/apache/hudi/table/HoodieCopyOnWriteTable.java#L200

      this sets an Avro Schema on the config
       
      but I see that AvroReadSupport.init is getting a different config instance, with avro schema set to null and falls back to what is in parquet. Which breaks during the old/new data merge. I’m pretty sure it worked before as we had successful schema evolutions. Any idea why it might be happening? 
       
      Caused by changes in :
      https://github.com/apache/incubator-hudi/pull/755

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              vbalaji Balaji Varadarajan
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m