Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-279

Regression in Schema Evolution due to PR-755

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

      Description

      Reported by Alex:

      https://github.com/apache/incubator-hudi/blob/master/hudi-client/src/main/java/org/apache/hudi/table/HoodieCopyOnWriteTable.java#L200

      this sets an Avro Schema on the config
       
      but I see that AvroReadSupport.init is getting a different config instance, with avro schema set to null and falls back to what is in parquet. Which breaks during the old/new data merge. I’m pretty sure it worked before as we had successful schema evolutions. Any idea why it might be happening? 
       
      Caused by changes in :
      https://github.com/apache/incubator-hudi/pull/755

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              vbalaji Balaji Varadarajan

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20m
                20m

                  Issue deployment