Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-1589

Rollback metadata is not backwards compatible

    XMLWordPrintableJSON

    Details

      Description

      When turning on archival for ROLLBACK files, we see the following exception

       

      21/02/05 18:53:39 ERROR table.HoodieTimelineArchiveLog: Failed to archive commits, .commit file: 20200225204435.rollback
      org.apache.avro.AvroTypeException: Found com.uber.hoodie.avro.model.HoodieRollbackPartitionMetadata, expecting org.apache.hudi.avro.model.HoodieRollbackPartitionMetadata, missing required field rollbackLogFiles
      	at org.apache.avro.io.ResolvingDecoder.doAction(ResolvingDecoder.java:292)
      	at org.apache.avro.io.parsing.Parser.advance(Parser.java:88)
      	at org.apache.avro.io.ResolvingDecoder.readFieldOrder(ResolvingDecoder.java:130)
      	at org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:215)
      

      The `rollbackLogFiles` should have a default value "null" to read and encode older rollback files. 

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                nishith29 Nishith Agarwal
                Reporter:
                nishith29 Nishith Agarwal
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: