Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-3265

Implement a custom serializer for the WriteStatus

    XMLWordPrintableJSON

Details

    • Task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • flink

    Description

      When the structure of WriteStatus changed, and when we restart the Flink job with the new version, the job will fail to recover.

      To Reproduce

      Steps to reproduce the behavior:

      1. Start a flink job.
      1. Changed the WriteStatus and restart
      1. The job can't recover.

      We need to implement a custom serializer for the WriteStatus.

       

      Ref issue: https://github.com/apache/hudi/issues/4032

       

      Attachments

        Activity

          People

            garyli Gary Li
            shivnarayan sivabalan narayanan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: