Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-19999

State Processor API classes leaking into savepoint

    XMLWordPrintableJSON

Details

    Description

      Currently, any configuration for serializers that you are using when writing a State Processor API job will be shared with the serializers that are used for writing a savepoint. However, your normal job shouldn't necessarily depend on (helper) classes that you only use in the StateProc API job.

      By default, for example, ExecutionConfig#autoTypeRegistrationEnabled = true and thus classes like org.apache.flink.runtime.checkpoint.OperatorSubtaskState will be registered with Kryo and will thus also be needed when reading the created savepoint if you have Kryo serialization in your job.

      This particular instance can be worked around by calling ExecutionConfig#disableAutoTypeRegistration() but the problem is probably bigger and extends to other type registrations, e.g. POJOs, as well.

      Attachments

        Activity

          People

            Unassigned Unassigned
            nkruber Nico Kruber
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: