Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-13566

Support checkpoint configuration through flink-conf.yaml

    XMLWordPrintableJSON

Details

    Description

      Currently basic checkpointing configuration happens through the StreamExecutionEnvironment and the CheckpointConfig class.

      There is no way to configure checkpointing behaviour purely from the flink-conf.yaml file (or provide a default checkpointing behaviour) as it always needs to happen programmatically through the environment.

      The checkpoint config settings are then translated down to the CheckpointCoordinatorConfiguration which will control the runtime behaviour.

      As checkpointing related settings are operational features that should not affect the application logic I think we need to support configuring these params through the flink-conf yaml.

      In order to do this we probably need to rework the CheckpointConfig class so that it distinguishes parameters that the user actually set from the defaults (to support overriding what was set in the conf).

      Attachments

        Activity

          People

            Unassigned Unassigned
            gyfora Gyula Fora
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: