Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-4256 Fine-grained recovery
  3. FLINK-4312

Remove Serializabiliy of ExecutionGraph

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 1.1.0
    • 1.2.0
    • Runtime / Coordination
    • None

    Description

      As a preparatory task for reworking the ExecutionGraph for finer grained recovery, I would clean up the serializability:

      • As long as a job is running, the ExecutionGraph cannot be serializable
      • Once it is completed, the ExecutionGraph is sent to a local archive actor. This does not require that the graph is serializable.
      • In the future, archived execution data should be served from a static dump of the execution data anyways, not from an archived graph. That allows us to move the web monitor server to a separate trusted process (gateway / dispatcher) that will never be in touch with user code.

      Attachments

        Activity

          People

            sewen Stephan Ewen
            sewen Stephan Ewen
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: