Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-4256 Fine-grained recovery
  3. FLINK-4312

Remove Serializabiliy of ExecutionGraph

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.1.0
    • Fix Version/s: 1.2.0
    • Component/s: Runtime / Coordination
    • Labels:
      None

      Description

      As a preparatory task for reworking the ExecutionGraph for finer grained recovery, I would clean up the serializability:

      • As long as a job is running, the ExecutionGraph cannot be serializable
      • Once it is completed, the ExecutionGraph is sent to a local archive actor. This does not require that the graph is serializable.
      • In the future, archived execution data should be served from a static dump of the execution data anyways, not from an archived graph. That allows us to move the web monitor server to a separate trusted process (gateway / dispatcher) that will never be in touch with user code.

        Attachments

          Activity

            People

            • Assignee:
              sewen Stephan Ewen
              Reporter:
              sewen Stephan Ewen
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: