Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-5046

Avoid redundant serialization when creating the TaskDeploymentDescriptor

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.1.3, 1.2.0
    • 1.1.4, 1.2.0
    • Runtime / Coordination
    • None

    Description

      When creating the TaskDeploymentDescriptor we extract information from the ExecutionGraph which is defined job-wide and from the ExecutionJobVertex which is defined operator-wide. The extracted information will be serialized for every subtask even though it stays the same.

      As an improvement, we can serialize this information once and give the serialized byte array to the TaskDeploymentDescriptor. This will reduce the serialization work Flink has to do when deploying sub tasks.

      Attachments

        Activity

          People

            trohrmann Till Rohrmann
            trohrmann Till Rohrmann
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: