Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-5046

Avoid redundant serialization when creating the TaskDeploymentDescriptor

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.2.0, 1.1.3
    • Fix Version/s: 1.2.0, 1.1.4
    • Labels:
      None

      Description

      When creating the TaskDeploymentDescriptor we extract information from the ExecutionGraph which is defined job-wide and from the ExecutionJobVertex which is defined operator-wide. The extracted information will be serialized for every subtask even though it stays the same.

      As an improvement, we can serialize this information once and give the serialized byte array to the TaskDeploymentDescriptor. This will reduce the serialization work Flink has to do when deploying sub tasks.

        Attachments

          Activity

            People

            • Assignee:
              till.rohrmann Till Rohrmann
              Reporter:
              till.rohrmann Till Rohrmann
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: