Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-14582

Do not upload {uuid}-taskmanager-conf.yaml for each task manager container

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 1.9.1, 1.10.0
    • Fix Version/s: None
    • Component/s: Deployment / YARN
    • Labels:
      None

      Description

      Currently when we createTaskExecutorLaunchContext, a new task manager conf will be created and uploaded to hdfs. The time cost is unnecessary and could be reduced by using java options of task manager main class instead.

      By reducing the time of launch container in onContainersAllocated, we could avoid allocating excess containers as much as possible.

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              fly_in_gis Yang Wang

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment