Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-14582

Do not upload {uuid}-taskmanager-conf.yaml for each task manager container

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • 1.9.1, 1.10.0
    • None
    • Deployment / YARN
    • None

    Description

      Currently when we createTaskExecutorLaunchContext, a new task manager conf will be created and uploaded to hdfs. The time cost is unnecessary and could be reduced by using java options of task manager main class instead.

      By reducing the time of launch container in onContainersAllocated, we could avoid allocating excess containers as much as possible.

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. FLINK-13184 Starting a TaskExecutor blocks the YarnResourceManager's main thread

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. FLINK-12342 Yarn Resource Manager Acquires Too Many Containers

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              wangyang0918 Yang Wang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: