Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-18551

Don't need to download flink-conf.yaml when launching taskmanager on Yarn mode

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 1.10.1, 1.11.0
    • Fix Version/s: None
    • Component/s: Deployment / YARN
    • Labels:
      None

      Description

      In current flink version, launching a taskmanager on Yarn will follow these steps:
      1. download flink-conf.yaml file to the local working directory
      2. get Configuration object by reading local flink-conf.yaml file
      We could reduce the IO operation by setting flinkConfig to container env when createTaskExecutorContext in jobmanager side and getting Configuration object by system env in taskmanager side. This way we don't need to download flink-conf.yaml when launching taskmanager on Yarn and could accelerate the start process a little bit.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Yumeng Yumeng Zhang
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: