Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-4156

Job with -m yarn-cluster registers TaskManagers to another running Yarn session

    XMLWordPrintableJSON

Details

    Description

      When a job is started using cluster mode (-m yarn-cluster) and a Yarn session is running on the same cluster, the job accidentally registers it's worker tasks with the ongoing Yarn session. This happens because the same Zookeeper namespace is used.

      We should consider isolating Flink applications from another by using UUIDS, e.g. based on their application ids, in their Zookeeper paths.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. FLINK-4166 Generate automatic different namespaces in Zookeeper for Flink applications

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              srichter Stefan Richter
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: