Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-20685

Flink connect incorrect address of yarn's resouceManager scheduler

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Not A Problem
    • 1.12.0
    • None
    • flink-contrib
    • None
    • flink version: 1.12.0

      hadoop version: 3.1.3

      flink shaded hadoop version: flink-shaded-hadoop-3-uber-3.1.1.7.1.1.0

    Description

      flink version: 1.12.0

      hadoop version: 3.1.3

      flink shaded hadoop version: flink-shaded-hadoop-3-uber-3.1.1.7.1.1.0-565-9.0.jar

      Issue desc: When I start the flink session via script "yarn-session.sh", the console log shows " Deployment took more than 60 seconds. Please check if the requested resources are available in the YARN cluster". And yarn log shows this error "Retrying connect to server: 0.0.0.0/0.0.0.0:8030. Already tried 9 time(s)", in fact the yarn scheduler address is "hadmaster:9901" in the yarn-site.xml for me.

      I am sure that my yarn cluster is running normally because I can run other application on yarn succefully and there are enough resources too. I had set `YARN_CONF_DIR`, `HADOOP_CONF_DIR`, `HADOOP_CLASSPATH` in system env also.

      Attachments

        1. yarn.log
          101 kB
          Spongebob

        Activity

          People

            Unassigned Unassigned
            SpongebobZ Spongebob
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: