Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-11725

use flink cli when {{-yn}} * {{-ys}} < {{-p}}, the applied resources are erratic

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.7.2
    • 1.7.2
    • Runtime / Coordination
    • None
    • flink1.7.2

      linux

      java8

      kafka1.1

      scala 2.1

      CDH 

    Description

      I provide a simple example and used resource's picture for this issue 

      this application is about flink consumer kafka,  when submit job such as : 

      flink-1.7.1/bin/flink  run -m yarn-cluster -yn 1   -ynm test -p 5  -cMainConnect3  ./flinkDemo-1.0-SNAPSHOT.jar &

      or 

      flink-1.7.1/bin/flink  run -m yarn-cluster   -ynm test  -cMainConnect4  ./flinkDemo-1.0-SNAPSHOT.jar &

      from yarn web ,i see, the total resources are erratic, and in most cases, all the remaining resources of the cluster will be used by the application

       

      Attachments

        1. 1111.png
          27 kB
          shengjk1
        2. 2.png
          45 kB
          shengjk1
        3. 3.png
          44 kB
          shengjk1
        4. MainConnect3.java
          2 kB
          shengjk1
        5. MainConnect4.java
          3 kB
          shengjk1

        Activity

          shengjk1 shengjk1 added a comment - - edited

          i think two ways solve this issue:

          1).Add judgment about  if -yn * -ys < -p system.exit(1)  and Print message: -yn * -ys  shoule more than the -p

          2).Create taskManager with one solt until -yn * -ys >= -p  as default

          maybe 1) is more friendly to users

          shengjk1 shengjk1 added a comment - - edited i think two ways solve this issue: 1).Add judgment about  if  -yn * -ys < -p system.exit(1)  and Print message:  -yn * -ys   shoule more than the -p 2).Create taskManager with one solt until  -yn * -ys >= -p   as default maybe 1) is more friendly to users
          shengjk1 shengjk1 added a comment -

          1.7.2已修复

          shengjk1 shengjk1 added a comment - 1.7.2已修复

          People

            Unassigned Unassigned
            shengjk1 shengjk1
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: