Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-10222

Dataflow sets CPU limits on docker containers near zero so Java 11 only detects 1 CPU

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.26.0
    • runner-dataflow
    • None

    Description

      When specifying the worker-type as "n1-highcpu-4" the resulting thread number is 4 when the pipeline is compiled by Java8, and only 1 when the pipeline is compiled by Java11.

      Specifying numberOfWorkerHarnessThreads does not change amount of detected threads.

      Amount of available CPUs is received via "Runtime.getRuntime().availableProcessors()"

      Attachments

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-2530 Make Beam compatible with next Java LTS version (Java 11)

          • P3 - Non-urgent bugs, features, and improvements
          • Triage Needed

          Activity

            People

              kenn Kenneth Knowles
              Ardagan Mikhail Gryzykhin
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: