Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-7400

off-heap limits set to conservatively in cluster environments

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 1.3.0, 1.3.1, 1.3.2, 1.4.0
    • Fix Version/s: 1.4.0
    • Component/s: Cluster Management, Mesos, YARN
    • Labels:
      None

      Description

      Inside ContaineredTaskManagerParameters, since FLINK-6217, the offHeapSize is set to the amount of memory Flink will use off-heap which will be set as the value for -XX:MaxDirectMemorySize in various cases. This does not account for any off-heap use by other components than Flink, e.g. RocksDB, other libraries, or the JVM itself.

      We should add the cutoff from the CONTAINERIZED_HEAP_CUTOFF_RATIO configuration parameter to offHeapSize as implied by the description on what this parameter is there for.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                NicoK Nico Kruber
                Reporter:
                NicoK Nico Kruber
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: