Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-10884

Flink on yarn TM container will be killed by nodemanager because of the exceeded physical memory.

    Details

      Description

      TM container will be killed by nodemanager because of  the exceeded physical memory. I found the lanuch context lanuching TM container that "container memory = heap memory + offHeapSizeMB" at the class org.apache.flink.runtime.clusterframework.ContaineredTaskManagerParameters from line 160 to 166  I set a safety margin for the whole memory container using. For example if the container limit 3g memory, the sum memory that "heap memory + offHeapSizeMB"  is equal to 2.4g to prevent the container being killed. Do we have the ready-made solution or I can commit my solution.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                1026688210 wgcn
                Reporter:
                1026688210 wgcn
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 10m
                  10m