Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10047

Memory consume of process tree will consider subprocess which may make container exit unexcepted

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: nodemanager
    • Labels:
      None

      Description

      As below, we have a case which spark driver execute some scripts.Then sometimes the driver will be killed.

      yarn.174410.log.2019-12-17.000002:2019-12-17,06:59:14,831 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Container [pid=50529,containerID=container_e917_1576303656075_174957_01_003197] is running beyond physical memory limits. Current usage: 50.28 GB of 5.25 GB physical memory used; xxx. Killing container.
      
      boolean isProcessTreeOverLimit(String containerId,
                                        long currentMemUsage,
                                        long curMemUsageOfAgedProcesses,
                                        long vmemLimit) {
          boolean isOverLimit = false;
         
          /**
          if (currentMemUsage > (2 * vmemLimit)) {
            LOG.warn("Process tree for container: " + containerId
                + " running over twice " + "the configured limit. Limit=" + vmemLimit
                + ", current usage = " + currentMemUsage);
            isOverLimit = true;
          }
      

        Attachments

          Activity

            People

            • Assignee:
              cane zhoukang
              Reporter:
              cane zhoukang

              Dates

              • Created:
                Updated:

                Issue deployment