Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4459

container-executor should only kill process groups

    Details

    • Hadoop Flags:
      Reviewed

      Description

      When calling 'signal_container_as_user' in container-executor, it first checks whether process group exists, if not, it will kill the process itself(if it the process exists). It is not reasonable because that the process group does not exist means corresponding container has finished, if we kill the process itself, we just kill wrong process.

      We found it happened in our cluster many times. We used same account for starting NM and submitted app, and container-executor sometimes killed NM(the wrongly killed process might just be a newly started thread and was NM's child process).

        Attachments

        1. YARN-4459.03.patch
          4 kB
          Jason Lowe
        2. YARN-4459.02.patch
          2 kB
          Jun Gong
        3. YARN-4459.01.patch
          2 kB
          Jun Gong

          Issue Links

            Activity

              People

              • Assignee:
                hex108 Jun Gong
                Reporter:
                hex108 Jun Gong
              • Votes:
                0 Vote for this issue
                Watchers:
                14 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: