Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2721

Use job control for tasks (and therefore for pipes and streaming)

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • None
    • None
    • Reviewed

    Description

      We should use the setsid command when the task is launched to create a new session. We should be able to use the setsid program when we launch the bash process to create a new session. That will allow us to kill the entire session with a single signal and remove the need for the ping methods in both TaskTracker.Child and pipes.

      The patch uses setsid when creating new tasks sothat subprocesses of this process will be with in this new session(and this process will be the process leader for all the subprocesses). Thus killing the subprocesses becomes easy(just by killing all the processes in this process group) when killing the task.

      Attachments

        1. HADOOP-2721.patch
          5 kB
          Ravi Gummadi
        2. HADOOP-2721.patch
          6 kB
          Ravi Gummadi
        3. HADOOP-2721.patch
          6 kB
          Ravi Gummadi
        4. HADOOP-2721-v2.patch
          24 kB
          Ravi Gummadi
        5. HADOOP-2721-v3.patch
          34 kB
          Ravi Gummadi
        6. HADOOP-2721-v9.patch
          51 kB
          Ravi Gummadi
        7. HADOOP-2721-v10.patch
          53 kB
          Ravi Gummadi
        8. HADOOP-2721-v11.patch
          56 kB
          Ravi Gummadi
        9. HADOOP-2721-v11.1.patch
          58 kB
          Ravi Gummadi
        10. HADOOP-2721-v11.3.patch
          58 kB
          Ravi Gummadi
        11. HADOOP-2721-v11.4.patch
          57 kB
          Ravi Gummadi

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ravidotg Ravi Gummadi Assign to me
            omalley Owen O'Malley
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment