Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-6106

Provide an option in ShellCommandExecutor to timeout commands that do not complete within a certain amount of time.

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • util
    • None
    • Reviewed

    Description

      In MAPREDUCE-211 we came across a need to provide an option to timeout commands launched via the ShellCommandExecutor. The use case is for the health check script being developed in MAPREDUCE-211. We would like the TaskTracker thread to not be blocked by a problematic script or in instances where fork()+exec() has hung (which apparently has been observed in large clusters).

      Attachments

        1. HADOOP-6106-2.patch
          9 kB
          Sreekanth Ramakrishnan
        2. HADOOP-6106-1.patch
          9 kB
          Sreekanth Ramakrishnan
        3. HADOOP-6106.patch
          10 kB
          Hemanth Yamijala
        4. mapred-211-common-3.patch
          9 kB
          Sreekanth Ramakrishnan

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sreekanth Sreekanth Ramakrishnan
            yhemanth Hemanth Yamijala
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment