Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-6106

Provide an option in ShellCommandExecutor to timeout commands that do not complete within a certain amount of time.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • util
    • None
    • Reviewed

    Description

      In MAPREDUCE-211 we came across a need to provide an option to timeout commands launched via the ShellCommandExecutor. The use case is for the health check script being developed in MAPREDUCE-211. We would like the TaskTracker thread to not be blocked by a problematic script or in instances where fork()+exec() has hung (which apparently has been observed in large clusters).

      Attachments

        1. HADOOP-6106.patch
          10 kB
          Hemanth Yamijala
        2. HADOOP-6106-1.patch
          9 kB
          Sreekanth Ramakrishnan
        3. HADOOP-6106-2.patch
          9 kB
          Sreekanth Ramakrishnan
        4. mapred-211-common-3.patch
          9 kB
          Sreekanth Ramakrishnan

        Issue Links

          blocks

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-211 Provide a node health check script and run it periodically to check the node health status

          • Major - Major loss of function.
          • Closed

          Activity

            People

              sreekanth Sreekanth Ramakrishnan
              yhemanth Hemanth Yamijala
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: