Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-211

Provide a node health check script and run it periodically to check the node health status

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • None
    • None
    • Reviewed
    • Provides ability to run a health check script on the tasktracker nodes and blacklist nodes if they are unhealthy.

    Description

      Hadoop must have some mechanism to find the health status of a node . It should run the health check script periodically and if there is any errors, it should black list the node. This will be really helpful when we run static mapred clusters. Else we may have to run some scripts/daemons periodically to find the node status and take it offline manually.

      Attachments

        1. mapred-211-internal.patch
          56 kB
          Sreekanth Ramakrishnan
        2. mapred-211-mapred-9.patch
          56 kB
          Sreekanth Ramakrishnan
        3. mapred-211-mapred-8.patch
          55 kB
          Sreekanth Ramakrishnan
        4. MAPREDUCE-211-forrest.patch
          3 kB
          Hemanth Yamijala
        5. mapred-211-mapred-7.patch
          55 kB
          Sreekanth Ramakrishnan
        6. mapred-211-mapred-5.patch
          50 kB
          Sreekanth Ramakrishnan
        7. mapred-211-mapred-4.patch
          52 kB
          Sreekanth Ramakrishnan
        8. mapred-211-mapred-3.patch
          50 kB
          Sreekanth Ramakrishnan
        9. mapred-211-common-3.patch
          9 kB
          Sreekanth Ramakrishnan
        10. blacklist2.png
          49 kB
          Sreekanth Ramakrishnan
        11. mapred-211-mapred-2.patch
          60 kB
          Sreekanth Ramakrishnan
        12. mapred-211-mapred-1.patch
          60 kB
          Sreekanth Ramakrishnan
        13. mapred-211-core-1.patch
          9 kB
          Sreekanth Ramakrishnan
        14. hadoop-5478-6.patch
          63 kB
          Sreekanth Ramakrishnan
        15. cluster_setup.pdf
          54 kB
          Sreekanth Ramakrishnan
        16. blacklist1.png
          40 kB
          Sreekanth Ramakrishnan
        17. active.png
          26 kB
          Sreekanth Ramakrishnan
        18. hadoop-5478-5.patch
          39 kB
          Sreekanth Ramakrishnan
        19. hadoop-5478-4.patch
          22 kB
          Sreekanth Ramakrishnan
        20. hadoop-5478-3.patch
          39 kB
          Sreekanth Ramakrishnan
        21. hadoop-5478-2.patch
          27 kB
          Sreekanth Ramakrishnan
        22. hadoop-5478-1.patch
          22 kB
          Sreekanth Ramakrishnan

        Issue Links

        is blocked by

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-6106 Provide an option in ShellCommandExecutor to timeout commands that do not complete within a certain amount of time.

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sreekanth Sreekanth Ramakrishnan
            aroop Aroop Maliakkal
            Votes:
            0 Vote for this issue
            Watchers:
            18 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment