Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-211

Provide a node health check script and run it periodically to check the node health status

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • None
    • None
    • Reviewed
    • Provides ability to run a health check script on the tasktracker nodes and blacklist nodes if they are unhealthy.

    Description

      Hadoop must have some mechanism to find the health status of a node . It should run the health check script periodically and if there is any errors, it should black list the node. This will be really helpful when we run static mapred clusters. Else we may have to run some scripts/daemons periodically to find the node status and take it offline manually.

      Attachments

        1. active.png
          26 kB
          Sreekanth Ramakrishnan
        2. blacklist1.png
          40 kB
          Sreekanth Ramakrishnan
        3. blacklist2.png
          49 kB
          Sreekanth Ramakrishnan
        4. cluster_setup.pdf
          54 kB
          Sreekanth Ramakrishnan
        5. hadoop-5478-1.patch
          22 kB
          Sreekanth Ramakrishnan
        6. hadoop-5478-2.patch
          27 kB
          Sreekanth Ramakrishnan
        7. hadoop-5478-3.patch
          39 kB
          Sreekanth Ramakrishnan
        8. hadoop-5478-4.patch
          22 kB
          Sreekanth Ramakrishnan
        9. hadoop-5478-5.patch
          39 kB
          Sreekanth Ramakrishnan
        10. hadoop-5478-6.patch
          63 kB
          Sreekanth Ramakrishnan
        11. mapred-211-common-3.patch
          9 kB
          Sreekanth Ramakrishnan
        12. mapred-211-core-1.patch
          9 kB
          Sreekanth Ramakrishnan
        13. mapred-211-internal.patch
          56 kB
          Sreekanth Ramakrishnan
        14. mapred-211-mapred-1.patch
          60 kB
          Sreekanth Ramakrishnan
        15. mapred-211-mapred-2.patch
          60 kB
          Sreekanth Ramakrishnan
        16. mapred-211-mapred-3.patch
          50 kB
          Sreekanth Ramakrishnan
        17. mapred-211-mapred-4.patch
          52 kB
          Sreekanth Ramakrishnan
        18. mapred-211-mapred-5.patch
          50 kB
          Sreekanth Ramakrishnan
        19. mapred-211-mapred-7.patch
          55 kB
          Sreekanth Ramakrishnan
        20. mapred-211-mapred-8.patch
          55 kB
          Sreekanth Ramakrishnan
        21. mapred-211-mapred-9.patch
          56 kB
          Sreekanth Ramakrishnan
        22. MAPREDUCE-211-forrest.patch
          3 kB
          Hemanth Yamijala

        Issue Links

        is blocked by

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-6106 Provide an option in ShellCommandExecutor to timeout commands that do not complete within a certain amount of time.

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sreekanth Sreekanth Ramakrishnan
            aroop Aroop Maliakkal
            Votes:
            0 Vote for this issue
            Watchers:
            18 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment