Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-211

Provide a node health check script and run it periodically to check the node health status

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • None
    • None
    • Reviewed
    • Provides ability to run a health check script on the tasktracker nodes and blacklist nodes if they are unhealthy.

    Description

      Hadoop must have some mechanism to find the health status of a node . It should run the health check script periodically and if there is any errors, it should black list the node. This will be really helpful when we run static mapred clusters. Else we may have to run some scripts/daemons periodically to find the node status and take it offline manually.

      Attachments

        1. active.png
          26 kB
          Sreekanth Ramakrishnan
        2. blacklist1.png
          40 kB
          Sreekanth Ramakrishnan
        3. blacklist2.png
          49 kB
          Sreekanth Ramakrishnan
        4. cluster_setup.pdf
          54 kB
          Sreekanth Ramakrishnan
        5. hadoop-5478-1.patch
          22 kB
          Sreekanth Ramakrishnan
        6. hadoop-5478-2.patch
          27 kB
          Sreekanth Ramakrishnan
        7. hadoop-5478-3.patch
          39 kB
          Sreekanth Ramakrishnan
        8. hadoop-5478-4.patch
          22 kB
          Sreekanth Ramakrishnan
        9. hadoop-5478-5.patch
          39 kB
          Sreekanth Ramakrishnan
        10. hadoop-5478-6.patch
          63 kB
          Sreekanth Ramakrishnan
        11. mapred-211-common-3.patch
          9 kB
          Sreekanth Ramakrishnan
        12. mapred-211-core-1.patch
          9 kB
          Sreekanth Ramakrishnan
        13. mapred-211-internal.patch
          56 kB
          Sreekanth Ramakrishnan
        14. mapred-211-mapred-1.patch
          60 kB
          Sreekanth Ramakrishnan
        15. mapred-211-mapred-2.patch
          60 kB
          Sreekanth Ramakrishnan
        16. mapred-211-mapred-3.patch
          50 kB
          Sreekanth Ramakrishnan
        17. mapred-211-mapred-4.patch
          52 kB
          Sreekanth Ramakrishnan
        18. mapred-211-mapred-5.patch
          50 kB
          Sreekanth Ramakrishnan
        19. mapred-211-mapred-7.patch
          55 kB
          Sreekanth Ramakrishnan
        20. mapred-211-mapred-8.patch
          55 kB
          Sreekanth Ramakrishnan
        21. mapred-211-mapred-9.patch
          56 kB
          Sreekanth Ramakrishnan
        22. MAPREDUCE-211-forrest.patch
          3 kB
          Hemanth Yamijala

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-6106 Provide an option in ShellCommandExecutor to timeout commands that do not complete within a certain amount of time.

          • Major - Major loss of function.
          • Closed

          Activity

            People

              sreekanth Sreekanth Ramakrishnan
              aroop Aroop Maliakkal
              Votes:
              0 Vote for this issue
              Watchers:
              18 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: