Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14348

Need HDFS Health scripts for monitoring datanode

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: scripts
    • Labels:
      None

      Description

      Sick machines cause issues, that HDFS will not automatically remediate that.
      Upon a bad health, the DN should either stop sending block reports, simply shut itself down, or indicate the problem in some other way.
      We need a script to achieve this for DN.

      MapReduceV1 had something, see https://issues.apache.org/jira/browse/MAPREDUCE-211 . Hadoop-common moved into hadoop-yarn-project for Hadoop v2, meaning we have a solution for YARN but are lacking what we need in HDFS.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              rahulshrivastava Rahul Shrivastava
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: