Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.20.203.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      This is an umbrella Jira for tracking all the issues and work related for handling disk failures across the Hadoop stack. Today, Hadoop handles disk failures to some extent but not all the issues. This involves understanding both startup and runtime issues related to disk failures in the Hadoop components.

      Scope: The initial scope of work will only be for DataNode and TaskTracker related disk failure issues.

      Methodology: Injecting disk failures in SCSI layer at various runtime points of Hadoop and observing Hadoop's behavior for improvement.

        Issue Links

          Activity

          Hide
          Wang Xu added a comment -

          Hi folks,

          Could HDFS-1362 be treated as a solution on DataNode? Or any other features are required?

          For now, HDFS-457 could stop service of failed disks and HDFS-1362 could add disks or re-enable disks after repaired them by means of reconfigure DataNode based on HADOOP-7001.

          Show
          Wang Xu added a comment - Hi folks, Could HDFS-1362 be treated as a solution on DataNode? Or any other features are required? For now, HDFS-457 could stop service of failed disks and HDFS-1362 could add disks or re-enable disks after repaired them by means of reconfigure DataNode based on HADOOP-7001 .
          Hide
          Bharath Mundlapudi added a comment -

          Hi Wang Xu,

          I have some comments regarding HDFS-1362. I will provide my comments on that jira.

          Show
          Bharath Mundlapudi added a comment - Hi Wang Xu, I have some comments regarding HDFS-1362 . I will provide my comments on that jira.
          Hide
          Harsh J added a comment -

          Bharath,

          Since all of this work's goal was done - can this be closed?

          Show
          Harsh J added a comment - Bharath, Since all of this work's goal was done - can this be closed?

            People

            • Assignee:
              Bharath Mundlapudi
              Reporter:
              Bharath Mundlapudi
            • Votes:
              0 Vote for this issue
              Watchers:
              20 Start watching this issue

              Dates

              • Created:
                Updated:

                Development