Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.17.2
    • Fix Version/s: 0.20.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Modified dfsadmin -report to report under replicated blocks. blocks with corrupt replicas, and missing blocks".

      Description

      A whole bunch of datanodes became dead because of some network problems resulting in heartbeat timeouts although datanodes were fine.

      Many processes started to fail because of the corrupted filesystem.

      In order to catch and diagnose such problems faster the namenode should detect the corruption automatically and provide a way to alert operations. At the minimum it should show the fact of corruption on the GUI.

        Attachments

        1. HADOOP-4103-branch-20.patch
          18 kB
          Raghu Angadi
        2. HADOOP-4103.patch
          22 kB
          Raghu Angadi
        3. HADOOP-4103.patch
          22 kB
          Raghu Angadi
        4. HADOOP-4103.patch
          23 kB
          Raghu Angadi
        5. HADOOP-4103.patch
          19 kB
          Raghu Angadi

          Activity

            People

            • Assignee:
              rangadi Raghu Angadi
              Reporter:
              ckunz Christian Kunz
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: