Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.17.2
    • Fix Version/s: 0.20.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Modified dfsadmin -report to report under replicated blocks. blocks with corrupt replicas, and missing blocks".

      Description

      A whole bunch of datanodes became dead because of some network problems resulting in heartbeat timeouts although datanodes were fine.

      Many processes started to fail because of the corrupted filesystem.

      In order to catch and diagnose such problems faster the namenode should detect the corruption automatically and provide a way to alert operations. At the minimum it should show the fact of corruption on the GUI.

      1. HADOOP-4103-branch-20.patch
        18 kB
        Raghu Angadi
      2. HADOOP-4103.patch
        22 kB
        Raghu Angadi
      3. HADOOP-4103.patch
        22 kB
        Raghu Angadi
      4. HADOOP-4103.patch
        23 kB
        Raghu Angadi
      5. HADOOP-4103.patch
        19 kB
        Raghu Angadi

        Activity

        Christian Kunz created issue -
        Christian Kunz made changes -
        Field Original Value New Value
        Description A whole bunch of datanodes became dead because of some network problems resulting in heartbeat timeouts although datanodes were fine.

        Many processes started to fail because of the corrupted filesystem.

        In order to catch and diagnose such problems faster the namenode should detect the corruption automatically and provide a way to alert operations. At the minimum it should the fact of corruption on the GUI.
        A whole bunch of datanodes became dead because of some network problems resulting in heartbeat timeouts although datanodes were fine.

        Many processes started to fail because of the corrupted filesystem.

        In order to catch and diagnose such problems faster the namenode should detect the corruption automatically and provide a way to alert operations. At the minimum it should show the fact of corruption on the GUI.
        Raghu Angadi made changes -
        Assignee Raghu Angadi [ rangadi ]
        Raghu Angadi made changes -
        Attachment HADOOP-4103.patch [ 12400564 ]
        Raghu Angadi made changes -
        Attachment HADOOP-4103.patch [ 12400980 ]
        Raghu Angadi made changes -
        Attachment HADOOP-4103.patch [ 12401076 ]
        Raghu Angadi made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hadoop Flags [Reviewed]
        Raghu Angadi made changes -
        Fix Version/s 0.20.0 [ 12313438 ]
        Raghu Angadi made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Raghu Angadi made changes -
        Attachment HADOOP-4103.patch [ 12401261 ]
        Raghu Angadi made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Robert Chansler made changes -
        Release Note Modified dfsadmin -report to count under replicated blocks. blocks with corrupt replicas, and missing blocks".
        Hadoop Flags [Reviewed] [Incompatible change, Reviewed]
        Raghu Angadi made changes -
        Attachment HADOOP-4103-branch-20.patch [ 12401362 ]
        Raghu Angadi made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Release Note Modified dfsadmin -report to count under replicated blocks. blocks with corrupt replicas, and missing blocks". Modified dfsadmin -report to report under replicated blocks. blocks with corrupt replicas, and missing blocks".
        Resolution Fixed [ 1 ]
        Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
        Nigel Daley made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Owen O'Malley made changes -
        Component/s dfs [ 12310710 ]

          People

          • Assignee:
            Raghu Angadi
            Reporter:
            Christian Kunz
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development