Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-3521

Allow namenode to tolerate edit log corruption

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.3
    • Fix Version/s: 1.2.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      HDFS-3479 adds checking for edit log corruption. It uses a fixed UNCHECKED_REGION_LENGTH (=PREALLOCATION_LENGTH) so that the bytes at the end within the length is not checked. Instead of not checking the bytes, we should check everything and allow toleration.

      1. h3521_20120610_b-1.patch
        37 kB
        Tsz Wo Nicholas Sze
      2. h3521_20120611_b-1.0.patch
        38 kB
        Tsz Wo Nicholas Sze
      3. h3521_20120611_b-1.patch
        41 kB
        Tsz Wo Nicholas Sze

        Issue Links

          Activity

          Matt Foley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Chris Nauroth made changes -
          Link This issue is related to HDFS-4782 [ HDFS-4782 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue relates to HDFS-3540 [ HDFS-3540 ]
          Suresh Srinivas made changes -
          Fix Version/s 1.2.0 [ 12321657 ]
          Affects Version/s 1.0.3 [ 12320249 ]
          Luke Lu made changes -
          Fix Version/s 1.1.0 [ 12317959 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue breaks HDFS-3595 [ HDFS-3595 ]
          Luke Lu made changes -
          Fix Version/s 1.1.0 [ 12317959 ]
          Fix Version/s 1.2.0 [ 12321657 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h3521_20120611_b-1.0.patch [ 12531911 ]
          Tsz Wo Nicholas Sze made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Resolution Fixed [ 1 ]
          Tsz Wo Nicholas Sze made changes -
          Fix Version/s 1.2.0 [ 12321657 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h3521_20120611_b-1.patch [ 12531751 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h3521_20120610_b-1.patch [ 12531646 ]
          Tsz Wo Nicholas Sze made changes -
          Field Original Value New Value
          Summary Allow namenode to toleration edit log corruption Allow namenode to tolerate edit log corruption
          Tsz Wo Nicholas Sze created issue -

            People

            • Assignee:
              Tsz Wo Nicholas Sze
              Reporter:
              Tsz Wo Nicholas Sze
            • Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development