Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-761

Failure to process rename operation from edits log due to quota verification

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.2, 0.21.0, 0.22.0
    • Fix Version/s: 0.20.2, 0.21.0
    • Component/s: namenode
    • Labels:
      None
    • Release Note:
      Corrected an error when checking quota policy that resulted in a failure to read the edits log, stopping the primary/secondary name node.

      Description

      When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up.

        Attachments

        1. hdfs-761.rel21.patch
          8 kB
          Suresh Srinivas
        2. hdfs-761.rel20.patch
          3 kB
          Suresh Srinivas
        3. hdfs-761.patch
          6 kB
          Suresh Srinivas
        4. hdfs-761.1.rel20.patch
          4 kB
          Suresh Srinivas
        5. hdfs-761.1.patch
          6 kB
          Suresh Srinivas
        6. hdfs-761.1.patch
          6 kB
          Suresh Srinivas

          Issue Links

            Activity

              People

              • Assignee:
                sureshms Suresh Srinivas
                Reporter:
                sureshms Suresh Srinivas
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: