Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-761

Failure to process rename operation from edits log due to quota verification

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.20.2, 0.21.0, 0.22.0
    • 0.20.2, 0.21.0
    • namenode
    • None
    • Corrected an error when checking quota policy that resulted in a failure to read the edits log, stopping the primary/secondary name node.

    Description

      When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up.

      Attachments

        1. hdfs-761.patch
          6 kB
          Suresh Srinivas
        2. hdfs-761.rel20.patch
          3 kB
          Suresh Srinivas
        3. hdfs-761.1.patch
          6 kB
          Suresh Srinivas
        4. hdfs-761.1.rel20.patch
          4 kB
          Suresh Srinivas
        5. hdfs-761.1.patch
          6 kB
          Suresh Srinivas
        6. hdfs-761.rel21.patch
          8 kB
          Suresh Srinivas

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sureshms Suresh Srinivas
            sureshms Suresh Srinivas
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment