Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-761

Failure to process rename operation from edits log due to quota verification

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.20.2, 0.21.0, 0.22.0
    • 0.20.2, 0.21.0
    • namenode
    • None
    • Corrected an error when checking quota policy that resulted in a failure to read the edits log, stopping the primary/secondary name node.

    Description

      When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up.

      Attachments

        1. hdfs-761.1.patch
          6 kB
          Suresh Srinivas
        2. hdfs-761.1.patch
          6 kB
          Suresh Srinivas
        3. hdfs-761.1.rel20.patch
          4 kB
          Suresh Srinivas
        4. hdfs-761.patch
          6 kB
          Suresh Srinivas
        5. hdfs-761.rel20.patch
          3 kB
          Suresh Srinivas
        6. hdfs-761.rel21.patch
          8 kB
          Suresh Srinivas

        Issue Links

          Activity

            People

              sureshms Suresh Srinivas
              sureshms Suresh Srinivas
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: