Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7728

Avoid updating quota usage while loading edits

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Per the discussion here, currently we call INode#addSpaceConsumed while file/dir/snapshot deletion, even if this is still in the edits loading process. This is unnecessary and can cause issue like HDFS-7611. We should collect quota change and call FSDirectory#updateCount at the end of the operation.

        Attachments

        1. HDFS-7728.000.patch
          87 kB
          Jing Zhao
        2. HDFS-7728.001.patch
          87 kB
          Jing Zhao
        3. HDFS-7728.002.patch
          95 kB
          Jing Zhao
        4. HDFS-7728.003.patch
          97 kB
          Jing Zhao

          Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-11254 Standby NameNode may crash during failover if loading edits takes too long

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HDFS-7584 Enable Quota Support for Storage Types

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-6763 Initialize file system-wide quota once on transitioning to active

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              • Assignee:
                jingzhao Jing Zhao
                Reporter:
                jingzhao Jing Zhao
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: