Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7728

Avoid updating quota usage while loading edits

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.8.0, 3.0.0-alpha1
    • None
    • None
    • Reviewed

    Description

      Per the discussion here, currently we call INode#addSpaceConsumed while file/dir/snapshot deletion, even if this is still in the edits loading process. This is unnecessary and can cause issue like HDFS-7611. We should collect quota change and call FSDirectory#updateCount at the end of the operation.

      Attachments

        1. HDFS-7728.003.patch
          97 kB
          Jing Zhao
        2. HDFS-7728.002.patch
          95 kB
          Jing Zhao
        3. HDFS-7728.001.patch
          87 kB
          Jing Zhao
        4. HDFS-7728.000.patch
          87 kB
          Jing Zhao

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-11254 Standby NameNode may crash during failover if loading edits takes too long

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HDFS-7584 Enable Quota Support for Storage Types

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-6763 Initialize file system-wide quota once on transitioning to active

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              jingzhao Jing Zhao
              jingzhao Jing Zhao
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: