Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7728

Avoid updating quota usage while loading edits

          Details

          • Type: Bug
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: None
          • Fix Version/s: 2.8.0, 3.0.0-alpha1
          • Component/s: None
          • Labels:
            None
          • Target Version/s:
          • Hadoop Flags:
            Reviewed

            Description

            Per the discussion here, currently we call INode#addSpaceConsumed while file/dir/snapshot deletion, even if this is still in the edits loading process. This is unnecessary and can cause issue like HDFS-7611. We should collect quota change and call FSDirectory#updateCount at the end of the operation.

              Attachments

              1. HDFS-7728.003.patch
                97 kB
                Jing Zhao
              2. HDFS-7728.002.patch
                95 kB
                Jing Zhao
              3. HDFS-7728.001.patch
                87 kB
                Jing Zhao
              4. HDFS-7728.000.patch
                87 kB
                Jing Zhao

                Issue Links

                is related to

                Bug - A problem which impairs or prevents the functions of the product. HDFS-11254 Standby NameNode may crash during failover if loading edits takes too long

                • Critical - Crashes, loss of data, severe memory leak.
                • Resolved

                New Feature - A new feature of the product, which has yet to be developed. HDFS-7584 Enable Quota Support for Storage Types

                • Major - Major loss of function.
                • Closed
                relates to

                Bug - A problem which impairs or prevents the functions of the product. HDFS-6763 Initialize file system-wide quota once on transitioning to active

                • Major - Major loss of function.
                • Resolved

                  Activity

                    People

                    • Assignee:
                      jingzhao Jing Zhao
                      Reporter:
                      jingzhao Jing Zhao
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      7 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: