Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: HA branch (HDFS-1623)
    • Fix Version/s: HA branch (HDFS-1623)
    • Component/s: ha, test
    • Labels:
      None

      Description

      Quota is one of the areas I suspect we might have bugs in the current state HA implementation. We need to track quotas correctly on the standby so that when a failover occurs, all of the stats are up to date. Let's add some functional tests that exercise quotas during failover/failback.

      1. hdfs-2688.txt
        5 kB
        Todd Lipcon
      2. hdfs-2688.txt
        5 kB
        Todd Lipcon

        Activity

        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-HAbranch-build #57 (See https://builds.apache.org/job/Hadoop-Hdfs-HAbranch-build/57/)
        HDFS-2688. Add tests for quota tracking in an HA cluster. Contributed by Todd Lipcon.

        todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1235017
        Files :

        • /hadoop/common/branches/HDFS-1623/hadoop-hdfs-project/hadoop-hdfs/CHANGES.HDFS-1623.txt
        • /hadoop/common/branches/HDFS-1623/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestQuotasWithHA.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-HAbranch-build #57 (See https://builds.apache.org/job/Hadoop-Hdfs-HAbranch-build/57/ ) HDFS-2688 . Add tests for quota tracking in an HA cluster. Contributed by Todd Lipcon. todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1235017 Files : /hadoop/common/branches/ HDFS-1623 /hadoop-hdfs-project/hadoop-hdfs/CHANGES. HDFS-1623 .txt /hadoop/common/branches/ HDFS-1623 /hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestQuotasWithHA.java
        Hide
        Todd Lipcon added a comment -

        Yep, good catch. I'll commit this version of the patch which fixes the argument ordering. Thanks

        Show
        Todd Lipcon added a comment - Yep, good catch. I'll commit this version of the patch which fixes the argument ordering. Thanks
        Hide
        Eli Collins added a comment -

        +1 looks good.

        Nit: NS/DS_QUOTA and expectedSize should be the 1st parameter to assertEquals.

        Show
        Eli Collins added a comment - +1 looks good. Nit: NS/DS_QUOTA and expectedSize should be the 1st parameter to assertEquals.
        Hide
        Todd Lipcon added a comment -

        Here's a simple test which makes sure the space and ns quotas are properly tracked through changes applied by the edit tailer.

        Show
        Todd Lipcon added a comment - Here's a simple test which makes sure the space and ns quotas are properly tracked through changes applied by the edit tailer.

          People

          • Assignee:
            Todd Lipcon
            Reporter:
            Todd Lipcon
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development