Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14814

RBF: RouterQuotaUpdateService supports inherited rule.

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      I want to add a rule 'The quota should be set the same as the nearest parent' to Global Quota. Supposing we have the mount table below.

      M1: /dir-a                            ns0->/dir-a     {nquota=10,squota=20}
      M2: /dir-a/dir-b                 ns1->/dir-b     {nquota=-1,squota=30}
      M3: /dir-a/dir-b/dir-c       ns2->/dir-c     {nquota=-1,squota=-1}
      M4: /dir-d                           ns3->/dir-d     {nquota=-1,squota=-1}

       

      The quota for the remote locations on the namespaces should be:
      ns0->/dir-a     {nquota=10,squota=20}
      ns1->/dir-b     {nquota=10,squota=30}
      ns2->/dir-c      {nquota=10,squota=30}
      ns3->/dir-d     {nquota=-1,squota=-1}

       

      The quota of the remote location is set the same as the corresponding MountTable, and if there is no quota of the MountTable then the quota is set to the nearest parent MountTable with quota.

       

      It's easy to implement it. In RouterQuotaUpdateService each time we compute the currentQuotaUsage, we can get the quota info for each MountTable. We can do a
      check and fix all the MountTable which's quota doesn't match the rule above.

        Attachments

        1. HDFS-14814.001.patch
          17 kB
          Jinglun
        2. HDFS-14814.002.patch
          16 kB
          Jinglun
        3. HDFS-14814.003.patch
          16 kB
          Jinglun
        4. HDFS-14814.004.patch
          16 kB
          Jinglun
        5. HDFS-14814.005.patch
          17 kB
          Jinglun
        6. HDFS-14814.006.patch
          20 kB
          Jinglun
        7. HDFS-14814.007.patch
          19 kB
          Jinglun
        8. HDFS-14814.008.patch
          19 kB
          Jinglun
        9. HDFS-14814.009.patch
          19 kB
          Jinglun
        10. HDFS-14814.010.patch
          20 kB
          Jinglun
        11. HDFS-14814.011.patch
          17 kB
          Jinglun

          Issue Links

            Activity

              People

              • Assignee:
                LiJinglun Jinglun
                Reporter:
                LiJinglun Jinglun
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: