Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14814

RBF: RouterQuotaUpdateService supports inherited rule.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.3.0
    • None
    • None
    • Reviewed

    Description

      I want to add a rule 'The quota should be set the same as the nearest parent' to Global Quota. Supposing we have the mount table below.

      M1: /dir-a                            ns0->/dir-a     {nquota=10,squota=20}
      M2: /dir-a/dir-b                 ns1->/dir-b     {nquota=-1,squota=30}
      M3: /dir-a/dir-b/dir-c       ns2->/dir-c     {nquota=-1,squota=-1}
      M4: /dir-d                           ns3->/dir-d     {nquota=-1,squota=-1}

       

      The quota for the remote locations on the namespaces should be:
      ns0->/dir-a     {nquota=10,squota=20}
      ns1->/dir-b     {nquota=10,squota=30}
      ns2->/dir-c      {nquota=10,squota=30}
      ns3->/dir-d     {nquota=-1,squota=-1}

       

      The quota of the remote location is set the same as the corresponding MountTable, and if there is no quota of the MountTable then the quota is set to the nearest parent MountTable with quota.

       

      It's easy to implement it. In RouterQuotaUpdateService each time we compute the currentQuotaUsage, we can get the quota info for each MountTable. We can do a
      check and fix all the MountTable which's quota doesn't match the rule above.

      Attachments

        1. HDFS-14814.011.patch
          17 kB
          Jinglun
        2. HDFS-14814.010.patch
          20 kB
          Jinglun
        3. HDFS-14814.009.patch
          19 kB
          Jinglun
        4. HDFS-14814.008.patch
          19 kB
          Jinglun
        5. HDFS-14814.007.patch
          19 kB
          Jinglun
        6. HDFS-14814.006.patch
          20 kB
          Jinglun
        7. HDFS-14814.005.patch
          17 kB
          Jinglun
        8. HDFS-14814.004.patch
          16 kB
          Jinglun
        9. HDFS-14814.003.patch
          16 kB
          Jinglun
        10. HDFS-14814.002.patch
          16 kB
          Jinglun
        11. HDFS-14814.001.patch
          17 kB
          Jinglun

        Issue Links

          Activity

            People

              LiJinglun Jinglun
              LiJinglun Jinglun
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: