Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13891 HDFS RBF stabilization phase I
  3. HDFS-13443

RBF: Update mount table cache immediately after changing (add/update/remove) mount table entries.

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: HDFS-13891
    • Component/s: fs
    • Labels:
    • Hadoop Flags:
      Reviewed

      Description

      Currently mount table cache is updated periodically, by default cache is updated every minute. After change in mount table, user operations may still use old mount table. This is bit wrong.

      To update mount table cache, maybe we can do following

      • Add refresh API in MountTableManager which will update mount table cache.
      • When there is a change in mount table entries, router admin server can update its cache and ask other routers to update their cache. For example if there are three routers R1,R2,R3 in a cluster then add mount table entry API, at admin server side, will perform following sequence of action
        1. user submit add mount table entry request on R1
        2. R1 adds the mount table entry in state store
        3. R1 call refresh API on R2
        4. R1 calls refresh API on R3
        5. R1 directly freshest its cache
        6. Add mount table entry response send back to user.

        Attachments

        1. HDFS-13443-HDFS-13891-002.patch
          87 kB
          Mohammad Arshad
        2. HDFS-13443-HDFS-13891-001.patch
          86 kB
          Mohammad Arshad
        3. HDFS-13443-017.patch
          87 kB
          Mohammad Arshad
        4. HDFS-13443-016.patch
          87 kB
          Mohammad Arshad
        5. HDFS-13443-015.patch
          87 kB
          Mohammad Arshad
        6. HDFS-13443-014.patch
          87 kB
          Mohammad Arshad
        7. HDFS-13443-013.patch
          87 kB
          Mohammad Arshad
        8. HDFS-13443-012.patch
          88 kB
          Mohammad Arshad
        9. HDFS-13443.011.patch
          87 kB
          Mohammad Arshad
        10. HDFS-13443.010.patch
          87 kB
          Mohammad Arshad
        11. HDFS-13443.009.patch
          89 kB
          Mohammad Arshad
        12. HDFS-13443.008.patch
          89 kB
          Mohammad Arshad
        13. HDFS-13443.007.patch
          83 kB
          Mohammad Arshad
        14. HDFS-13443.006.patch
          82 kB
          Mohammad Arshad
        15. HDFS-13443.005.patch
          76 kB
          Mohammad Arshad
        16. HDFS-13443.004.patch
          72 kB
          Mohammad Arshad
        17. HDFS-13443.003.patch
          71 kB
          Mohammad Arshad
        18. HDFS-13443.002.patch
          72 kB
          Mohammad Arshad
        19. HDFS-13443.001.patch
          72 kB
          Mohammad Arshad
        20. HDFS-13443-branch-2.002.patch
          65 kB
          Mohammad Arshad
        21. HDFS-13443-branch-2.001.patch
          66 kB
          Mohammad Arshad

          Issue Links

            Activity

              People

              • Assignee:
                arshad.mohammad Mohammad Arshad
                Reporter:
                arshad.mohammad Mohammad Arshad
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: