Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15087

RBF: Balance/Rename across federation namespaces

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      The Xiaomi storage team has developed a new feature called HFR(HDFS Federation Rename) that enables us to do balance/rename across federation namespaces. The idea is to first move the meta to the dst NameNode and then link all the replicas. It has been working in our largest production cluster for 2 months. We use it to balance the namespaces. It turns out HFR is fast and flexible. The detail could be found in the design doc. 

      Looking forward to a lively discussion.

        Attachments

        1. HFR_Rename Across Federation Namespaces.pdf
          234 kB
          Jinglun
        2. HDFS-15087.initial.patch
          356 kB
          Jinglun

          Issue Links

            Activity

              People

              • Assignee:
                LiJinglun Jinglun
                Reporter:
                LiJinglun Jinglun
              • Votes:
                0 Vote for this issue
                Watchers:
                23 Start watching this issue

                Dates

                • Created:
                  Updated: