Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15747

RBF: Rename across sub-namespaces.

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Since we have HDFS-15294, we can use it to rename across namespaces. This Jira proposes a basic implementation: enable the Router to handle rename within multi-namespaces with the federation balance tool.

      If the conditions below are satisfied, the router will rename the path across namespaces:
      1. The 'enable rename across namespaces' switch is on. Default is off.
      2. The remote location of src and the dst should be exactly one and should at different namespaces.

      We can implement this in 2 steps:
      1. Move hadoop-federation-balance module to hadoop-hdfs-rbf. That's because the implementation of federation balance depends on hadoop-hdfs-rbf and hadoop-distcp. To avoid circular dependency we can move hadoop-federation-balance to hadoop-hdfs-rbf and let hadoo-hdfs-rbf depend on hadoop-distcp.

      1. Move the router-related part from hadoop-federation-balance module to hadoop-hdfs-rbf module. So we can keep the hadoop-federation-balance module independent.
      2. The basic implementation of rename across sub-namespaces. This step relies on step one.

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HDFS-15923 RBF: Authentication failed when rename accross sub clusters

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HDFS-14431 RBF: Rename with multiple subclusters should fail if no eligible locations

          • Major - Major loss of function.
          • Patch Available

          New Feature - A new feature of the product, which has yet to be developed. HDFS-15087 RBF: Balance/Rename across federation namespaces

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. HDFS-15294 Federation balance tool

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              LiJinglun Jinglun
              LiJinglun Jinglun
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 5h 20m
                  5h 20m