Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11573

Support rename between different NameNodes in federated HDFS

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: federation
    • Labels:
      None
    • Flags:
      Patch

      Description

      Federated file system can improve overall scalability by dividing a single namespace into multiple sub-namespaces. Since the divided sub-namespace are held by different namenodes, rename operation between those sub-namespace is forbidden. Due to this restriction, many applications have to be rewritten to work around the issue after migrated to federated file system. Supporting rename between different namenodes would make it much easier to migrate to federated file systems.

      We have finished a preliminary implementation of this feature in a 2.6 branch. I'll upload a write-up regarding the design in a few days. And then I'll re-org the code against the trunk and upload the patch.

        Attachments

        1. HDFS-11573-2.6.5-001.patch
          317 kB
          zhouyingchao
        2. HDFS_federation_rename.pdf
          368 kB
          zhouyingchao

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              sinago zhouyingchao
            • Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated: