Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11573

Support rename between different NameNodes in federated HDFS

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • federation
    • None
    • Patch

    Description

      Federated file system can improve overall scalability by dividing a single namespace into multiple sub-namespaces. Since the divided sub-namespace are held by different namenodes, rename operation between those sub-namespace is forbidden. Due to this restriction, many applications have to be rewritten to work around the issue after migrated to federated file system. Supporting rename between different namenodes would make it much easier to migrate to federated file systems.

      We have finished a preliminary implementation of this feature in a 2.6 branch. I'll upload a write-up regarding the design in a few days. And then I'll re-org the code against the trunk and upload the patch.

      Attachments

        1. HDFS-11573-2.6.5-001.patch
          317 kB
          zhouyingchao
        2. HDFS_federation_rename.pdf
          368 kB
          zhouyingchao

        Activity

          People

            Unassigned Unassigned
            sinago zhouyingchao
            Votes:
            0 Vote for this issue
            Watchers:
            13 Start watching this issue

            Dates

              Created:
              Updated: