Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13098

RBF: Datanodes interacting with Routers

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Datanodes talk to particular Namenodes. We could use the Router infrastructure for the Datanodes to register/heartbeating into them and the Routers would forward this to particular Namenodes. This would make the assignment of Datanodes to subclusters potentially more dynamic.

      The implementation would potentially include:

      • Router to implement part of DatanodeProtocol
      • Forwarding DN messages into Routers
      • Policies to assign datanodes to subclusters
      • Datanodes to make blockpool configuration dynamic

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            elgoiri Íñigo Goiri

            Dates

              Created:
              Updated:

              Slack

                Issue deployment