• Type: Sub-task Sub-task
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: hdfs-client
    • Labels:


      HDFS-3146 and HDFS-3216 expose multiple DN interfaces to the client. In order for clients, in aggregate, to use multiple DN interfaces clients should pick different interfaces when transferring blocks. Given that we cache client <-> DN connections the policy of picking a remote interface at random for each new connection seems best (vs round robin for example). In the future we could make the client congestion aware. We could also establish multiple connections between the client and DN and therefore use multiple interfaces for a single block transfer. Both of those are out of scope for this jira.

      1. hdfs-3218.txt
        7 kB
        Eli Collins


        Eli Collins created issue -
        Eli Collins made changes -
        Field Original Value New Value
        Target Version/s Multiple interfaces (HDFS-3140) [ 12320556 ]
        Eli Collins made changes -
        Summary The client should be able to use multiple remote DN interfaces for block transfer Use multiple remote DN interfaces for block transfer
        Eli Collins made changes -
        Attachment hdfs-3218.txt [ 12521792 ]
        Eli Collins made changes -
        Assignee Eli Collins [ eli2 ] Eli Collins [ eli ]


          • Assignee:
            Eli Collins
            Eli Collins
          • Votes:
            0 Vote for this issue
            1 Start watching this issue


            • Created: