[HDFS-15423] RBF: WebHDFS create shouldn't choose DN from all sub-clusters

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.4.0
• Component/s: rbf, webhdfs
• Labels: pull-request-available
• Hadoop Flags: Reviewed
• Assignee: Fengnan Li
• Reporter: Chao Sun
• Created: 20/Jun/20 01:51
• Updated: 15/Apr/21 23:12
• Resolved: 15/Apr/21 23:12

Description

In RouterWebHdfsMethods and for a CREATE call, chooseDatanode first gets all DNs via getDatanodeReport, and then randomly pick one from the list via getRandomDatanode. This logic doesn't seem correct as it should pick a DN for the specific cluster(s) of the input path.

Issue Links

• fixes: HDFS-15878 RBF: Fix TestRouterWebHDFSContractCreate#testSyncable
• relates to: HDFS-15884 RBF: Remove unused method getCreateLocation in RouterRpcServer
• links to: GitHub Pull Request #2605
• links to: GitHub Pull Request #2900
• links to: GitHub Pull Request #2903
• links to: GitHub Pull Request #2903