Details
-
Type:
Sub-task
-
Status: Resolved
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: Heterogeneous Storage (HDFS-2832)
-
Fix Version/s: Heterogeneous Storage (HDFS-2832)
-
Component/s: test
-
Labels:None
Description
The test assumes one block report per Datanode. We now send one block report per storage, the test needs to be updated.
Activity
Hi Arpit, as discussed in HDFS-5481, the left part of v3 patch already include a fix for it, so I split it as a demo patch and put it here. Please feel free to merge with other test fixes. Thanks!
Show
Junping Du
added a comment - Hi Arpit, as discussed in HDFS-5481 , the left part of v3 patch already include a fix for it, so I split it as a demo patch and put it here. Please feel free to merge with other test fixes. Thanks!
Junping, here is a patch to fix this a little differently by adding MiniDFSCluster#DIRS_PER_DATANODE.
Show
Arpit Agarwal
added a comment - Junping, here is a patch to fix this a little differently by adding MiniDFSCluster#DIRS_PER_DATANODE .
+1. new patch looks good to me. We can have something like #DIRS_PER_DATANODE shortly. In future, we may add additional parameter on startDataNodes with num of DIRs (which is equal to storages or volumes). Shall we?
Show
Junping Du
added a comment - +1. new patch looks good to me. We can have something like #DIRS_PER_DATANODE shortly. In future, we may add additional parameter on startDataNodes with num of DIRs (which is equal to storages or volumes). Shall we?
Thanks Junping! I committed the fix to branch HDFS-2832.
Show
Arpit Agarwal
added a comment - Thanks Junping! I committed the fix to branch HDFS-2832 .
I have a patch for this issue, trying to see if I can combine any more test fixes in the same patch.