Details
-
Test
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Now that we support multiple EC policies, we need a way test it to catch potential issues.
UPDATE:
Since many existing EC unit tests need some changes to use multiple EC policies, it would be good to create a jira for every few tests. Based on some discussion in HDFS-7866 and HDFS-9962, this task follows the below idea.
- Default policy (RS-6-3) always gets tested.
- Create a random ec policy test if the test is long-running (e.g. using minicluster many times).
- If the test is not long, all policies test with parametrizing would be better.
If you are interested in this work, please join it and create a jira under this jira.
Attachments
Issue Links
- incorporates
-
HDFS-11823 Extend TestDFSStripedIutputStream/TestDFSStripedOutputStream with a random EC policy
- Resolved
- is related to
-
HDFS-7866 Erasure coding: NameNode manages multiple erasure coding policies
- Resolved
-
HDFS-11964 Decoding inputs should be correctly prepared in pread
- Resolved
As I proposed in
HDFS-7866, one possible solution is to randomly choose a policy in each test. Kai also suggested to make sure the default policy always gets tested.drankye, zhz, let's use this JIRA to reach an agreement. Would like to know your opinions. Thanks.