[HDFS-12303] Change default EC cell size to 1MB for better performance - ASF JIRA

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Blocker
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 3.0.0-beta1
Component/s: None
Labels:
- hdfs-ec-3.0-must-do

Target Version/s:

3.0.0-beta1
Hadoop Flags:

Incompatible change
Release Note:
The cell size of the provided HDFS erasure coding policies has been changed from 64k to 1024k for better performance. The policy names have all been changed accordingly, i.e. RS-6-3.1024k.

Description

As discussed in ~~HDFS-11814~~, 1MB cell size shows better performance than others during the tests.

Attachments

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HDFS-12303.00.patch
15/Aug/17 10:10
24 kB
Wei Zhou
HDFS-12303.01.patch
21/Aug/17 02:29
28 kB
Wei Zhou
HDFS-12303.02.patch
23/Aug/17 06:13
34 kB
Wei Zhou

Activity

Comment

This comment will be Viewable by All Users Viewable by All Users

Cancel

People

Assignee:: Wei Zhou

Reporter:: Wei Zhou

Votes:: 0 Vote for this issue

Watchers:: 6 Start watching this issue

Dates

Created:: 15/Aug/17 05:47

Updated:: 11/Sep/17 21:13

Resolved:: 25/Aug/17 21:14

Agile

Slack

Issue deployment