[HDFS-3697] Enable fadvise readahead by default

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.0.2-alpha, 3.0.0-alpha1
• Fix Version/s: 1.2.0, 2.0.2-alpha
• Component/s: datanode, performance
• Hadoop Flags: Reviewed

Release Note

The datanode now performs 4MB readahead by default when reading data from its disks, if the native libraries are present. This has been shown to improve performance in many workloads. The feature may be disabled by setting dfs.datanode.readahead.bytes to "0".

• Assignee: Todd Lipcon
• Reporter: Todd Lipcon
• Created: 20/Jul/12 19:09
• Updated: 12/May/16 18:12
• Resolved: 02/Aug/12 17:51

Description

The fadvise features have been implemented for some time, and we've enabled them in production at a lot of customer sites without difficulty. I'd like to enable the readahead feature by default in future versions so that users get this benefit without any manual configuration required.

The other fadvise features seem to be more workload-dependent and need further testing before enabling by default.

Issue Links

• relates to: HDFS-3754 BlockSender doesn't shutdown ReadaheadPool threads