[HDFS-1338] Improve TestDFSIO

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: test
• Assignee: Unassigned
• Reporter: Arun Murthy
• Created: 10/Aug/10 16:39
• Updated: 27/Sep/12 14:25

Description

Currently the read test in TestDFSIO benchmark just opens a large side file and measures the read performance. The MR scheduler has no opportunity to do any optimization for the TestDFSIO MR application. The side-effect of this is that it is very hard to do any meaningful analysis of the results of the benchmark i.e. to check if node-local or rack-local or off-switch read performance improved/degraded.

Issue Links

• relates to: MAPREDUCE-2023 TestDFSIO read test may not read specified bytes.