[HADOOP-4745] EC2 scripts should configure Hadoop to use all available disks on large instances

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.19.0
• Component/s: contrib/cloud
• Assignee: Thomas White
• Reporter: Thomas White
• Created: 01/Dec/08 14:50
• Updated: 31/Dec/09 01:27
• Resolved: 31/Dec/09 01:27

Description

The Hadoop configuration on EC2 currently always uses a single disk, even when more are available (http://docs.amazonwebservices.com/AWSEC2/2007-08-29/DeveloperGuide/instance-storage.html). Performance is significantly boosted by using all the available disks, so we should configure Hadoop to use them automatically.

Issue Links

• is related to: HADOOP-4382 Run Hadoop sort benchmark on Amazon EC2