[HADOOP-9656] Gridmix unit tests fail on Windows and Linux

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.1.0-beta, 3.0.0-alpha1
• Fix Version/s: 2.1.0-beta
• Component/s: test, tools
• Target Version/s: 2.1.0-beta
• Hadoop Flags: Reviewed
• Assignee: Chuan Liu
• Reporter: Chuan Liu
• Created: 20/Jun/13 04:22
• Updated: 12/May/16 18:26
• Resolved: 25/Jun/13 19:31

Description

The following three Gridmix unit tests fail on both Windows and Linux:

• TestGridmixSubmission
• TestLoadJob
• TestSleepJob
• TestDistCacheEmulation

For the first three unit tests, one common cause of failure for both Windows and Linux is that -1 was passed to scaleConfigParameter() as the default per-task memory request in GridmixJob.configureHighRamProperties() method.

In additional to the memory setting issue, Windows also have a path issue. In CommonJobTest.doSubmission() method, "root" path is an HDFS path. However, it is initialized as a local file path. This lead to later failure to create "root" on HDFS.

For TestDistCacheEmulation, the test asserts a different permission (0644) than the permission that GridmixGenerateDistCacheData job sets on those files.

Issue Links

• is part of: HADOOP-8562 Enhancements to support Hadoop on Windows Server and Windows Azure environments