[HADOOP-2888] Enhancements to gridmix scripts

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.17.0
• Fix Version/s: 0.17.0
• Component/s: test
• Assignee: Mukund Madhugiri
• Reporter: Mukund Madhugiri
• Created: 25/Feb/08 19:21
• Updated: 21/May/08 20:05
• Resolved: 13/Mar/08 00:56

Description

I would like to propose enhancements to the gridmix scripts to make it:
1. easier to setup parameters for the test run and data generation (makes it easier to automate the runs using something like hudson)
2. ensure the benchmarks wait until they are completed (makes it easier to automate the runs using something like hudson)

Here are the details:
Ability to override these parameters in gridmix-env

• HADOOP_HOME
• GRID_MIX_HOME
• EXAMPLE_JAR
• APP_JAR
• STREAM_JAR
• GRID_MIX_DATA
• GRID_MIX_PROG

Ability to override these parameters in generateData.sh

• COMPRESSED_DATA_BYTES
• UNCOMPRESSED_DATA_BYTES
• INDIRECT_DATA_BYTES

Ability for the tests submitted to the same cluster to wait until they are done. Changes will be in:

• submissionScripts/monsterQueriesToSameCluster
• submissionScripts/maxentToSameCluster
• submissionScripts/textSortToSameCluster
• submissionScripts/webdataScanToSameCluster
• submissionScripts/webdataSortToSameCluster