[HBASE-2343] [EC2] Test harness

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Assignee: Unassigned
• Reporter: Andrew Kyle Purtell
• Created: 18/Mar/10 00:35
• Updated: 11/Jun/22 23:20
• Resolved: 12/May/14 00:46

Description

Build an EC2-backed web service that allows one to

• Select a base AMI (with HBase public AMIs as default) and instance types

• Upload replacement Hadoop or HBase jars, additional jars for lib/

• Upload additional files, i.e. test scripts, in a controlled manner

• Execute ./bin/hadoop or ./bin/hbase with a supplied command line

Each test would get its own transient cluster. All output and logs would be collected from the cluster just before it is terminated and made available on an ongoing basis for posterity.

Given what I've been working with recently and am most familiar with, I'd implement it as a servlet: can use the jars provided by AWS with their command line tools directly, jsch, etc.

Issue Links

• relates to: HBASE-2341 Suite of test scripts that a.) load a cluster with a verifiable dataset and b.) do random kills of regionserver+datanodes in small cluster