[HDFS-1341] Provide a mechanism to run functional tests on a real cluster

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.22.0
• Component/s: test
• Tags: herriot
• Assignee: Unassigned
• Reporter: Konstantin I Boudnik
• Created: 14/Aug/10 01:02
• Updated: 27/Sep/10 04:14

Description

With Herriot framework (implemented by HADOOP-6332 at all) in place it'd be great to have a way to run on a real cluster all (or as many as possible) functional tests using MiniDFSCluster at the moment.

This might possible be accomplished in two ways:

• by runtime dependency injection to specify underlying cluster abstraction to be chosen (MiniDFSCluster mock or a proxy for real cluster provided by Herriot library)
• by extending MiniDFSCluster to become a transparent adapter between a test and Herriot's real cluster proxy.

Having this in place will tremendously benefit overall quality of HDFS (and potentially all Hadoop) be reusing existing functional testbase for system testing.

Issue Links

• is related to: HADOOP-6332 Large-scale Automated Test Framework
• is related to: HDFS-1134 Large-scale Automated Framework