[HDFS-3167] CLI-based driver for MiniDFSCluster

• Type: New Feature
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.0.0-alpha
• Fix Version/s: 2.0.0-alpha
• Component/s: test
• Target Version/s: 2.0.0-alpha
• Hadoop Flags: Reviewed
• Assignee: Henry Robinson
• Reporter: Henry Robinson
• Created: 30/Mar/12 21:25
• Updated: 28/Sep/15 20:58
• Resolved: 01/Apr/12 17:31

Description

Picking up a thread again from MAPREDUCE-987, I've found it very useful to have a CLI driver for running a single-process DFS cluster, particularly when developing features in HDFS clients. For example, being able to spin up a local cluster easily was tremendously useful for correctness testing of HDFS-2834.

I'd like to contribute a class based on the patch for MAPREDUCE-987 we've been using fairly extensively. Only for DFS, not MR since much has changed MR-side since the original patch.

Issue Links

• is related to: MAPREDUCE-987 Exposing MiniDFS and MiniMR clusters as a single process command-line