[BIGTOP-1032] Refactor hdfs/TestCLI and hdfs/TestAppend to be generic filesystem tests

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.7.0
• Fix Version/s: backlog
• Component/s: tests
• Assignee: Martin Bukatovic
• Reporter: jay vyas
• Created: 19/Jul/13 20:26
• Updated: 18/Jun/14 09:00
• Resolved: 18/Jun/14 09:00

Description

The TestCLI and TestAppend classes both have hard references to an HDFS user shell, although most of their functionality is actually geared towards testing the abstract FileSystem interface.

Removing a couple of lines from TestCLI:

String[] createTestcliDirCmds =

{"hadoop fs -mkdir -p " + TEST_DIR_ABSOLUTE, "hadoop fs -chmod 777 " + TEST_DIR_ABSOLUTE}

;
shHDFS.exec(createTestcliDirCmds);

And a this line from TestAppend:

shHDFS.exec("hadoop fsck /user/$USERNAME/$testAppendInput/test2.file$date");

This will essentially allow bigtop suites to be used to validate file system functionality in clusters with heterogenous https://wiki.apache.org/hadoop/HCFS/ implementations.

Issue Links

• is related to: BIGTOP-1307 Some TestCLI cases fail with 'No such file or directory'
• is superceded by: BIGTOP-1342 Make TestCLI usable for both HDFS and HCFS
• relates to: BIGTOP-1321 TestCLI: check assumptions before the test run