[MAPREDUCE-1774] Large-scale Automated Framework

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.21.0
• Fix Version/s: 0.21.0
• Component/s: test
• Hadoop Flags: Reviewed
• Assignee: Konstantin I Boudnik
• Reporter: Konstantin I Boudnik
• Created: 07/May/10 05:32
• Updated: 02/May/13 02:29
• Resolved: 26/Jun/10 20:27

Description

This is MapReduce part of HADOOP-6332

Issue Links

• blocks: HADOOP-6786 test-patch needs to verify Herriot integrity
• blocks: MAPREDUCE-1646 Task Killing tests
• blocks: MAPREDUCE-1713 Utilities for system tests specific.
• is blocked by: HADOOP-6771 Herriot's artifact id for Maven deployment should be set to hadoop-core-instrumented
• is blocked by: HADOOP-6875 [Herriot] Cleanup of temp. configurations is needed upon restart of a cluster
• is depended upon by: MAPREDUCE-1790 Automatic resolution of Lzo codecs is needed.
• is depended upon by: MAPREDUCE-1827 [Herriot] Task Killing/Failing tests for a streaming job.
• is depended upon by: MAPREDUCE-1898 [Herriot] Implement a functionality for getting the job summary information of a job.
• is depended upon by: MAPREDUCE-1957 [Herriot] Test Job cache directories cleanup after job completes.
• is depended upon by: MAPREDUCE-1963 [Herriot] TaskMemoryManager should log process-tree's status while killing tasks
• is depended upon by: MAPREDUCE-1693 Process tree clean up of either a failed task or killed task tests.
• is depended upon by: MAPREDUCE-1710 Process tree clean up of exceeding memory limit tasks.
• is depended upon by: MAPREDUCE-1731 Process tree clean up suspended task tests.
• is depended upon by: MAPREDUCE-1809 Ant build changes for Streaming system tests in contrib projects.
• is depended upon by: MAPREDUCE-1899 [Herriot] Test jobsummary information for different jobs.
• is depended upon by: HADOOP-6839 [Herriot] Implement a functionality for getting the user list for creating proxy users.
• is depended upon by: MAPREDUCE-1812 New properties for suspend and resume process.
• is depended upon by: MAPREDUCE-1896 [Herriot] New property for multi user list.
• is related to: HADOOP-6332 Large-scale Automated Test Framework
• is required by: MAPREDUCE-1760 Herriot tests for MapReduce should support submission into a specific queue
• is required by: MAPREDUCE-1616 Automate system test case for checking the file permissions in mapred.local.dir
• is required by: MAPREDUCE-1654 Automate the job killing system test case.
• is required by: MAPREDUCE-1671 Test scenario for "Killing Task Attempt id till job fails"
• is required by: MAPREDUCE-1672 Create test scenario for "distributed cache file behaviour, when dfs file is not modified"
• is required by: MAPREDUCE-1676 Create test scenario for "distributed cache file behaviour, when dfs file is modified"
• is required by: MAPREDUCE-1677 Test scenario for a distributed cache file behaviour when the file is private
• is required by: MAPREDUCE-1730 Automate test scenario for successful/killed jobs' memory is properly removed from jobtracker after these jobs retire.
• is required by: MAPREDUCE-1741 Automate the test scenario of job related files are moved from history directory to done directory
• is required by: MAPREDUCE-1794 Test the job status of lost task trackers before and after the timeout.

Sub-Tasks

• Remote cluster control functionality needs JavaDocs improvement: Closed