[HADOOP-3750] Fix and enforce module dependencies

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.20.0
• Hadoop Flags: Incompatible change, Reviewed
• Release Note: Removed deprecated method parseArgs from org.apache.hadoop.fs.FileSystem.
• Assignee: Sharad Agarwal
• Reporter: Thomas White
• Created: 11/Jul/08 12:02
• Updated: 08/Jul/09 16:52
• Resolved: 04/Dec/08 10:23

Description

Since HADOOP-2916 Hadoop Core consists of modules in independent source trees: core, hdfs, mapred (and others). The dependencies between them should be enforced to avoid cyclic dependencies. At present they all have dependencies on each other.

Issue Links

• blocks: HDFS-256 Split HDFS into sub project
• blocks: MAPREDUCE-231 Split map/reduce into sub-project
• is blocked by: HADOOP-4631 Split the default configurations into 3 parts
• relates to: MAPREDUCE-395 Dependency cycle: Submitter and TaskTracker
• relates to: MAPREDUCE-480 Dependency cycle: log and mapred

Sub-Tasks

• Refactor org.apache.hadoop.mapred.StatusHttpServer: Closed
• Fix simple module dependencies between core, hdfs and mapred: Closed
• Add setVerifyChecksum() method to FileSystem: Closed
• Move LineRecordReader.LineReader class to util package: Closed
• Create a MapReduce-specific ReflectionUtils that handles JobConf and JobConfigurable: Closed
• Remove Task's dependency on concrete file systems: Closed
• Remove RunJar's dependency on JobClient: Closed