[HADOOP-1587] Tasks run by MiniMRCluster don't get sysprops from TestCases

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.14.0
• Component/s: test

Environment

unix

• Assignee: Devaraj Das
• Reporter: Alejandro Abdelnur
• Created: 10/Jul/07 14:30
• Updated: 20/Aug/07 18:12
• Resolved: 25/Jul/07 20:45

Description

While it seems a general problem it is surfacing in streaming TestSymLink testcase with patch for HADOOP-1558

The contrib testcases use src/contrib/test/hadoop-site.xml.
The property 'mapred.system.dir' is this file is defined as with a variable '${contrib.name}'.
The src/build/build-contrib.xml ant file sets the sysproperty 'contrib.name' to the name of the contrib component for the JVM running the testcase.

The problem is that when a testcase uses MiniMRCluster the TaskRunner forks a JVM for the task and in this JVM (which uses the above hadoop-site.xml) the variable 'contrib.name' is undefined.

If I hardcode 'streaming' in the hadoop-site.xml for the TestSymLink the testcase works fine.

Issue Links

• blocks: HADOOP-1558 changes to OutputFormat to work on temporary directory to enable re-running crashed jobs (Issue: 1121)