[MAPREDUCE-2485] reinitialize CLASSPATH variable when executing Mapper/Reducer code

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 0.20.2
• Component/s: pipes

Environment

Ubuntu 10.04 LTS

• Assignee: Unassigned
• Reporter: Tom Melendez
• Created: 11/May/11 22:03
• Updated: 23/May/11 23:18
• Resolved: 23/May/11 23:18

Description

We're using pipes, and using libhdfs inside our mapper and reducer code. We've determined that we need to execute a putenv call in order for libhdfs to actually have access to the CLASSPATH. Ideally, it should just use the CLASSPATH we set when the job was executed.

For some more context, see these threads:
https://groups.google.com/a/cloudera.org/group/cdh-user/browse_thread/thread/ae9808d80fb132fb?tvc=2
http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.user/25830