[WHIRR-62] Mark fewer parameters in hadoop-site.xml as final

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Component/s: contrib/python
• Assignee: Unassigned
• Reporter: Eli Collins
• Created: 28/Jul/10 17:21
• Updated: 07/Aug/11 20:38
• Resolved: 07/Aug/11 20:38

Description

The hadoop-site.xml generated by hadoop-ec2-init-remote.sh makes a number of parameters final, per below it looks like some of these might be reasonably be over-ridden (eg you can override mapred.child.java.opts but not mapred.child.ulimit).

Would be great if hadoop-site.xml was pulled out into a separate file so users could see the template and easily update it with specific values they want to set.

>> On Jul 21, 1:59 am, "Bradford (LusciousPear)"
>> <[e-mail]> wrote:
>>> It looks like sometimes, setting something in my Flow's jobconf is not
>>> making it to the nodes.
>>>
>>> For example:
>>>
>>> flow.getJobConf().set("mapred.child.ulimit", "177772100000");
>>> flow.getJobConf().set("mapred.child.java.opts", "-Xmx1024m -Xms1024m -
>>> XX:+UseConcMarkSweepGC");
>>>
>>> If I look at the job.xml for that task, I'll see:
>>> mapred.child.ulimit 1126400
>>> mapred.child.java.opts -Xmx1024m -Xms1024m -XX:+UseConcMarkSweepGC
>>>
>>> Any ideas?
>>>
>>> -B
>>
>> –
>> You received this message because you are subscribed to the Google Groups
>> "cascading-user" group.
>> To post to this group, send email to [e-mail].