[BIGTOP-575] [Pseudo-dist config] Should yarn.nodemanager.remote-app-log-dir really be set?

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Fix Version/s: backlog
• Assignee: Unassigned
• Reporter: Harsh J
• Created: 04/May/12 06:48
• Updated: 30/Apr/13 04:26

Description

Currently we have in pseudo-dist config, the following set:

  <property>
    <description>Where to aggregate logs to.</description>
    <name>yarn.nodemanager.remote-app-log-dir</name>
    <value>/var/log/hadoop-yarn/apps</value>
  </property>

This requires the admin user (hdfs) to create:

hdfs dfs -mkdir /var/log/hadoop-yarn/apps, which is different from the local /var/log/hadoop-yarn/apps (is that even used? I see it being created locally).

So the two questions:

• I think we can leave this override as the default hdfs:///tmp/logs would be easier to start with?
• Also, is the local /var/log/hadoop-yarn/apps really required?