[GEARPUMP-161] Application logs are not created on Yarn

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0
• Fix Version/s: 0.8.0
• Component/s: yarn
• Environment: yarn deployment: 1 master, 1 worker
• Assignee: Karol Brejna
• Reporter: Karol Brejna
• Created: 22/Jun/16 10:40
• Updated: 12/Dec/16 12:58
• Resolved: 12/Dec/16 12:58

Description

I have a simple cluster (1 master, 1 worker) running on YARN.

I deploy an app. The app lands on a worker (cdh-worker-2 machine in this case).

I inspect the worker and the app settings in the dashborad.

Worker dir is shown as: /var/log/hadoop-yarn/container/application_1466296175601_0020/container_e05_1466296175601_0020_01_000003

App log dir: /data1/hadoop/yarn/nm/usercache/cf/appcache/application_1466296175601_0020/container_e05_1466296175601_0020_01_000003/logs

The logs are written to worker log dir under stderr.

But there is no such a folder for app logs. 'logs' doesn exists under indicated location.

I tried to do a wrokarounds (as I thought it may be a simple permissions issue):

1.
chmod 777 on parent dir (/data1/hadoop/yarn/nm/usercache/cf/appcache/application_1466296175601_0020/container_e05_1466296175601_0020_01_000003)
restarted app
No results here. logs dir not created.

2.
created logs dir by hand and changed permissions:
mkdir logs
chmod 777 logs

No results here. logs dir not populated.