[SLIDER-163] Change recommended app_log_dir value for HBase

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Slider 0.40
• Assignee: Ted Yu
• Reporter: Ted Yu
• Created: 24/Jun/14 18:00
• Updated: 10/Jul/14 19:52
• Resolved: 24/Jun/14 20:05

Description

With the following value:

    "site.global.app_log_dir": "${AGENT_LOG_ROOT}/app/log",

I observed the actual log directory having deeply nested structure:

-Dhbase.log.dir=/grid/0/hdp/yarn/log/application_1403300788015_0005/container_1403300788015_0005_01_000003,/grid/1/hdp/yarn/log/application_1403300788015_0005/container_1403300788015_0005_01_000003,/grid/2/hdp/yarn/log/application_1403300788015_0005/container_1403300788015_0005_01_000003,/grid/3/hdp/yarn/log/application_1403300788015_0005/container_1403300788015_0005_01_000003,/grid/4/hdp/yarn/log/application_1403300788015_0005/container_1403300788015_0005_01_000003,/grid/5/hdp/yarn/log/application_1403300788015_0005/container_1403300788015_0005_01_000003/app/log

This was due to ApplicationConstants.Environment.LOG_DIRS containing all possible locations for app logs.
I tried a few other options and found that the following achieves what is desired:

    "site.global.app_log_dir": "app/log",

Under /grid/4/hdp/yarn/local/usercache/yarn/appcache/application_1403300788015_0007/container_1403300788015_0007_01_000003/app/log/, I saw:

gc.log-201406241714                               hbase-yarn-master-hor12n11.gq1.ygridcore.net.out
hbase-yarn-master-hor12n11.gq1.ygridcore.net.log  SecurityAuth.audit

Issue Links

• relates to: SLIDER-116 Log handling for long-lived applications