[SAMZA-641] YARN fails to start

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Component/s: hello-samza
• Assignee: Unassigned
• Reporter: Ryan Oblak
• Created: 07/Apr/15 18:26
• Updated: 18/Apr/15 00:16
• Resolved: 18/Apr/15 00:16

Description

I followed the "Get the Code" instructions, but when I tried to run bin/grid bootstrap I received errors:

EXECUTING: start yarn
mkdir: cannot create directory `/logs': Permission denied
chown: cannot access `/logs': No such file or directory
starting resourcemanager, logging to /logs/yarn-roblak-resourcemanager-roblak-ld1.out
/home/roblak/workspace/hello-samza/deploy/yarn/sbin/yarn-daemon.sh: line 124: /logs/yarn-roblak-resourcemanager-roblak-ld1.out: No such file or directory
head: cannot open `/logs/yarn-roblak-resourcemanager-roblak-ld1.out' for reading: No such file or directory
/home/roblak/workspace/hello-samza/deploy/yarn/sbin/yarn-daemon.sh: line 129: /logs/yarn-roblak-resourcemanager-roblak-ld1.out: No such file or directory
/home/roblak/workspace/hello-samza/deploy/yarn/sbin/yarn-daemon.sh: line 130: /logs/yarn-roblak-resourcemanager-roblak-ld1.out: No such file or directory

I'm unable to find any YARN-related processes:

 hello-samza git:(latest) ✗ ps aux | grep -i yarn
roblak   30275  0.0  0.0 103252   888 pts/2    R+   10:59   0:00 grep --color=auto --exclude-dir=.bzr --exclude-dir=.cvs --exclude-dir=.git --exclude-dir=.hg --exclude-dir=.svn -i yarn
 hello-samza git:(latest) ✗ ps aux | grep -i resourcemanager          
roblak     652  0.0  0.0 103252   876 pts/2    S+   11:16   0:00 grep --color=auto --exclude-dir=.bzr --exclude-dir=.cvs --exclude-dir=.git --exclude-dir=.hg --exclude-dir=.svn -i resourcemanager
 hello-samza git:(latest) ✗ ps aux | grep -i nodemanager    
roblak     700  0.0  0.0 103252   880 pts/2    S+   11:16   0:00 grep --color=auto --exclude-dir=.bzr --exclude-dir=.cvs --exclude-dir=.git --exclude-dir=.hg --exclude-dir=.svn -i nodemanager

And there's nothing at http://localhost:8088.

Setting YARN_LOG_DIR makes the log errors go away but produces nice errors, and it still fails to start.

hello-samza git:(latest) ✗ YARN_LOG_DIR=$PWD/logs bin/grid start yarn
EXECUTING: start yarn
starting resourcemanager, logging to /home/roblak/workspace/hello-samza/logs/yarn-roblak-resourcemanager-roblak-ld1.out
nice: /bin/yarn: No such file or directory
starting nodemanager, logging to /home/roblak/workspace/hello-samza/logs/yarn-roblak-nodemanager-roblak-ld1.out
nice: /bin/yarn: No such file or directory

I get the sense that if I ran bin/grid start yarn as root everything would work, but that doesn't seem appropriate nor should it be necessary to do so.

I'll update this ticket if I find a solution