[AMBARI-19180] Service Flume failed to start with "cannot open /grid/0/log/flume/a1.out for reading: Permission denied"

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.5.0
• Fix Version/s: 2.5.0
• Assignee: Dmytro Sen
• Reporter: Vivek Rathod
• Created: 12/Dec/16 20:58
• Updated: 24/Feb/17 17:45
• Resolved: 24/Feb/17 17:17

Description

STR:
-> Delete the following services on the cluster : Flume, Atlas, Hbase, Sqoop, Storm, Knox, AMS
-> Add them back using add service wizard
Flume fails to start with

2016-12-12 03:47:12,640 - Execute['ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0'] {'logoutput': True, 'tries': 20, 'try_sleep': 10}
2016-12-12 03:47:12,667 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:47:22,706 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:47:32,748 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:47:42,791 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:47:52,835 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:48:02,880 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:48:12,926 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:48:22,974 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:48:33,021 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:48:43,063 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:48:53,104 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:49:03,153 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:49:13,191 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:49:23,237 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:49:33,277 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:49:43,318 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:49:53,366 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:50:03,401 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:50:13,449 - Retrying after 10 seconds. Reason: Execution of 'ambari-sudo.sh  -H -E pgrep -o -u cstm-flume -f '^/usr/jdk64/jdk1.8.0_77.*a1.*' | ambari-sudo.sh  -H -E tee /var/run/flume/a1.pid  && test ${PIPESTATUS[0]} -eq 0' returned 1. 
2016-12-12 03:50:23,498 - Execute['find /grid/0/log/flume -maxdepth 1 -type f -name '*' -exec echo '==> {} <==' \; -exec tail -n 40 {} \;'] {'logoutput': True, 'ignore_failures': True, 'user': None}
==> /grid/0/log/flume/a1.out <==
tail: cannot open `/grid/0/log/flume/a1.out' for reading: Permission denied
==> /grid/0/log/flume/flume-a1.log <==
tail: cannot open `/grid/0/log/flume/flume-a1.log' for reading: Permission denied
==> /grid/0/log/flume/a2.out <==
tail: cannot open `/grid/0/log/flume/a2.out' for reading: Permission denied
==> /grid/0/log/flume/flume-a2.log <==
tail: cannot open `/grid/0/log/flume/flume-a2.log' for reading: Permission denied

Command failed after 1 tries

Issue Links

• links to: Review Board