[METRON-342] Deployment - full-dev-platform - grok_upload - Error accessing file:/usr/metron/0.2.0BETA/patterns

• Type: Bug
• Status: To Do
• Priority: Trivial
• Resolution: Unresolved
• Labels: deployment

Environment

yoyo@yoyo-desktop:~/incubator-metron/metron-deployment/scripts$ ./platform-info.sh
Metron 0.2.0BETA
--
* master
--
commit 1182d1a87ce6a7b19b23a2d93bb72819835da102
Author: justinleet <[e-mail]>
Date: Wed Jul 20 11:15:34 2016 -0400

    METRON-334 Travis CI cache Maven dependencies (justinleet via dlyle65535) closes apache/incubator-metron#196
--
 metron-deployment/vagrant/full-dev-platform/Vagrantfile | 5 +++--
 1 file changed, 3 insertions(+), 2 deletions(-)
--
ansible 2.0.0.2
  config file =
  configured module search path = Default w/o overrides
--
Vagrant 1.8.5
--
Python 2.7.12
--
Apache Maven 3.3.9
Maven home: /usr/share/maven
Java version: 1.8.0_101, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-8-oracle/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "4.4.0-31-generic", arch: "amd64", family: "unix"
--
Linux yoyo-desktop 4.4.0-31-generic #50-Ubuntu SMP Wed Jul 13 00:07:12 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux

• External issue URL: https://github.com/apache/incubator-metron/pull/220
• Assignee: Unassigned
• Reporter: Yohann
• Created: 22/Jul/16 14:09
• Updated: 11/Feb/17 17:24

Description

hdfs user can't access to /usr/metron/0.2.0BETA/patterns for the copy of grok parsers to /apps/metron

yoyo@yoyo-desktop:~/incubator-metron/metron-deployment/vagrant/full-dev-platform$ vagrant provision
==> node1: Running provisioner: ansible...
    node1: Running ansible-playbook...
...
2016-07-22 14:34:23,656 p=9023 u=yoyo |  TASK [metron_streaming : include] **********************************************
2016-07-22 14:34:23,715 p=9023 u=yoyo |  included: /home/yoyo/incubator-metron/metron-deployment/roles/metron_streaming/tasks/grok_upload.yml for node1
2016-07-22 14:34:23,775 p=9023 u=yoyo |  TASK [metron_streaming : Create HDFS directory for grok patterns] **************
2016-07-22 14:34:26,213 p=9023 u=yoyo |  changed: [node1]
2016-07-22 14:34:26,217 p=9023 u=yoyo |  TASK [metron_streaming : Assign hfds user as owner of  /apps/metron/patterns HDFS directory] ***
2016-07-22 14:34:28,765 p=9023 u=yoyo |  changed: [node1]
2016-07-22 14:34:28,770 p=9023 u=yoyo |  TASK [metron_streaming : Assign permissions of HDFS /apps/metron/patterns directory] ***
2016-07-22 14:34:31,281 p=9023 u=yoyo |  changed: [node1]
2016-07-22 14:34:31,287 p=9023 u=yoyo |  TASK [metron_streaming : Upload Grok Patterns to hdfs:///apps/metron] **********
2016-07-22 14:34:33,814 p=9023 u=yoyo |  fatal: [node1]: FAILED! => {"changed": true, "cmd": ["hdfs", "dfs", "-put", "-f", "/usr/metron/0.2.0BETA/patterns", "/apps/metron"], "delta": "0:00:02.107232", "end": "2016-07-22 12:34:33.629405", "failed": true, "rc": 1, "start": "2016-07-22 12:34:31.522173", "stderr": "put: Error accessing file:/usr/metron/0.2.0BETA/patterns", "stdout": "", "stdout_lines": [], "warnings": []}
2016-07-22 14:34:33,815 p=9023 u=yoyo |  PLAY RECAP *********************************************************************
2016-07-22 14:34:33,816 p=9023 u=yoyo |  node1                      : ok=172  changed=31   unreachable=0    failed=1   

[vagrant@node1 ~]$ ls -l /usr/metron/0.2.0BETA
total 20
d---------.  2 root root 4096 22 juil. 12:19 bin
d---------.  3 root root 4096 22 juil. 12:19 config
d---------. 12 root root 4096 22 juil. 12:19 flux
drwxr-xr-x.  2 root root 4096 22 juil. 12:34 lib
d---------.  2 root root 4096 22 juil. 12:19 patterns

Issue Links

• links to: GitHub Pull Request #220