Details
-
Bug
-
Status: Done
-
Major
-
Resolution: Done
-
0.4.2
-
None
-
AWS
Description
I'm trying to deploy Metron on AWS using the cloud deployment method.
It looks like it is having problems with building the master node
[metron-test] sensors,ambari_master,ec2,monit
I tried rebuilding the node from scratch and running the run script multiple times, always with the same result.
During the installation I'm getting the following log:
TASK [setup] *******************************************************************
ok: [localhost]
ok: [ec2-34-227-190-43.compute-1.amazonaws.com]
ok: [ec2-34-201-150-57.compute-1.amazonaws.com]
ok: [ec2-54-162-174-97.compute-1.amazonaws.com]
ok: [ec2-34-207-187-45.compute-1.amazonaws.com]
ok: [ec2-52-91-15-158.compute-1.amazonaws.com]
ok: [ec2-34-229-153-26.compute-1.amazonaws.com]
ok: [ec2-52-73-77-81.compute-1.amazonaws.com]
ok: [ec2-54-175-242-208.compute-1.amazonaws.com]
ok: [ec2-54-85-210-26.compute-1.amazonaws.com]
ok: [ec2-34-229-86-210.compute-1.amazonaws.com]
TASK [metron-builder : Build Metron] *******************************************
fatal: [ec2-34-227-190-43.compute-1.amazonaws.com -> localhost]: FAILED! => {"changed": true, "cmd": "cd /root/metron/metron-deployment/amazon-ec2/../playbooks/../.. && mvn clean package -DskipTests -T 2C -P HDP-2.5.0.0,mpack", "delta": "0:00:03.308032", "end": "2017-11-16 14:04:52.835967", "failed": true, "rc": 1, "start": "2017-11-16 14:04:49.527935", "stderr": "", "stdout": "Warning: JAVA_HOME environment variable is not set.\n[INFO] Scanning for projects...\n[INFO] ------------------------------------------------------------------------\n[INFO] Reactor Build Order:\n[INFO] \n[INFO] Metron\n[INFO] metron-stellar\n[INFO] stellar-common\n[INFO] metron-analytics\n[INFO] metron-maas-common\n[INFO] metron-platform\n[INFO] metron-zookeeper\n[INFO] metron-test-utilities\n[INFO] metron-integration-test\n[INFO] metron-maas-service\n[INFO] metron-common\n[INFO] metron-statistics\n[INFO] metron-writer\n[INFO] metron-storm-kafka-override\n[INFO] metron-storm-kafka\n[INFO] metron-hbase\n[INFO] metron-profiler-common\n[INFO] metron-profiler-client\n[INFO] metron-profiler\n[INFO] metron-hbase-client\n[INFO] metron-enrichment\n[INFO] m
etron-indexing\n[INFO] metron-solr\n[INFO] metron-pcap\n[INFO] metron-parsers\n[INFO] metron-pcap-backend\n[INFO] metron-data-management\n[INFO] metron-api\n[INFO] metron-management\n[INFO] elasticsearch-shaded\n[INFO] metron-elasticsearch\n[INFO] metron-deployment\n[INFO] Metron Ambari Management Pack\n[INFO] metron-contrib\n[INFO] metron-docker\n[INFO] metron-interface\n[INFO] metron-config\n[INFO] metron-alerts\n[INFO] metron-rest-client\n[INFO] metron-rest\n[INFO] site-book\n[INFO] 3rd party Functions (just for tests)\n[INFO] \n[INFO] Using the MultiThreadedBuilder implementation with a thread count of 4\n[INFO] \n[INFO] ------------------------------------------------------------------------\n[INFO] Building Metron 0.4.2\n[INFO] ------------------------------------------------------------------------\n[INFO] \n[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ Metron ---\n[INFO] \n[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ Metron ---\n[INFO] \n[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (default) @ Metron ---
\n[INFO] argLine set to -javaagent:/root/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/root/metron/target/jacoco.exec\n[INFO] \n[INFO] --- jacoco-maven-plugin:0.7.9:report (report) @ Metron ---\n[INFO] Skipping JaCoCo execution due to missing execution data file.\n[INFO] \n[INFO] ------------------------------------------------------------------------\n[INFO] Building metron-stellar 0.4.2\n[INFO] ------------------------------------------------------------------------\n[INFO] \n[INFO] ------------------------------------------------------------------------\n[INFO] Building metron-analytics 0.4.2\n[INFO] ------------------------------------------------------------------------\n[INFO] \n[INFO] ------------------------------------------------------------------------\n[INFO] Building metron-deployment 0.4.2\n[INFO] -----------------------------------------------------
-------------------\n[INFO] \n[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ metron-deployment ---\n[INFO] \n[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ metron-deployment ---\n[INFO] \n[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (default) @ metron-deployment ---\n[INFO] argLine set to -javaagent:/root/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/root/metron/metron-deployment/target/jacoco.exec\n[INFO] \n[INFO] --- jacoco-maven-plugin:0.7.9:report (report) @ metron-deployment ---\n[INFO] \n[INFO] Skipping JaCoCo execution due to missing execution data file.\n[INFO] \n[INFO] ------------------------------------------------------------------------\n[INFO] Building metron-contrib 0.4.2\n[INFO] ------------------------------------------------------------------------\n[INFO] \n[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ metron-contrib ---\n[INFO] \n[INFO] --- maven-enforcer-plugin:1.4
.1:enforce (enforce-versions) @ metron-contrib ---\n[INFO] \n[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (default) @ metron-contrib ---\n[INFO] ------------------------------------------------------------------------\n[INFO] Building metron-platform 0.4.2\n[INFO] ------------------------------------------------------------------------\n[INFO] argLine set to -javaagent:/root/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/root/metron/metron-contrib/target/jacoco.exec\n[INFO] \n[INFO] --- jacoco-maven-plugin:0.7.9:report (report) @ metron-contrib ---\n[INFO] Skipping JaCoCo execution due to missing execution data file.\n[INFO] \n[INFO] ------------------------------------------------------------------------\n[INFO] Building metron-interface 0.4.2\n[INFO] ------------------------------------------------------------------------\n[INFO] ------------------------------------------------------------------------\n[INFO] Reactor Summary:\n[INFO] \n[INFO] Metron ............................................. SUC
CESS [ 0.851 s]\n[INFO] metron-stellar ..................................... SKIPPED\n[INFO] stellar-common ..................................... SKIPPED\n[INFO] metron-analytics ................................... SKIPPED\n[INFO] metron-maas-common ................................. SKIPPED\n[INFO] metron-platform .................................... SKIPPED\n[INFO] metron-zookeeper ................................... SKIPPED\n[INFO] metron-test-utilities .............................. SKIPPED\n[INFO] metron-integration-test ............................ SKIPPED\n[INFO] metron-maas-service ................................ SKIPPED\n[INFO] metron-common ...................................... SKIPPED\n[INFO] metron-statistics .................................. SKIPPED\n[INFO] metron-writer ...................................... SKIPPED\n[INFO] metron-storm-kafka-override ........................ SKIPPED\n[INFO] metron-storm-kafka ................................. SKIPPED\n[INFO] metron-hbase ....................................... SKIPPED\n[INFO] metron-profiler-common ............................. SKIPPED\n[INFO] metron-prof
iler-client ............................. SKIPPED\n[INFO] metron-profiler .................................... SKIPPED\n[INFO] metron-hbase-client ................................ SKIPPED\n[INFO] metron-enrichment .................................. SKIPPED\n[INFO] metron-indexing .................................... SKIPPED\n[INFO] metron-solr ..................................
...... SKIPPED\n[INFO] metron-pcap ........................................ SKIPPED\n[INFO] metron-parsers ..................................... SKIPPED\n[INFO] metron-pcap-backend ................................ SKIPPED\n[INFO] metron-data-management ............................. SKIPPED\n[INFO] metron-api ......................................... SKIPPED\n[INFO] metron-manag
ement .................................. SKIPPED\n[INFO] elasticsearch-shaded ............................... SKIPPED\n[INFO] metron-elasticsearch ............................... SKIPPED\n[INFO] metron-deployment .................................. SUCCESS [ 0.005 s]\n[INFO] Metron Ambari Management Pack ...................... SKIPPED\n[INFO] metron-contrib ....................
................. SUCCESS [ 0.007 s]\n[INFO] metron-docker ...................................... SKIPPED\n[INFO] metron-interface ................................... FAILURE [ 0.011 s]\n[INFO] metron-config ...................................... SKIPPED\n[INFO] metron-alerts ...................................... SKIPPED\n[INFO] metron-rest-client ...........................
...... SKIPPED\n[INFO] metron-rest ........................................ SKIPPED\n[INFO] site-book .......................................... SKIPPED\n[INFO] 3rd party Functions (just for tests) ............... SKIPPED\n[INFO] ------------------------------------------------------------------------\n[INFO] BUILD FAILURE\n[INFO] -----------------------------------------------
-------------------------\n[INFO] Total time: 1.554 s (Wall Clock)\n[INFO] Finished at: 2017-11-16T14:04:52+00:00\n[INFO] Final Memory: 24M/177M\n[INFO] ------------------------------------------------------------------------\n[ERROR] Failed to execute goal on project metron-interface: Could not resolve dependencies for project org.apache.metron:metron-interface:pom:0.4.2: Coul
d not find artifact sun.jdk:tools:jar:LATEST at specified path /usr/lib/jvm/java-8-openjdk-amd64/jre/../lib/tools.jar -> [Help 1]\n[ERROR] \n[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.\n[ERROR] Re-run Maven using the -X switch to enable full debug logging.\n[ERROR] \n[ERROR] For more information about the errors and possible solutions, pl
ease read the following articles:\n[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException\n[ERROR] \n[ERROR] After correcting the problems, you can resume the build with the command\n[ERROR] mvn <goals> -rf :metron-interface\n[INFO] \n[INFO] -----------------------
-------------------------------------------------\n[INFO] Skipping site-book\n[INFO] This project has been banned from the build due to previous failures.\n[INFO] ------------------------------------------------------------------------\n[INFO] \n[INFO] -------------------------------------------------------
-----------------\n[INFO] Skipping Metron Ambari Management Pack\n[INFO] This project has been banned from the build due to previous failures.\n[INFO] ------------------------------------------------------------------------\n[INFO] \n[INFO] -------------------------------------------------------------------
-----\n[INFO] Skipping metron-docker\n[INFO] This project has been banned from the build due to previous failures.\n[INFO] ------------------------------------------------------------------------", "stdout_lines": ["Warning: JAVA_HOME environment variable is not set.", "[INFO] Scanning for projects...", "[INFO] -------------------------------------------------------------------
-----", "[INFO] Reactor Build Order:", "[INFO] ", "[INFO] Metron", "[INFO] metron-stellar", "[INFO] stellar-common", "[INFO] metron-analytics", "[INFO] metron-maas-common", "[INFO] metron-platform", "[INFO] metron-zookeeper", "[INFO] metron-test-utilities", "[INFO] metron-integration-test", "[INFO] metron-maas-service", "[INFO] metron-common", "[INFO] metron-statistics", "[INFO
] metron-writer", "[INFO] metron-storm-kafka-override", "[INFO] metron-storm-kafka", "[INFO] metron-hbase", "[INFO] metron-profiler-common", "[INFO] metron-profiler-client", "[INFO] metron-profiler", "[INFO] metron-hbase-client", "[INFO] metron-enrichment", "[INFO] metron-indexing", "[INFO] metron-solr", "[INFO] metron-pcap", "[INFO] metron-parsers", "[INFO] metron-pcap-backend
", "[INFO] metron-data-management", "[INFO] metron-api", "[INFO] metron-management", "[INFO] elasticsearch-shaded", "[INFO] metron-elasticsearch", "[INFO] metron-deployment", "[INFO] Metron Ambari Management Pack", "[INFO] metron-contrib", "[INFO] metron-docker", "[INFO] metron-interface", "[INFO] metron-config", "[INFO] metron-alerts", "[INFO] metron-rest-client", "[INFO] metr
on-rest", "[INFO] site-book", "[INFO] 3rd party Functions (just for tests)", "[INFO] ", "[INFO] Using the MultiThreadedBuilder implementation with a thread count of 4", "[INFO] ", "[INFO] ------------------------------------------------------------------------", "[INFO] Building Metron 0.4.2", "[INFO] -----
-------------------------------------------------------------------", "[INFO] ", "[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ Metron ---", "[INFO] ", "[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ Metron ---", "[INFO] ", "[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (default) @ Metron ---", "[INFO] argLine set to -javaagent:/root/.m2/re
pository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/root/metron/target/jacoco.exec", "[INFO] ", "[INFO] --- jacoco-maven-plugin:0.7.9:report (report) @ Metron ---", "[INFO] Skipping JaCoCo execution due to missing execution data file.", "[INFO] ", "[INFO] ----------------
--------------------------------------------------------", "[INFO] Building metron-stellar 0.4.2", "[INFO] ------------------------------------------------------------------------", "[INFO] ", "[INFO] ------------------------------------------------------------------------", "[INFO] Building metron-analytic
s 0.4.2", "[INFO] ------------------------------------------------------------------------", "[INFO] ", "[INFO] ------------------------------------------------------------------------", "[INFO] Building metron-deployment 0.4.2", "[INFO] ----------------------------------------------------------------------
--", "[INFO] ", "[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ metron-deployment ---", "[INFO] ", "[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ metron-deployment ---", "[INFO] ", "[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (default) @ metron-deployment ---", "[INFO] argLine set to -javaagent:/root/.m2/repository/org/jacoco/org.jacoco.a
gent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/root/metron/metron-deployment/target/jacoco.exec", "[INFO] ", "[INFO] --- jacoco-maven-plugin:0.7.9:report (report) @ metron-deployment ---", "[INFO] ", "[INFO] Skipping JaCoCo execution due to missing execution data file.", "[INFO]
", "[INFO] ------------------------------------------------------------------------", "[INFO] Building metron-contrib 0.4.2", "[INFO] ------------------------------------------------------------------------", "[INFO] ", "[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ metron-contrib ---", "[INFO] ", "[INFO] --- mave
n-enforcer-plugin:1.4.1:enforce (enforce-versions) @ metron-contrib ---", "[INFO] ", "[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (default) @ metron-contrib ---", "[INFO] ------------------------------------------------------------------------", "[INFO] Building metron-platform 0.4.2", "[INFO] ------------------------------------------------------------------------", "[I
NFO] argLine set to -javaagent:/root/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/root/metron/metron-contrib/target/jacoco.exec", "[INFO] ", "[INFO] --- jacoco-maven-plugin:0.7.9:report (report) @ metron-contrib ---", "[INFO] Skipping JaCoCo execution due to missing execution data file.", "[INFO]
", "[INFO] ------------------------------------------------------------------------", "[INFO] Building metron-interface 0.4.2", "[INFO] ------------------------------------------------------------------------", "[INFO] ------------------------------------------------------------------------", "[INFO] Reactor Summary:", "[INFO] ", "[INFO] M
etron ............................................. SUCCESS [ 0.851 s]", "[INFO] metron-stellar ..................................... SKIPPED", "[INFO] stellar-common ..................................... SKIPPED", "[INFO] metron-analytics ................................... SKIPPED", "[INFO] metron-maas-common ................................. SKIPPED", "[INFO] metron-platfor
m .................................... SKIPPED", "[INFO] metron-zookeeper ................................... SKIPPED", "[INFO] metron-test-utilities .............................. SKIPPED", "[INFO] metron-integration-test ............................ SKIPPED", "[INFO] metron-maas-service ................................ SKIPPED", "[INFO] metron-common .........................
............. SKIPPED", "[INFO] metron-statistics .................................. SKIPPED", "[INFO] metron-writer ...................................... SKIPPED", "[INFO] metron-storm-kafka-override ........................ SKIPPED", "[INFO] metron-storm-kafka ................................. SKIPPED", "[INFO] metron-hbase ....................................... SKIPPED", "
[INFO] metron-profiler-common ............................. SKIPPED", "[INFO] metron-profiler-client ............................. SKIPPED", "[INFO] metron-profiler .................................... SKIPPED", "[INFO] metron-hbase-client ................................ SKIPPED", "[INFO] metron-enrichment .................................. SKIPPED", "[INFO] metron-indexing ..
.................................. SKIPPED", "[INFO] metron-solr ........................................ SKIPPED", "[INFO] metron-pcap ........................................ SKIPPED", "[INFO] metron-parsers ..................................... SKIPPED", "[INFO] metron-pcap-backend ................................ SKIPPED", "[INFO] metron-data-management ....................
......... SKIPPED", "[INFO] metron-api ......................................... SKIPPED", "[INFO] metron-management .................................. SKIPPED", "[INFO] elasticsearch-shaded ............................... SKIPPED", "[INFO] metron-elasticsearch ............................... SKIPPED", "[INFO] metron-deployment .................................. SUCCESS [ 0.00
5 s]", "[INFO] Metron Ambari Management Pack ...................... SKIPPED", "[INFO] metron-contrib ..................................... SUCCESS [ 0.007 s]", "[INFO] metron-docker ...................................... SKIPPED", "[INFO] metron-interface ................................... FAILURE [ 0.011 s]", "[INFO] metron-config ...................................... SKIP
PED", "[INFO] metron-alerts ...................................... SKIPPED", "[INFO] metron-rest-client ................................. SKIPPED", "[INFO] metron-rest ........................................ SKIPPED", "[INFO] site-book .......................................... SKIPPED", "[INFO] 3rd party Functions (just for tests) ............... SKIPPED", "[INFO] -----------
-------------------------------------------------------------", "[INFO] BUILD FAILURE", "[INFO] ------------------------------------------------------------------------", "[INFO] Total time: 1.554 s (Wall Clock)", "[INFO] Finished at: 2017-11-16T14:04:52+00:00", "[INFO] Final Memory: 24M/177M", "[INFO] ------------------------------------------------------------------------", "
[ERROR] Failed to execute goal on project metron-interface: Could not resolve dependencies for project org.apache.metron:metron-interface:pom:0.4.2: Could not find artifact sun.jdk:tools:jar:LATEST at specified path /usr/lib/jvm/java-8-openjdk-amd64/jre/../lib/tools.jar -> [Help 1]", "[ERROR] ", "[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch
.", "[ERROR] Re-run Maven using the -X switch to enable full debug logging.", "[ERROR] ", "[ERROR] For more information about the errors and possible solutions, please read the following articles:", "[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException", "[ERROR] ", "[ERROR] After correcting the problems, you can resume the build with
the command", "[ERROR] mvn <goals> -rf :metron-interface", "[INFO] ", "[INFO] ------------------------------------------------------------------------", "[INFO] Skipping site-book", "[INFO] This project has been banned from the build due to previous failures.", "[INFO] ------------------------------------
------------------------------------", "[INFO] ", "[INFO] ------------------------------------------------------------------------", "[INFO] Skipping Metron Ambari Management Pack", "[INFO] This project has been banned from the build due to previous failures.", "[INFO] --------------------------------------
----------------------------------", "[INFO] ", "[INFO] ------------------------------------------------------------------------", "[INFO] Skipping metron-docker", "[INFO] This project has been banned from the build due to previous failures.", "[INFO] --------------------------------------------------------
----------------"], "warnings": []}
PLAY RECAP *********************************************************************
ec2-34-201-150-57.compute-1.amazonaws.com : ok=16 changed=1 unreachable=0 failed=0
ec2-34-207-187-45.compute-1.amazonaws.com : ok=16 changed=1 unreachable=0 failed=0
ec2-34-227-190-43.compute-1.amazonaws.com : ok=21 changed=8 unreachable=0 failed=1
ec2-34-229-153-26.compute-1.amazonaws.com : ok=16 changed=1 unreachable=0 failed=0
ec2-34-229-86-210.compute-1.amazonaws.com : ok=16 changed=1 unreachable=0 failed=0
ec2-52-73-77-81.compute-1.amazonaws.com : ok=16 changed=1 unreachable=0 failed=0
ec2-52-91-15-158.compute-1.amazonaws.com : ok=16 changed=1 unreachable=0 failed=0
ec2-54-162-174-97.compute-1.amazonaws.com : ok=16 changed=1 unreachable=0 failed=0
ec2-54-175-242-208.compute-1.amazonaws.com : ok=16 changed=1 unreachable=0 failed=0
ec2-54-85-210-26.compute-1.amazonaws.com : ok=16 changed=1 unreachable=0 failed=0
localhost : ok=32 changed=7 unreachable=0 failed=0
Attachments
Issue Links
- links to
