[AMBARI-9542] Ams Service Check failed on 3-node cluster

• Type: Task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.0
• Component/s: ambari-server
• Epic Link: Ambari Metrics System
• Assignee: Florian Barca
• Reporter: Florian Barca
• Due: 11/Feb/15
• Created: 10/Feb/15 03:18
• Updated: 10/Feb/15 18:52
• Resolved: 10/Feb/15 17:37

Description

During cluster deployment (all services except Knox), Ams Service Check failed with

stderr: /var/lib/ambari-agent/data/errors-85.txt
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/AMS/0.1.0/package/scripts/service_check.py", line 114, in <module>
AMSServiceCheck().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 184, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/AMS/0.1.0/package/scripts/service_check.py", line 53, in service_check
conn.request("POST", self.AMS_METRICS_POST_URL, metric_json, headers)
File "/usr/lib64/python2.6/httplib.py", line 914, in request
self._send_request(method, url, body, headers)
File "/usr/lib64/python2.6/httplib.py", line 951, in _send_request
self.endheaders()
File "/usr/lib64/python2.6/httplib.py", line 908, in endheaders
self._send_output()
File "/usr/lib64/python2.6/httplib.py", line 780, in _send_output
self.send(msg)
File "/usr/lib64/python2.6/httplib.py", line 739, in send
self.connect()
File "/usr/lib64/python2.6/httplib.py", line 720, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
socket.error: [Errno 111] Connection refused

stdout: /var/lib/ambari-agent/data/output-85.txt
2015-01-16 16:02:53,199 - AMS service check was started.
2015-01-16 16:02:53,209 - Generated metrics:
{
"metrics": [
{
"metricname": "AMS.SmokeTest.FakeMetric",
"appid": "amssmoketestfake",
"hostname": "dlysnichenko1-1.c.pramod-thangali.internal",
"timestamp": 1419860001000,
"starttime": 1419860001000,
"metrics":

{ "1419860001000": 0.0200197813927, "1419860002000": 1421424173.2 }

}
]
}

2015-01-16 16:02:53,209 - Connecting (POST) to 0.0.0.0:6188/ws/v1/timeline/metrics/

Issue Links

• links to: Code review