Uploaded image for project: 'Chukwa (retired)'
  1. Chukwa (retired)
  2. CHUKWA-737

Add heartbeat adaptor to push chukwa agent status to remote http server

Add voteWatch issue
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Reopened
    • Major
    • Resolution: Unresolved
    • 0.7.0
    • None
    • Data Collection
    • None

    Description

      Provide a generic HeartbeatAdaptor which can periodically send status reports to a remote http server. The adaptor can be configured with arbitrary number of component status checkers and it will send out a single status report for all components.

      Example - to send out the status of chukwa agent as well as a rest interface (in this case chukwa agent rest), we add the following adaptor:
      add HeartbeatAdaptor DefaultProcessor (ChukwaStatusChecker, HttpStatusChecker Chukwa.rest.server http://localhost:9090/rest/v1/adaptor) 3 0

      This will send out status reports such as -
      {"time":1424213867980,"components":[

      {"host":"host.example.com","component":"Chukwa.Agent","adaptor.count":1}

      ,

      {"status":"running","component":"Chukwa.rest.server","uri":"http:\/\/localhost:9090\/rest\/v1"}

      ]}

      Additional configuration needed in chukwa-agent-conf.xml
      chukwa.http.writer.host
      chukwa.http.writer.port
      if PipelineConnector is used, add org.apache.hadoop.chukwa.datacollection.writer.HttpWriter to head of pipeline

      Attachments

        1. CHUKWA-737.patch3
          24 kB
          shreyas subramanya
        2. CHUKWA-737.patch2
          23 kB
          shreyas subramanya
        3. CHUKWA-737.patch
          23 kB
          shreyas subramanya

        Activity

          People

            shreyass123 shreyas subramanya
            shreyass123 shreyas subramanya

            Dates

              Created:
              Updated:

              Slack

                Issue deployment