Uploaded image for project: 'Chukwa'
  1. Chukwa
  2. CHUKWA-546

Add SocketAdaptor for collecting data from SocketAppender

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Data Collection
    • Labels:
      None

      Description

      SyslogAppender splits log which are greater than 1024 bytes into different message. The fragmentation of the message is very difficult for Chukwa to process the message on the collector side. Hence, I am dropping the idea of using SyslogAppender. The alternative approach is to implement SocketAdaptor to stream SocketAppender log file to Chukwa.

        Activity

        Hide
        eyang Eric Yang added a comment -
        • Implemented SocketAdaptor
        • Converted Log4JMetricsContext to use SocketAdaptor

        SocketAdaptor Usage:

        add SocketAdaptor HadoopMetrics 9095 0
        
        Show
        eyang Eric Yang added a comment - Implemented SocketAdaptor Converted Log4JMetricsContext to use SocketAdaptor SocketAdaptor Usage: add SocketAdaptor HadoopMetrics 9095 0
        Hide
        asrabkin Ari Rabkin added a comment -

        Looked good, and I just committed it.

        Show
        asrabkin Ari Rabkin added a comment - Looked good, and I just committed it.

          People

          • Assignee:
            eyang Eric Yang
            Reporter:
            eyang Eric Yang
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development