Uploaded image for project: 'Chukwa (retired)'
  1. Chukwa (retired)
  2. CHUKWA-409

Make SocketTeeWriter work in a single stage pipleine

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 0.3.0
    • None
    • Data Collection
    • None

    Description

      I wanted to use SocketTeeWriter without going through the steps of
      writing to HDFS.
      It seems that PipelineStageWriter is designed to have any number of
      PipeLineable writers, optionally followed by a SeqFileWriter.
      So I changed my collector config :

      <property>
      <name>chukwaCollector.writerClass</name>
      <value>org.apache.hadoop.chukwa.datacollection.writer.PipelineStageWriter</value>
      </property>

      <property>
      <name>chukwaCollector.pipeline</name>
      <value>org.apache.hadoop.chukwa.datacollection.writer.SocketTeeWriter</value>
      </property>

      After doing one minor change to SocketTeeWriter, I could get this to
      work. The advantage is that now I do not need to set up HDFS.

      Attachments

        1. CHUKWA-409.patch
          0.9 kB
          thushara wijeratna

        Activity

          People

            Unassigned Unassigned
            thushara thushara wijeratna
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: