Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2438

Make Syslog source message body configurable

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.6.0
    • Component/s: None
    • Labels:
      None

      Description

      FLUME-2217 and FLUME-1666 enabled adding or removing headers from the syslog body. If headers are completely removed, it would be nice to be able to add back in host name and timestamp.

      1. FLUME-2438.0.patch
        36 kB
        Abraham Elmahrek
      2. FLUME-2438.1.patch
        56 kB
        Abraham Elmahrek
      3. FLUME-2438.2.patch
        48 kB
        Abraham Elmahrek
      4. FLUME-2438.3.patch
        50 kB
        Abraham Elmahrek
      5. FLUME-2438.4.patch
        50 kB
        Abraham Elmahrek

        Issue Links

          Activity

          Hide
          hudson Hudson added a comment -

          UNSTABLE: Integrated in flume-trunk #652 (See https://builds.apache.org/job/flume-trunk/652/)
          FLUME-2438. Make Syslog source message body configurable (mpercy: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=e3b9b09cca015728a16e1368b26188c10a35df09)

          • flume-ng-core/src/test/java/org/apache/flume/source/TestMultiportSyslogTCPSource.java
          • flume-ng-core/src/main/java/org/apache/flume/source/SyslogTcpSource.java
          • flume-ng-core/src/main/java/org/apache/flume/source/SyslogUDPSource.java
          • flume-ng-doc/sphinx/FlumeUserGuide.rst
          • flume-ng-core/src/main/java/org/apache/flume/source/SyslogUtils.java
          • flume-ng-core/src/main/java/org/apache/flume/source/MultiportSyslogTCPSource.java
          • flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogUtils.java
          • flume-ng-core/src/main/java/org/apache/flume/source/SyslogParser.java
          • flume-ng-tests/src/test/java/org/apache/flume/test/util/SyslogAgent.java
          • flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogParser.java
          • flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogUdpSource.java
          • flume-ng-tests/src/test/java/org/apache/flume/test/agent/TestSyslogSource.java
          • flume-ng-core/src/main/java/org/apache/flume/source/SyslogSourceConfigurationConstants.java
          • flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogTcpSource.java
          • flume-ng-tests/src/test/java/org/apache/flume/test/util/StagedInstall.java
          Show
          hudson Hudson added a comment - UNSTABLE: Integrated in flume-trunk #652 (See https://builds.apache.org/job/flume-trunk/652/ ) FLUME-2438 . Make Syslog source message body configurable (mpercy: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=e3b9b09cca015728a16e1368b26188c10a35df09 ) flume-ng-core/src/test/java/org/apache/flume/source/TestMultiportSyslogTCPSource.java flume-ng-core/src/main/java/org/apache/flume/source/SyslogTcpSource.java flume-ng-core/src/main/java/org/apache/flume/source/SyslogUDPSource.java flume-ng-doc/sphinx/FlumeUserGuide.rst flume-ng-core/src/main/java/org/apache/flume/source/SyslogUtils.java flume-ng-core/src/main/java/org/apache/flume/source/MultiportSyslogTCPSource.java flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogUtils.java flume-ng-core/src/main/java/org/apache/flume/source/SyslogParser.java flume-ng-tests/src/test/java/org/apache/flume/test/util/SyslogAgent.java flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogParser.java flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogUdpSource.java flume-ng-tests/src/test/java/org/apache/flume/test/agent/TestSyslogSource.java flume-ng-core/src/main/java/org/apache/flume/source/SyslogSourceConfigurationConstants.java flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogTcpSource.java flume-ng-tests/src/test/java/org/apache/flume/test/util/StagedInstall.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Flume-trunk-hbase-98 #12 (See https://builds.apache.org/job/Flume-trunk-hbase-98/12/)
          FLUME-2438. Make Syslog source message body configurable (mpercy: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=e3b9b09cca015728a16e1368b26188c10a35df09)

          • flume-ng-core/src/main/java/org/apache/flume/source/SyslogParser.java
          • flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogParser.java
          • flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogUtils.java
          • flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogUdpSource.java
          • flume-ng-core/src/main/java/org/apache/flume/source/MultiportSyslogTCPSource.java
          • flume-ng-core/src/main/java/org/apache/flume/source/SyslogUDPSource.java
          • flume-ng-core/src/main/java/org/apache/flume/source/SyslogSourceConfigurationConstants.java
          • flume-ng-core/src/main/java/org/apache/flume/source/SyslogUtils.java
          • flume-ng-tests/src/test/java/org/apache/flume/test/util/SyslogAgent.java
          • flume-ng-tests/src/test/java/org/apache/flume/test/agent/TestSyslogSource.java
          • flume-ng-core/src/test/java/org/apache/flume/source/TestMultiportSyslogTCPSource.java
          • flume-ng-tests/src/test/java/org/apache/flume/test/util/StagedInstall.java
          • flume-ng-core/src/main/java/org/apache/flume/source/SyslogTcpSource.java
          • flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogTcpSource.java
          • flume-ng-doc/sphinx/FlumeUserGuide.rst
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Flume-trunk-hbase-98 #12 (See https://builds.apache.org/job/Flume-trunk-hbase-98/12/ ) FLUME-2438 . Make Syslog source message body configurable (mpercy: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=e3b9b09cca015728a16e1368b26188c10a35df09 ) flume-ng-core/src/main/java/org/apache/flume/source/SyslogParser.java flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogParser.java flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogUtils.java flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogUdpSource.java flume-ng-core/src/main/java/org/apache/flume/source/MultiportSyslogTCPSource.java flume-ng-core/src/main/java/org/apache/flume/source/SyslogUDPSource.java flume-ng-core/src/main/java/org/apache/flume/source/SyslogSourceConfigurationConstants.java flume-ng-core/src/main/java/org/apache/flume/source/SyslogUtils.java flume-ng-tests/src/test/java/org/apache/flume/test/util/SyslogAgent.java flume-ng-tests/src/test/java/org/apache/flume/test/agent/TestSyslogSource.java flume-ng-core/src/test/java/org/apache/flume/source/TestMultiportSyslogTCPSource.java flume-ng-tests/src/test/java/org/apache/flume/test/util/StagedInstall.java flume-ng-core/src/main/java/org/apache/flume/source/SyslogTcpSource.java flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogTcpSource.java flume-ng-doc/sphinx/FlumeUserGuide.rst
          Hide
          mpercy Mike Percy added a comment -

          Pushed to trunk and 1.6 branches

          Show
          mpercy Mike Percy added a comment - Pushed to trunk and 1.6 branches
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit 5734a4ab5e1445c5c77c0277c1a22ca7addfdc9d in flume's branch refs/heads/flume-1.6 from Mike Percy
          [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=5734a4a ]

          FLUME-2438. Make Syslog source message body configurable

          Allow for specifying particular fields to keep in the body of the event
          or drop, representing them only in Flume event headers.

          (Abraham Elmahrek via Mike Percy)

          Show
          jira-bot ASF subversion and git services added a comment - Commit 5734a4ab5e1445c5c77c0277c1a22ca7addfdc9d in flume's branch refs/heads/flume-1.6 from Mike Percy [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=5734a4a ] FLUME-2438 . Make Syslog source message body configurable Allow for specifying particular fields to keep in the body of the event or drop, representing them only in Flume event headers. (Abraham Elmahrek via Mike Percy)
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit e3b9b09cca015728a16e1368b26188c10a35df09 in flume's branch refs/heads/trunk from Mike Percy
          [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=e3b9b09 ]

          FLUME-2438. Make Syslog source message body configurable

          Allow for specifying particular fields to keep in the body of the event
          or drop, representing them only in Flume event headers.

          (Abraham Elmahrek via Mike Percy)

          Show
          jira-bot ASF subversion and git services added a comment - Commit e3b9b09cca015728a16e1368b26188c10a35df09 in flume's branch refs/heads/trunk from Mike Percy [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=e3b9b09 ] FLUME-2438 . Make Syslog source message body configurable Allow for specifying particular fields to keep in the body of the event or drop, representing them only in Flume event headers. (Abraham Elmahrek via Mike Percy)
          Hide
          mpercy Mike Percy added a comment -

          +1

          Show
          mpercy Mike Percy added a comment - +1

            People

            • Assignee:
              abec Abraham Elmahrek
              Reporter:
              abec Abraham Elmahrek
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development