[CAMEL-14369] Camel Syslog Consumer doesn't handle syslog message from netcat/python client - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Not A Bug
Affects Version/s: 3.0.0
Fix Version/s: None
Component/s: camel-syslog
Labels:
None

Estimated Complexity:
Unknown

Description

I developed syslog server in camel like below

 from("netty:udp://127.0.0.1:514?sync=false&allowDefaultCodec=false")
    .routeId("sysloglistener").routeGroup("sysloglistener-group")
    .unmarshal().syslog()
    .to("log:DEBUG?showBody=true&showHeaders=true");

I tested with simple netcat command and it throws error

 echo "Test syslog message from Netcat" | nc -w1 -u 127.0.0.1 514

*Error Trace:*

2020-01-06 23:27:08.756 DEBUG 2772 --- [ntExecutorGroup] o.a.c.i.engine.DefaultReactiveExecutor   : Queuing reactive work: Step[ID-imrans-MBP-1578349622523-0-5,DefaultErrorHandler[Unmarshal[org.apache.camel.component.syslog.SyslogDataFormat@270d43a7]]]
    2020-01-06 23:27:08.757 DEBUG 2772 --- [ntExecutorGroup] o.a.c.i.engine.DefaultReactiveExecutor   : Queuing reactive work: CamelInternalProcessor - UnitOfWork - afterProcess - DefaultErrorHandler[Unmarshal[org.apache.camel.component.syslog.SyslogDataFormat@270d43a7]] - ID-imrans-MBP-1578349622523-0-5
    2020-01-06 23:27:08.757 DEBUG 2772 --- [ntExecutorGroup] o.a.c.i.engine.DefaultReactiveExecutor   : Queuing reactive work: Step[ID-imrans-MBP-1578349622523-0-5,DefaultErrorHandler[Unmarshal[org.apache.camel.component.syslog.SyslogDataFormat@270d43a7]]]
    2020-01-06 23:27:08.757 DEBUG 2772 --- [ntExecutorGroup] o.a.c.i.engine.DefaultReactiveExecutor   : Queuing reactive work: Callback[org.apache.camel.processor.CamelInternalProcessor$$Lambda$1103/433074890@3c888d6f]
    2020-01-06 23:27:08.761 ERROR 2772 --- [ntExecutorGroup] o.a.c.p.e.DefaultErrorHandler            : Failed delivery for (MessageId: ID-imrans-MBP-1578349622523-0-6 on ExchangeId: ID-imrans-MBP-1578349622523-0-5). Exhausted after delivery attempt: 1 caught: java.nio.BufferUnderflowException
    
    Message History
    ---------------------------------------------------------------------------------------------------------------------------------------
    RouteId              ProcessorId          Processor                                                                        Elapsed (ms)
    [sysloglistener    ] [sysloglistener    ] [from[netty://udp://127.0.0.1:514?allowDefaultCodec=false&sync=false]          ] [         2]
    [sysloglistener    ] [unmarshal1        ] [unmarshal[org.apache.camel.model.dataformat.SyslogDataFormat@7ec1effa]        ] [         0]
    
    Stacktrace
    ---------------------------------------------------------------------------------------------------------------------------------------
    
    java.nio.BufferUnderflowException: null
    	at java.nio.Buffer.nextGetIndex(Buffer.java:500) ~[na:1.8.0_121]
    	at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:135) ~[na:1.8.0_121]
    	at org.apache.camel.component.syslog.SyslogConverter.parseMessage(SyslogConverter.java:147) ~[camel-syslog-3.0.0.jar:3.0.0]
    	at org.apache.camel.component.syslog.SyslogDataFormat.unmarshal(SyslogDataFormat.java:47) ~[camel-syslog-3.0.0.jar:3.0.0]
    	at org.apache.camel.support.processor.UnmarshalProcessor.process(UnmarshalProcessor.java:62) ~[camel-support-3.0.0.jar:3.0.0]
    	at org.apache.camel.processor.errorhandler.RedeliveryErrorHandler$RedeliveryState.run(RedeliveryErrorHandler.java:476) ~[camel-base-3.0.0.jar:3.0.0]
    	at org.apache.camel.impl.engine.DefaultReactiveExecutor$Worker.schedule(DefaultReactiveExecutor.java:185) [camel-base-3.0.0.jar:3.0.0]
    	at org.apache.camel.impl.engine.DefaultReactiveExecutor.scheduleMain(DefaultReactiveExecutor.java:59) [camel-base-3.0.0.jar:3.0.0]
    	at org.apache.camel.processor.Pipeline.process(Pipeline.java:87) [camel-base-3.0.0.jar:3.0.0]
    	at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:228) [camel-base-3.0.0.jar:3.0.0]
    	at org.apache.camel.component.netty.handlers.ServerChannelHandler.processAsynchronously(ServerChannelHandler.java:141) [camel-netty-3.0.0.jar:3.0.0]
    	at org.apache.camel.component.netty.handlers.ServerChannelHandler.channelRead0(ServerChannelHandler.java:112) [camel-netty-3.0.0.jar:3.0.0]
    	at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) [netty-all-4.1.43.Final.jar:4.1.43.Final]
    	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) [netty-all-4.1.43.Final.jar:4.1.43.Final]
    	at io.netty.channel.AbstractChannelHandlerContext.access$600(AbstractChannelHandlerContext.java:56) [netty-all-4.1.43.Final.jar:4.1.43.Final]
    	at io.netty.channel.AbstractChannelHandlerContext$7.run(AbstractChannelHandlerContext.java:365) [netty-all-4.1.43.Final.jar:4.1.43.Final]
    	at io.netty.util.concurrent.DefaultEventExecutor.run(DefaultEventExecutor.java:66) [netty-all-4.1.43.Final.jar:4.1.43.Final]
    	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050) [netty-all-4.1.43.Final.jar:4.1.43.Final]
    	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-all-4.1.43.Final.jar:4.1.43.Final]
    	at java.lang.Thread.run(Thread.java:745) [na:1.8.0_121]
    
    2020-01-06 23:27:08.762 DEBUG 2772 --- [ntExecutorGroup] o.a.c.i.engine.DefaultReactiveExecutor   : Queuing reactive work: Callback[org.apache.camel.processor.Pipeline$$Lambda$1105/1936839498@779c7a4d]
    2020-01-06 23:27:08.762 DEBUG 2772 --- [ntExecutorGroup] o.a.c.i.engine.DefaultReactiveExecutor   : Queuing reactive work: Step[ID-imrans-MBP-1578349622523-0-5,Pipeline[[Channel[Unmarshal[org.apache.camel.component.syslog.SyslogDataFormat@270d43a7]], Channel[sendTo(log://DEBUG?showBody=true&showHeaders=true)]]]]
    2020-01-06 23:27:08.762 DEBUG 2772 --- [ntExecutorGroup] o.a.c.i.engine.DefaultReactiveExecutor   : Queuing reactive work: Callback[org.apache.camel.processor.CamelInternalProcessor$$Lambda$1103/433074890@730c9c78]
    2020-01-06 23:27:08.762 DEBUG 2772 --- [ntExecutorGroup] o.a.c.i.engine.DefaultReactiveExecutor   : Queuing reactive work: Callback[org.apache.camel.component.netty.handlers.ServerChannelHandler$1@789d178]

I tried with python client

    $ cat syslog-client1.py 
    import logging
    import logging.handlers
    
    my_logger = logging.getLogger('MyLogger')
    my_logger.setLevel(logging.DEBUG)
    
    handler = logging.handlers.SysLogHandler(address = ('127.0.0.1',514))
    
    my_logger.addHandler(handler)
    
    my_logger.debug('this is debug')
    my_logger.critical('this is critical')

this time error is different `Invalid syslog message, missing a mandatory space after month`

 2020-01-06 23:32:03.846 ERROR 2796 --- [ntExecutorGroup] o.a.c.component.syslog.SyslogConverter   : Invalid syslog message, missing a mandatory space after month
    2020-01-06 23:32:03.846 DEBUG 2796 --- [ntExecutorGroup] o.a.c.i.engine.DefaultReactiveExecutor   : Queuing reactive work: Step[ID-imrans-MBP-1578349917797-0-7,DefaultErrorHandler[Unmarshal[org.apache.camel.component.syslog.SyslogDataFormat@1da4b3f9]]]
    2020-01-06 23:32:03.846 DEBUG 2796 --- [ntExecutorGroup] o.a.c.i.engine.DefaultReactiveExecutor   : Queuing reactive work: Callback[org.apache.camel.processor.CamelInternalProcessor$$Lambda$1103/1805110340@57ed6495]
    2020-01-06 23:32:03.847 ERROR 2796 --- [ntExecutorGroup] o.a.c.p.e.DefaultErrorHandler            : Failed delivery for (MessageId: ID-imrans-MBP-1578349917797-0-8 on ExchangeId: ID-imrans-MBP-1578349917797-0-7). Exhausted after delivery attempt: 1 caught: java.lang.NullPointerException
    
    Message History
    ---------------------------------------------------------------------------------------------------------------------------------------
    RouteId              ProcessorId          Processor                                                                        Elapsed (ms)
    [sysloglistener    ] [sysloglistener    ] [from[netty://udp://127.0.0.1:514?allowDefaultCodec=false&sync=false]          ] [         0]
    [sysloglistener    ] [unmarshal1        ] [unmarshal[org.apache.camel.model.dataformat.SyslogDataFormat@682d75eb]        ] [         0]
    
    Stacktrace
    ---------------------------------------------------------------------------------------------------------------------------------------
    
    java.lang.NullPointerException: null
    	at org.apache.camel.component.syslog.SyslogConverter.parseRfc3164Date(SyslogConverter.java:370) ~[camel-syslog-3.0.0.jar:3.0.0]
    	at org.apache.camel.component.syslog.SyslogConverter.parseMessage(SyslogConverter.java:185) ~[camel-syslog-3.0.0.jar:3.0.0]
    	at org.apache.camel.component.syslog.SyslogDataFormat.unmarshal(SyslogDataFormat.java:47) ~[camel-syslog-3.0.0.jar:3.0.0]
    	at org.apache.camel.support.processor.UnmarshalProcessor.process(UnmarshalProcessor.java:62) ~[camel-support-3.0.0.jar:3.0.0]
    	at org.apache.camel.processor.errorhandler.RedeliveryErrorHandler$RedeliveryState.run(RedeliveryErrorHandler.java:476) ~[camel-base-3.0.0.jar:3.0.0]
    	at org.apache.camel.impl.engine.DefaultReactiveExecutor$Worker.schedule(DefaultReactiveExecutor.java:185) [camel-base-3.0.0.jar:3.0.0]
    	at org.apache.camel.impl.engine.DefaultReactiveExecutor.scheduleMain(DefaultReactiveExecutor.java:59) [camel-base-3.0.0.jar:3.0.0]
    	at org.apache.camel.processor.Pipeline.process(Pipeline.java:87) [camel-base-3.0.0.jar:3.0.0]
    	at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:228) [camel-base-3.0.0.jar:3.0.0]
    	at org.apache.camel.component.netty.handlers.ServerChannelHandler.processAsynchronously(ServerChannelHandler.java:141) [camel-netty-3.0.0.jar:3.0.0]
    	at org.apache.camel.component.netty.handlers.ServerChannelHandler.channelRead0(ServerChannelHandler.java:112) [camel-netty-3.0.0.jar:3.0.0]
    	at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) [netty-all-4.1.43.Final.jar:4.1.43.Final]
    	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) [netty-all-4.1.43.Final.jar:4.1.43.Final]
    	at io.netty.channel.AbstractChannelHandlerContext.access$600(AbstractChannelHandlerContext.java:56) [netty-all-4.1.43.Final.jar:4.1.43.Final]
    	at io.netty.channel.AbstractChannelHandlerContext$7.run(AbstractChannelHandlerContext.java:365) [netty-all-4.1.43.Final.jar:4.1.43.Final]
    	at io.netty.util.concurrent.DefaultEventExecutor.run(DefaultEventExecutor.java:66) [netty-all-4.1.43.Final.jar:4.1.43.Final]
    	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1050) [netty-all-4.1.43.Final.jar:4.1.43.Final]
    	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-all-4.1.43.Final.jar:4.1.43.Final]
    	at java.lang.Thread.run(Thread.java:745) [na:1.8.0_121]

Above server code works if i send syslog message from client developed in Apache Camel, Please find below link of github repo

SyslogApplication

Attachments

Activity

People

Assignee:: Unassigned

Reporter:: imran raza khan

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 06/Jan/20 22:46

Updated:: 08/Jan/20 10:59

Resolved:: 07/Jan/20 20:54