Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-14909

Netty IOExceptions caused by unclean client disconnects being logged at INFO instead of TRACE

    XMLWordPrintableJSON

    Details

    • Severity:
      Low

      Description

      Observed spam logs on 3.0.17 cluster with redundant Netty IOExceptions caused due to client-side disconnections.

      INFO  [epollEventLoopGroup-2-28] 2018-11-20 23:23:04,386 Message.java:619 - Unexpected exception during request; channel = [id: 0x12995bc1, L:/xxx.xx.xxx.xxx:7104 - R:/xxx.xx.xxx.xxx:33754]
      io.netty.channel.unix.Errors$NativeIoException: syscall:read(...)() failed: Connection reset by peer
      	at io.netty.channel.unix.FileDescriptor.readAddress(...)(Unknown Source) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
      
      INFO  [epollEventLoopGroup-2-23] 2018-11-20 13:16:33,263 Message.java:619 - Unexpected exception during request; channel = [id: 0x98bd7c0e, L:/xxx.xx.xxx.xxx:7104 - R:/xxx.xx.xx.xx:33350]
      io.netty.channel.unix.Errors$NativeIoException: readAddress() failed: Connection timed out
      	at io.netty.channel.unix.Errors.newIOException(Errors.java:117) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
      	at io.netty.channel.unix.Errors.ioResult(Errors.java:138) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
      	at io.netty.channel.unix.FileDescriptor.readAddress(FileDescriptor.java:175) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
      	at io.netty.channel.epoll.AbstractEpollChannel.doReadBytes(AbstractEpollChannel.java:238) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
      	at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:926) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
      	at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:397) [netty-all-4.0.44.Final.jar:4.0.44.Final]
      	at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:302) [netty-all-4.0.44.Final.jar:4.0.44.Final]
      	at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) [netty-all-4.0.44.Final.jar:4.0.44.Final]
      	at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:144) [netty-all-4.0.44.Final.jar:4.0.44.Final]
      

      CASSANDRA-7849 addresses this for JAVA IO Exception like "java.io.IOException: Connection reset by peer", but not for Netty IOException since the exception message in Netty includes method name.

        Attachments

          Activity

            People

            • Assignee:
              sumanth.pasupuleti Sumanth Pasupuleti
              Reporter:
              sumanth.pasupuleti Sumanth Pasupuleti
              Authors:
              Sumanth Pasupuleti
              Reviewers:
              Jason Brown
            • Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: