[STORM-3511] Nimbus logs got flood with TTransportException Error messages (because of thrift 0.12.0)

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0, 2.1.0
• Fix Version/s: 2.2.0, 2.1.1
• Labels: pull-request-available
• Assignee: Luke Marjoram
• Reporter: Ethan Li
• Created: 25/Sep/19 16:43
• Updated: 03/Jan/20 15:59
• Resolved: 03/Jan/20 15:59

Description

Submitting a wordCountTopology works in secure cluster. But the following

2019-09-25 13:53:46.560 o.a.s.t.s.TThreadPoolServer pool-15-thread-1 [ERROR] Thrift error occurred during processing of message.
org.apache.storm.thrift.transport.TTransportException: null
        at org.apache.storm.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) ~[shaded-deps-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.thrift.transport.TTransport.readAll(TTransport.java:86) ~[shaded-deps-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:374) ~[shaded-deps-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:451) ~[shaded-deps-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.thrift.transport.TSaslTransport.read(TSaslTransport.java:433) ~[shaded-deps-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.thrift.transport.TSaslServerTransport.read(TSaslServerTransport.java:43) ~[shaded-deps-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.thrift.transport.TTransport.readAll(TTransport.java:86) ~[shaded-deps-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:425) ~[shaded-deps-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:321) ~[shaded-deps-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:225) ~[shaded-deps-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.thrift.TBaseProcessor.process(TBaseProcessor.java:27) ~[shaded-deps-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.security.auth.sasl.SaslTransportPlugin$TUGIWrapProcessor.process(SaslTransportPlugin.java:147) ~[storm-client-2.0.1.y.jar:2.0.1.y]
        at org.apache.storm.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:310) [shaded-deps-2.0.1.y.jar:2.0.1.y]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_181]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_181]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]

flood the nimbus log. (2.0.1.y is our internal version. The code is basically community 2.0.0)

This is similar to the issue found in Thrift community and got fixed in 0.13.0 but it's not released yet https://issues.apache.org/jira/browse/THRIFT-4805

Issue Links

• links to: GitHub Pull Request #3178
• links to: GitHub Pull Request #3179