[STORM-3256] If all thread counts exceed 32767, the system will generate errors

• Type: Improvement
• Status: Open
• Priority: Blocker
• Resolution: Unresolved
• Affects Version/s: 1.1.0
• Component/s: storm-client
• Labels: patch
• Environment: CentOs 7.1
• Flags: Important
• Docs Text: If all thread counts exceed 32767, the system will generate errors, MessageBatch.java Line141.
• Assignee: Unassigned
• Reporter: bb_wolf
• Created: 15/Oct/18 15:34
• Updated: 06/Jan/19 15:55

Description

If all thread counts exceed 32767, the system will generate errors, MessageBatch.java Line141.

 

Storm systems are used for low latency and a linear increase in the number of concurrencies as servers increase.
If you set up four workers per server, it's easy to achieve 4000 degrees of parallelism, that is, 4000 threads per server, then 10 servers will exceed 32767.
Supporting only 32767 threads is a disaster for large-scale computing.
It is hoped that this function can be improved and repaired as soon as possible.