[KAFKA-3317] too many open files between kafka borkers or may between borker and clients

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.9.0.0, 0.9.0.1
• Environment: CentOS release 6.5 (Final); kafka_2.11-0.9.0.1
• Flags: Important
• Assignee: Unassigned
• Reporter: david
• Created: 02/Mar/16 15:11
• Updated: 25/Oct/16 10:20

Description

there is much open files in my java app client which write msg to kafka broker, i used

<dependency>
<groupId>org.apache.kafka</groupId>
<artifactId>kafka-clients</artifactId>
<version>0.9.0.1</version>
</dependency>

new api to write msg. when i use

lsof -p 8780 | wc -l
19184
lsof -p 8780 | grep XmlIpcRegSvc | wc -l
4920
lsof -p 8780 | grep pipe | wc -l
9576
lsof -p 8780 | grep eventpoll | wc -l
4792

where 8780 is my java app pid.

java 37121 app *796u IPv6 960673997 0t0 TCP mad183:50213->mad180:XmlIpcRegSvc (ESTABLISHED)

there are many ESTABLISHED XmlIpcRegSvc , and seems not closed.
and It likes use ipv6 .