[FLUME-1293] NIO channel selector open throws "Too many open files" exception

• Type: Wish
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.1.0
• Component/s: Docs
• Labels: newbie possibly_obsolete

Environment

-bash-3.2$ java -version
java version "1.6.0_24"
Java(TM) SE Runtime Environment (build 1.6.0_24-b07)
Java HotSpot(TM) 64-Bit Server VM (build 19.1-b02, mixed mode)


-bash-3.2$ uname -a
Linux test.test.com 2.6.18-194.26.1.0.1.el5 #1 SMP Tue Nov 9 18:48:15 EST 2010 x86_64 x86_64 x86_64 GNU/Linux

• Assignee: Unassigned
• Reporter: Mubarak Seyed
• Created: 19/Jun/12 19:53
• Updated: 06/Jul/17 22:44

Description

2012-06-19 19:01:21,998 ERROR api.NettyAvroRpcClient: RPC connection error :
java.io.IOException: Error connecting to /x.x.x.x:9090
	at org.apache.avro.ipc.NettyTransceiver.getChannel(NettyTransceiver.java:249)
	at org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:198)
	at org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:147)
	at org.apache.flume.api.NettyAvroRpcClient.connect(NettyAvroRpcClient.java:115)
	at org.apache.flume.api.NettyAvroRpcClient.connect(NettyAvroRpcClient.java:104)
	at org.apache.flume.api.NettyAvroRpcClient.<init>(NettyAvroRpcClient.java:89)
	at org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFactory.java:131)
	at org.apache.flume.sink.AvroSink.createConnection(AvroSink.java:148)
	at org.apache.flume.sink.AvroSink.verifyConnection(AvroSink.java:176)
	at org.apache.flume.sink.AvroSink.process(AvroSink.java:231)
	at org.apache.flume.sink.FailoverSinkProcessor.process(FailoverSinkProcessor.java:162)
	at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
	at java.lang.Thread.run(Thread.java:662)
Caused by: org.jboss.netty.channel.ChannelException: Failed to create a selector.
	at org.jboss.netty.channel.socket.nio.NioWorker.register(NioWorker.java:105)
	at org.jboss.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:403)
	at org.jboss.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:370)
	at org.jboss.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:292)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
	... 1 more
Caused by: java.io.IOException: Too many open files
	at sun.nio.ch.IOUtil.initPipe(Native Method)
	at sun.nio.ch.EPollSelectorImpl.<init>(EPollSelectorImpl.java:49)
	at sun.nio.ch.EPollSelectorProvider.openSelector(EPollSelectorProvider.java:18)
	at java.nio.channels.Selector.open(Selector.java:209)
	at org.jboss.netty.channel.socket.nio.NioWorker.register(NioWorker.java:103)