[CASSANDRA-14934] Cassandra Too many open files .

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Not A Bug
• Fix Version/s: 3.10
• Component/s: Local/Config
• Labels: performance

Environment

This is in the Production environment .

We have observed 70k open files for the process in non-prd . 

 

Attached the entire logs of the open files . 

• Severity: Normal
• Since Version: 3.11.3
• Assignee: Umashankar
• Reporter: Umashankar

Authors

Umashankar

• Created: 14/Dec/18 05:28
• Updated: 08/Jul/19 17:05
• Resolved: 08/Jul/19 17:05

Description

We have 4 Node with 2 DC . 

We are seeing 

Caused by: java.nio.file.FileSystemException: /apps/cassandra/data/commitlog/CommitLog-6-1544453835569.log: Too many open files .

We have increased the ulimit to 24 k. 

lsof | grep <processid> 

.3.3 million records . 

 

Found ~ .2.5 millions of records are of TCP connection with either Socket connection status as ESTABLISHED/LISTEN . Found that connections are of datasource on 9042 . 

 

Thanks