[YARN-1145] Potential file handle leak in aggregated logs web ui

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.5-alpha, 0.23.9, 2.1.1-beta
• Fix Version/s: 0.23.11, 2.3.0
• Target Version/s: 0.23.11
• Hadoop Flags: Reviewed
• Assignee: Rohith Sharma K S
• Reporter: Rohith Sharma K S
• Created: 29/Aug/13 06:02
• Updated: 24/Feb/14 20:56
• Resolved: 16/Dec/13 19:29

Description

Any problem in getting aggregated logs for rendering on web ui, then LogReader is not closed.

Now, it reader is not closed which causing many connections in close_wait state.

hadoopuser@hadoopuser:> jps
27909 JobHistoryServer

DataNode port is 50010. When greped with DataNode port, many connections are in CLOSE_WAIT from JHS.
hadoopuser@hadoopuser:> netstat -tanlp |grep 50010
tcp 0 0 10.18.40.48:50010 0.0.0.0:* LISTEN 21453/java
tcp 1 0 10.18.40.48:20596 10.18.40.48:50010 CLOSE_WAIT 27909/java
tcp 1 0 10.18.40.48:19667 10.18.40.152:50010 CLOSE_WAIT 27909/java
tcp 1 0 10.18.40.48:20593 10.18.40.48:50010 CLOSE_WAIT 27909/java
tcp 1 0 10.18.40.48:12290 10.18.40.48:50010 CLOSE_WAIT 27909/java
tcp 1 0 10.18.40.48:19662 10.18.40.152:50010 CLOSE_WAIT 27909/java