Issue Details (XML | Word | Printable)

Key: HADOOP-2909
Type: Bug Bug
Status: Closed Closed
Resolution: Fixed
Priority: Major Major
Assignee: Hairong Kuang
Reporter: Hairong Kuang
Votes: 0
Watchers: 2
Operations

If you were logged in you would be able to see more operations.
Hadoop Common

Improve IPC idle connection management

Created: 27/Feb/08 06:58 PM   Updated: 22/Aug/08 07:50 PM
Return to search
Component/s: ipc
Affects Version/s: 0.16.0
Fix Version/s: 0.18.0

Time Tracking:
Not Specified

File Attachments:
  Size
Text File Licensed for inclusion in ASF works idleConn.patch 2008-06-02 11:15 PM Hairong Kuang 3 kB
Issue Links:
Incorporates
 

Hadoop Flags: Reviewed, Incompatible change
Release Note:
Removed property ipc.client.maxidletime from the default configuration. The allowed idle time is twice ipc.client.connection.maxidletime.
Resolution Date: 03/Jun/08 11:09 PM


 Description  « Hide
IPC server determines if a connection is idle or not by checking if the connection does not have any IO activity for a predefined max idle time. An idle connection will be closed even if the connection still has outstanding requests or replies. This causes RPC failures when a server becomes slow or if a request takes a long time to be served. In jira, I'd like to propose the following changes to IPC idle management:
1. Add data structures to the IPC server that keep track of outstanding requests.
2. IPC server does not close a connection that has outstanding requests/replies even when it has no IO activities for a while.
3. The default client-side max idle time should be in several minutes not 1 second.
4. The server-side max idle time should be greater than the client-side max idle time, for example, twice of the client-side max idle time. So server mainly deals with clients that are crashed without closing
its connections.

 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
Hairong Kuang made changes - 27/Feb/08 07:00 PM
Field Original Value New Value
Link This issue is part of HADOOP-2864 [ HADOOP-2864 ]
Robert Chansler made changes - 25/Mar/08 03:03 AM
Fix Version/s 0.17.0 [ 12312913 ]
Hairong Kuang made changes - 02/Jun/08 11:15 PM
Attachment idleConn.patch [ 12383264 ]
Hairong Kuang made changes - 02/Jun/08 11:15 PM
Assignee Hairong Kuang [ hairong ]
Fix Version/s 0.18.0 [ 12312972 ]
Hairong Kuang made changes - 02/Jun/08 11:31 PM
Status Open [ 1 ] Patch Available [ 10002 ]
Hairong Kuang made changes - 03/Jun/08 11:09 PM
Hadoop Flags [Incompatible change, Reviewed]
Release Note Property ipc.client.maxidletime is removed from the default configuration. Instead it is defined as twice of the ipc.client.connection.maxidletime.
Resolution Fixed [ 1 ]
Status Patch Available [ 10002 ] Resolved [ 5 ]
Robert Chansler made changes - 27/Jun/08 09:00 PM
Release Note Property ipc.client.maxidletime is removed from the default configuration. Instead it is defined as twice of the ipc.client.connection.maxidletime.
Removed property ipc.client.maxidletime from the default configuration. The allowed idle time is twice ipc.client.connection.maxidletime.
Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
Nigel Daley made changes - 22/Aug/08 07:50 PM
Status Resolved [ 5 ] Closed [ 6 ]