[#HADOOP-2909] Improve IPC idle connection management

Hadoop Common

Improve IPC idle connection management

Created: 27/Feb/08 06:58 PM Updated: 22/Aug/08 07:50 PM

Return to search

Component/s:

ipc

Affects Version/s:

0.16.0

Fix Version/s:

0.18.0

Time Tracking:

Not Specified

File Attachments:

	File Name	Date Attached	Attached By	Size
	idleConn.patch	2008-06-02 11:15 PM	Hairong Kuang	3 kB

Issue Links:

Incorporates

This issue is part of:

HADOOP-2864 Improve the Scalability and Robustness of IPC

Hadoop Flags:	Reviewed, Incompatible change
Release Note:	« Hide Removed property ipc.client.maxidletime from the default configuration. The allowed idle time is twice ipc.client.connection.maxidletime. Show » Removed property ipc.client.maxidletime from the default configuration. The allowed idle time is twice ipc.client.connection.maxidletime.
Resolution Date:	03/Jun/08 11:09 PM

Description

« Hide

IPC server determines if a connection is idle or not by checking if the connection does not have any IO activity for a predefined max idle time. An idle connection will be closed even if the connection still has outstanding requests or replies. This causes RPC failures when a server becomes slow or if a request takes a long time to be served. In jira, I'd like to propose the following changes to IPC idle management:
1. Add data structures to the IPC server that keep track of outstanding requests.
2. IPC server does not close a connection that has outstanding requests/replies even when it has no IO activities for a while.
3. The default client-side max idle time should be in several minutes not 1 second.
4. The server-side max idle time should be greater than the client-side max idle time, for example, twice of the client-side max idle time. So server mainly deals with clients that are crashed without closing
its connections.

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

Hairong Kuang made changes - 27/Feb/08 07:00 PM

Field	Original Value	New Value
Link		This issue is part of HADOOP-2864 [ HADOOP-2864 ]

Robert Chansler made changes - 25/Mar/08 03:03 AM

Fix Version/s

0.17.0 [ 12312913 ]

Hairong Kuang made changes - 02/Jun/08 11:15 PM

Attachment

idleConn.patch [ 12383264 ]

Hairong Kuang made changes - 02/Jun/08 11:15 PM

Assignee		Hairong Kuang [ hairong ]
Fix Version/s		0.18.0 [ 12312972 ]

Hairong Kuang made changes - 02/Jun/08 11:31 PM

Status

Open [ 1 ]

Patch Available [ 10002 ]

Hairong Kuang made changes - 03/Jun/08 11:09 PM

Hadoop Flags		[Incompatible change, Reviewed]
Release Note		Property ipc.client.maxidletime is removed from the default configuration. Instead it is defined as twice of the ipc.client.connection.maxidletime.
Resolution		Fixed [ 1 ]
Status	Patch Available [ 10002 ]	Resolved [ 5 ]

Robert Chansler made changes - 27/Jun/08 09:00 PM

Release Note	Property ipc.client.maxidletime is removed from the default configuration. Instead it is defined as twice of the ipc.client.connection.maxidletime.	Removed property ipc.client.maxidletime from the default configuration. The allowed idle time is twice ipc.client.connection.maxidletime.
Hadoop Flags	[Reviewed, Incompatible change]	[Incompatible change, Reviewed]

Nigel Daley made changes - 22/Aug/08 07:50 PM

Status

Resolved [ 5 ]

Closed [ 6 ]