Description
Servers and clients (client include datanodes, tasktrackers, DFSClients & tasks) should not cache connections or maybe cache them for very short periods of time. Clients should set up & tear down connections to the servers everytime they need to contact the servers (including the heartbeats). If connection is cached, then reuse the existing connection for a few subsequent transactions until the connection expires. The heartbeat interval should be more so that many more clients (order of tens of thousands) can be accomodated within 1 heartbeat interval.
Attachments
Attachments
Issue Links
- is blocked by
-
HADOOP-362 tasks can get lost when reporting task completion to the JobTracker has an error
- Closed