[TEZ-1091] Respect keepAlive parameter when cleaning up Fetcher connections

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.5.0
• Assignee: Rajesh Balamohan
• Reporter: Rajesh Balamohan
• Created: 29/Apr/14 09:23
• Updated: 06/Sep/14 01:36
• Resolved: 02/May/14 21:03

Description

Query: Query_17 (shuffle intensive query)

1. Certain fetchers are making too many calls in tight loop fashion to shufflehandler. This happens only when MapOutput.Type == WAIT. This would created pressure on ShuffleHandler on large scale cluster.

Please refer to "fetcher #24" as an example in the attachment.

2. If keepalive is enabled, CleanupConnection() should disconnect the connection only in exception path.