[HDFS-9384] TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.8.0, 3.0.0-alpha1
• Component/s: test
• Target Version/s: 2.8.0
• Hadoop Flags: Reviewed
• Assignee: Chris Nauroth
• Reporter: Chris Nauroth
• Created: 05/Nov/15 18:40
• Updated: 30/Aug/16 01:23
• Resolved: 06/Nov/15 06:21

Description

TestWebHdfsContentLength runs a simple hand-coded HTTP server in a background thread to simulate some WebHDFS server responses. In some environments (notably Windows), I have observed that the test can hang and fail intermittently. The root cause is that the server fails to fully consume the client's input. This causes a mismatch in the TCP conversation state, and ultimately the client side hangs, then aborts after the 60-second socket timeout.