Details
Major Description
Webhdfs uses jetty. The size of the request thread pool is limited, but jetty will accept and queue infinite connections. Every queued connection is "heavy" with buffers, etc. Unlike data streamer connections, thousands of webhdfs connections will quickly OOM a DN. The accepted requests must be bounded and excess clients rejected so they retry on a new DN.