[HDFS-13265] MiniDFSCluster should set reasonable defaults to reduce resource consumption

• Type: Improvement
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Component/s: datanode, namenode, test
• Assignee: Erik Krogen
• Reporter: Erik Krogen
• Created: 12/Mar/18 20:32
• Updated: 04/Sep/18 14:53

Description

MiniDFSCluster takes its defaults from DFSConfigKeys defaults, but many of these are not suitable for a unit test environment. For example, the default handler thread count of 10 is definitely more than necessary for (almost?) any unit test. We should set reasonable, lower defaults unless a test specifically requires more.

Issue Links

• depends upon: HADOOP-15311 HttpServer2 needs a way to configure the acceptor/selector count
• depends upon: HDFS-13272 DataNodeHttpServer to have configurable HttpServer2 threads
• depends upon: HDFS-13493 Reduce the HttpServer2 thread count on DataNodes
• mentioned in: Page Loading...