[HDFS-2911] Gracefully handle OutOfMemoryErrors

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.23.0, 1.0.0
• Component/s: datanode, namenode
• Target Version/s: 2.0.0-alpha
• Assignee: Unassigned
• Reporter: Eli Collins
• Created: 07/Feb/12 21:52
• Updated: 31/Aug/12 05:39
• Resolved: 31/Aug/12 04:44

Description

We should gracefully handle j.l.OutOfMemoryError exceptions in the NN or DN. We should catch them in a high-level handler, cleanly fail the RPC (vs sending back the OOM stackrace) or background thread, and shutdown the NN or DN. Currently the process is left in a not well-test tested state (continuously fails RPCs and internal threads, may or may not recover and doesn't shutdown gracefully).