[HDFS-11192] OOM during Quota Initialization lead to Namenode hang

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Brahma Reddy Battula
• Reporter: Brahma Reddy Battula
• Created: 30/Nov/16 09:44
• Updated: 01/Feb/19 13:42

Description

AFAIK ,In RecurisveTask Execution, When ForkjoinThreadpool's thread dies or not able to create,it will not notify the parent.Parent still waiting for the notify call..that's not timed waiting also.

Trace from Namenode log

Exception in thread "ForkJoinPool-1-worker-2" Exception in thread "ForkJoinPool-1-worker-3" java.lang.OutOfMemoryError: unable to create new native thread
        at java.lang.Thread.start0(Native Method)
        at java.lang.Thread.start(Thread.java:714)
        at java.util.concurrent.ForkJoinPool.createWorker(ForkJoinPool.java:1486)
        at java.util.concurrent.ForkJoinPool.tryAddWorker(ForkJoinPool.java:1517)
        at java.util.concurrent.ForkJoinPool.deregisterWorker(ForkJoinPool.java:1609)
        at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:167)
java.lang.OutOfMemoryError: unable to create new native thread
        at java.lang.Thread.start0(Native Method)
        at java.lang.Thread.start(Thread.java:714)
        at java.util.concurrent.ForkJoinPool.createWorker(ForkJoinPool.java:1486)
        at java.util.concurrent.ForkJoinPool.tryAddWorker(ForkJoinPool.java:1517)
        at java.util.concurrent.ForkJoinPool.deregisterWorker(ForkJoinPool.java:1609)
        at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:167)

Issue Links

• is related to: HDFS-8865 Improve quota initialization performance