[PHOENIX-6111] Jenkins jobs are unable to create new native thread

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Assignee: Istvan Toth
• Reporter: Istvan Toth
• Created: 28/Aug/20 04:32
• Updated: 29/Sep/20 08:13
• Resolved: 29/Sep/20 08:13

Description

Jenkins jobs are randomly failing  with 

java.lang.OutOfMemoryError: unable to create new native thread

The ulimit on the slaves is 30000, and cannot be increased from within the job.

The typical thread count used by our test suite is 3-4000.

It is not clear yet if this is caused by our thread use spiking, or if a parallel job exhausts the thread limit.

Issue Links

• depends upon: PHOENIX-6102 Better isolation for CI jobs an ASF Jenkins
• depends upon: PHOENIX-5032 add Apache Yetus to Phoenix
• is related to: HBASE-25081 Up the container nproc uplimit to 30000