[TEZ-4344] Collect jstack periodically from all containers

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.10.3
• Assignee: Ayush Saxena
• Reporter: László Bodor
• Created: 27/Oct/21 16:33
• Updated: 18/Dec/23 12:36
• Resolved: 18/Jul/23 06:10

Description

1. set a property of interval of seconds (default: 0 ==> off)
2. attach jstack files to app logs (this is easy maybe, putting jstack log files next to app syslog files can make it included by yarn)

jstack should have a name like containername_dagname_timestamp

+option if containers should create jstacks even when idle (don't have a task assigned to them), by default they're not supposed to do so

I don't want to have a jstack dependency for this (configure path, etc.), so an internal thread dump facility is preferred with zero configuration.

Also this doesn't require new endpoints of AM and task containers (like TEZ-4345), this can be implemented quite easily.

Issue Links

• is related to: TEZ-4527 Add generic and pluggable hooks for DAGs and task attempts
• links to: GitHub Pull Request #299