Details
-
New Feature
-
Status: Patch Available
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
TEZ-4344 added a capability to periodically dump thread information to Tez. I think the basic architecture, injecting an additional process into DAGAppMaster or TezChild, is potentially extensible.
For example, we maintain a very similar patch to collect stack traces.
- https://speakerdeck.com/okumin/hive-distributed-profiling-system-in-treasure-data-english-version-number-tdtechtalk?slide=26
- https://api-docs.treasuredata.com/blog/hive-distributed-profiling/
I would propose to make the injection step pluggable and maintain TezThreadDumpHelper as one of the plugins.
Attachments
Issue Links
- relates to
-
TEZ-4344 Collect jstack periodically from all containers
-
- Resolved
-
- links to
