[SPARK-44893] ThreadInfo improvements for monitoring APIs

• Type: Umbrella
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Spark Core, Web UI
• Labels: releasenotes
• Assignee: Kent Yao
• Reporter: Kent Yao
• Created: 21/Aug/23 11:02
• Updated: 15/Mar/24 15:23
• Resolved: 15/Mar/24 08:14

Issue Links

• is related to: SPARK-44896 Consider adding information os_prio, cpu, elapsed, tid, nid, etc., from the jstack tool
• is related to: SPARK-44111 Prepare Apache Spark 4.0.0

Sub-Tasks

• Add a button to download thread dump as a txt file in Spark UI: Resolved
• Considering 'daemon', 'priority' from higher JDKs for ThreadStackTrace class: Resolved
• Use toString instead of stacktrace for task reaper threadDump: Resolved
• Direct Task ThreadDump: Resolved
• Flame Graph Support For Executor Thread Dump Page: Resolved
• Add spark.ui.threadDump.flamegraphEnabled config to switch flame graph on/off: Resolved
• Collapse Support for Flamegraph and thread dump details: Resolved