[OOZIE-2296] Add an Oozie diagnostic bundle tool

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: trunk
• Fix Version/s: 5.0.0b1
• Component/s: tools
• Assignee: Attila Sasvári
• Reporter: Robert Kanter
• Created: 07/Jul/15 17:08
• Updated: 25/Jan/18 21:01
• Resolved: 15/Nov/17 13:54

Description

To help with our support cases, I've built a tool that collects a bunch of job and other information from Oozie that throws it all in a tarball. The idea is that the user can just click a button in Cloudera Manager, and it will run this tool.

This tool could be useful for others as an easy way to get information out of Oozie, so I thought I'd contribute it here. It's built as a "tool" (so it sits next to the sharelib and database tools), and simply uses the Oozie client for getting pretty much everything, so it doesn't require anything special.

Here's the information that it can get:

1. Sharelib: ooze admin -shareliblist and oozie admin -shareliblist <foo>
2. Oozie Server's resolved loaded configuration (from admin endpoint)
3. Other admin commands output (queue dump, env vars, etc)
4. Thread dump (HOST:11000/oozie/admin/jvminfo.jsp)
5. Details from last n jobs and/or specific list of jobs
   • job.properties contents
   • XML definition
   • verbose status for each job and each action etc
   • Oozie logs
   • Unfortunately, we can't get the launcher jobs' logs from Hadoop
6. Metrics/Instrumentation

Issue Links

• depends upon: OOZIE-2181 JsonToBean has some missing and incorrect mappings
• depends upon: OOZIE-2174 Add missing admin commands to OozieClient and OozieCLI
• is depended upon by: OOZIE-3074 Machine-readable format for Oozie diagnostic bundles
• is depended upon by: OOZIE-3073 Do not use LogsCLI to fetch Oozie Launcher AM logs for Diagnostics bundles
• links to: ReviewBoard