[SAMZA-1518] Add CPU utilization and file descriptor count to JvmMetrics

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.14.0
• Labels: newbie
• Assignee: Jake Maes
• Reporter: Jake Maes
• Created: 29/Nov/17 00:54
• Updated: 01/Dec/17 01:40
• Resolved: 01/Dec/17 01:38

Description

With the addition of multithreading in Samza, we've seen more jobs become bottlenecked on CPU. In order to help trouble shoot these cases, we should add the following metrics to JvmMetrics.scala:

process-cpu-usage - com.sun.management.OperatingSystemMXBean#getProcessCpuLoad()
system-cpu-usage - com.sun.management.OperatingSystemMXBean#getSystemCpuLoad()
open-file-descriptor-count - com.sun.management.UnixOperatingSystemMXBean#getOpenFileDescriptorCount()
thread-count - java.lang.management.ThreadMXBean#getThreadCount()

The first three metrics will only be emitted if the bean returned by ManagementFactory.getOperatingSystemMXBean() is of the appropriate type.

All of the new metrics should be gauges, not counters.

Issue Links

• links to: GitHub Pull Request #372