diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md b/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md index 1d5ea5e..025b01f 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md @@ -415,6 +415,57 @@ NodeManagerMetrics shows the statistics of the containers in the node. Each metr | `goodLocalDirsDiskUtilizationPerc` | Current disk utilization percentage across all good local directories | | `goodLogDirsDiskUtilizationPerc` | Current disk utilization percentage across all good log directories | +ContainerMetrics +------------------ + +ContainerMetrics shows the resource utilization statistics of a container. Each metrics record contains tags such as ContainerPid and Hostname as additional information along with metrics. + +| Name | Description | +|:---- |:---- | +| `pMemLimitMBs` | Physical memory limit of the container in MB | +| `vMemLimitMBs` | Virtual memory limit of the container in MB | +| `vCoreLimit` | CPU limit of the container in number of vcores | +| `launchDurationMs` | Container launch duration in MS | +| `localizationDurationMs` | Container localization duration in MS | +| `StartTime` | Time in MS when container starts | +| `FinishTime` | Time in MS when container finishes | +| `ExitCode` | Container's exit code | +| `PMemUsageMBsNumUsage` | Total number of physical memory usages | +| `PMemUsageMBsAvgMBs` | Average physical memory usage in MB | +| `PMemUsageMBsStdevMBs` | Standard deviation of the physical memory usage in MB | +| `PMemUsageMBsMinMBs` | Minimal physical memory usage in MB | +| `PMemUsageMBsMaxMBs` | Maximum physical memory usage in MB | +| `PMemUsageMBsIMinMBs` | Minimal physical memory usage in MB of current _interval_ (the time of _interval_ is specified by yarn.nodemanager.container-metrics.period-ms) | +| `PMemUsageMBsIMaxMBs` | Maximum physical memory usage in MB of current _interval_ (the time of _interval_ is specified by yarn.nodemanager.container-metrics.period-ms) | +| `PMemUsageMBsINumUsage` | Total number of physical memory usage resolutions in current _interval_ (the time of _interval_ is specified by yarn.nodemanager.container-metrics.period-ms) | +| `PCpuUsagePercentNumUsage` | Total number of physical CPU core usages | +| `PCpuUsagePercentAvgPercents` | Average physical CPU core percent usage | +| `PCpuUsagePercentStdevPercents` | Standard deviation of physical CPU core percent usage | +| `PCpuUsagePercentMinPercents` | Minimal physical CPU core percent usage| +| `PCpuUsagePercentMaxPercents` | Maximum physical CPU core percent usage | +| `PCpuUsagePercentIMinPercents` | Minimal physical CPU core percent usage in current _interval_ (the time of _interval_ is specified by yarn.nodemanager.container-metrics.period-ms) | +| `PCpuUsagePercentIMaxPercents` | Maximum physical CPU core percent usage in current _interval_ (the time of _interval_ is specified by yarn.nodemanager.container-metrics.period-ms) | +| `PCpuUsagePercentINumUsage` | Total number of physical Cpu core usage resolutions in current _interval_ (the time of _interval_ is specified by yarn.nodemanager.container-metrics.period-ms) | +| `MilliVcoreUsageNumUsage` | Total number of vcore usages | +| `MilliVcoreUsageAvgMilliVcores` | 1000 times of average vcore usage | +| `MilliVcoreUsageStdevMilliVcores` | 1000 times of standard deviation of vcore usage | +| `MilliVcoreUsageMinMilliVcores` | 1000 times of minimal vcore usage | +| `MilliVcoreUsageMaxMilliVcores` | 1000 times of maximum vcore usage | +| `MilliVcoreUsageIMinMilliVcores` | 1000 times of average vcore usage in current _interval_ (the time of _interval_ is specified by yarn.nodemanager.container-metrics.period-ms) | +| `MilliVcoreUsageIMaxMilliVcores` | 1000 times of maximum vcore usage in current _interval_ (the time of _interval_ is specified by yarn.nodemanager.container-metrics.period-ms) | +| `MilliVcoreUsageINumUsage` | Total number of vcore usage resolutions in current _interval_ (the time of _interval_ is specified by yarn.nodemanager.container-metrics.period-ms) | +| `PMemUsageMBHistogramNumUsage` | Total number of physical memory usage (1 second granularity) | +| `PMemUsageMBHistogram50thPercentileMBs` | The 50th percentile of physical memory usage in MB (1 second granularity) | +| `PMemUsageMBHistogram75thPercentileMBs` | The 75th percentile of physical memory usage in MB (1 second granularity) | +| `PMemUsageMBHistogram90thPercentileMBs` | The 90th percentile of physical memory usage in MB (1 second granularity) | +| `PMemUsageMBHistogram95thPercentileMBs` | The 95th percentile of physical memory usage in MB (1 second granularity) | +| `PMemUsageMBHistogram99thPercentileMBs` | The 99th percentile of physical memory usage in MB (1 second granularity) | +| `PCpuUsagePercentHistogramNumUsage` | Total number of physical CPU core usage (1 second granularity) | +| `PCpuUsagePercentHistogram50thPercentilePercents` | The 50th percentile of physical CPU core percent usage (1 second granularity) | +| `PCpuUsagePercentHistogram75thPercentilePercents` | The 75th percentile of physical CPU core percent usage (1 second granularity) | +| `PCpuUsagePercentHistogram90thPercentilePercents` | The 90th percentile of physical CPU core percent usage (1 second granularity) | +| `PCpuUsagePercentHistogram95thPercentilePercents` | The 95th percentile of physical CPU core percent usage (1 second granularity) | +| `PCpuUsagePercentHistogram99thPercentilePercents` | The 99th percentile of physical CPU core percent usage (1 second granularity) | ugi context =========== @@ -479,5 +530,3 @@ StartupProgress metrics shows the statistics of NameNode startup. Four metrics a | *phase*`ElapsedTime` | Total elapsed time in the phase in milliseconds | | *phase*`Total` | Total number of steps in the phase | | *phase*`PercentComplete` | Current rate completed in the phase  (The max value is not 100 but 1.0) | - -