Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
$CHUKWA_CONF_DIR/hadoop-log4j.properties file contains a list of appender to stream Hadoop logs to Chukwa. This was designed for Hadoop 0.20.x. For supporting Hadoop 2.x, we need to update the log4j.properties example, and hadoop-metrics2.properties files as examples of how to stream logs and metrics to Chukwa.
On Chukwa side, the initial_adaptors file also need to register SocketAdaptors to stream the data to Chukwa.
The define ports to stream data are:
| Port | Description |
|---|---|
| 9095 | Hadoop Metrics |
| 9096 | Hadoop NN Log |
| 9097 | Hadoop SNN Log |
| 9098 | Hadoop DN Log |
| 9099 | Hadoop RM Log |
| 9100 | Hadoop NM Log |
| 9101 | Hadoop HS Log |
| 9102 | Hadoop RM Summary |
| 9103 | Hadoop TLA |