Index: 082/ops.html
===================================================================
--- 082/ops.html (revision 1634540)
+++ 082/ops.html (revision 1634682)
@@ -574,6 +574,16 @@
| "kafka.consumer":name="([-.\w]+)-MaxLag",type="ConsumerFetcherManager" |
|
+
+ | The average fraction of time the network processors are idle |
+ "kafka.network":type="SocketServer",name="NetworkProcessorAvgIdlePercent" |
+ between 0 and 1, ideally > 0.3 |
+
+
+ | The average fraction of time the request handler threads are idle |
+ "kafka.server":type="KafkaRequestHandlerPool",name="RequestHandlerAvgIdlePercent" |
+ between 0 and 1, ideally > 0.3 |
+
We recommend monitor GC time and other stats and various server stats such as CPU utilization, I/O service time, etc.
Index: 082/configuration.html
===================================================================
--- 082/configuration.html (revision 1634540)
+++ 082/configuration.html (revision 1634682)
@@ -112,8 +112,8 @@
The log for a topic partition is stored as a directory of segment files. This setting controls the size to which a segment file will grow before a new segment is rolled over in the log. This setting can be overridden on a per-topic basis (see the per-topic configuration section). |
- | log.roll.hours |
- 24 * 7 |
+ log.roll.{ms,hours} |
+ 24 * 7 hours |
This setting will force Kafka to roll a new log segment even if the log.segment.bytes size has not been reached. This setting can be overridden on a per-topic basis (see the per-topic configuration section). |
@@ -122,7 +122,7 @@
| This can take either the value delete or compact. If delete is set, log segments will be deleted when they reach the size or time limits set. If compact is set log compaction will be used to clean out obsolete records. This setting can be overridden on a per-topic basis (see the per-topic configuration section). |
- | log.retention.{minutes,hours} |
+ log.retention.{ms,minutes,hours} |
7 days |
The amount of time to keep a log segment before it is deleted, i.e. the default data retention window for all topics. Note that if both log.retention.minutes and log.retention.bytes are both set we delete a segment when either limit is exceeded. This setting can be overridden on a per-topic basis (see the per-topic configuration section). |
@@ -310,7 +310,7 @@
| controlled.shutdown.enable |
- false |
+ true |
Enable controlled shutdown of the broker. If enabled, the broker will move all leaders on it to some other brokers before shutting itself down. This reduces the unavailability window during shutdown. |
@@ -325,7 +325,7 @@
| auto.leader.rebalance.enable |
- false |
+ true |
If this is enabled the controller will automatically try to balance leadership for partitions among the brokers by periodically returning leadership to the "preferred" replica for each partition if it is available. |
@@ -344,6 +344,41 @@
| 1024 |
The maximum amount of metadata to allow clients to save with their offsets. |
+
+ | max.connections.per.ip |
+ Int.MaxValue |
+ The maximum number of connections that a broker allows from each ip address. |
+
+
+ | max.connections.per.ip.overrides |
+ |
+ Per-ip or hostname overrides to the default maximum number of connections. |
+
+
+ | connections.max.idle.ms |
+ 600000 |
+ Idle connections timeout: the server socket processor threads close the connections that idle more than this. |
+
+
+ | log.roll.jitter.{ms,hours} |
+ 600000 |
+ The maximum jitter to subtract from logRollTimeMillis. |
+
+
+ | num.recovery.threads.per.data.dir |
+ 600000 |
+ The number of threads per data directory to be used for log recovery at startup and flushing at shutdown. |
+
+
+ | unclean.leader.election.enable |
+ true |
+ Indicates whether to enable replicas not in the ISR set to be elected as leader as a last resort, even though doing so may result in data loss. |
+
+
+ | delete.topic.enable |
+ false |
+ Enable delete topic. |
+
More details about broker configuration can be found in the scala class kafka.server.KafkaConfig.
@@ -448,6 +483,12 @@
log.roll.hours |
This configuration controls the period of time after which Kafka will force the log to roll even if the segment file isn't full to ensure that retention can delete or compact old data. |
+
+ | segment.jitter.ms |
+ 0 |
+ log.roll.jitter.{ms,hours} |
+ The maximum jitter to subtract from logRollTimeMillis. |
+