[KAFKA-16125] Add parser for the metrics.verbosity config

• Type: Task
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Assignee: Qichao Chu
• Reporter: Qichao Chu
• Created: 14/Jan/24 21:27
• Updated: 14/Jan/24 21:28

Description

metrics.verbosity will be a new dynamic config introduced to control the verbosity(fan-out rate) of the metrics. It's a config with JSON format specifying the condition controlling fan-out of the metrics.

The parser will have the following validation responsibilities:

1. Validate that the config conforms to JSON format.
2. Validate that the level field is configured correctly with a set level
3. Validate that the names field pattern is acceptable to java.util.regex-compatible
4. Validate that the filters field conforms to JSON map format
5. Validate that all the filter patterns are acceptable to java.util.regex-compatible
6. Validate that no other field exists in the config

After parsing and validating the config, the parser should:

• Generate a config object which contains the level, names, and filter fields. There should exist a default verbosity level too.
• Inside the object, the predicates should also be generated to allow fast querying of the rules
• Overwrite/update the existing predicates if the config is updated

The config object should:

• Determine the verbosity level supplied with the topic name and the metrics name
• If not defined, fall back to the default config level

Issue Links

• is a child of: KAFKA-15447 Partition Level Throughput Metrics