[KAFKA-6804] Event values should not be included in log messages

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.1
• Component/s: streams
• Assignee: Unassigned
• Reporter: Jussi Lyytinen
• Created: 19/Apr/18 09:26
• Updated: 15/May/20 02:33
• Resolved: 15/May/20 02:33

Description

In certain error situations, event values are included in log messages:

2018-04-19 08:00:28 [my-component-37670563-39be-4fcb-92e1-02f115aca43c-StreamThread-2] ERROR o.a.k.s.p.i.AssignedTasks - stream-thread [my-component-37670563-39be-4fcb-92e1-02f115aca43c-StreamThread-2] Failed to commit stream task 1_1 due to the following error:
org.apache.kafka.streams.errors.StreamsException: task [1_1] Abort sending since an error caught with a previous record (key [my-key] value [my-value] ...

In some environments, this is highly undesired behavior since the values can contain sensitive information. Error logs are usually collected to separate systems not meant for storing such information (e.g. patient or financial data).

Issue Links

• is fixed by: KAFKA-8501 Remove key and value from exception message