[YARN-10236] LogAggregation cycles might collide with log writes

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.3.0
• Component/s: log-aggregation
• Assignee: Unassigned
• Reporter: Andras Gyori
• Created: 16/Apr/20 12:17
• Updated: 16/Apr/20 12:28

Description

A LogAggregation cycle might interrupt an in-progress logging. Chance of this is happening is low, however, not zero. Due to this race condition, a log entry could be entirely discarded, without being written to the log file.

Tested with specifications:

• Kerberos + SSL enabled
• TFile + Rolling log aggregation

The log file misses the 58th entry due to this behaviour.