[FLINK-8357] enable rolling in default log settings

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.12.0
• Component/s: Build System, Deployment / Scripts
• Labels: pull-request-available usability

Release Note

The default log4j configuration has changed: Besides the existing rolling of log files on startup of Flink, they also roll once they've reached a size of 100MB. Flink keeps a total of 10 log files, effectively limiting the total size of the log directory to 1GB (per Flink service logging to that directory)

• Assignee: Jörn Kottmann
• Reporter: Mingmin Xu
• Created: 04/Jan/18 00:21
• Updated: 16/Feb/22 14:37
• Resolved: 28/Oct/20 06:24

Description

The release packages uses org.apache.log4j.FileAppender for log4j and ch.qos.logback.core.FileAppender for logback, which could results in very large log files.

For most cases, if not all, we need to enable rotation in a production cluster, and I suppose it's a good idea to make rotation as default.

Issue Links

• causes: FLINK-26105 Rolling log filenames cause end-to-end test to fail (example test failure "Running HA (hashmap, async)")
• links to: GitHub Pull Request #5371
• links to: GitHub Pull Request #5371
• links to: GitHub Pull Request #13457