[MESOS-3348] Add either log rotation or capped-size logging (for tasks)

• Type: Story
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.23.0
• Labels: mesosphere
• Story Points: 13
• Assignee: Joseph Wu
• Reporter: Joseph Wu
• Created: 01/Sep/15 00:44
• Updated: 26/Nov/18 12:32
• Resolved: 26/Nov/18 12:32

Description

Tasks currently log their output (i.e. stdout/stderr) to files (the "sandbox") on an agent's disk. In some cases, the accumulation of these logs can completely fill up the agent's disk and thereby kill the task or machine.

To prevent this, we should either implement a log rotation mechanism or capped-size logging. This would be used by executors to control the amount of logs they keep.

Master/agent logs will not be affected.

We will first scope out several possible approaches for log rotation/capping in a design document (see MESOS-3356). Once an approach is chosen, this story will be broken down into some corresponding issues.

Issue Links

• contains: MESOS-3356 Scope out approaches to deal with logging to finite disks (i.e. log rotation|capped-size logging).
• is related to: MESOS-588 Add option to master to send stdout and stderr to syslog
• is related to: MESOS-1375 Log rotation capable
• relates to: MESOS-2153 Add support for systemd journal for logging