[KUDU-720] Log GC never runs if MRS is under constant write pressure

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: Private Beta
• Component/s: tablet, tserver
• Target Version/s: Private Beta
• Assignee: Jean-Daniel Cryans
• Reporter: Todd Lipcon
• Created: 21/Apr/15 13:18
• Updated: 29/Feb/16 09:15
• Resolved: 29/May/15 13:14

Description

In KUDU-716 I ran a large TPCH write benchmark where the writer wrote constantly for the whole life of the tablet server. Thus, the tablet server always flushed and never decided to log GC. So, restart's taking quite a long time as it churns through lots of irrelevant log segments.

We should consider either changing priorities for log GC, or decouple it from the maintenance manager thread (running GC is pretty cheap, maybe doesnt' need to be carefully scheduled/prioritized).

Issue Links

• is related to: KUDU-716 Single-disk tpch_real_world with SF=500 should complete successfully