[APLO-245] The LevelDB store does not seem to get cleaned/compacted

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5, 1.6
• Component/s: apollo-leveldb
• Assignee: Hiram R. Chirino
• Reporter: Lionel Cons
• Created: 17/Aug/12 08:14
• Updated: 30/Jan/13 15:05
• Resolved: 28/Jan/13 18:15

Description

We use the default message store: LevelDB.

On one broker with poor performance, we noticed a quite big store (file system wise) while there are zero messages in the queues.

In concrete terms, the REST API reports for the aggregated dest-metrics:

'queue_items' => 0,
'queue_size' => 0,

While on the box itself, in the data directory, we see:

$ du -ks .
434992 .
$ find . -type f | wc -l
471

So 400MB and 471 files is a lot to hold zero messages...

FWIW, the store page in the console reports something quite different:

disk usage: 760.689 mb

Log Status

Log File | Msg Refs | File Size
0000003a0eb4031b.log | 0 | 100.000 mb

Index recovery starts from log position: 0000003a0eb4031b

Append position: 0000003a13bed684
Index Status

Compactions
Level Files Size(MB) Time(sec) Read(MB) Write(MB)
--------------------------------------------------
0 0 0 0 0 2
1 7 9 2 12 9
2 108 91 0 0 0
3 114 227 0 0 0