[FLUME-1007] JDBC Channel using Derby as a provider does not scale

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.0.0
• Component/s: Channel
• Assignee: Arvind Prabhakar
• Reporter: Brock Noland
• Created: 28/Feb/12 13:09
• Updated: 29/Feb/12 03:40

Description

In the attached test, I fill up the JDBC Channel and then drain it. It appears as the number of the events in the channel increase, the length it takes to drain the queue increases in a non-linear fashion.

Events 5,000
Put 2907 ms
Take 33615 ms

Events 10,000
Put 4469 ms
Take 259937 ms

Events: 15,000
Put 6590 ms
Take 643294 ms

Sub-Tasks

• Allow the optional disabling of foreign keys: Resolved
• Configuration keys for JDBC channel contain redundant prefix.: Resolved
• JDBC Channel invokes size query on every put: Resolved
• JDBC Channel should use multiple tables for storing events: Open