Flume
  1. Flume
  2. FLUME-1007

JDBC Channel using Derby as a provider does not scale

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: v1.0.0
    • Fix Version/s: None
    • Component/s: Channel
    • Labels:
      None

      Description

      In the attached test, I fill up the JDBC Channel and then drain it. It appears as the number of the events in the channel increase, the length it takes to drain the queue increases in a non-linear fashion.

      Events 5,000
      Put 2907 ms
      Take 33615 ms

      Events 10,000
      Put 4469 ms
      Take 259937 ms

      Events: 15,000
      Put 6590 ms
      Take 643294 ms

        Activity

        Hide
        Brock Noland added a comment -

        Attached demonstrates the problem. It is NOT meant for commit.

        Show
        Brock Noland added a comment - Attached demonstrates the problem. It is NOT meant for commit.

          People

          • Assignee:
            Arvind Prabhakar
            Reporter:
            Brock Noland
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:

              Development