-
Type:
Bug
-
Status: Resolved
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: 1.4.0
-
Fix Version/s: 1.5.0
-
Component/s: flume-sink
-
Labels:None
The Flume sink uses MANUAL_FLUSH mode. If a set of operations is too large for the flush buffer, it will fail-- potentially over and over, if the channel supports retrying the transaction.
We should be able to fix this by using AUTO_FLUSH_BACKGROUND, adjusting the buffer size, or returning a more useful error so that users can reconfigure their sink's batch size (though that size is in # of ops, not bytes).