[FLUME-418] Add batching and compression arguments to agent and collectors

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.4
• Component/s: Node
• Assignee: Jonathan Hsieh
• Reporter: Jonathan Hsieh
• Created: 20/Dec/10 23:07
• Updated: 06/Aug/11 00:14
• Resolved: 09/May/11 23:52

Description

Currently it is difficult to enable batching and compression on e2e mode. Add some kw args to enable batching and compression on the agent side, and uncompress and unbatch on the collector side.

Issue Links

• blocks: FLUME-219 Recipe for batching and wire compression.
• is blocked by: FLUME-471 Add metrics to batching/unbatching/gzip/gunzip decorators
• is blocked by: FLUME-559 Add compression and batching features to rpcsinks and rpcsources.
• is blocked by: FLUME-470 Flume code generator should regenerate kwargs
• is related to: FLUME-603 Revisit Performance tests
• relates to: FLUME-219 Recipe for batching and wire compression.