[FLUME-2469] DatasetSink should load dataset when needed, not at startup

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.5.0
• Fix Version/s: 1.6.0
• Component/s: Sinks+Sources
• Assignee: Ryan Blue
• Reporter: Ryan Blue
• Created: 16/Sep/14 19:36
• Updated: 17/Apr/15 01:21
• Resolved: 25/Sep/14 07:00

Description

The DatasetSink currently loads the target dataset when it starts and fails to initialize if it can't be loaded. This causes minor headaches because it requires an order when setting up a data flow (create the dataset, configure the sink, start flume). The sink should wait until records are sent to load the dataset.