[FLUME-258] TailDir should include source file name metadata for sink

• Type: New Feature
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.9.0, 0.9.1, 0.9.1u1
• Fix Version/s: 0.9.2
• Component/s: Node

Environment

Linux

• Assignee: Jonathan Hsieh
• Reporter: Disabled imported user
• Created: 05/Oct/10 12:13
• Updated: 28/Jun/11 03:32
• Resolved: 04/Nov/10 21:02

Description

When a node use tailDir, and tails for more then one source file, I would like
to recognize the source file name in the sink.

for example:

I have a dir with 3 files in it.
/evia/flume/file1
/evia/flume/file2
/evia/flume/file3

so I want that in the sink all events from file2 will be in a file that have prefix file2.....

Maybe the way to do it is to add the filename as a field of the metadata??

Thanks

Issue Links

• is blocked by: FLUME-252 Update Tail to get rid of races and truncation problems.