[FLUME-251] time filter for tail-dir

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.9.4
• Fix Version/s: 0.9.5
• Assignee: Unassigned
• Reporter: Anurag Phadke
• Created: 29/Sep/10 00:26
• Updated: 05/Nov/14 08:12
• Resolved: 05/Nov/14 08:12

Description

tailDir currently supports tail'ing all file names that match a regex for a given directory. Adding time-stamp support to only tail files created after a given time-period would be nice.
for eg: Archive folders get data that's added daily and also contain 'n' months old data. There are instances where we only need files that are 'x' days old (x << n)

sample tailDir call would look something like:
tailDir("<path>"[,fileregex="*.gz", createdAfter="2010-09-20"]);