[FLUME-2990] Write access to sensitive files in spool directory source

• Type: Wish
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 1.5.2
• Component/s: Sinks+Sources
• Assignee: Unassigned
• Reporter: Shankar G
• Created: 08/Sep/16 07:34
• Updated: 08/Sep/16 07:34

Description

I have a flume agent ingesting my files from spool directory source to hdfs
I'm a little concerned here because I'm forced to give write permission to my all important data files so that flume could rename the file. I understand flume does this to identify the processed files and avoid processing the same file again.
However data security is a critical concern here.
So at this point I wish if there were an alternative way so that I get my critical data ingested without compromising on their security