Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Duplicate
-
None
-
None
-
None
-
None
Description
We should add the capability to the HDFS sink to specify a prefix for the .tmp files. I believe this needs to be configurable and disabled by default.
However we should document that we recommend "_" or "." as a prefix for the temp files.
This is because Hadoop's default FileInputFormat will skip files beginning with "_" or "."
Attachments
Issue Links
- duplicates
-
FLUME-1702 HDFSEventSink should write to a hidden file as opposed to a .tmp file
- Resolved