Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
1.4.0
-
None
-
None
Description
When hdfs paths are date dependent, many handles can get left open for a long time without anything happening to them.
Idea here is to watch the last update of each bucketWriter, and track idle writers, closing them once they pass a configured timeout
Attachments
Attachments
Issue Links
- is related to
-
FLUME-1350 HDFS file handle not closed properly when date bucketing
- Open
- links to