Details
-
Bug
-
Status: Open
-
Minor
-
Resolution: Unresolved
-
2.0.0, 1.x
-
None
-
None
-
None
Description
Description:
AbstractHDFSBolt has WritersMap. This evicts least recently used AbstractHDFSWriter out of the writers map, however, does not close the file in open state by the oldest entry.
Steps to reproduce error:
1) Use new Max open files feature and set the value to 1.
2) Write data to two or three different files in hdfs using AvroBolt.
3) Check output directory using fsck in hdfs.
Expected: only one file open in output directory.
Actual: > 1 files are in open state.