Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
0.4.1
-
None
-
latest 0.5.1
Description
The expected state that should be retained by listHDFS processor is the last modified timestamp. The processor instead is retaining the filename and path of every file it lists. This results in excessive disk usage by zookeeper to retain this filename based state.