-
Type:
Improvement
-
Status: Resolved
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: 1.5.0
-
Fix Version/s: 1.6.0
-
Component/s: Sinks+Sources
-
Labels:None
As mentioned in FLUME-2309, the directory listing can it self become the bottleneck when accessing directories with a large number of files (>1M). The fix in that JIRA added in the ability to specify `RANDOM` as a Consume-Order to avoid sorting large lists.
The slowness of the directory listing is still un-addressed.
- relates to
-
FLUME-2505 Test added in FLUME-2502 is flaky
-
- Resolved
-