[FLUME-3294] Fix polling logic in TaildirSource

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.8.0
• Fix Version/s: 1.9.0
• Assignee: Peter Turcsanyi
• Reporter: Peter Turcsanyi
• Created: 22/Nov/18 12:33
• Updated: 22/Nov/18 22:34
• Resolved: 22/Nov/18 20:59

Description

TaildirSource.process() always returns Status.READY and sleeps inside the method.
It should return Status.READY / Status.BACKOFF and this status would control the common backoff sleeping mechanism implemented in PollableSourceRunner.PollingRunner.

This is an old issue, but due to the changes implemented in FLUME-3101, it can lead to unnecessary waiting cycles. So it must be fixed now.

Issue Links

• is related to: FLUME-3101 taildir source may endless loop when tail a file
• links to: GitHub Pull Request #241