[BEAM-3689] Direct runner leak a reader for every 10 input records

• Type: Improvement
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.4.0
• Component/s: runner-direct
• Assignee: Raghu Angadi
• Reporter: Raghu Angadi
• Created: 12/Feb/18 00:49
• Updated: 24/Jul/20 20:16
• Resolved: 01/Mar/18 05:20

Description

Direct runner reads 10 records at a time from a reader. I think the intention is to reuse the reader, but it reuses only if the reader is idle initially, not when the source has messages available.

When I was testing KafkaIO with direct runner it kept opening new reader for every 10 records and soon ran out of file descriptors.

Issue Links

• links to: GitHub Pull Request #4658