[ARROW-11784] [Rust][DataFusion] CoalesceBatchesStream doesn't honor Stream interface

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.1, 4.0.0
• Component/s: Rust - DataFusion
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/27636
• Assignee: Unassigned
• Reporter: Ximo Guanter
• Created: 25/Feb/21 16:38
• Updated: 11/Jan/23 08:22
• Resolved: 26/Feb/21 11:09

Description

The Stream interface has a contract which states that you cannot poll anymore once you have received None. See futures::prelude::Stream - Rust (docs.rs)

This is not being honored and it causes a hand if you CoallesceBatchesExec after a RepartitionExec

Issue Links

• links to: GitHub Pull Request #9574