[FLINK-8755] SpilledSubpartitionView wrongly relys on the backlog for determining whether more data is available

• Type: Sub-task
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: Runtime / Network
• Assignee: Nico Kruber
• Reporter: Nico Kruber
• Created: 23/Feb/18 09:17
• Updated: 15/Mar/18 16:56
• Resolved: 15/Mar/18 16:56

Description

public BufferAndBacklog getNextBuffer() throws IOException, InterruptedException {
//...
        int newBacklog = parent.decreaseBuffersInBacklog(current);
        return new BufferAndBacklog(current, newBacklog > 0, newBacklog, nextBufferIsEvent);

relies on the backlog to signal further data availability. However, if there are only events left in the buffer queue, their buffers are not included in the backlog counting and therefore, isMoreAvailable will be wrongly false here.

Issue Links

• links to: GitHub Pull Request #5581