[IMPALA-8784] Implement a RowBatchQueue backed by a BufferedTupleStream

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Component/s: Backend
• Epic Color: ghx-label-5
• Assignee: Sahil Takiar
• Reporter: Sahil Takiar
• Created: 23/Jul/19 19:04
• Updated: 31/Jul/19 19:53
• Resolved: 31/Jul/19 19:53

Description

The BufferedPlanRootSink should use a RowBatchQueue backed by a BufferedTupleStream. This requires the following changes:

• Creating a new SpillableRowBatchQueue that implements RowBatchQueue and internally uses a BufferedTupleStream
• Changing the implementation of RowBatchQueue used by BufferedPlanRootSink to SpillableRowBatchQueue
• Update PlanRootSink.java so that it sets a ResourceProfile that should be used by the BufferedPlanRootSink
• Update DataSinks.thrift so that it passes ResourceProfile-s from the fe/ to the be/
• BufferedPlanRootSink should Initialize and close a ReservationManager to be used by the BufferedTupleStream

Issue Links

• duplicates: IMPALA-8818 Replace deque queue with spillable queue in BufferedPlanRootSink