[HIVE-26412] Create interface to fetch available slots during split calculation

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-2
• Component/s: Query Planning, Tez
• Labels: pull-request-available
• Target Version/s: 4.0.0
• Assignee: Adesh Kumar Rao
• Reporter: Adesh Kumar Rao
• Created: 19/Jul/22 17:14
• Updated: 29/Nov/22 10:46
• Resolved: 01/Aug/22 11:17

Description

HiveSplitGenerator is tightly coupled with Tez's InputContext to fetch the available slots during split calculation. Creating a interface to fetch the available slots will allow having other implementation too which are more suitable for different cloud vendors. 

The idea is to have a default implementation using Tez's InputContext and a new HiveConfiguration pointing to the class implementing the interface. Different cloud vendors can plugin there strategy by implementing the interface.

Issue Links

• Is contained by: HIVE-26751 Bug Fixes and Improvements for 3.2.0 release
• links to: GitHub Pull Request #3456