[HIVE-24212] Refactor to take advantage of list* optimisations in cloud storage connectors

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Rajesh Balamohan
• Created: 30/Sep/20 10:54
• Updated: 02/Feb/21 23:44
• Resolved: 02/Feb/21 23:44

Description

https://issues.apache.org/jira/browse/HADOOP-17022, https://issues.apache.org/jira/browse/HADOOP-17281, https://issues.apache.org/jira/browse/HADOOP-16830 etc help in reducing number of roundtrips to remote systems in cloud storage.

Creating this ticket to do minor refactoring to take advantage of the above optimizations.

Issue Links

• relates to: HIVE-24717 Migrate to listStatusIterator in moving files
• links to: GitHub Pull Request #1538