[DRILL-8287] Add Support for Keyset Based Pagination

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.20.2
• Fix Version/s: 1.21.0
• Component/s: Storage - HTTP
• Assignee: Charles Givre
• Reporter: Charles Givre
• Created: 25/Aug/22 14:55
• Updated: 15/Sep/22 14:40
• Resolved: 15/Sep/22 14:40

Description

Some APIs such as HubSpot use values in the result set to indicate whether there are additional pages.  This PR adds support for this kind of pagination.  Note that current implementation only works for JSON based APIs.