[CAMEL-17127] camel-salesforce - Default Bulk API V2 client does not allow locator and maxRecords query param to be added for get query results endpoint.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.13.0
• Component/s: camel-salesforce
• Labels: help-wanted
• Estimated Complexity: Unknown
• Assignee: Jeremy Ross
• Reporter: Ashutosh Gupta
• Created: 25/Oct/21 22:13
• Updated: 28/Oct/21 16:49
• Resolved: 28/Oct/21 15:22

Description

Salesforce Bulk API v2 Get Query Job Result endpoint has provision to pass locator and maxRecords query params in url which allows pagination in case of huge data set but "

bulk2GetQueryJobResults" operation of camel-salesforce component have a hardcoded url which does not have these queryparam:
https://github.com/apache/camel/blob/aef037026f354bfe09f4009821a027ca535a1619/components/camel-salesforce/camel-salesforce-component/src/main/java/org/apache/camel/component/salesforce/internal/client/DefaultBulkApiV2Client.java#L204

Therefore, if a data set is too big then we can only receive data of first page/file and there is no way to get next set of data.

Issue Links

• links to: GitHub Pull Request #6349