[NIFI-13869] Enhance QuerySalesforceObject Processor to Support Querying Deleted Records

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.25.0
• Fix Version/s: 2.0.0, 1.29.0
• Component/s: Extensions
• Assignee: Nicolae Puica
• Reporter: Nicolae Puica
• Created: 14/Oct/24 13:01
• Updated: 25/Oct/24 20:29
• Resolved: 22/Oct/24 16:38

Description

Currently, the QuerySalesforceObject processor in NiFi is capable of querying active records from Salesforce. However, it lacks the functionality to retrieve deleted records, which is critical for scenarios where we need to track changes or removals of records, especially for audit and compliance purposes. This improvement will add support for querying deleted records (soft deletes in Salesforce), leveraging the isDeleted field in Salesforce's SOQL queries.

Requirements:

1. New Processor Property:

• • Add a Boolean property: Include Deleted Records.
  • When set to true, the processor should include records where the isDeleted field is true.

1. SOQL Query Modification:

• • Modify the query structure to include the isDeleted field in the WHERE clause when querying the object. For example:
    • SELECT Id, Name, IsDeleted FROM ContentVersion WHERE IsDeleted = true.

1. Backward Compatibility:

• • Ensure backward compatibility by keeping the default behavior of excluding deleted records unless the new property is enabled.

Acceptance Criteria:

• Users should be able to enable or disable the querying of deleted records via a new processor property.
• The processor should return both deleted and non-deleted records when appropriate.

Issue Links

• links to: GitHub Pull Request #9434
• links to: GitHub Pull Request #9439