[SPARK-48925] Introduce interface to ensure extra strategy do planning of scan plan (with additional filters and projections)

• Type: Task
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 4.0.0
• Component/s: Spark Core
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Uros Stankovic
• Created: 17/Jul/24 13:33
• Updated: 23/Jul/24 14:05

Description

If we have some plan that contains scan with filter (or project) as parent, it can happen we want to do planning of scan using extra strategies instead of DataSourceV2Strategy.

One of use-cases:
Snowflake and BigQuery connectors have their own strategies and we want to prohibit DataSourceV2Strategy to do planning of scan node.

Despite the fact extra strategies have priority, it can happen that strategy fails to plan 
Filter->Relation, but it can plan only Relation without its parent. In that case, DataSourceV2Strategy will jump in and it will be able to plan Filter->Relation in just one pass.

So we want to have ability to prevent that for certain Scan classes

Issue Links

• links to: GitHub Pull Request #47443