[SPARK-41896] Filtering by row_index always returns empty results

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: Spark Core
• Assignee: Jan-Ole Sasse
• Reporter: Jan-Ole Sasse
• Created: 05/Jan/23 09:17
• Updated: 16/Jan/23 12:18
• Resolved: 14/Jan/23 04:29

Description

Queries that include a filter with row_index currently always return an empty result. This is because we consider all metadata attributes constant per file here and the filter then always evaluates to false.

This should be fixed as a follow up to SPARK-41791

Issue Links

• links to: [Github] Pull Request #39408 (olaky)
• links to: [Github] Pull Request #39608 (olaky)