[SPARK-39819] DS V2 aggregate push down can work with Top N or Paging (Sort with group expressions)

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: SQL
• Assignee: Jiaan Geng
• Reporter: Jiaan Geng
• Created: 20/Jul/22 04:06
• Updated: 09/Aug/22 03:49
• Resolved: 09/Aug/22 03:49

Description

Currently, DS V2 aggregate push-down cannot work with Top N (order by ... limit ...) or Paging (order by ... limit ... offset ...).
If it can work with Top N or Paging, it will be better performance.

Issue Links

• links to: [Github] Pull Request #37238 (beliefer)
• links to: [Github] Pull Request #37320 (beliefer)