[SPARK-17515] CollectLimit.execute() should perform per-partition limits

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.1, 2.1.0
• Component/s: SQL
• Target Version/s: 2.0.1, 2.1.0
• Assignee: Josh Rosen
• Reporter: Josh Rosen
• Created: 13/Sep/16 02:08
• Updated: 13/Sep/16 11:03
• Resolved: 13/Sep/16 11:03

Description

CollectLimit.execute() incorrectly omits per-partition limits, leading to performance regressions in case this case is hit (which should not happen in normal operation, but can occur in some pathological corner-cases

Issue Links

• links to: [Github] Pull Request #15070 (JoshRosen)