[SPARK-2391] LIMIT queries ship a whole partition of data for in-memory tables

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.1.0
• Component/s: SQL
• Target Version/s: 1.1.0
• Assignee: Michael Armbrust
• Reporter: Michael Armbrust
• Created: 07/Jul/14 18:30
• Updated: 08/Jul/14 07:42
• Resolved: 08/Jul/14 07:42

Description

Basically the problem here is that Spark's take() runs jobs using allowLocal = true.

Issue Links

• links to: Github pull request