[SPARK-9412] Support records larger than a page size

• Type: Improvement
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: SQL
• Target Version/s: 1.5.0
• Epic Link: Tungsten Phase 1
• Assignee: Josh Rosen
• Reporter: Reynold Xin
• Created: 28/Jul/15 18:50
• Updated: 07/Aug/15 06:50
• Resolved: 07/Aug/15 06:50

Description

Currently in Tungsten, we don't support records that are larger than a page.

Sub-Tasks

• Support records larger than default page size in BytesToBytesMap: Resolved
• Support records larger than default page size in UnsafeExternalSorter: Resolved
• Support records larger than default page size in UnsafeShuffleExternalSorter: Resolved