[SPARK-7313] Allow for configuring max_samples in range partitioner.

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Won't Fix
• Component/s: Spark Core
• Assignee: Mridul Muralidharan
• Reporter: Mridul Muralidharan
• Created: 01/May/15 22:07
• Updated: 04/Oct/16 17:37
• Resolved: 04/Oct/16 17:37

Description

Currently, we assume that 1e6 is a reasonable upper bound to number of keys while sampling. This works fine when size of keys is 'small' - but breaks for anything non-trivial.

Issue Links

• links to: [Github] Pull Request #5848 (mridulm)