[IMPALA-887] Improve partition pruning time

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: Impala 1.2.4
• Fix Version/s: Impala 1.4
• Assignee: Dimitris Tsirogiannis
• Reporter: Alan Choi
• Created: 14/Mar/14 23:10
• Updated: 20/Dec/15 00:05
• Resolved: 04/Jun/14 01:05

Description

Impala can roughly prune 10k partitions per sec. For huge tables, it might have >30k partitions. For queries that have tight SLA, the partition pruning time can be significant.

Hive's partition pruning is faster than Impala.