[HIVE-7992] StatsRulesProcFactory should gracefully handle overflows

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.13.1
• Fix Version/s: 0.14.0
• Component/s: Statistics
• Assignee: Prasanth Jayachandran
• Reporter: Mostafa Mokhtar
• Created: 05/Sep/14 01:26
• Updated: 13/Nov/14 19:43
• Resolved: 07/Sep/14 07:53

Description

When StatsRulesProcFactory overflows it sets data size to 0 and as a result the Vertex will ask for a single task, this results in a fairly slow running query, most likely the overflow is a result of higher than usual number of rows.

The class should detect an overflow and set a flag when an overflow occurs, if an overflow occurs StatsRulesProcFactory should request the maximum number of tasks for the vertex.

Issue Links

• links to: Review Board