[HIVE-2127] Improve stats gathering reliability by retries on failures with hive.stats.retries.max and hive.stats.retries.wait

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.8.0
• Component/s: Query Processor, Statistics
• Hadoop Flags: Reviewed
• Assignee: Ning Zhang
• Reporter: Ning Zhang
• Created: 23/Apr/11 03:18
• Updated: 16/Dec/11 23:56
• Resolved: 27/Apr/11 14:19

Description

Stats publishing and aggregation only try once and if there is any exception it will fail and return. If many mappers/reducers updating stats at the same time, it is very common to get lock timeout. We should make stats more reliable by retry when there is an SQLException.