[KYLIN-3635] Percentile calculation on Spark engine is wrong

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: v2.3.0, v2.3.1, v2.4.0, v2.3.2, v2.4.1, v2.5.0
• Fix Version/s: v2.4.2, v2.5.1
• Component/s: Spark Engine
• Assignee: Shao Feng Shi
• Reporter: Shao Feng Shi
• Created: 18/Oct/18 11:12
• Updated: 06/Nov/18 02:21
• Resolved: 29/Oct/18 08:34

Description

As titled; Received reporting that percentile result is wrong when using Spark engine. Checked the code and found the object was reused and not reset, the problem won't happen on normal MR as it would be serialized before next call, but would be a problem on Spark, as the object was cached in-memory and be serialized later.

Issue Links

• links to: GitHub Pull Request #294
• links to: GitHub Pull Request #316