[KUDU-3056] kudu-spark HdrHistogramAccumulator is too big, and make spark job failed

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.9.0
• Fix Version/s: 1.12.0
• Component/s: spark
• Target Version/s: 1.9.0
• Assignee: Grant Henke
• Reporter: caiconghui
• Created: 17/Feb/20 14:12
• Updated: 03/Jun/20 16:06
• Resolved: 20/Feb/20 22:46

Description

in production envrinment, we use kudu-spark to read kudu table, but even we don't use the
HdrHistogramAccumulator, the HdrHistogramAccumulator stored in an array is stiil so big,
totoal of them are almost 2 MB, so that when the number of kudu-spark task(for read kudu data and shuffle) is more than 900, the spark job failed, and the follwing error occured,

Job aborted due to stage failure: Total size of serialized results of 1413 tasks (3.0 GB) is bigger than spark.driver.maxResultSize (3.0 GB)

Issue Links

• is duplicated by: KUDU-3054 Init kudu.write_duration accumulator lazily