[KYLIN-3472] TopN merge in Spark engine performance tunning - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Minor
Resolution: Fixed
Affects Version/s: None
Fix Version/s: v2.5.0
Component/s: Spark Engine
Labels:
None

Description

Spark executor thread dump shows most CPU are spent on TopNCounter#merge .

Attachments

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

image-2018-07-27-18-16-12-112.png
27/Jul/18 10:16
153 kB
Shao Feng Shi
image-2018-07-27-18-16-12-192.png
27/Jul/18 10:16
138 kB
Shao Feng Shi

Issue Links

causes

KYLIN-3693 TopN, Count distinct incorrect in Spark engine

Closed

Activity

People

Assignee:: Shao Feng Shi

Reporter:: Shao Feng Shi

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 27/Jul/18 10:05

Updated:: 18/Nov/18 13:55

Resolved:: 29/Aug/18 01:00