[KYLIN-1857] Show available memory on UI - in System Tab (and other runtime statistics)

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: v1.5.2, v1.5.2.1
• Assignee: Unassigned
• Reporter: Richard Calaba
• Created: 07/Jul/16 15:48
• Updated: 30/Oct/19 09:24
• Resolved: 30/Oct/19 09:24

Description

I have run into situation that Kylin dies (exception in log says heap out of memory) if I try to run 3 parallel cubes with high-cardinality dimensions. It is reproduceable scenario. I have set max snapshot size to 2GB and -Xmx to 16GB.

If I run the cube build one-by-one -> Kylin doesn't die.

As we have have no idea about memory requirements before we start building the cube(s) then for now it would be beneficial at least to monitor basic Kylin VM statistics, i.e.:

– current memory occupied by snaphots
– total memory allocation & total free memory
– how many (and which) temporary (intermediate) objects (in hive/hbase/filesystem) are created ...

Issue Links

• relates to: KYLIN-1908 Collect Metrics to JMX