Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Won't Fix
-
v1.2, v1.5.2
-
None
-
None
Description
A whole dimension is kept in memory.
We should have a way to keep only certain number / size of total rows to be kept in memory. A LRU cache for rows in the dimension will help keep memory in check.
Why not store all the dimensions data in hbase in a different table with a prefix of dimensionid, and all calls to the dimensions (get based on dim key), is mapped to hbase.
This does mean it will cost more time on a miss.
Attachments
Issue Links
- relates to
-
KYLIN-1428 Scalable dictionary to support cardinality of billions
- Closed