Description
In KYLIN-2349 and KYLIN-2353, we changed the storage format of BitmapCounter for better performance. In the new format, cardinality and serialized size are recorded in the header part. This enables us to retrieve those information without deserialize the whole data.
However, cardinality and serialized size can be quickly calculated just from the header of roaring format. Performance tests show that we could achieve the same performance gain without the format change. The benefits are
- there is no need for user to rebuild existing cube to get better performance
- there is no need for developer to maintain two formats and deal with compatibility issues
Attachments
Issue Links
- is related to
-
KYLIN-2387 A new BitmapCounter with better performance
-
- Closed
-