Details
-
Improvement
-
Status: In Progress
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
If we can accurately judge by the minMax status, we don’t need to load the dictionary from filesystem and compare one by one anymore.
Similarly , Bloomfilter needs to load from filesystem, it may costs time and memory. If we can exactly determine the existence/nonexistence of the value from minMax or dictionary filters , then we can avoid using Bloomfilter to Improve performance.
For example,
- read data greater than x1 in the block, if minMax in status is all greater than x1, then we don't need to read dictionary and compare one by one.
- If we already have page dictionaries and have compared one by one, we don't need to read BloomFilter and compare.