[CARBONDATA-4123] Bloom index query with Index server giving incorrect results

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.1.1
• Assignee: Unassigned
• Reporter: SHREELEKHYA GAMPA
• Created: 09/Feb/21 07:45
• Updated: 17/Feb/21 16:18
• Resolved: 17/Feb/21 16:18

Description

Queries: create table and load data so that it can create >1 blocklet.

 

spark-sql> select count from test_rcd where city = 'city40';
2021-02-04 22:13:29,759 | WARN | pool-24-thread-1 | It is not recommended to set off-heap working memory size less than 512MB, so setting default value to 512 | org.apache.carbondata.core.memory.UnsafeMemoryManager.<clinit>(UnsafeMemoryManager.java:83)
10
Time taken: 2.417 seconds, Fetched 1 row(s)
spark-sql> CREATE INDEX dm_rcd ON TABLE test_rcd (city) AS 'bloomfilter' properties ('BLOOM_SIZE'='640000', 'BLOOM_FPP'='0.00001');
2021-02-04 22:13:58,683 | AUDIT | main | {"time":"February 4, 2021 10:13:58 PM CST","username":"carbon","opName":"CREATE INDEX","opId":"15148202700230273","opStatus":"START"} | carbon.audit.logOperationStart(Auditor.java:74)
2021-02-04 22:13:58,759 | WARN | main | Bloom compress is not configured for index dm_rcd, use default value true | org.apache.carbondata.index.bloom.BloomCoarseGrainIndexFactory.validateAndGetBloomCompress(BloomCoarseGrainIndexFactory.java:202)
2021-02-04 22:13:59,292 | WARN | Executor task launch worker for task 2 | Bloom compress is not configured for index dm_rcd, use default value true | org.apache.carbondata.index.bloom.BloomCoarseGrainIndexFactory.validateAndGetBloomCompress(BloomCoarseGrainIndexFactory.java:202)
2021-02-04 22:13:59,629 | WARN | main | Bloom compress is not configured for index dm_rcd, use default value true | org.apache.carbondata.index.bloom.BloomCoarseGrainIndexFactory.validateAndGetBloomCompress(BloomCoarseGrainIndexFactory.java:202)
2021-02-04 22:14:00,331 | AUDIT | main | {"time":"February 4, 2021 10:14:00 PM CST","username":"carbon","opName":"CREATE INDEX","opId":"15148202700230273","opStatus":"SUCCESS","opTime":"1648 ms","table":"default.test_rcd","extraInfo":{"provider":"bloomfilter","indexName":"dm_rcd","bloom_size":"640000","bloom_fpp":"0.00001"}} | carbon.audit.logOperationEnd(Auditor.java:97)
Time taken: 1.818 seconds
spark-sql> select count from test_rcd where city = 'city40';
30
Time taken: 0.556 seconds, Fetched 1 row(s)
spark-sql>