[KYLIN-3403] Querying sample cube with filter "KYLIN_CAL_DT.WEEK_BEG_DT >= CAST('2001-09-09' AS DATE)" returns unexpected empty result set

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: v2.4.1, v2.5.0
• Component/s: Query Engine
• Assignee: Yifan Zhang
• Reporter: Yifan Zhang
• Created: 12/Jun/18 06:52
• Updated: 09/Sep/18 05:53
• Resolved: 08/Jul/18 09:29

Description

2018-05-16 13:30:17,824 DEBUG [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] cachesync.CachedCrudAssist : Loaded 3 ColumnACL(s) out of 3 resource
2018-05-16 13:30:17,840 INFO [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] routing.QueryRouter : Find candidates by table DEFAULT.KYLIN_SALES and project=learn_kylin : INVERTED_INDEX[name=kylin_sales_cube],CUBE[name=kylin_sales_cube]
2018-05-16 13:30:17,841 INFO [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] routing.QueryRouter : Applying rule: class org.apache.kylin.query.routing.rules.RemoveBlackoutRealizationsRule, realizations before: [INVERTED_INDEX[name=kylin_sales_cube],CUBE[name=kylin_sales_cube]], realizations after: [INVERTED_INDEX[name=kylin_sales_cube],CUBE[name=kylin_sales_cube]]
2018-05-16 13:30:17,843 INFO [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] routing.QueryRouter : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [INVERTED_INDEX[name=kylin_sales_cube],CUBE[name=kylin_sales_cube]], realizations after: [INVERTED_INDEX[name=kylin_sales_cube],CUBE[name=kylin_sales_cube]]
2018-05-16 13:30:17,844 INFO [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] rules.RealizationSortRule : INVERTED_INDEX[name=kylin_sales_cube] priority 1 cost 8360. CUBE[name=kylin_sales_cube] priority 1 cost 836.
2018-05-16 13:30:17,844 INFO [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] routing.QueryRouter : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [INVERTED_INDEX[name=kylin_sales_cube],CUBE[name=kylin_sales_cube]], realizations after: [CUBE[name=kylin_sales_cube],INVERTED_INDEX[name=kylin_sales_cube]]
2018-05-16 13:30:17,844 INFO [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] routing.QueryRouter : The realizations remaining: [CUBE[name=kylin_sales_cube],INVERTED_INDEX[name=kylin_sales_cube]],and the final chosen one for current olap context 0 is CUBE[name=kylin_sales_cube]
2018-05-16 13:30:18,042 DEBUG [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] enumerator.OLAPEnumerator : query storage...
2018-05-16 13:30:18,082 DEBUG [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] gtrecord.GTCubeStorageQueryBase : Need storage aggregation
2018-05-16 13:30:18,083 INFO [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] gtrecord.GTCubeStorageQueryBase : exactAggregation is false because need storage aggregation
2018-05-16 13:30:18,091 INFO [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] lookup.SnapshotManager : Loading snapshotTable from /table_snapshot/DEFAULT.KYLIN_CAL_DT/2d3d125a-30f7-438f-bede-7212c5666f4a.snapshot, with loadData: true
2018-05-16 13:30:18,197 DEBUG [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] lookup.SnapshotManager : Loaded snapshot at /table_snapshot/DEFAULT.KYLIN_CAL_DT/2d3d125a-30f7-438f-bede-7212c5666f4a.snapshot
2018-05-16 13:30:18,426 INFO [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] gtrecord.GTCubeStorageQueryBase : Filter column set for query: []
2018-05-16 13:30:18,426 INFO [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] gtrecord.GTCubeStorageQueryBase : Filter mask is: 0
2018-05-16 13:30:18,426 DEBUG [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] gtrecord.GTCubeStorageQueryBase : storageLimitLevel set to NO_LIMIT because derived column require post aggregation: [DEFAULT.KYLIN_SALES.PART_DT]
2018-05-16 13:30:18,426 DEBUG [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] gtrecord.GTCubeStorageQueryBase : storageLimitLevel set to NO_LIMIT because the query has order by
2018-05-16 13:30:18,427 INFO [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] gtrecord.GTCubeStorageQueryBase : Cuboid identified: cube=kylin_sales_cube, cuboidId=16384, groupsD=[], filterD=[], limitPushdown=2147483647, limitLevel=NO_LIMIT, storageAggr=true
2018-05-16 13:30:18,429 INFO [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] gtrecord.CubeSegmentScanner : Init CubeSegmentScanner for segment 20120101000000_20180403152544
2018-05-16 13:30:18,476 INFO [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] gtrecord.ScannerWorker : Segment kylin_sales_cube[20120101000000_20180403152544] will be skipped
2018-05-16 13:30:18,477 DEBUG [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] enumerator.OLAPEnumerator : return TupleIterator...
2018-05-16 13:30:18,481 INFO [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] service.QueryService : Processed rows for each storageContext: 0
2018-05-16 13:30:18,481 INFO [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] service.QueryService : Stats of SQL response: isException: false, duration: 2711, total scan count 0
2018-05-16 13:30:18,512 INFO [Query aa20e5fd-8b86-4359-a87a-2a2e7b8c100a-162] service.QueryService :
==========================[QUERY]===============================
Query Id: aa20e5fd-8b86-4359-a87a-2a2e7b8c100a
SQL: SELECT COUNT(1) AS "TRANS_CNT"
FROM "DEFAULT"."KYLIN_SALES" AS "KYLIN_SALES"
JOIN "DEFAULT"."KYLIN_CAL_DT" AS "KYLIN_CAL_DT" ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
JOIN "DEFAULT"."KYLIN_CATEGORY_GROUPINGS" AS "KYLIN_CATEGORY_GROUPINGS" ON KYLIN_SALES.LEAF_CATEG_ID = KYLIN_CATEGORY_GROUPINGS.LEAF_CATEG_ID
AND KYLIN_SALES.LSTG_SITE_ID = KYLIN_CATEGORY_GROUPINGS.SITE_ID
JOIN "DEFAULT"."KYLIN_ACCOUNT" AS "BUYER_ACCOUNT" ON KYLIN_SALES.BUYER_ID = BUYER_ACCOUNT.ACCOUNT_ID
JOIN "DEFAULT"."KYLIN_ACCOUNT" AS "SELLER_ACCOUNT" ON KYLIN_SALES.SELLER_ID = SELLER_ACCOUNT.ACCOUNT_ID
JOIN "DEFAULT"."KYLIN_COUNTRY" AS "BUYER_COUNTRY" ON BUYER_ACCOUNT.ACCOUNT_COUNTRY = BUYER_COUNTRY.COUNTRY
JOIN "DEFAULT"."KYLIN_COUNTRY" AS "SELLER_COUNTRY" ON SELLER_ACCOUNT.ACCOUNT_COUNTRY = SELLER_COUNTRY.COUNTRY
WHERE KYLIN_CAL_DT.WEEK_BEG_DT >= date'2001-09-05'

ORDER BY "TRANS_CNT" ASC
LIMIT 10000
User: ADMIN
Success: true
Duration: 2.742
Project: learn_kylin
Realization Names: [CUBE[name=kylin_sales_cube]]
Cuboid Ids: [16384]
Total scan count: 0
Total scan bytes: 0
Result row count: 1
Accept Partial: true
Is Partial Result: false
Hit Exception Cache: false
Storage cache used: false
Is Query Push-Down: false
Is Prepare: false
Trace URL: null
Message: null
==========================[QUERY]===============================

Issue Links

• links to: GitHub Pull Request #159