7:15:12 =================================== FAILURES =================================== 07:15:12 TestMinMaxFilters.test_min_max_filters[protocol: beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: kudu/none] 07:15:12 [gw1] linux2 -- Python 2.7.5 /data/jenkins/workspace/impala-cdpd-master-core-asan/repos/Impala/bin/../infra/python/env/bin/python 07:15:12 query_test/test_runtime_filters.py:208: in test_min_max_filters 07:15:12 test_file_vars={'$RUNTIME_FILTER_WAIT_TIME_MS': str(WAIT_TIME_MS)}) 07:15:12 common/impala_test_suite.py:718: in run_test_case 07:15:12 update_section=pytest.config.option.update_results) 07:15:12 common/test_result_verifier.py:627: in verify_runtime_profile 07:15:12 % (function, field, expected_value, actual_value, actual)) 07:15:12 E AssertionError: Aggregation of SUM over ProbeRows did not match expected results. 07:15:12 E EXPECTED VALUE: 07:15:12 E 619 07:15:12 E 07:15:12 E ACTUAL VALUE: 07:15:12 E 684 07:15:12 E 07:15:12 E PROFILE: 07:15:12 E Query (id=3e4f518e4d9e96dc:79a7e24200000000): 07:15:12 E DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. 07:15:12 E Summary: 07:15:12 E Session ID: 63420040284816d2:0849293ae400f29c 07:15:12 E Session Type: BEESWAX 07:15:12 E Start Time: 2020-07-28 19:48:40.930654000 07:15:12 E End Time: 2020-07-28 19:57:53.203099000 07:15:12 E Query Type: QUERY 07:15:12 E Query State: FINISHED 07:15:12 E Impala Query State: FINISHED 07:15:12 E Query Status: OK 07:15:12 E Impala Version: impalad version 4.0.0-SNAPSHOT DEBUG (build 0b37f03b40de16d87e334062307ff498d63e7cff) 07:15:12 E User: jenkins 07:15:12 E Connected User: jenkins 07:15:12 E Delegated User: 07:15:12 E Network Address: ::1:52534 07:15:12 E Default Db: functional_kudu 07:15:12 E Sql Statement: select STRAIGHT_JOIN count(*) from decimal_rtf_tbl a 07:15:12 E join [BROADCAST] decimal_rtf_tiny_tbl b 07:15:12 E where a.d28_28 = b.d28_28 and b.d28_28 != 0 07:15:12 E Coordinator: impala-ec2-centos74-r5-4xlarge-ondemand-0810.vpc.cloudera.com:22000 07:15:12 E Query Options (set by configuration): ABORT_ON_ERROR=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,RUNTIME_FILTER_WAIT_TIME_MS=200000,DISABLE_CODEGEN_ROWS_THRESHOLD=0,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=query_test/test_runtime_filters.py::TestMinMaxFilters::()::test_min_max_filters[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_threshold':0}|t 07:15:12 E Query Options (set by configuration and planner): ABORT_ON_ERROR=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,RUNTIME_FILTER_WAIT_TIME_MS=200000,MT_DOP=0,DISABLE_CODEGEN_ROWS_THRESHOLD=0,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=query_test/test_runtime_filters.py::TestMinMaxFilters::()::test_min_max_filters[protocol:beeswax|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_threshold':0}|t 07:15:12 E Plan: 07:15:12 E ---------------- 07:15:12 E Max Per-Host Resource Reservation: Memory=1.94MB Threads=5 07:15:12 E Per-Host Resource Estimates: Memory=25MB 07:15:12 E Analyzed query: SELECT /* +straight_join */ count(*) FROM 07:15:12 E functional_kudu.decimal_rtf_tbl a INNER JOIN /* +BROADCAST */ 07:15:12 E functional_kudu.decimal_rtf_tiny_tbl b WHERE a.d28_28 = b.d28_28 AND b.d28_28 != 07:15:12 E CAST(0 AS DECIMAL(3,0)) 07:15:12 E 07:15:12 E F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 07:15:12 E | Per-Host Resources: mem-estimate=10.02MB mem-reservation=0B thread-reservation=1 07:15:12 E PLAN-ROOT SINK 07:15:12 E | output exprs: count(*) 07:15:12 E | mem-estimate=0B mem-reservation=0B thread-reservation=0 07:15:12 E | 07:15:12 E 06:AGGREGATE [FINALIZE] 07:15:12 E | output: count:merge(*) 07:15:12 E | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 07:15:12 E | tuple-ids=2 row-size=8B cardinality=1 07:15:12 E | in pipelines: 06(GETNEXT), 03(OPEN) 07:15:12 E | 07:15:12 E 05:EXCHANGE [UNPARTITIONED] 07:15:12 E | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 07:15:12 E | tuple-ids=2 row-size=8B cardinality=1 07:15:12 E | in pipelines: 03(GETNEXT) 07:15:12 E | 07:15:12 E F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 07:15:12 E Per-Host Resources: mem-estimate=13.44MB mem-reservation=1.94MB thread-reservation=2 07:15:12 E 03:AGGREGATE 07:15:12 E | output: count(*) 07:15:12 E | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 07:15:12 E | tuple-ids=2 row-size=8B cardinality=1 07:15:12 E | in pipelines: 03(GETNEXT), 00(OPEN) 07:15:12 E | 07:15:12 E 02:HASH JOIN [INNER JOIN, BROADCAST] 07:15:12 E | hash predicates: a.d28_28 = b.d28_28 07:15:12 E | fk/pk conjuncts: a.d28_28 = b.d28_28 07:15:12 E | runtime filters: RF001[min_max] <- b.d28_28 07:15:12 E | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 07:15:12 E | tuple-ids=0,1 row-size=32B cardinality=1 07:15:12 E | in pipelines: 00(GETNEXT), 01(OPEN) 07:15:12 E | 07:15:12 E |--04:EXCHANGE [BROADCAST] 07:15:12 E | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 07:15:12 E | | tuple-ids=1 row-size=16B cardinality=4 07:15:12 E | | in pipelines: 01(GETNEXT) 07:15:12 E | | 07:15:12 E | F01:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 07:15:12 E | Per-Host Resources: mem-estimate=1.50MB mem-reservation=0B thread-reservation=2 07:15:12 E | 01:SCAN KUDU [functional_kudu.decimal_rtf_tiny_tbl b] 07:15:12 E | predicates: b.d28_28 != CAST(0 AS DECIMAL(3,0)) 07:15:12 E | mem-estimate=1.50MB mem-reservation=0B thread-reservation=1 07:15:12 E | tuple-ids=1 row-size=16B cardinality=4 07:15:12 E | in pipelines: 01(GETNEXT) 07:15:12 E | 07:15:12 E 00:SCAN KUDU [functional_kudu.decimal_rtf_tbl a] 07:15:12 E predicates: a.d28_28 != CAST(0 AS DECIMAL(3,0)) 07:15:12 E runtime filters: RF001[min_max] -> a.d28_28 07:15:12 E mem-estimate=1.50MB mem-reservation=0B thread-reservation=1 07:15:12 E tuple-ids=0 row-size=16B cardinality=140 07:15:12 E in pipelines: 00(GETNEXT) 07:15:12 E ---------------- 07:15:12 E Estimated Per-Host Mem: 26165248 07:15:12 E Request Pool: default-pool 07:15:12 E Per Host Min Memory Reservation: impala-ec2-centos74-r5-4xlarge-ondemand-0810.vpc.cloudera.com:22002(1.94 MB) impala-ec2-centos74-r5-4xlarge-ondemand-0810.vpc.cloudera.com:22001(1.94 MB) impala-ec2-centos74-r5-4xlarge-ondemand-0810.vpc.cloudera.com:22000(1.94 MB) 07:15:12 E Per Host Number of Fragment Instances: impala-ec2-centos74-r5-4xlarge-ondemand-0810.vpc.cloudera.com:22002(2) impala-ec2-centos74-r5-4xlarge-ondemand-0810.vpc.cloudera.com:22001(2) impala-ec2-centos74-r5-4xlarge-ondemand-0810.vpc.cloudera.com:22000(3) 07:15:12 E Admission result: Admitted immediately 07:15:12 E Cluster Memory Admitted: 74.86 MB 07:15:12 E Executor Group: default 07:15:12 E ExecSummary: 07:15:12 E Operator #Hosts #Inst Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail 07:15:12 E -------------------------------------------------------------------------------------------------------------------------------------------------- 07:15:12 E F02:ROOT 1 1 0.000ns 0.000ns 0 0 07:15:12 E 06:AGGREGATE 1 1 7.000ms 7.000ms 1 1 16.00 KB 10.00 MB FINALIZE 07:15:12 E 05:EXCHANGE 1 1 1.000ms 1.000ms 3 1 32.00 KB 16.00 KB UNPARTITIONED 07:15:12 E F00:EXCHANGE SENDER 3 3 1.666ms 2.000ms 16.00 KB 0 07:15:12 E 03:AGGREGATE 3 3 0.000ns 0.000ns 3 1 88.00 KB 10.00 MB 07:15:12 E 02:HASH JOIN 3 3 39.666ms 47.000ms 37 1 2.00 MB 1.94 MB INNER JOIN, BROADCAST 07:15:12 E |--04:EXCHANGE 3 3 1.000ms 2.000ms 39 4 160.00 KB 16.00 KB BROADCAST 07:15:12 E | F01:EXCHANGE SENDER 3 3 5.666ms 7.000ms 24.00 KB 0 07:15:12 E | 01:SCAN KUDU 3 3 321.334ms 426.001ms 39 4 60.00 KB 1.50 MB functional_kudu.decimal_rtf_tiny_tbl b 07:15:12 E 00:SCAN KUDU 3 3 76.000ms 108.000ms 684 140 80.00 KB 1.50 MB functional_kudu.decimal_rtf_tbl a 07:15:12 E Errors: 07:15:12 E Query Compilation: 8.754ms 07:15:12 E - Metadata of all 2 tables cached: 459.012us (459.012us) 07:15:12 E - Analysis finished: 702.078us (243.066us) 07:15:12 E - Authorization finished (noop): 723.757us (21.679us) 07:15:12 E - Value transfer graph computed: 1.124ms (401.234us) 07:15:12 E - Single node plan created: 6.009ms (4.884ms) 07:15:12 E - Runtime filters computed: 6.126ms (116.494us) 07:15:12 E - Distributed plan created: 6.140ms (14.298us) 07:15:12 E - Planning finished: 8.754ms (2.613ms) 07:15:12 E Query Timeline: 9m12s 07:15:12 E - Query submitted: 2.000ms (2.000ms) 07:15:12 E - Planning finished: 13.000ms (11.000ms) 07:15:12 E - Submit for admission: 15.000ms (2.000ms) 07:15:12 E - Completed admission: 32.000ms (17.000ms) 07:15:12 E - Ready to start on 3 backends: 41.000ms (9.000ms) 07:15:12 E - All 3 execution backends (7 fragment instances) started: 69.000ms (28.000ms) 07:15:12 E - Rows available: 9m12s (9m12s) 07:15:12 E - First row fetched: 9m12s (33.000ms) 07:15:12 E - Last row fetched: 9m12s (1.000ms) 07:15:12 E - Released admission control resources: 9m12s (15.000ms) 07:15:12 E - AdmissionControlTimeSinceLastUpdate: 70.000ms 07:15:12 E - ComputeScanRangeAssignmentTimer: 9.000ms 07:15:12 E Frontend: 07:15:12 E ImpalaServer: 07:15:12 E - ClientFetchWaitTimer: 31.000ms 07:15:12 E - NumRowsFetched: 1 (1) 07:15:12 E - NumRowsFetchedFromCache: 0 (0) 07:15:12 E - RowMaterializationRate: 18.00 /sec 07:15:12 E - RowMaterializationTimer: 54.000ms 07:15:12 E Execution Profile 3e4f518e4d9e96dc:79a7e24200000000:(Total: 9m12s, non-child: 0.000ns, % non-child: 0.00%) 07:15:12 E Number of filters: 1 07:15:12 E Filter routing table: 07:15:12 E ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled 07:15:12 E ------------------------------------------------------------------------------------------------------------------- 07:15:12 E 1 2 0 LOCAL false 0 (3) N/A N/A true 07:15:12 E Backend startup latencies: Count: 3, min / max: 10ms / 12ms, 25th %-ile: 10ms, 50th %-ile: 11ms, 75th %-ile: 11ms, 90th %-ile: 12ms, 95th %-ile: 12ms, 99.9th %-ile: 12ms 07:15:12 E Slowest backend to start up: impala-ec2-centos74-r5-4xlarge-ondemand-0810.vpc.cloudera.com:22001 07:15:12 E Final filter table: 07:15:12 E ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled 07:15:12 E ------------------------------------------------------------------------------------------------------------------- 07:15:12 E 1 2 0 LOCAL false 0 (3) N/A N/A true