03:55:33 =================================== FAILURES =================================== 03:55:33 TestMtDopParquetFiltering.test_parquet_filtering[exec_option: {'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} | table_format: parquet/none] 03:55:33 [gw2] linux2 -- Python 2.6.6 /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/bin/../infra/python/env/bin/python 03:55:33 query_test/test_mt_dop.py:115: in test_parquet_filtering 03:55:33 self.run_test_case('QueryTest/mt-dop-parquet-filtering', vector) 03:55:33 common/impala_test_suite.py:399: in run_test_case 03:55:33 verify_runtime_profile(test_section['RUNTIME_PROFILE'], result.runtime_profile) 03:55:33 common/test_result_verifier.py:490: in verify_runtime_profile 03:55:33 actual)) 03:55:33 E AssertionError: Did not find matches for lines in runtime profile: 03:55:33 E EXPECTED LINES: 03:55:33 E row_regex: .*NumRowGroups: 3.* 03:55:33 E 03:55:33 E ACTUAL PROFILE: 03:55:33 E Query (id=7b45e2d6aa7364d6:c7607ef800000000): 03:55:33 E DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. 03:55:33 E Summary: 03:55:33 E Session ID: e44826aef681430c:96de03ef5e382e95 03:55:33 E Session Type: BEESWAX 03:55:33 E Start Time: 2017-03-07 03:28:59.086538000 03:55:33 E End Time: 03:55:33 E Query Type: QUERY 03:55:33 E Query State: CREATED 03:55:33 E Query Status: OK 03:55:33 E Impala Version: impalad version 2.9.0-SNAPSHOT DEBUG (build 9b923a1a277d90d7056e9c64f97904a90d8f231b) 03:55:33 E User: jenkins 03:55:33 E Connected User: jenkins 03:55:33 E Delegated User: 03:55:33 E Network Address: 127.0.0.1:33042 03:55:33 E Default Db: functional_parquet 03:55:33 E Sql Statement: select count(*) from functional_parquet.alltypes where id < 10000 03:55:33 E Coordinator: impala-boost-static-burst-slave-003c.vpc.cloudera.com:22000 03:55:33 E Query Options (non default): ABORT_ON_ERROR=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,MT_DOP=3 03:55:33 E Plan: 03:55:33 E ---------------- 03:55:33 E Estimated Per-Host Requirements: Memory=26.00MB VCores=1 03:55:33 E WARNING: The following tables are missing relevant table and/or column statistics. 03:55:33 E functional_parquet.alltypes 03:55:33 E 03:55:33 E PLAN-ROOT SINK 03:55:33 E | 03:55:33 E 03:AGGREGATE [FINALIZE] 03:55:33 E | output: count:merge(*) 03:55:33 E | hosts=1 per-host-mem=unavailable 03:55:33 E | tuple-ids=1 row-size=8B cardinality=1 03:55:33 E | 03:55:33 E 02:EXCHANGE [UNPARTITIONED] 03:55:33 E | hosts=1 per-host-mem=unavailable 03:55:33 E | tuple-ids=1 row-size=8B cardinality=1 03:55:33 E | 03:55:33 E 01:AGGREGATE 03:55:33 E | output: count(*) 03:55:33 E | hosts=1 per-host-mem=10.00MB 03:55:33 E | tuple-ids=1 row-size=8B cardinality=1 03:55:33 E | 03:55:33 E 00:SCAN HDFS [functional_parquet.alltypes, RANDOM] 03:55:33 E partitions=24/24 files=24 size=165.17KB 03:55:33 E predicates: id < 10000 03:55:33 E table stats: unavailable 03:55:33 E column stats: unavailable 03:55:33 E parquet statistics predicates: id < 10000 03:55:33 E parquet dictionary predicates: id < 10000 03:55:33 E hosts=1 per-host-mem=16.00MB 03:55:33 E tuple-ids=0 row-size=4B cardinality=unavailable 03:55:33 E ---------------- 03:55:33 E Estimated Per-Host Mem: 27262976 03:55:33 E Estimated Per-Host VCores: 1 03:55:33 E Tables Missing Stats: functional_parquet.alltypes 03:55:33 E Request Pool: default-pool 03:55:33 E Admission result: Admitted immediately 03:55:33 E Planner Timeline: 4.404ms 03:55:33 E - Analysis finished: 1.040ms (1.040ms) 03:55:33 E - Equivalence classes computed: 1.117ms (76.483us) 03:55:33 E - Single node plan created: 2.881ms (1.764ms) 03:55:33 E - Runtime filters computed: 2.917ms (35.405us) 03:55:33 E - Distributed plan created: 3.059ms (142.587us) 03:55:33 E - Parallel plans created: 3.097ms (38.337us) 03:55:33 E - Planning finished: 4.404ms (1.306ms) 03:55:33 E Query Timeline: 140.002ms 03:55:33 E - Query submitted: 0.000ns (0.000ns) 03:55:33 E - Planning finished: 5.000ms (5.000ms) 03:55:33 E - Submit for admission: 6.000ms (1.000ms) 03:55:33 E - Completed admission: 7.000ms (1.000ms) 03:55:33 E - Ready to start 4 fragment instances: 7.000ms (0.000ns) 03:55:33 E - All 4 fragment instances started: 12.000ms (5.000ms) 03:55:33 E - Rows available: 95.001ms (83.001ms) 03:55:33 E - First row fetched: 137.002ms (42.000ms) 03:55:33 E - ComputeScanRangeAssignmentTimer: 0.000ns 03:55:33 E ImpalaServer: 03:55:33 E - ClientFetchWaitTimer: 42.000ms 03:55:33 E - RowMaterializationTimer: 2.000ms 03:55:33 E Execution Profile 7b45e2d6aa7364d6:c7607ef800000000:(Total: 89.001ms, non-child: 0.000ns, % non-child: 0.00%) 03:55:33 E Fragment instance start latencies: Count: 4, min / max: 1ms / 3ms, 25th %-ile: 1ms, 50th %-ile: 2ms, 75th %-ile: 2ms, 90th %-ile: 3ms, 95th %-ile: 3ms, 99.9th %-ile: 3ms 03:55:33 E Per Node Peak Memory Usage: impala-boost-static-burst-slave-003c.vpc.cloudera.com:22000(581.50 KB) 03:55:33 E - FiltersReceived: 0 (0) 03:55:33 E - FinalizationTimer: 0.000ns 03:55:33 E Coordinator Fragment F01: 03:55:33 E Instance 7b45e2d6aa7364d6:c7607ef800000000 (host=impala-boost-static-burst-slave-003c.vpc.cloudera.com:22000):(Total: 129.002ms, non-child: 44.000ms, % non-child: 34.11%) 03:55:33 E MemoryUsage(500.000ms): 16.00 KB 03:55:33 E - AverageThreadTokens: 0.00 03:55:33 E - BloomFilterBytes: 0 03:55:33 E - PeakMemoryUsage: 36.02 KB (36880) 03:55:33 E - PerHostPeakMemUsage: 581.50 KB (595456) 03:55:33 E - RowsProduced: 1 (1) 03:55:33 E - TotalNetworkReceiveTime: 61.001ms 03:55:33 E - TotalNetworkSendTime: 0.000ns 03:55:33 E - TotalStorageWaitTime: 0.000ns 03:55:33 E - TotalThreadsInvoluntaryContextSwitches: 1 (1) 03:55:33 E - TotalThreadsTotalWallClockTime: 103.001ms 03:55:33 E - TotalThreadsSysTime: 0.000ns 03:55:33 E - TotalThreadsUserTime: 1.000ms 03:55:33 E - TotalThreadsVoluntaryContextSwitches: 8 (8) 03:55:33 E Fragment Instance Lifecycle Timings: 03:55:33 E - ExecTime: 42.000ms 03:55:33 E - ExecTreeExecTime: 0.000ns 03:55:33 E - OpenTime: 61.001ms 03:55:33 E - ExecTreeOpenTime: 61.001ms 03:55:33 E - PrepareTime: 26.000ms 03:55:33 E - ExecTreePrepareTime: 0.000ns 03:55:33 E BlockMgr: 03:55:33 E - BlockWritesOutstanding: 0 (0) 03:55:33 E - BlocksCreated: 0 (0) 03:55:33 E - BlocksRecycled: 0 (0) 03:55:33 E - BufferedPins: 0 (0) 03:55:33 E - MaxBlockSize: 8.00 MB (8388608) 03:55:33 E - MemoryLimit: 42.93 GB (46095990784) 03:55:33 E - PeakMemoryUsage: 0 03:55:33 E - ScratchBytesRead: 0 03:55:33 E - ScratchBytesWritten: 0 03:55:33 E - ScratchFileUsedBytes: 0 03:55:33 E - ScratchReads: 0 (0) 03:55:33 E - ScratchWrites: 0 (0) 03:55:33 E - TotalBufferWaitTime: 0.000ns 03:55:33 E - TotalEncryptionTime: 0.000ns 03:55:33 E - TotalReadBlockTime: 0.000ns 03:55:33 E PLAN_ROOT_SINK: 03:55:33 E - PeakMemoryUsage: 0 03:55:33 E CodeGen:(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) 03:55:33 E - CodegenTime: 0.000ns 03:55:33 E - CompileTime: 0.000ns 03:55:33 E - LoadTime: 0.000ns 03:55:33 E - ModuleBitcodeSize: 1.93 MB (2020204) 03:55:33 E - NumFunctions: 0 (0) 03:55:33 E - NumInstructions: 0 (0) 03:55:33 E - OptimizationTime: 0.000ns 03:55:33 E - PeakMemoryUsage: 0 03:55:33 E - PrepareTime: 24.000ms 03:55:33 E AGGREGATION_NODE (id=3):(Total: 61.001ms, non-child: 0.000ns, % non-child: 0.00%) 03:55:33 E - BuildTime: 0.000ns 03:55:33 E - GetResultsTime: 0.000ns 03:55:33 E - HTResizeTime: 0.000ns 03:55:33 E - HashBuckets: 0 (0) 03:55:33 E - LargestPartitionPercent: 0 (0) 03:55:33 E - MaxPartitionLevel: 0 (0) 03:55:33 E - NumRepartitions: 0 (0) 03:55:33 E - PartitionsCreated: 0 (0) 03:55:33 E - PeakMemoryUsage: 28.00 KB (28672) 03:55:33 E - RowsRepartitioned: 0 (0) 03:55:33 E - RowsReturned: 1 (1) 03:55:33 E - RowsReturnedRate: 16.00 /sec 03:55:33 E - SpilledPartitions: 0 (0) 03:55:33 E EXCHANGE_NODE (id=2):(Total: 61.001ms, non-child: 0.000ns, % non-child: 0.00%) 03:55:33 E BytesReceived(500.000ms): 0 03:55:33 E - BytesReceived: 48.00 B (48) 03:55:33 E - ConvertRowBatchTime: 0.000ns 03:55:33 E - DeserializeRowBatchTimer: 0.000ns 03:55:33 E - FirstBatchArrivalWaitTime: 58.000ms 03:55:33 E - PeakMemoryUsage: 0 03:55:33 E - RowsReturned: 3 (3) 03:55:33 E - RowsReturnedRate: 49.00 /sec 03:55:33 E - SendersBlockedTimer: 0.000ns 03:55:33 E - SendersBlockedTotalTimer(*): 0.000ns 03:55:33 E Averaged Fragment F00:(Total: 82.001ms, non-child: 3.666ms, % non-child: 4.47%) 03:55:33 E split sizes: min: 48.37 KB, max: 61.82 KB, avg: 55.06 KB, stddev: 5.49 KB 03:55:33 E completion times: min:83.001ms max:83.001ms mean: 83.001ms stddev:0.471ns 03:55:33 E execution rates: min:582.75 KB/sec max:744.76 KB/sec mean:663.33 KB/sec stddev:66.14 KB/sec 03:55:33 E num instances: 3 03:55:33 E - AverageThreadTokens: 1.00 03:55:33 E - BloomFilterBytes: 0 03:55:33 E - PeakMemoryUsage: 188.50 KB (193024) 03:55:33 E - PerHostPeakMemUsage: 581.50 KB (595456) 03:55:33 E - RowsProduced: 1 (1) 03:55:33 E - TotalNetworkReceiveTime: 0.000ns 03:55:33 E - TotalNetworkSendTime: 333.339us 03:55:33 E - TotalStorageWaitTime: 7.333ms 03:55:33 E - TotalThreadsInvoluntaryContextSwitches: 61 (61) 03:55:33 E - TotalThreadsTotalWallClockTime: 53.334ms 03:55:33 E - TotalThreadsSysTime: 2.333ms 03:55:33 E - TotalThreadsUserTime: 41.660ms 03:55:33 E - TotalThreadsVoluntaryContextSwitches: 42 (42) 03:55:33 E Fragment Instance Lifecycle Timings: 03:55:33 E - ExecTime: 333.339us 03:55:33 E - ExecTreeExecTime: 0.000ns 03:55:33 E - OpenTime: 53.000ms 03:55:33 E - ExecTreeOpenTime: 12.666ms 03:55:33 E - PrepareTime: 28.333ms 03:55:33 E - ExecTreePrepareTime: 333.339us 03:55:33 E DataStreamSender (dst_id=2):(Total: 333.339us, non-child: 333.339us, % non-child: 100.00%) 03:55:33 E - BytesSent: 16.00 B (16) 03:55:33 E - NetworkThroughput(*): 0.00 /sec 03:55:33 E - OverallThroughput: 5.21 KB/sec 03:55:33 E - PeakMemoryUsage: 16.00 KB (16384) 03:55:33 E - RowsReturned: 1 (1) 03:55:33 E - SerializeBatchTime: 0.000ns 03:55:33 E - TransmitDataRPCTime: 0.000ns 03:55:33 E - UncompressedRowBatchSize: 16.00 B (16) 03:55:33 E CodeGen:(Total: 65.001ms, non-child: 65.001ms, % non-child: 100.00%) 03:55:33 E - CodegenTime: 2.000ms 03:55:33 E - CompileTime: 5.000ms 03:55:33 E - LoadTime: 0.000ns 03:55:33 E - ModuleBitcodeSize: 1.93 MB (2020204) 03:55:33 E - NumFunctions: 19 (19) 03:55:33 E - NumInstructions: 321 (321) 03:55:33 E - OptimizationTime: 33.667ms 03:55:33 E - PeakMemoryUsage: 160.50 KB (164352) 03:55:33 E - PrepareTime: 26.000ms 03:55:33 E AGGREGATION_NODE (id=1):(Total: 13.000ms, non-child: 1.333ms, % non-child: 10.26%) 03:55:33 E - BuildTime: 0.000ns 03:55:33 E - GetResultsTime: 0.000ns 03:55:33 E - HTResizeTime: 0.000ns 03:55:33 E - HashBuckets: 0 (0) 03:55:33 E - LargestPartitionPercent: 0 (0) 03:55:33 E - MaxPartitionLevel: 0 (0) 03:55:33 E - NumRepartitions: 0 (0) 03:55:33 E - PartitionsCreated: 0 (0) 03:55:33 E - PeakMemoryUsage: 25.00 KB (25600) 03:55:33 E - RowsRepartitioned: 0 (0) 03:55:33 E - RowsReturned: 1 (1) 03:55:33 E - RowsReturnedRate: 77.00 /sec 03:55:33 E - SpilledPartitions: 0 (0) 03:55:33 E HDFS_SCAN_NODE (id=0):(Total: 11.666ms, non-child: 11.666ms, % non-child: 100.00%) 03:55:33 E - AverageHdfsReadThreadConcurrency: 0.00 03:55:33 E - AverageScannerThreadConcurrency: 0.00 03:55:33 E - BytesRead: 67.80 KB (69424) 03:55:33 E - BytesReadDataNodeCache: 0 03:55:33 E - BytesReadLocal: 0 03:55:33 E - BytesReadRemoteUnexpected: 0 03:55:33 E - BytesReadShortCircuit: 0 03:55:33 E - DecompressionTime: 0.000ns 03:55:33 E - MaxCompressedTextFileLength: 0 03:55:33 E - NumColumns: 1 (1) 03:55:33 E - NumDictFilteredRowGroups: 0 (0) 03:55:33 E - NumDisksAccessed: 3 (3) 03:55:33 E - NumRowGroups: 8 (8) 03:55:33 E - NumScannerThreadsStarted: 0 (0) 03:55:33 E - NumScannersWithNoReads: 0 (0) 03:55:33 E - NumStatsFilteredRowGroups: 0 (0) 03:55:33 E - PeakMemoryUsage: 35.01 KB (35850) 03:55:33 E - PerReadThreadRawHdfsThroughput: 44.17 MB/sec 03:55:33 E - RemoteScanRanges: 0 (0) 03:55:33 E - RowsRead: 2.43K (2433) 03:55:33 E - RowsReturned: 2.43K (2433) 03:55:33 E - RowsReturnedRate: 208.83 K/sec 03:55:33 E - ScanRangesComplete: 8 (8) 03:55:33 E - ScannerThreadsInvoluntaryContextSwitches: 0 (0) 03:55:33 E - ScannerThreadsTotalWallClockTime: 0.000ns 03:55:33 E - MaterializeTupleTime(*): 0.000ns 03:55:33 E - ScannerThreadsSysTime: 0.000ns 03:55:33 E - ScannerThreadsUserTime: 0.000ns 03:55:33 E - ScannerThreadsVoluntaryContextSwitches: 0 (0) 03:55:33 E - TotalRawHdfsReadTime(*): 666.678us 03:55:33 E - TotalReadThroughput: 121.15 KB/sec 03:55:33 E Fragment F00: 03:55:33 E Instance 7b45e2d6aa7364d6:c7607ef800000001 (host=impala-boost-static-burst-slave-003c.vpc.cloudera.com:22000):(Total: 83.001ms, non-child: 3.000ms, % non-child: 3.61%) 03:55:33 E Hdfs split stats (:<# splits>/): -1:9/61.82 KB 03:55:33 E MemoryUsage(500.000ms): 59.17 KB 03:55:33 E ThreadUsage(500.000ms): 1 03:55:33 E - AverageThreadTokens: 1.00 03:55:33 E - BloomFilterBytes: 0 03:55:33 E - PeakMemoryUsage: 188.50 KB (193024) 03:55:33 E - PerHostPeakMemUsage: 581.50 KB (595456) 03:55:33 E - RowsProduced: 1 (1) 03:55:33 E - TotalNetworkReceiveTime: 0.000ns 03:55:33 E - TotalNetworkSendTime: 0.000ns 03:55:33 E - TotalStorageWaitTime: 11.000ms 03:55:33 E - TotalThreadsInvoluntaryContextSwitches: 58 (58) 03:55:33 E - TotalThreadsTotalWallClockTime: 55.000ms 03:55:33 E - TotalThreadsSysTime: 4.000ms 03:55:33 E - TotalThreadsUserTime: 40.994ms 03:55:33 E - TotalThreadsVoluntaryContextSwitches: 50 (50) 03:55:33 E Fragment Instance Lifecycle Timings: 03:55:33 E - ExecTime: 0.000ns 03:55:33 E - ExecTreeExecTime: 0.000ns 03:55:33 E - OpenTime: 55.000ms 03:55:33 E - ExecTreeOpenTime: 14.000ms 03:55:33 E - PrepareTime: 27.000ms 03:55:33 E - ExecTreePrepareTime: 0.000ns 03:55:33 E DataStreamSender (dst_id=2):(Total: 1.000ms, non-child: 1.000ms, % non-child: 100.00%) 03:55:33 E - BytesSent: 16.00 B (16) 03:55:33 E - NetworkThroughput(*): 0.00 /sec 03:55:33 E - OverallThroughput: 15.62 KB/sec 03:55:33 E - PeakMemoryUsage: 16.00 KB (16384) 03:55:33 E - RowsReturned: 1 (1) 03:55:33 E - SerializeBatchTime: 0.000ns 03:55:33 E - TransmitDataRPCTime: 0.000ns 03:55:33 E - UncompressedRowBatchSize: 16.00 B (16) 03:55:33 E CodeGen:(Total: 65.001ms, non-child: 65.001ms, % non-child: 100.00%) 03:55:33 E - CodegenTime: 2.000ms 03:55:33 E - CompileTime: 5.000ms 03:55:33 E - LoadTime: 0.000ns 03:55:33 E - ModuleBitcodeSize: 1.93 MB (2020204) 03:55:33 E - NumFunctions: 19 (19) 03:55:33 E - NumInstructions: 321 (321) 03:55:33 E - OptimizationTime: 34.000ms 03:55:33 E - PeakMemoryUsage: 160.50 KB (164352) 03:55:33 E - PrepareTime: 25.000ms 03:55:33 E AGGREGATION_NODE (id=1):(Total: 14.000ms, non-child: 1.000ms, % non-child: 7.14%) 03:55:33 E ExecOption: Codegen Enabled 03:55:33 E - BuildTime: 0.000ns 03:55:33 E - GetResultsTime: 0.000ns 03:55:33 E - HTResizeTime: 0.000ns 03:55:33 E - HashBuckets: 0 (0) 03:55:33 E - LargestPartitionPercent: 0 (0) 03:55:33 E - MaxPartitionLevel: 0 (0) 03:55:33 E - NumRepartitions: 0 (0) 03:55:33 E - PartitionsCreated: 0 (0) 03:55:33 E - PeakMemoryUsage: 25.00 KB (25600) 03:55:33 E - RowsRepartitioned: 0 (0) 03:55:33 E - RowsReturned: 1 (1) 03:55:33 E - RowsReturnedRate: 71.00 /sec 03:55:33 E - SpilledPartitions: 0 (0) 03:55:33 E HDFS_SCAN_NODE (id=0):(Total: 13.000ms, non-child: 13.000ms, % non-child: 100.00%) 03:55:33 E Hdfs split stats (:<# splits>/): -1:9/61.82 KB 03:55:33 E ExecOption: PARQUET Codegen Enabled, Codegen enabled: 9 out of 9 03:55:33 E Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 03:55:33 E File Formats: PARQUET/SNAPPY:9 03:55:33 E BytesRead(500.000ms): 66.24 KB 03:55:33 E - FooterProcessingTime: (Avg: 555.564us ; Min: 0.000ns ; Max: 1.000ms ; Number of samples: 9) 03:55:33 E - AverageHdfsReadThreadConcurrency: 0.00 03:55:33 E - AverageScannerThreadConcurrency: 0.00 03:55:33 E - BytesRead: 76.11 KB (77937) 03:55:33 E - BytesReadDataNodeCache: 0 03:55:33 E - BytesReadLocal: 0 03:55:33 E - BytesReadRemoteUnexpected: 0 03:55:33 E - BytesReadShortCircuit: 0 03:55:33 E - DecompressionTime: 0.000ns 03:55:33 E - MaxCompressedTextFileLength: 0 03:55:33 E - NumColumns: 1 (1) 03:55:33 E - NumDictFilteredRowGroups: 0 (0) 03:55:33 E - NumDisksAccessed: 3 (3) 03:55:33 E - NumRowGroups: 9 (9) 03:55:33 E - NumScannerThreadsStarted: 0 (0) 03:55:33 E - NumScannersWithNoReads: 0 (0) 03:55:33 E - NumStatsFilteredRowGroups: 0 (0) 03:55:33 E - PeakMemoryUsage: 35.01 KB (35850) 03:55:33 E - PerReadThreadRawHdfsThroughput: 74.33 MB/sec 03:55:33 E - RemoteScanRanges: 0 (0) 03:55:33 E - RowsRead: 2.73K (2730) 03:55:33 E - RowsReturned: 2.73K (2730) 03:55:33 E - RowsReturnedRate: 210.00 K/sec 03:55:33 E - ScanRangesComplete: 9 (9) 03:55:33 E - ScannerThreadsInvoluntaryContextSwitches: 0 (0) 03:55:33 E - ScannerThreadsTotalWallClockTime: 0.000ns 03:55:33 E - MaterializeTupleTime(*): 0.000ns 03:55:33 E - ScannerThreadsSysTime: 0.000ns 03:55:33 E - ScannerThreadsUserTime: 0.000ns 03:55:33 E - ScannerThreadsVoluntaryContextSwitches: 0 (0) 03:55:33 E - TotalRawHdfsReadTime(*): 1.000ms 03:55:33 E - TotalReadThroughput: 132.47 KB/sec 03:55:33 E Instance 7b45e2d6aa7364d6:c7607ef800000003 (host=impala-boost-static-burst-slave-003c.vpc.cloudera.com:22000):(Total: 82.001ms, non-child: 5.000ms, % non-child: 6.10%) 03:55:33 E Hdfs split stats (:<# splits>/): -1:7/48.37 KB 03:55:33 E MemoryUsage(500.000ms): 65.16 KB 03:55:33 E ThreadUsage(500.000ms): 1 03:55:33 E - AverageThreadTokens: 1.00 03:55:33 E - BloomFilterBytes: 0 03:55:33 E - PeakMemoryUsage: 188.50 KB (193024) 03:55:33 E - PerHostPeakMemUsage: 581.50 KB (595456) 03:55:33 E - RowsProduced: 1 (1) 03:55:33 E - TotalNetworkReceiveTime: 0.000ns 03:55:33 E - TotalNetworkSendTime: 1.000ms 03:55:33 E - TotalStorageWaitTime: 5.000ms 03:55:33 E - TotalThreadsInvoluntaryContextSwitches: 57 (57) 03:55:33 E - TotalThreadsTotalWallClockTime: 52.000ms 03:55:33 E - TotalThreadsSysTime: 0.000ns 03:55:33 E - TotalThreadsUserTime: 42.993ms 03:55:33 E - TotalThreadsVoluntaryContextSwitches: 33 (33) 03:55:33 E Fragment Instance Lifecycle Timings: 03:55:33 E - ExecTime: 1.000ms 03:55:33 E - ExecTreeExecTime: 0.000ns 03:55:33 E - OpenTime: 51.000ms 03:55:33 E - ExecTreeOpenTime: 11.000ms 03:55:33 E - PrepareTime: 30.000ms 03:55:33 E - ExecTreePrepareTime: 0.000ns 03:55:33 E DataStreamSender (dst_id=2): 03:55:33 E - BytesSent: 16.00 B (16) 03:55:33 E - NetworkThroughput(*): 0.00 /sec 03:55:33 E - OverallThroughput: 0.00 /sec 03:55:33 E - PeakMemoryUsage: 16.00 KB (16384) 03:55:33 E - RowsReturned: 1 (1) 03:55:33 E - SerializeBatchTime: 0.000ns 03:55:33 E - TransmitDataRPCTime: 0.000ns 03:55:33 E - UncompressedRowBatchSize: 16.00 B (16) 03:55:33 E CodeGen:(Total: 66.001ms, non-child: 66.001ms, % non-child: 100.00%) 03:55:33 E - CodegenTime: 2.000ms 03:55:33 E - CompileTime: 5.000ms 03:55:33 E - LoadTime: 0.000ns 03:55:33 E - ModuleBitcodeSize: 1.93 MB (2020204) 03:55:33 E - NumFunctions: 19 (19) 03:55:33 E - NumInstructions: 321 (321) 03:55:33 E - OptimizationTime: 33.000ms 03:55:33 E - PeakMemoryUsage: 160.50 KB (164352) 03:55:33 E - PrepareTime: 28.000ms 03:55:33 E AGGREGATION_NODE (id=1):(Total: 11.000ms, non-child: 1.000ms, % non-child: 9.09%) 03:55:33 E ExecOption: Codegen Enabled 03:55:33 E - BuildTime: 0.000ns 03:55:33 E - GetResultsTime: 0.000ns 03:55:33 E - HTResizeTime: 0.000ns 03:55:33 E - HashBuckets: 0 (0) 03:55:33 E - LargestPartitionPercent: 0 (0) 03:55:33 E - MaxPartitionLevel: 0 (0) 03:55:33 E - NumRepartitions: 0 (0) 03:55:33 E - PartitionsCreated: 0 (0) 03:55:33 E - PeakMemoryUsage: 25.00 KB (25600) 03:55:33 E - RowsRepartitioned: 0 (0) 03:55:33 E - RowsReturned: 1 (1) 03:55:33 E - RowsReturnedRate: 90.00 /sec 03:55:33 E - SpilledPartitions: 0 (0) 03:55:33 E HDFS_SCAN_NODE (id=0):(Total: 10.000ms, non-child: 10.000ms, % non-child: 100.00%) 03:55:33 E Hdfs split stats (:<# splits>/): -1:7/48.37 KB 03:55:33 E ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 03:55:33 E Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 03:55:33 E File Formats: PARQUET/SNAPPY:7 03:55:33 E BytesRead(500.000ms): 49.40 KB 03:55:33 E - FooterProcessingTime: (Avg: 1.000ms ; Min: 0.000ns ; Max: 2.000ms ; Number of samples: 7) 03:55:33 E - AverageHdfsReadThreadConcurrency: 0.00 03:55:33 E - AverageScannerThreadConcurrency: 0.00 03:55:33 E - BytesRead: 59.57 KB (61003) 03:55:33 E - BytesReadDataNodeCache: 0 03:55:33 E - BytesReadLocal: 0 03:55:33 E - BytesReadRemoteUnexpected: 0 03:55:33 E - BytesReadShortCircuit: 0 03:55:33 E - DecompressionTime: 0.000ns 03:55:33 E - MaxCompressedTextFileLength: 0 03:55:33 E - NumColumns: 1 (1) 03:55:33 E - NumDictFilteredRowGroups: 0 (0) 03:55:33 E - NumDisksAccessed: 3 (3) 03:55:33 E - NumRowGroups: 7 (7) 03:55:33 E - NumScannerThreadsStarted: 0 (0) 03:55:33 E - NumScannersWithNoReads: 0 (0) 03:55:33 E - NumStatsFilteredRowGroups: 0 (0) 03:55:33 E - PeakMemoryUsage: 35.01 KB (35850) 03:55:33 E - PerReadThreadRawHdfsThroughput: 58.18 MB/sec 03:55:33 E - RemoteScanRanges: 0 (0) 03:55:33 E - RowsRead: 2.14K (2140) 03:55:33 E - RowsReturned: 2.14K (2140) 03:55:33 E - RowsReturnedRate: 214.00 K/sec 03:55:33 E - ScanRangesComplete: 7 (7) 03:55:33 E - ScannerThreadsInvoluntaryContextSwitches: 0 (0) 03:55:33 E - ScannerThreadsTotalWallClockTime: 0.000ns 03:55:33 E - MaterializeTupleTime(*): 0.000ns 03:55:33 E - ScannerThreadsSysTime: 0.000ns 03:55:33 E - ScannerThreadsUserTime: 0.000ns 03:55:33 E - ScannerThreadsVoluntaryContextSwitches: 0 (0) 03:55:33 E - TotalRawHdfsReadTime(*): 1.000ms 03:55:33 E - TotalReadThroughput: 98.79 KB/sec 03:55:33 E Instance 7b45e2d6aa7364d6:c7607ef800000002 (host=impala-boost-static-burst-slave-003c.vpc.cloudera.com:22000):(Total: 81.001ms, non-child: 3.000ms, % non-child: 3.70%) 03:55:33 E Hdfs split stats (:<# splits>/): -1:8/54.99 KB 03:55:33 E MemoryUsage(500.000ms): 65.16 KB 03:55:33 E ThreadUsage(500.000ms): 1 03:55:33 E - AverageThreadTokens: 1.00 03:55:33 E - BloomFilterBytes: 0 03:55:33 E - PeakMemoryUsage: 188.50 KB (193024) 03:55:33 E - PerHostPeakMemUsage: 581.50 KB (595456) 03:55:33 E - RowsProduced: 1 (1) 03:55:33 E - TotalNetworkReceiveTime: 0.000ns 03:55:33 E - TotalNetworkSendTime: 0.000ns 03:55:33 E - TotalStorageWaitTime: 6.000ms 03:55:33 E - TotalThreadsInvoluntaryContextSwitches: 69 (69) 03:55:33 E - TotalThreadsTotalWallClockTime: 53.000ms 03:55:33 E - TotalThreadsSysTime: 3.000ms 03:55:33 E - TotalThreadsUserTime: 40.994ms 03:55:33 E - TotalThreadsVoluntaryContextSwitches: 44 (44) 03:55:33 E Fragment Instance Lifecycle Timings: 03:55:33 E - ExecTime: 0.000ns 03:55:33 E - ExecTreeExecTime: 0.000ns 03:55:33 E - OpenTime: 53.000ms 03:55:33 E - ExecTreeOpenTime: 13.000ms 03:55:33 E - PrepareTime: 28.000ms 03:55:33 E - ExecTreePrepareTime: 1.000ms 03:55:33 E DataStreamSender (dst_id=2): 03:55:33 E - BytesSent: 16.00 B (16) 03:55:33 E - NetworkThroughput(*): 0.00 /sec 03:55:33 E - OverallThroughput: 0.00 /sec 03:55:33 E - PeakMemoryUsage: 16.00 KB (16384) 03:55:33 E - RowsReturned: 1 (1) 03:55:33 E - SerializeBatchTime: 0.000ns 03:55:33 E - TransmitDataRPCTime: 0.000ns 03:55:33 E - UncompressedRowBatchSize: 16.00 B (16) 03:55:33 E CodeGen:(Total: 64.001ms, non-child: 64.001ms, % non-child: 100.00%) 03:55:33 E - CodegenTime: 2.000ms 03:55:33 E - CompileTime: 5.000ms 03:55:33 E - LoadTime: 0.000ns 03:55:33 E - ModuleBitcodeSize: 1.93 MB (2020204) 03:55:33 E - NumFunctions: 19 (19) 03:55:33 E - NumInstructions: 321 (321) 03:55:33 E - OptimizationTime: 34.000ms 03:55:33 E - PeakMemoryUsage: 160.50 KB (164352) 03:55:33 E - PrepareTime: 25.000ms 03:55:33 E AGGREGATION_NODE (id=1):(Total: 14.000ms, non-child: 2.000ms, % non-child: 14.29%) 03:55:33 E ExecOption: Codegen Enabled 03:55:33 E - BuildTime: 0.000ns 03:55:33 E - GetResultsTime: 0.000ns 03:55:33 E - HTResizeTime: 0.000ns 03:55:33 E - HashBuckets: 0 (0) 03:55:33 E - LargestPartitionPercent: 0 (0) 03:55:33 E - MaxPartitionLevel: 0 (0) 03:55:33 E - NumRepartitions: 0 (0) 03:55:33 E - PartitionsCreated: 0 (0) 03:55:33 E - PeakMemoryUsage: 25.00 KB (25600) 03:55:33 E - RowsRepartitioned: 0 (0) 03:55:33 E - RowsReturned: 1 (1) 03:55:33 E - RowsReturnedRate: 71.00 /sec 03:55:33 E - SpilledPartitions: 0 (0) 03:55:33 E HDFS_SCAN_NODE (id=0):(Total: 12.000ms, non-child: 12.000ms, % non-child: 100.00%) 03:55:33 E Hdfs split stats (:<# splits>/): -1:8/54.99 KB 03:55:33 E ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 03:55:33 E Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 03:55:33 E File Formats: PARQUET/SNAPPY:8 03:55:33 E BytesRead(500.000ms): 66.09 KB 03:55:33 E - FooterProcessingTime: (Avg: 500.008us ; Min: 0.000ns ; Max: 1.000ms ; Number of samples: 8) 03:55:33 E - AverageHdfsReadThreadConcurrency: 0.00 03:55:33 E - AverageScannerThreadConcurrency: 0.00 03:55:33 E - BytesRead: 67.71 KB (69332) 03:55:33 E - BytesReadDataNodeCache: 0 03:55:33 E - BytesReadLocal: 0 03:55:33 E - BytesReadRemoteUnexpected: 0 03:55:33 E - BytesReadShortCircuit: 0 03:55:33 E - DecompressionTime: 0.000ns 03:55:33 E - MaxCompressedTextFileLength: 0 03:55:33 E - NumColumns: 1 (1) 03:55:33 E - NumDictFilteredRowGroups: 0 (0) 03:55:33 E - NumDisksAccessed: 3 (3) 03:55:33 E - NumRowGroups: 8 (8) 03:55:33 E - NumScannerThreadsStarted: 0 (0) 03:55:33 E - NumScannersWithNoReads: 0 (0) 03:55:33 E - NumStatsFilteredRowGroups: 0 (0) 03:55:33 E - PeakMemoryUsage: 35.01 KB (35850) 03:55:33 E - PerReadThreadRawHdfsThroughput: 0.00 /sec 03:55:33 E - RemoteScanRanges: 0 (0) 03:55:33 E - RowsRead: 2.43K (2430) 03:55:33 E - RowsReturned: 2.43K (2430) 03:55:33 E - RowsReturnedRate: 202.50 K/sec 03:55:33 E - ScanRangesComplete: 8 (8) 03:55:33 E - ScannerThreadsInvoluntaryContextSwitches: 0 (0) 03:55:33 E - ScannerThreadsTotalWallClockTime: 0.000ns 03:55:33 E - MaterializeTupleTime(*): 0.000ns 03:55:33 E - ScannerThreadsSysTime: 0.000ns 03:55:33 E - ScannerThreadsUserTime: 0.000ns 03:55:33 E - ScannerThreadsVoluntaryContextSwitches: 0 (0) 03:55:33 E - TotalRawHdfsReadTime(*): 0.000ns 03:55:33 E - TotalReadThroughput: 132.17 KB/sec 03:55:33 ---------------------------- Captured stderr setup ----------------------------- 03:55:33 -- connecting to: localhost:21000 03:55:33 ----------------------------- Captured stderr call ----------------------------- 03:55:33 -- executing against localhost:21000 03:55:33 use functional_parquet; 03:55:33 03:55:33 SET disable_codegen=False; 03:55:33 SET batch_size=0; 03:55:33 SET num_nodes=0; 03:55:33 SET mt_dop=3; 03:55:33 SET abort_on_error=1; 03:55:33 SET exec_single_node_rows_threshold=0; 03:55:33 -- executing against localhost:21000 03:55:33 select count(*) from functional_parquet.alltypes where id < 10000; 03:55:33 03:55:33 TestParquet.test_filtering[exec_option: {'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} | table_format: parquet/none] 03:55:33 [gw0] linux2 -- Python 2.6.6 /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/bin/../infra/python/env/bin/python 03:55:33 query_test/test_scanners.py:317: in test_filtering 03:55:33 self.run_test_case('QueryTest/parquet-filtering', vector) 03:55:33 common/impala_test_suite.py:399: in run_test_case 03:55:33 verify_runtime_profile(test_section['RUNTIME_PROFILE'], result.runtime_profile) 03:55:33 common/test_result_verifier.py:490: in verify_runtime_profile 03:55:33 actual)) 03:55:33 E AssertionError: Did not find matches for lines in runtime profile: 03:55:33 E EXPECTED LINES: 03:55:33 E row_regex: .*NumRowGroups: 8.* 03:55:33 E 03:55:33 E ACTUAL PROFILE: 03:55:33 E Query (id=364890dfb40dcc8d:5304c4e800000000): 03:55:33 E DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. 03:55:33 E Summary: 03:55:33 E Session ID: 8c43ce6a8ee4d206:88dc5a4a9c3732a8 03:55:33 E Session Type: BEESWAX 03:55:33 E Start Time: 2017-03-07 03:36:44.393244000 03:55:33 E End Time: 03:55:33 E Query Type: QUERY 03:55:33 E Query State: CREATED 03:55:33 E Query Status: OK 03:55:33 E Impala Version: impalad version 2.9.0-SNAPSHOT DEBUG (build 9b923a1a277d90d7056e9c64f97904a90d8f231b) 03:55:33 E User: jenkins 03:55:33 E Connected User: jenkins 03:55:33 E Delegated User: 03:55:33 E Network Address: 127.0.0.1:34780 03:55:33 E Default Db: functional_parquet 03:55:33 E Sql Statement: select count(*) from functional_parquet.alltypes where id < 10000 03:55:33 E Coordinator: impala-boost-static-burst-slave-003c.vpc.cloudera.com:22000 03:55:33 E Query Options (non default): ABORT_ON_ERROR=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0 03:55:33 E Plan: 03:55:33 E ---------------- 03:55:33 E Estimated Per-Host Requirements: Memory=26.00MB VCores=1 03:55:33 E WARNING: The following tables are missing relevant table and/or column statistics. 03:55:33 E functional_parquet.alltypes 03:55:33 E 03:55:33 E PLAN-ROOT SINK 03:55:33 E | 03:55:33 E 03:AGGREGATE [FINALIZE] 03:55:33 E | output: count:merge(*) 03:55:33 E | hosts=1 per-host-mem=unavailable 03:55:33 E | tuple-ids=1 row-size=8B cardinality=1 03:55:33 E | 03:55:33 E 02:EXCHANGE [UNPARTITIONED] 03:55:33 E | hosts=1 per-host-mem=unavailable 03:55:33 E | tuple-ids=1 row-size=8B cardinality=1 03:55:33 E | 03:55:33 E 01:AGGREGATE 03:55:33 E | output: count(*) 03:55:33 E | hosts=1 per-host-mem=10.00MB 03:55:33 E | tuple-ids=1 row-size=8B cardinality=1 03:55:33 E | 03:55:33 E 00:SCAN HDFS [functional_parquet.alltypes, RANDOM] 03:55:33 E partitions=24/24 files=24 size=165.17KB 03:55:33 E predicates: id < 10000 03:55:33 E table stats: unavailable 03:55:33 E column stats: unavailable 03:55:33 E parquet statistics predicates: id < 10000 03:55:33 E parquet dictionary predicates: id < 10000 03:55:33 E hosts=1 per-host-mem=16.00MB 03:55:33 E tuple-ids=0 row-size=4B cardinality=unavailable 03:55:33 E ---------------- 03:55:33 E Estimated Per-Host Mem: 27262976 03:55:33 E Estimated Per-Host VCores: 1 03:55:33 E Tables Missing Stats: functional_parquet.alltypes 03:55:33 E Request Pool: default-pool 03:55:33 E Admission result: Admitted immediately 03:55:33 E Planner Timeline: 5.293ms 03:55:33 E - Analysis finished: 1.486ms (1.486ms) 03:55:33 E - Equivalence classes computed: 1.553ms (66.354us) 03:55:33 E - Single node plan created: 4.543ms (2.990ms) 03:55:33 E - Runtime filters computed: 4.570ms (27.185us) 03:55:33 E - Distributed plan created: 4.681ms (110.775us) 03:55:33 E - Planning finished: 5.293ms (612.419us) 03:55:33 E Query Timeline: 192.003ms 03:55:33 E - Query submitted: 0.000ns (0.000ns) 03:55:33 E - Planning finished: 7.000ms (7.000ms) 03:55:33 E - Submit for admission: 10.000ms (3.000ms) 03:55:33 E - Completed admission: 11.000ms (1.000ms) 03:55:33 E - Ready to start 2 fragment instances: 14.000ms (3.000ms) 03:55:33 E - All 2 fragment instances started: 27.000ms (13.000ms) 03:55:33 E - Rows available: 152.002ms (125.002ms) 03:55:33 E - First row fetched: 187.003ms (35.000ms) 03:55:33 E - ComputeScanRangeAssignmentTimer: 2.000ms 03:55:33 E ImpalaServer: 03:55:33 E - ClientFetchWaitTimer: 35.000ms 03:55:33 E - RowMaterializationTimer: 3.000ms 03:55:33 E Execution Profile 364890dfb40dcc8d:5304c4e800000000:(Total: 135.002ms, non-child: 0.000ns, % non-child: 0.00%) 03:55:33 E Number of filters: 0 03:55:33 E Filter routing table: 03:55:33 E ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled 03:55:33 E ---------------------------------------------------------------------------------------------------------------------------- 03:55:33 E 03:55:33 E Fragment instance start latencies: Count: 2, min / max: 4ms / 9ms, 25th %-ile: 4ms, 50th %-ile: 4ms, 75th %-ile: 9ms, 90th %-ile: 9ms, 95th %-ile: 9ms, 99.9th %-ile: 9ms 03:55:33 E Per Node Peak Memory Usage: impala-boost-static-burst-slave-003c.vpc.cloudera.com:22000(204.50 KB) 03:55:33 E - FiltersReceived: 0 (0) 03:55:33 E - FinalizationTimer: 0.000ns 03:55:33 E Coordinator Fragment F01: 03:55:33 E Instance 364890dfb40dcc8d:5304c4e800000000 (host=impala-boost-static-burst-slave-003c.vpc.cloudera.com:22000):(Total: 168.002ms, non-child: 39.000ms, % non-child: 23.21%) 03:55:33 E - AverageThreadTokens: 0.00 03:55:33 E - BloomFilterBytes: 0 03:55:33 E - PeakMemoryUsage: 28.01 KB (28680) 03:55:33 E - PerHostPeakMemUsage: 204.50 KB (209408) 03:55:33 E - RowsProduced: 1 (1) 03:55:33 E - TotalNetworkReceiveTime: 70.001ms 03:55:33 E - TotalNetworkSendTime: 0.000ns 03:55:33 E - TotalStorageWaitTime: 0.000ns 03:55:33 E - TotalThreadsInvoluntaryContextSwitches: 2 (2) 03:55:33 E - TotalThreadsTotalWallClockTime: 110.001ms 03:55:33 E - TotalThreadsSysTime: 0.000ns 03:55:33 E - TotalThreadsUserTime: 1.000ms 03:55:33 E - TotalThreadsVoluntaryContextSwitches: 9 (9) 03:55:33 E Fragment Instance Lifecycle Timings: 03:55:33 E - ExecTime: 37.000ms 03:55:33 E - ExecTreeExecTime: 0.000ns 03:55:33 E - OpenTime: 73.001ms 03:55:33 E - ExecTreeOpenTime: 71.001ms 03:55:33 E - PrepareTime: 58.000ms 03:55:33 E - ExecTreePrepareTime: 2.000ms 03:55:33 E BlockMgr: 03:55:33 E - BlockWritesOutstanding: 0 (0) 03:55:33 E - BlocksCreated: 0 (0) 03:55:33 E - BlocksRecycled: 0 (0) 03:55:33 E - BufferedPins: 0 (0) 03:55:33 E - MaxBlockSize: 8.00 MB (8388608) 03:55:33 E - MemoryLimit: 42.93 GB (46095990784) 03:55:33 E - PeakMemoryUsage: 0 03:55:33 E - ScratchBytesRead: 0 03:55:33 E - ScratchBytesWritten: 0 03:55:33 E - ScratchFileUsedBytes: 0 03:55:33 E - ScratchReads: 0 (0) 03:55:33 E - ScratchWrites: 0 (0) 03:55:33 E - TotalBufferWaitTime: 0.000ns 03:55:33 E - TotalEncryptionTime: 0.000ns 03:55:33 E - TotalReadBlockTime: 0.000ns 03:55:33 E PLAN_ROOT_SINK: 03:55:33 E - PeakMemoryUsage: 0 03:55:33 E CodeGen:(Total: 56.000ms, non-child: 56.000ms, % non-child: 100.00%) 03:55:33 E - CodegenTime: 0.000ns 03:55:33 E - CompileTime: 0.000ns 03:55:33 E - LoadTime: 0.000ns 03:55:33 E - ModuleBitcodeSize: 1.93 MB (2020204) 03:55:33 E - NumFunctions: 0 (0) 03:55:33 E - NumInstructions: 0 (0) 03:55:33 E - OptimizationTime: 0.000ns 03:55:33 E - PeakMemoryUsage: 0 03:55:33 E - PrepareTime: 55.000ms 03:55:33 E AGGREGATION_NODE (id=3):(Total: 73.001ms, non-child: 3.000ms, % non-child: 4.11%) 03:55:33 E - BuildTime: 0.000ns 03:55:33 E - GetResultsTime: 0.000ns 03:55:33 E - HTResizeTime: 0.000ns 03:55:33 E - HashBuckets: 0 (0) 03:55:33 E - LargestPartitionPercent: 0 (0) 03:55:33 E - MaxPartitionLevel: 0 (0) 03:55:33 E - NumRepartitions: 0 (0) 03:55:33 E - PartitionsCreated: 0 (0) 03:55:33 E - PeakMemoryUsage: 20.00 KB (20480) 03:55:33 E - RowsRepartitioned: 0 (0) 03:55:33 E - RowsReturned: 1 (1) 03:55:33 E - RowsReturnedRate: 13.00 /sec 03:55:33 E - SpilledPartitions: 0 (0) 03:55:33 E EXCHANGE_NODE (id=2):(Total: 70.001ms, non-child: 0.000ns, % non-child: 0.00%) 03:55:33 E - BytesReceived: 16.00 B (16) 03:55:33 E - ConvertRowBatchTime: 0.000ns 03:55:33 E - DeserializeRowBatchTimer: 0.000ns 03:55:33 E - FirstBatchArrivalWaitTime: 70.001ms 03:55:33 E - PeakMemoryUsage: 0 03:55:33 E - RowsReturned: 1 (1) 03:55:33 E - RowsReturnedRate: 14.00 /sec 03:55:33 E - SendersBlockedTimer: 0.000ns 03:55:33 E - SendersBlockedTotalTimer(*): 0.000ns 03:55:33 E Averaged Fragment F00:(Total: 126.002ms, non-child: 19.000ms, % non-child: 15.08%) 03:55:33 E split sizes: min: 165.17 KB, max: 165.17 KB, avg: 165.17 KB, stddev: 0 03:55:33 E completion times: min:129.002ms max:129.002ms mean: 129.002ms stddev:0.000ns 03:55:33 E execution rates: min:1.25 MB/sec max:1.25 MB/sec mean:1.25 MB/sec stddev:0.00 /sec 03:55:33 E num instances: 1 03:55:33 E - AverageThreadTokens: 0.00 03:55:33 E - BloomFilterBytes: 0 03:55:33 E - PeakMemoryUsage: 188.50 KB (193024) 03:55:33 E - PerHostPeakMemUsage: 204.50 KB (209408) 03:55:33 E - RowsProduced: 1 (1) 03:55:33 E - TotalNetworkReceiveTime: 0.000ns 03:55:33 E - TotalNetworkSendTime: 1.000ms 03:55:33 E - TotalStorageWaitTime: 16.000ms 03:55:33 E - TotalThreadsInvoluntaryContextSwitches: 158 (158) 03:55:33 E - TotalThreadsTotalWallClockTime: 122.002ms 03:55:33 E - TotalThreadsSysTime: 1.999ms 03:55:33 E - TotalThreadsUserTime: 52.991ms 03:55:33 E - TotalThreadsVoluntaryContextSwitches: 121 (121) 03:55:33 E Fragment Instance Lifecycle Timings: 03:55:33 E - ExecTime: 3.000ms 03:55:33 E - ExecTreeExecTime: 0.000ns 03:55:33 E - OpenTime: 67.001ms 03:55:33 E - ExecTreeOpenTime: 29.000ms 03:55:33 E - PrepareTime: 56.000ms 03:55:33 E - ExecTreePrepareTime: 4.000ms 03:55:33 E DataStreamSender (dst_id=2): 03:55:33 E - BytesSent: 16.00 B (16) 03:55:33 E - NetworkThroughput(*): 0.00 /sec 03:55:33 E - OverallThroughput: 0.00 /sec 03:55:33 E - PeakMemoryUsage: 16.00 KB (16384) 03:55:33 E - RowsReturned: 1 (1) 03:55:33 E - SerializeBatchTime: 0.000ns 03:55:33 E - TransmitDataRPCTime: 0.000ns 03:55:33 E - UncompressedRowBatchSize: 16.00 B (16) 03:55:33 E CodeGen:(Total: 74.001ms, non-child: 74.001ms, % non-child: 100.00%) 03:55:33 E - CodegenTime: 2.000ms 03:55:33 E - CompileTime: 6.000ms 03:55:33 E - LoadTime: 0.000ns 03:55:33 E - ModuleBitcodeSize: 1.93 MB (2020204) 03:55:33 E - NumFunctions: 19 (19) 03:55:33 E - NumInstructions: 321 (321) 03:55:33 E - OptimizationTime: 31.000ms 03:55:33 E - PeakMemoryUsage: 160.50 KB (164352) 03:55:33 E - PrepareTime: 37.000ms 03:55:33 E AGGREGATION_NODE (id=1):(Total: 33.000ms, non-child: 0.000ns, % non-child: 0.00%) 03:55:33 E - BuildTime: 0.000ns 03:55:33 E - GetResultsTime: 0.000ns 03:55:33 E - HTResizeTime: 0.000ns 03:55:33 E - HashBuckets: 0 (0) 03:55:33 E - LargestPartitionPercent: 0 (0) 03:55:33 E - MaxPartitionLevel: 0 (0) 03:55:33 E - NumRepartitions: 0 (0) 03:55:33 E - PartitionsCreated: 0 (0) 03:55:33 E - PeakMemoryUsage: 25.00 KB (25600) 03:55:33 E - RowsRepartitioned: 0 (0) 03:55:33 E - RowsReturned: 1 (1) 03:55:33 E - RowsReturnedRate: 30.00 /sec 03:55:33 E - SpilledPartitions: 0 (0) 03:55:33 E HDFS_SCAN_NODE (id=0):(Total: 38.000ms, non-child: 38.000ms, % non-child: 100.00%) 03:55:33 E - AverageHdfsReadThreadConcurrency: 0.00 03:55:33 E - AverageScannerThreadConcurrency: 0.00 03:55:33 E - BytesRead: 203.39 KB (208272) 03:55:33 E - BytesReadDataNodeCache: 0 03:55:33 E - BytesReadLocal: 0 03:55:33 E - BytesReadRemoteUnexpected: 0 03:55:33 E - BytesReadShortCircuit: 0 03:55:33 E - DecompressionTime: 0.000ns 03:55:33 E - MaxCompressedTextFileLength: 0 03:55:33 E - NumColumns: 1 (1) 03:55:33 E - NumDictFilteredRowGroups: 0 (0) 03:55:33 E - NumDisksAccessed: 3 (3) 03:55:33 E - NumRowGroups: 24 (24) 03:55:33 E - NumScannerThreadsStarted: 2 (2) 03:55:33 E - NumScannersWithNoReads: 0 (0) 03:55:33 E - NumStatsFilteredRowGroups: 0 (0) 03:55:33 E - PeakMemoryUsage: 92.02 KB (94228) 03:55:33 E - PerReadThreadRawHdfsThroughput: 198.62 MB/sec 03:55:33 E - RemoteScanRanges: 0 (0) 03:55:33 E - RowBatchQueueGetWaitTime: 28.000ms 03:55:33 E - RowBatchQueuePutWaitTime: 0.000ns 03:55:33 E - RowsRead: 7.30K (7300) 03:55:33 E - RowsReturned: 7.30K (7300) 03:55:33 E - RowsReturnedRate: 192.10 K/sec 03:55:33 E - ScanRangesComplete: 24 (24) 03:55:33 E - ScannerThreadsInvoluntaryContextSwitches: 150 (150) 03:55:33 E - ScannerThreadsTotalWallClockTime: 52.000ms 03:55:33 E - MaterializeTupleTime(*): 8.000ms 03:55:33 E - ScannerThreadsSysTime: 999.000us 03:55:33 E - ScannerThreadsUserTime: 14.997ms 03:55:33 E - ScannerThreadsVoluntaryContextSwitches: 51 (51) 03:55:33 E - TotalRawHdfsReadTime(*): 1.000ms 03:55:33 E - TotalReadThroughput: 0.00 /sec 03:55:33 E Fragment F00: 03:55:33 E Instance 364890dfb40dcc8d:5304c4e800000001 (host=impala-boost-static-burst-slave-003c.vpc.cloudera.com:22000):(Total: 126.002ms, non-child: 19.000ms, % non-child: 15.08%) 03:55:33 E Hdfs split stats (:<# splits>/): -1:24/165.17 KB 03:55:33 E - AverageThreadTokens: 0.00 03:55:33 E - BloomFilterBytes: 0 03:55:33 E - PeakMemoryUsage: 188.50 KB (193024) 03:55:33 E - PerHostPeakMemUsage: 204.50 KB (209408) 03:55:33 E - RowsProduced: 1 (1) 03:55:33 E - TotalNetworkReceiveTime: 0.000ns 03:55:33 E - TotalNetworkSendTime: 1.000ms 03:55:33 E - TotalStorageWaitTime: 16.000ms 03:55:33 E - TotalThreadsInvoluntaryContextSwitches: 158 (158) 03:55:33 E - TotalThreadsTotalWallClockTime: 122.002ms 03:55:33 E - TotalThreadsSysTime: 1.999ms 03:55:33 E - TotalThreadsUserTime: 52.991ms 03:55:33 E - TotalThreadsVoluntaryContextSwitches: 121 (121) 03:55:33 E Fragment Instance Lifecycle Timings: 03:55:33 E - ExecTime: 3.000ms 03:55:33 E - ExecTreeExecTime: 0.000ns 03:55:33 E - OpenTime: 67.001ms 03:55:33 E - ExecTreeOpenTime: 29.000ms 03:55:33 E - PrepareTime: 56.000ms 03:55:33 E - ExecTreePrepareTime: 4.000ms 03:55:33 E DataStreamSender (dst_id=2): 03:55:33 E - BytesSent: 16.00 B (16) 03:55:33 E - NetworkThroughput(*): 0.00 /sec 03:55:33 E - OverallThroughput: 0.00 /sec 03:55:33 E - PeakMemoryUsage: 16.00 KB (16384) 03:55:33 E - RowsReturned: 1 (1) 03:55:33 E - SerializeBatchTime: 0.000ns 03:55:33 E - TransmitDataRPCTime: 0.000ns 03:55:33 E - UncompressedRowBatchSize: 16.00 B (16) 03:55:33 E CodeGen:(Total: 74.001ms, non-child: 74.001ms, % non-child: 100.00%) 03:55:33 E - CodegenTime: 2.000ms 03:55:33 E - CompileTime: 6.000ms 03:55:33 E - LoadTime: 0.000ns 03:55:33 E - ModuleBitcodeSize: 1.93 MB (2020204) 03:55:33 E - NumFunctions: 19 (19) 03:55:33 E - NumInstructions: 321 (321) 03:55:33 E - OptimizationTime: 31.000ms 03:55:33 E - PeakMemoryUsage: 160.50 KB (164352) 03:55:33 E - PrepareTime: 37.000ms 03:55:33 E AGGREGATION_NODE (id=1):(Total: 33.000ms, non-child: 0.000ns, % non-child: 0.00%) 03:55:33 E ExecOption: Codegen Enabled 03:55:33 E - BuildTime: 0.000ns 03:55:33 E - GetResultsTime: 0.000ns 03:55:33 E - HTResizeTime: 0.000ns 03:55:33 E - HashBuckets: 0 (0) 03:55:33 E - LargestPartitionPercent: 0 (0) 03:55:33 E - MaxPartitionLevel: 0 (0) 03:55:33 E - NumRepartitions: 0 (0) 03:55:33 E - PartitionsCreated: 0 (0) 03:55:33 E - PeakMemoryUsage: 25.00 KB (25600) 03:55:33 E - RowsRepartitioned: 0 (0) 03:55:33 E - RowsReturned: 1 (1) 03:55:33 E - RowsReturnedRate: 30.00 /sec 03:55:33 E - SpilledPartitions: 0 (0) 03:55:33 E HDFS_SCAN_NODE (id=0):(Total: 38.000ms, non-child: 38.000ms, % non-child: 100.00%) 03:55:33 E Hdfs split stats (:<# splits>/): -1:24/165.17 KB 03:55:33 E ExecOption: PARQUET Codegen Enabled, Codegen enabled: 24 out of 24 03:55:33 E Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 03:55:33 E File Formats: PARQUET/SNAPPY:24 03:55:33 E - FooterProcessingTime: (Avg: 333.338us ; Min: 0.000ns ; Max: 2.000ms ; Number of samples: 24) 03:55:33 E - AverageHdfsReadThreadConcurrency: 0.00 03:55:33 E - AverageScannerThreadConcurrency: 0.00 03:55:33 E - BytesRead: 203.39 KB (208272) 03:55:33 E - BytesReadDataNodeCache: 0 03:55:33 E - BytesReadLocal: 0 03:55:33 E - BytesReadRemoteUnexpected: 0 03:55:33 E - BytesReadShortCircuit: 0 03:55:33 E - DecompressionTime: 0.000ns 03:55:33 E - MaxCompressedTextFileLength: 0 03:55:33 E - NumColumns: 1 (1) 03:55:33 E - NumDictFilteredRowGroups: 0 (0) 03:55:33 E - NumDisksAccessed: 3 (3) 03:55:33 E - NumRowGroups: 24 (24) 03:55:33 E - NumScannerThreadsStarted: 2 (2) 03:55:33 E - NumScannersWithNoReads: 0 (0) 03:55:33 E - NumStatsFilteredRowGroups: 0 (0) 03:55:33 E - PeakMemoryUsage: 92.02 KB (94228) 03:55:33 E - PerReadThreadRawHdfsThroughput: 198.62 MB/sec 03:55:33 E - RemoteScanRanges: 0 (0) 03:55:33 E - RowBatchQueueGetWaitTime: 28.000ms 03:55:33 E - RowBatchQueuePutWaitTime: 0.000ns 03:55:33 E - RowsRead: 7.30K (7300) 03:55:33 E - RowsReturned: 7.30K (7300) 03:55:33 E - RowsReturnedRate: 192.10 K/sec 03:55:33 E - ScanRangesComplete: 24 (24) 03:55:33 E - ScannerThreadsInvoluntaryContextSwitches: 150 (150) 03:55:33 E - ScannerThreadsTotalWallClockTime: 52.000ms 03:55:33 E - MaterializeTupleTime(*): 8.000ms 03:55:33 E - ScannerThreadsSysTime: 999.000us 03:55:33 E - ScannerThreadsUserTime: 14.997ms 03:55:33 E - ScannerThreadsVoluntaryContextSwitches: 51 (51) 03:55:33 E - TotalRawHdfsReadTime(*): 1.000ms 03:55:33 E - TotalReadThroughput: 0.00 /sec 03:55:33 ----------------------------- Captured stderr call ----------------------------- 03:55:33 -- executing against localhost:21000 03:55:33 use functional_parquet; 03:55:33 03:55:33 SET disable_codegen=False; 03:55:33 SET abort_on_error=1; 03:55:33 SET exec_single_node_rows_threshold=0; 03:55:33 SET batch_size=0; 03:55:33 SET num_nodes=0; 03:55:33 -- executing against localhost:21000 03:55:33 select count(*) from functional_parquet.alltypes where id < 10000; 03:55:33 03:55:33 ====== 2 failed, 1258 passed, 159 skipped, 10 xfailed in 2948.76 seconds ======= 03:55:33 ============================= test session starts ==============================