Query (id=a446891ff8db3004:9b3a722700000000): DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. Summary: Session ID: 9e4840026cb4cd7b:2bae762a3672c48f Session Type: BEESWAX Start Time: 2017-07-26 16:04:37.508576000 End Time: 2017-07-26 16:04:59.851295000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.9.0-cdh5.12.0 DEBUG (build 03c6ddbdcec39238be4f5b14a300d5c4f576097e) User: dev Connected User: dev Delegated User: Network Address: 192.168.123.3:44006 Default Db: tpch_kudu Sql Statement: select coalesce(a2.n_nationkey, a1.p_size), a1.p_size, a2.n_nationkey FROM part a1 LEFT JOIN nation a2 ON (a1.p_size) = (a2.n_nationkey) Coordinator: 8e2246ec72d3:22000 Query Options (non default): EXPLAIN_LEVEL=2 Plan: ---------------- Per-Host Resource Reservation: Memory=136.00MB Per-Host Resource Estimates: Memory=10.00MB F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 04:EXCHANGE [UNPARTITIONED] | mem-estimate=0B mem-reservation=0B | tuple-ids=0,1N row-size=6B cardinality=200000 | F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 02:HASH JOIN [LEFT OUTER JOIN, BROADCAST] | hash predicates: (a1.p_size) = (a2.n_nationkey) | mem-estimate=56B mem-reservation=136.00MB | tuple-ids=0,1N row-size=6B cardinality=200000 | |--03:EXCHANGE [BROADCAST] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=1 row-size=2B cardinality=25 | | | F01:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 | 01:SCAN KUDU [tpch_kudu.nation a2] | mem-estimate=0B mem-reservation=0B | tuple-ids=1 row-size=2B cardinality=25 | 00:SCAN KUDU [tpch_kudu.part a1] mem-estimate=0B mem-reservation=0B tuple-ids=0 row-size=4B cardinality=200000 ---------------- Estimated Per-Host Mem: 10485760 Per-Host Memory Reservation: 142606336 Request Pool: default-pool Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------- 04:EXCHANGE 1 49.526ms 49.526ms 200.00K 200.00K 0 0 UNPARTITIONED 02:HASH JOIN 3 7.620ms 7.796ms 200.00K 200.00K 1.06 MB 56.00 B LEFT OUTER JOIN, BROADCAST |--03:EXCHANGE 3 96.699us 121.134us 25 25 0 0 BROADCAST | 01:SCAN KUDU 3 3.245ms 3.757ms 25 25 24.00 KB 0 tpch_kudu.nation a2 00:SCAN KUDU 3 4.409ms 4.602ms 200.00K 200.00K 767.00 KB 0 tpch_kudu.part a1 Errors: Planner Timeline: 167.176ms - Analysis finished: 3.296ms (3.296ms) - Equivalence classes computed: 3.505ms (208.675us) - Single node plan created: 158.354ms (154.849ms) - Runtime filters computed: 158.451ms (97.106us) - Distributed plan created: 160.443ms (1.992ms) - Planning finished: 167.176ms (6.732ms) Query Timeline: 22s349ms - Query submitted: 113.270us (113.270us) - Planning finished: 169.508ms (169.395ms) - Submit for admission: 170.571ms (1.062ms) - Completed admission: 170.691ms (120.440us) - Ready to start on 3 backends: 171.425ms (734.128us) - All 3 execution backends (7 fragment instances) started: 173.298ms (1.873ms) - Rows available: 486.164ms (312.865ms) - First row fetched: 516.377ms (30.213ms) - Unregister query: 22s342ms (21s826ms) - ComputeScanRangeAssignmentTimer: 512.798us ImpalaServer: - ClientFetchWaitTimer: 20s905ms - RowMaterializationTimer: 947.066ms Execution Profile a446891ff8db3004:9b3a722700000000:(Total: 1s261ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 3, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms Per Node Peak Memory Usage: 8e2246ec72d3:22000(5.25 MB) 8e2246ec72d3:22001(1.86 MB) 8e2246ec72d3:22002(1.86 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F02:(Total: 22s127ms, non-child: 21s767ms, % non-child: 98.37%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:22s128ms max:22s128ms mean: 22s128ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.19 MB (4390174) - PerHostPeakMemUsage: 5.25 MB (5503512) - RowsProduced: 200.00K (200000) - TotalNetworkReceiveTime: 278.487ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 171 (171) - TotalThreadsTotalWallClockTime: 22s100ms - TotalThreadsSysTime: 18.146ms - TotalThreadsUserTime: 954.499ms - TotalThreadsVoluntaryContextSwitches: 197 (197) Fragment Instance Lifecycle Timings: - ExecTime: 21s814ms - ExecTreeExecTime: 50.281ms - OpenTime: 285.154ms - ExecTreeOpenTime: 272.533ms - PrepareTime: 27.101ms - ExecTreePrepareTime: 137.734us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 16 (16) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 26.85 GB (28835321856) - PeakMemoryUsage: 688.00 B (688) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 38.222ms, non-child: 38.222ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.108ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2077312) - NumFunctions: 4 (4) - NumInstructions: 59 (59) - OptimizationTime: 9.666ms - PeakMemoryUsage: 29.50 KB (30208) - PrepareTime: 25.808ms EXCHANGE_NODE (id=4):(Total: 322.047ms, non-child: 322.047ms, % non-child: 100.00%) - BytesReceived: 2.11 MB (2207804) - ConvertRowBatchTime: 38.870ms - DeserializeRowBatchTimer: 20.490ms - FirstBatchArrivalWaitTime: 272.519ms - PeakMemoryUsage: 0 - RowsReturned: 200.00K (200000) - RowsReturnedRate: 621.03 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Coordinator Fragment F02: Instance a446891ff8db3004:9b3a722700000000 (host=8e2246ec72d3:22000):(Total: 22s127ms, non-child: 21s767ms, % non-child: 98.37%) MemoryUsage(500.000ms): 16.10 KB, 4.14 MB, 4.06 MB, 3.95 MB, 3.87 MB, 3.76 MB, 3.69 MB, 3.59 MB, 3.50 MB, 3.39 MB, 3.31 MB, 3.20 MB, 3.11 MB, 3.01 MB, 2.94 MB, 2.88 MB, 2.81 MB, 2.73 MB, 2.62 MB, 2.54 MB, 2.43 MB, 2.32 MB, 2.24 MB, 2.13 MB, 2.02 MB, 1.91 MB, 1.83 MB, 1.72 MB, 1.61 MB, 1.53 MB, 1.42 MB, 1.31 MB, 1.21 MB, 1.12 MB, 1.01 MB, 929.71 KB, 820.05 KB, 732.22 KB, 622.39 KB, 512.69 KB, 424.93 KB, 315.04 KB, 205.30 KB, 80.21 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.19 MB (4390174) - PerHostPeakMemUsage: 5.25 MB (5503512) - RowsProduced: 200.00K (200000) - TotalNetworkReceiveTime: 278.487ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 171 (171) - TotalThreadsTotalWallClockTime: 22s100ms - TotalThreadsSysTime: 18.146ms - TotalThreadsUserTime: 954.499ms - TotalThreadsVoluntaryContextSwitches: 197 (197) Fragment Instance Lifecycle Timings: - ExecTime: 21s814ms - ExecTreeExecTime: 50.281ms - OpenTime: 285.154ms - ExecTreeOpenTime: 272.533ms - PrepareTime: 27.101ms - ExecTreePrepareTime: 137.734us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 16 (16) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 26.85 GB (28835321856) - PeakMemoryUsage: 688.00 B (688) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 38.222ms, non-child: 38.222ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.108ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2077312) - NumFunctions: 4 (4) - NumInstructions: 59 (59) - OptimizationTime: 9.666ms - PeakMemoryUsage: 29.50 KB (30208) - PrepareTime: 25.808ms EXCHANGE_NODE (id=4):(Total: 322.047ms, non-child: 49.526ms, % non-child: 15.38%) BytesReceived(500.000ms): 0, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB - BytesReceived: 2.11 MB (2207804) - ConvertRowBatchTime: 38.870ms - DeserializeRowBatchTimer: 20.490ms - FirstBatchArrivalWaitTime: 272.519ms - PeakMemoryUsage: 0 - RowsReturned: 200.00K (200000) - RowsReturnedRate: 621.03 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 364.777ms, non-child: 3.398ms, % non-child: 0.93%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:365.784ms max:367.199ms mean: 366.506ms stddev:578.062us execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 3 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.85 MB (1938100) - PerHostPeakMemUsage: 2.99 MB (3134876) - RowsProduced: 66.67K (66666) - TotalNetworkReceiveTime: 30.965us - TotalNetworkSendTime: 1.602ms - TotalStorageWaitTime: 4.774ms - TotalThreadsInvoluntaryContextSwitches: 39 (39) - TotalThreadsTotalWallClockTime: 356.603ms - TotalThreadsSysTime: 3.669ms - TotalThreadsUserTime: 335.569ms - TotalThreadsVoluntaryContextSwitches: 26 (26) Fragment Instance Lifecycle Timings: - ExecTime: 53.940ms - ExecTreeExecTime: 8.001ms - OpenTime: 270.464ms - ExecTreeOpenTime: 3.288ms - PrepareTime: 40.257ms - ExecTreePrepareTime: 543.888us DataStreamSender (dst_id=4):(Total: 54.926ms, non-child: 54.926ms, % non-child: 100.00%) - BytesSent: 718.69 KB (735934) - NetworkThroughput(*): 61.03 MB/sec - OverallThroughput: 12.80 MB/sec - PeakMemoryUsage: 36.56 KB (37440) - RowsReturned: 66.67K (66666) - SerializeBatchTime: 43.300ms - TransmitDataRPCTime: 11.561ms - UncompressedRowBatchSize: 908.38 KB (930182) CodeGen:(Total: 294.427ms, non-child: 294.427ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 21.710ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2077312) - NumFunctions: 59 (59) - NumInstructions: 2.52K (2520) - OptimizationTime: 244.086ms - PeakMemoryUsage: 1.23 MB (1290240) - PrepareTime: 28.015ms HASH_JOIN_NODE (id=2):(Total: 12.025ms, non-child: 7.620ms, % non-child: 63.37%) - BuildRows: 25 (25) - BuildTime: 522.929us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.06 MB (1116416) - ProbeRows: 66.67K (66666) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.452ms - RowsReturned: 66.67K (66666) - RowsReturnedRate: 5.55 M/sec Hash Join Builder (join_node_id=2): - BuildRowsPartitionTime: 10.430us - BuildRowsPartitioned: 25 (25) - GetNewBlockTime: 95.284us - HashBuckets: 43 (43) - HashCollisions: 0 (0) - HashTablesBuildTime: 207.260us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1066800) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=3):(Total: 96.699us, non-child: 96.699us, % non-child: 100.00%) - BytesReceived: 182.00 B (182) - ConvertRowBatchTime: 12.213us - DeserializeRowBatchTimer: 104.377us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 25 (25) - RowsReturnedRate: 266.08 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns KUDU_SCAN_NODE (id=0):(Total: 4.409ms, non-child: 4.409ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 754.00 KB (772096) - RowsRead: 66.67K (66666) - RowsReturned: 66.67K (66666) - RowsReturnedRate: 15.13 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 31.209ms - MaterializeTupleTime(*): 2.781ms - ScannerThreadsSysTime: 1.007ms - ScannerThreadsUserTime: 18.613ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalKuduScanRoundTrips: 3 (3) - TotalReadThroughput: 0.00 /sec BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 16 (16) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 26.85 GB (28835321856) - PeakMemoryUsage: 688.00 B (688) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns Fragment F00: Instance a446891ff8db3004:9b3a722700000004 (host=8e2246ec72d3:22002):(Total: 364.974ms, non-child: 5.616ms, % non-child: 1.54%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 1.35 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.86 MB (1947999) - PerHostPeakMemUsage: 1.86 MB (1947999) - RowsProduced: 67.07K (67068) - TotalNetworkReceiveTime: 37.604us - TotalNetworkSendTime: 3.708ms - TotalStorageWaitTime: 4.501ms - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 357.576ms - TotalThreadsSysTime: 3.952ms - TotalThreadsUserTime: 336.252ms - TotalThreadsVoluntaryContextSwitches: 32 (32) Fragment Instance Lifecycle Timings: - ExecTime: 53.970ms - ExecTreeExecTime: 8.374ms - OpenTime: 269.878ms - ExecTreeOpenTime: 3.497ms - PrepareTime: 41.027ms - ExecTreePrepareTime: 420.506us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 16 (16) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 26.85 GB (28835321856) - PeakMemoryUsage: 688.00 B (688) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 51.997ms, non-child: 51.997ms, % non-child: 100.00%) - BytesSent: 722.97 KB (740318) - NetworkThroughput(*): 64.28 MB/sec - OverallThroughput: 13.58 MB/sec - PeakMemoryUsage: 36.56 KB (37440) - RowsReturned: 67.07K (67068) - SerializeBatchTime: 40.956ms - TransmitDataRPCTime: 10.983ms - UncompressedRowBatchSize: 913.95 KB (935886) CodeGen:(Total: 294.965ms, non-child: 294.965ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 21.625ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2077312) - NumFunctions: 59 (59) - NumInstructions: 2.52K (2520) - OptimizationTime: 243.330ms - PeakMemoryUsage: 1.23 MB (1290240) - PrepareTime: 29.395ms HASH_JOIN_NODE (id=2):(Total: 12.394ms, non-child: 7.796ms, % non-child: 62.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 25 (25) - BuildTime: 524.654us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.06 MB (1116416) - ProbeRows: 67.07K (67068) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.863ms - RowsReturned: 67.07K (67068) - RowsReturnedRate: 5.41 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 13.979us - BuildRowsPartitioned: 25 (25) - GetNewBlockTime: 79.446us - HashBuckets: 43 (43) - HashCollisions: 0 (0) - HashTablesBuildTime: 243.727us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1066800) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=3):(Total: 121.134us, non-child: 121.134us, % non-child: 100.00%) BytesReceived(500.000ms): 182.00 B - BytesReceived: 182.00 B (182) - ConvertRowBatchTime: 15.272us - DeserializeRowBatchTimer: 90.882us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 25 (25) - RowsReturnedRate: 206.38 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns KUDU_SCAN_NODE (id=0):(Total: 4.602ms, non-child: 4.602ms, % non-child: 100.00%) BytesRead(500.000ms): 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 767.00 KB (785408) - RowsRead: 67.07K (67068) - RowsReturned: 67.07K (67068) - RowsReturnedRate: 14.57 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 32.692ms - MaterializeTupleTime(*): 2.926ms - ScannerThreadsSysTime: 1.250ms - ScannerThreadsUserTime: 21.312ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalKuduScanRoundTrips: 3 (3) - TotalReadThroughput: 0.00 /sec Instance a446891ff8db3004:9b3a722700000005 (host=8e2246ec72d3:22001):(Total: 364.729ms, non-child: 1.997ms, % non-child: 0.55%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 119.01 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.86 MB (1953119) - PerHostPeakMemUsage: 1.86 MB (1953119) - RowsProduced: 66.53K (66529) - TotalNetworkReceiveTime: 27.898us - TotalNetworkSendTime: 677.003us - TotalStorageWaitTime: 4.248ms - TotalThreadsInvoluntaryContextSwitches: 49 (49) - TotalThreadsTotalWallClockTime: 357.793ms - TotalThreadsSysTime: 3.882ms - TotalThreadsUserTime: 336.456ms - TotalThreadsVoluntaryContextSwitches: 21 (21) Fragment Instance Lifecycle Timings: - ExecTime: 53.905ms - ExecTreeExecTime: 7.637ms - OpenTime: 270.664ms - ExecTreeOpenTime: 3.207ms - PrepareTime: 40.055ms - ExecTreePrepareTime: 616.950us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 16 (16) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 26.85 GB (28835321856) - PeakMemoryUsage: 688.00 B (688) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 57.482ms, non-child: 57.482ms, % non-child: 100.00%) - BytesSent: 717.15 KB (734359) - NetworkThroughput(*): 54.77 MB/sec - OverallThroughput: 12.18 MB/sec - PeakMemoryUsage: 36.56 KB (37440) - RowsReturned: 66.53K (66529) - SerializeBatchTime: 44.633ms - TransmitDataRPCTime: 12.787ms - UncompressedRowBatchSize: 906.58 KB (928337) CodeGen:(Total: 293.557ms, non-child: 293.557ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 22.119ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2077312) - NumFunctions: 59 (59) - NumInstructions: 2.52K (2520) - OptimizationTime: 244.099ms - PeakMemoryUsage: 1.23 MB (1290240) - PrepareTime: 26.702ms HASH_JOIN_NODE (id=2):(Total: 11.692ms, non-child: 7.470ms, % non-child: 63.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 25 (25) - BuildTime: 531.422us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.06 MB (1116416) - ProbeRows: 66.53K (66529) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.160ms - RowsReturned: 66.53K (66529) - RowsReturnedRate: 5.69 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 8.492us - BuildRowsPartitioned: 25 (25) - GetNewBlockTime: 90.225us - HashBuckets: 43 (43) - HashCollisions: 0 (0) - HashTablesBuildTime: 185.463us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1066800) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=3):(Total: 84.244us, non-child: 84.244us, % non-child: 100.00%) BytesReceived(500.000ms): 182.00 B - BytesReceived: 182.00 B (182) - ConvertRowBatchTime: 10.565us - DeserializeRowBatchTimer: 126.610us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 25 (25) - RowsReturnedRate: 296.76 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns KUDU_SCAN_NODE (id=0):(Total: 4.227ms, non-child: 4.227ms, % non-child: 100.00%) BytesRead(500.000ms): 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 767.00 KB (785408) - RowsRead: 66.53K (66529) - RowsReturned: 66.53K (66529) - RowsReturnedRate: 15.74 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 32.390ms - MaterializeTupleTime(*): 2.780ms - ScannerThreadsSysTime: 877.000us - ScannerThreadsUserTime: 20.045ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalKuduScanRoundTrips: 3 (3) - TotalReadThroughput: 0.00 /sec Instance a446891ff8db3004:9b3a722700000006 (host=8e2246ec72d3:22000):(Total: 364.629ms, non-child: 2.581ms, % non-child: 0.71%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 1.35 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.82 MB (1913183) - PerHostPeakMemUsage: 5.25 MB (5503512) - RowsProduced: 66.40K (66403) - TotalNetworkReceiveTime: 27.393us - TotalNetworkSendTime: 420.511us - TotalStorageWaitTime: 5.575ms - TotalThreadsInvoluntaryContextSwitches: 35 (35) - TotalThreadsTotalWallClockTime: 354.442ms - TotalThreadsSysTime: 3.173ms - TotalThreadsUserTime: 333.999ms - TotalThreadsVoluntaryContextSwitches: 27 (27) Fragment Instance Lifecycle Timings: - ExecTime: 53.945ms - ExecTreeExecTime: 7.991ms - OpenTime: 270.850ms - ExecTreeOpenTime: 3.160ms - PrepareTime: 39.690ms - ExecTreePrepareTime: 594.210us DataStreamSender (dst_id=4):(Total: 55.300ms, non-child: 55.300ms, % non-child: 100.00%) - BytesSent: 715.94 KB (733127) - NetworkThroughput(*): 64.05 MB/sec - OverallThroughput: 12.64 MB/sec - PeakMemoryUsage: 36.56 KB (37440) - RowsReturned: 66.40K (66403) - SerializeBatchTime: 44.311ms - TransmitDataRPCTime: 10.915ms - UncompressedRowBatchSize: 904.61 KB (926325) CodeGen:(Total: 294.759ms, non-child: 294.759ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 21.385ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2077312) - NumFunctions: 59 (59) - NumInstructions: 2.52K (2520) - OptimizationTime: 244.831ms - PeakMemoryUsage: 1.23 MB (1290240) - PrepareTime: 27.947ms HASH_JOIN_NODE (id=2):(Total: 11.988ms, non-child: 7.593ms, % non-child: 63.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 25 (25) - BuildTime: 512.714us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.06 MB (1116416) - ProbeRows: 66.40K (66403) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.332ms - RowsReturned: 66.40K (66403) - RowsReturnedRate: 5.54 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 8.820us - BuildRowsPartitioned: 25 (25) - GetNewBlockTime: 116.182us - HashBuckets: 43 (43) - HashCollisions: 0 (0) - HashTablesBuildTime: 192.592us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1066800) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=3):(Total: 84.720us, non-child: 84.720us, % non-child: 100.00%) BytesReceived(500.000ms): 182.00 B - BytesReceived: 182.00 B (182) - ConvertRowBatchTime: 10.804us - DeserializeRowBatchTimer: 95.641us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 25 (25) - RowsReturnedRate: 295.09 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns KUDU_SCAN_NODE (id=0):(Total: 4.400ms, non-child: 4.400ms, % non-child: 100.00%) BytesRead(500.000ms): 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 728.00 KB (745472) - RowsRead: 66.40K (66403) - RowsReturned: 66.40K (66403) - RowsReturnedRate: 15.09 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 28.546ms - MaterializeTupleTime(*): 2.638ms - ScannerThreadsSysTime: 896.000us - ScannerThreadsUserTime: 14.484ms - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalKuduScanRoundTrips: 3 (3) - TotalReadThroughput: 0.00 /sec Averaged Fragment F01:(Total: 31.708ms, non-child: 1.739ms, % non-child: 5.48%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:32.234ms max:33.373ms mean: 32.696ms stddev:489.666us execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 3 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 226.67 KB (232106) - PerHostPeakMemUsage: 322.04 KB (329770) - RowsProduced: 8 (8) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 352.331us - TotalStorageWaitTime: 2.057ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 9.225ms - TotalThreadsSysTime: 676.666us - TotalThreadsUserTime: 2.520ms - TotalThreadsVoluntaryContextSwitches: 20 (20) Fragment Instance Lifecycle Timings: - ExecTime: 2.533ms - ExecTreeExecTime: 1.674ms - OpenTime: 1.113ms - ExecTreeOpenTime: 1.011ms - PrepareTime: 27.972ms - ExecTreePrepareTime: 95.307us DataStreamSender (dst_id=3):(Total: 293.101us, non-child: 293.101us, % non-child: 100.00%) - BytesSent: 182.00 B (182) - NetworkThroughput(*): 1.01 MB/sec - OverallThroughput: 594.60 KB/sec - PeakMemoryUsage: 192.00 KB (196608) - RowsReturned: 8 (8) - SerializeBatchTime: 39.249us - TransmitDataRPCTime: 171.692us - UncompressedRowBatchSize: 182.00 B (182) CodeGen:(Total: 26.430ms, non-child: 26.430ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2077312) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 25.767ms KUDU_SCAN_NODE (id=1):(Total: 3.245ms, non-child: 3.245ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 24.00 KB (24576) - RowsRead: 8 (8) - RowsReturned: 8 (8) - RowsReturnedRate: 2.55 K/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 5.606ms - MaterializeTupleTime(*): 1.661ms - ScannerThreadsSysTime: 306.666us - ScannerThreadsUserTime: 1.692ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalKuduScanRoundTrips: 2 (2) - TotalReadThroughput: 0.00 /sec Fragment F01: Instance a446891ff8db3004:9b3a722700000003 (host=8e2246ec72d3:22000):(Total: 32.167ms, non-child: 2.717ms, % non-child: 8.45%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 228.00 KB (233472) - PerHostPeakMemUsage: 364.44 KB (373184) - RowsProduced: 9 (9) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 389.989us - TotalStorageWaitTime: 1.572ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 9.451ms - TotalThreadsSysTime: 949.000us - TotalThreadsUserTime: 2.847ms - TotalThreadsVoluntaryContextSwitches: 24 (24) Fragment Instance Lifecycle Timings: - ExecTime: 1.891ms - ExecTreeExecTime: 1.121ms - OpenTime: 1.560ms - ExecTreeOpenTime: 1.293ms - PrepareTime: 28.620ms - ExecTreePrepareTime: 92.399us DataStreamSender (dst_id=3):(Total: 292.853us, non-child: 292.853us, % non-child: 100.00%) - BytesSent: 198.00 B (198) - NetworkThroughput(*): 1.12 MB/sec - OverallThroughput: 660.26 KB/sec - PeakMemoryUsage: 192.00 KB (196608) - RowsReturned: 9 (9) - SerializeBatchTime: 38.843us - TransmitDataRPCTime: 169.235us - UncompressedRowBatchSize: 198.00 B (198) CodeGen:(Total: 26.264ms, non-child: 26.264ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2077312) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 25.501ms KUDU_SCAN_NODE (id=1):(Total: 2.892ms, non-child: 2.892ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 24.00 KB (24576) - RowsRead: 9 (9) - RowsReturned: 9 (9) - RowsReturnedRate: 3.11 K/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 6.026ms - MaterializeTupleTime(*): 1.110ms - ScannerThreadsSysTime: 404.000us - ScannerThreadsUserTime: 1.772ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalKuduScanRoundTrips: 3 (3) - TotalReadThroughput: 0.00 /sec Instance a446891ff8db3004:9b3a722700000001 (host=8e2246ec72d3:22002):(Total: 31.586ms, non-child: 1.102ms, % non-child: 3.49%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 228.00 KB (233472) - PerHostPeakMemUsage: 306.88 KB (314240) - RowsProduced: 11 (11) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 267.103us - TotalStorageWaitTime: 3.015ms - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 10.467ms - TotalThreadsSysTime: 541.000us - TotalThreadsUserTime: 1.902ms - TotalThreadsVoluntaryContextSwitches: 17 (17) Fragment Instance Lifecycle Timings: - ExecTime: 3.022ms - ExecTreeExecTime: 2.027ms - OpenTime: 1.019ms - ExecTreeOpenTime: 999.429us - PrepareTime: 27.461ms - ExecTreePrepareTime: 89.402us DataStreamSender (dst_id=3):(Total: 348.181us, non-child: 348.181us, % non-child: 100.00%) - BytesSent: 234.00 B (234) - NetworkThroughput(*): 1002.02 KB/sec - OverallThroughput: 656.31 KB/sec - PeakMemoryUsage: 192.00 KB (196608) - RowsReturned: 11 (11) - SerializeBatchTime: 40.766us - TransmitDataRPCTime: 228.054us - UncompressedRowBatchSize: 234.00 B (234) CodeGen:(Total: 26.377ms, non-child: 26.377ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2077312) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 25.757ms KUDU_SCAN_NODE (id=1):(Total: 3.757ms, non-child: 3.757ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 24.00 KB (24576) - RowsRead: 11 (11) - RowsReturned: 11 (11) - RowsReturnedRate: 2.93 K/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 6.451ms - MaterializeTupleTime(*): 2.013ms - ScannerThreadsSysTime: 263.000us - ScannerThreadsUserTime: 1.264ms - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalKuduScanRoundTrips: 3 (3) - TotalReadThroughput: 0.00 /sec Instance a446891ff8db3004:9b3a722700000002 (host=8e2246ec72d3:22001):(Total: 31.372ms, non-child: 1.397ms, % non-child: 4.45%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 224.00 KB (229376) - PerHostPeakMemUsage: 294.81 KB (301888) - RowsProduced: 5 (5) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 399.901us - TotalStorageWaitTime: 1.585ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 7.758ms - TotalThreadsSysTime: 540.000us - TotalThreadsUserTime: 2.812ms - TotalThreadsVoluntaryContextSwitches: 19 (19) Fragment Instance Lifecycle Timings: - ExecTime: 2.685ms - ExecTreeExecTime: 1.874ms - OpenTime: 759.858us - ExecTreeOpenTime: 743.021us - PrepareTime: 27.834ms - ExecTreePrepareTime: 104.120us DataStreamSender (dst_id=3):(Total: 238.271us, non-child: 238.271us, % non-child: 100.00%) - BytesSent: 114.00 B (114) - NetworkThroughput(*): 945.16 KB/sec - OverallThroughput: 467.23 KB/sec - PeakMemoryUsage: 192.00 KB (196608) - RowsReturned: 5 (5) - SerializeBatchTime: 38.138us - TransmitDataRPCTime: 117.788us - UncompressedRowBatchSize: 114.00 B (114) CodeGen:(Total: 26.649ms, non-child: 26.649ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2077312) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 26.042ms KUDU_SCAN_NODE (id=1):(Total: 3.087ms, non-child: 3.087ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 24.00 KB (24576) - RowsRead: 5 (5) - RowsReturned: 5 (5) - RowsReturnedRate: 1.62 K/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 4.340ms - MaterializeTupleTime(*): 1.860ms - ScannerThreadsSysTime: 253.000us - ScannerThreadsUserTime: 2.041ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalKuduScanRoundTrips: 2 (2) - TotalReadThroughput: 0.00 /sec