Query (id=5a408a9e1cf90692:874f81bf00000000): DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. Summary: Session ID: 8d462295a7c536e3:405e5fa2d5d84b8 Session Type: BEESWAX Start Time: 2017-07-26 16:04:50.788855000 End Time: 2017-07-26 16:05:03.687205000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.10.0-SNAPSHOT DEBUG (build c5a9b43db4315f4728a3454f20fa1b265a0de0fc) User: mikeb Connected User: mikeb Delegated User: Network Address: ::ffff:127.0.0.1:45053 Default Db: tpch_kudu Sql Statement: select coalesce(a2.n_nationkey, a1.p_size), a1.p_size, a2.n_nationkey FROM part a1 LEFT JOIN nation a2 ON (a1.p_size) = (a2.n_nationkey) Coordinator: mikeb-desktop:22000 Query Options (non default): MT_DOP=0 Plan: ---------------- Per-Host Resource Reservation: Memory=136.00MB Per-Host Resource Estimates: Memory=10.00MB F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=0B mem-reservation=0B PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 04:EXCHANGE [UNPARTITIONED] | mem-estimate=0B mem-reservation=0B | tuple-ids=0,1N row-size=6B cardinality=200000 | F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 Per-Host Resources: mem-estimate=56B mem-reservation=136.00MB 02:HASH JOIN [LEFT OUTER JOIN, BROADCAST] | hash predicates: (a1.p_size) = (a2.n_nationkey) | fk/pk conjuncts: (a1.p_size) = (a2.n_nationkey) | mem-estimate=56B mem-reservation=136.00MB | tuple-ids=0,1N row-size=6B cardinality=200000 | |--03:EXCHANGE [BROADCAST] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=1 row-size=2B cardinality=25 | | | F01:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 | Per-Host Resources: mem-estimate=0B mem-reservation=0B | 01:SCAN KUDU [tpch_kudu.nation a2] | mem-estimate=0B mem-reservation=0B | tuple-ids=1 row-size=2B cardinality=25 | 00:SCAN KUDU [tpch_kudu.part a1] mem-estimate=0B mem-reservation=0B tuple-ids=0 row-size=4B cardinality=200000 ---------------- Estimated Per-Host Mem: 10485760 Per-Host Memory Reservation: 142606336 Request Pool: default-pool Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------ 04:EXCHANGE 1 24.885ms 24.885ms 200.00K 200.00K 0 0 UNPARTITIONED 02:HASH JOIN 3 4.721ms 4.892ms 200.00K 200.00K 1.06 MB 56.00 B LEFT OUTER JOIN, BROADCAST |--03:EXCHANGE 3 49.471us 55.931us 25 25 0 0 BROADCAST | 01:SCAN KUDU 3 21.218ms 23.614ms 25 25 24.00 KB 0 tpch_kudu.nation a2 00:SCAN KUDU 3 4.108ms 6.368ms 200.00K 200.00K 793.00 KB 0 tpch_kudu.part a1 Errors: Planner Timeline: 16.669ms - Analysis finished: 3.696ms (3.696ms) - Equivalence classes computed: 3.874ms (177.430us) - Single node plan created: 15.736ms (11.862ms) - Runtime filters computed: 15.773ms (37.248us) - Distributed plan created: 15.900ms (127.427us) - Planning finished: 16.669ms (768.669us) Query Timeline: 12s900ms - Query submitted: 105.138us (105.138us) - Planning finished: 17.852ms (17.747ms) - Submit for admission: 18.304ms (452.034us) - Completed admission: 18.351ms (47.119us) - Ready to start on 3 backends: 18.649ms (297.796us) - All 3 execution backends (7 fragment instances) started: 19.318ms (669.385us) - Rows available: 198.853ms (179.534ms) - First row fetched: 253.594ms (54.741ms) - Unregister query: 12s898ms (12s644ms) - ComputeScanRangeAssignmentTimer: 210.647us ImpalaServer: - ClientFetchWaitTimer: 12s373ms - RowMaterializationTimer: 323.436ms Execution Profile 5a408a9e1cf90692:874f81bf00000000:(Total: 503.097ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 3, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms Per Node Peak Memory Usage: mikeb-desktop:22000(4.96 MB) mikeb-desktop:22001(1.81 MB) mikeb-desktop:22002(1.89 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F02:(Total: 12s863ms, non-child: 12s659ms, % non-child: 98.42%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:12s864ms max:12s864ms mean: 12s864ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.20 MB (4406562) - PerHostPeakMemUsage: 4.96 MB (5206007) - RowsProduced: 200.00K (200000) - TotalNetworkReceiveTime: 153.122ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 73 (73) - TotalThreadsTotalWallClockTime: 12s844ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 348.000ms - TotalThreadsVoluntaryContextSwitches: 199 (199) Fragment Instance Lifecycle Timings: - ExecTime: 12s683ms - ExecTreeExecTime: 25.310ms - OpenTime: 160.300ms - ExecTreeOpenTime: 151.373ms - PrepareTime: 19.128ms - ExecTreePrepareTime: 45.450us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 16 (16) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7171057152) - PeakMemoryUsage: 688.00 B (688) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 27.493ms, non-child: 27.493ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.296ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2061900) - NumFunctions: 4 (4) - NumInstructions: 59 (59) - OptimizationTime: 6.719ms - PeakMemoryUsage: 29.50 KB (30208) - PrepareTime: 18.980ms EXCHANGE_NODE (id=4):(Total: 176.253ms, non-child: 176.253ms, % non-child: 100.00%) - BytesReceived: 2.11 MB (2207823) - ConvertRowBatchTime: 20.804ms - DeserializeRowBatchTimer: 12.596ms - FirstBatchArrivalWaitTime: 151.366ms - PeakMemoryUsage: 0 - RowsReturned: 200.00K (200000) - RowsReturnedRate: 1.13 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Coordinator Fragment F02: Instance 5a408a9e1cf90692:874f81bf00000000 (host=mikeb-desktop:22000):(Total: 12s863ms, non-child: 12s659ms, % non-child: 98.42%) MemoryUsage(500.000ms): 16.10 KB, 4.04 MB, 3.76 MB, 3.67 MB, 3.52 MB, 3.46 MB, 3.39 MB, 3.14 MB, 2.86 MB, 2.60 MB, 2.34 MB, 2.07 MB, 1.81 MB, 1.55 MB, 1.44 MB, 1.38 MB, 1.36 MB, 1.36 MB, 1.23 MB, 1.14 MB, 1.14 MB, 1017.29 KB, 973.46 KB, 710.16 KB, 446.86 KB, 174.93 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.20 MB (4406562) - PerHostPeakMemUsage: 4.96 MB (5206007) - RowsProduced: 200.00K (200000) - TotalNetworkReceiveTime: 153.122ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 73 (73) - TotalThreadsTotalWallClockTime: 12s844ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 348.000ms - TotalThreadsVoluntaryContextSwitches: 199 (199) Fragment Instance Lifecycle Timings: - ExecTime: 12s683ms - ExecTreeExecTime: 25.310ms - OpenTime: 160.300ms - ExecTreeOpenTime: 151.373ms - PrepareTime: 19.128ms - ExecTreePrepareTime: 45.450us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 16 (16) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7171057152) - PeakMemoryUsage: 688.00 B (688) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 27.493ms, non-child: 27.493ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.296ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2061900) - NumFunctions: 4 (4) - NumInstructions: 59 (59) - OptimizationTime: 6.719ms - PeakMemoryUsage: 29.50 KB (30208) - PrepareTime: 18.980ms EXCHANGE_NODE (id=4):(Total: 176.253ms, non-child: 24.885ms, % non-child: 14.12%) BytesReceived(500.000ms): 0, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB, 2.11 MB - BytesReceived: 2.11 MB (2207823) - ConvertRowBatchTime: 20.804ms - DeserializeRowBatchTimer: 12.596ms - FirstBatchArrivalWaitTime: 151.366ms - PeakMemoryUsage: 0 - RowsReturned: 200.00K (200000) - RowsReturnedRate: 1.13 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 216.520ms, non-child: 5.045ms, % non-child: 2.33%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:214.912ms max:221.625ms mean: 217.213ms stddev:3.120ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 3 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.84 MB (1926589) - PerHostPeakMemUsage: 2.89 MB (3028603) - RowsProduced: 66.67K (66666) - TotalNetworkReceiveTime: 13.121us - TotalNetworkSendTime: 730.183us - TotalStorageWaitTime: 3.803ms - TotalThreadsInvoluntaryContextSwitches: 51 (51) - TotalThreadsTotalWallClockTime: 203.989ms - TotalThreadsSysTime: 1.333ms - TotalThreadsUserTime: 180.000ms - TotalThreadsVoluntaryContextSwitches: 27 (27) Fragment Instance Lifecycle Timings: - ExecTime: 34.678ms - ExecTreeExecTime: 5.134ms - OpenTime: 148.731ms - ExecTreeOpenTime: 3.477ms - PrepareTime: 33.058ms - ExecTreePrepareTime: 178.486us DataStreamSender (dst_id=4):(Total: 36.530ms, non-child: 36.530ms, % non-child: 100.00%) - BytesSent: 718.69 KB (735941) - NetworkThroughput(*): 85.79 MB/sec - OverallThroughput: 19.23 MB/sec - PeakMemoryUsage: 36.56 KB (37440) - RowsReturned: 66.67K (66666) - SerializeBatchTime: 28.248ms - TransmitDataRPCTime: 8.250ms - UncompressedRowBatchSize: 908.38 KB (930184) CodeGen:(Total: 166.116ms, non-child: 166.116ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 11.969ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2061900) - NumFunctions: 59 (59) - NumInstructions: 2.52K (2518) - OptimizationTime: 132.226ms - PeakMemoryUsage: 1.23 MB (1289216) - PrepareTime: 21.391ms HASH_JOIN_NODE (id=2):(Total: 8.827ms, non-child: 4.721ms, % non-child: 53.49%) - BuildRows: 25 (25) - BuildTime: 245.040us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.06 MB (1116416) - ProbeRows: 66.67K (66666) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.189ms - RowsReturned: 66.67K (66666) - RowsReturnedRate: 7.80 M/sec Hash Join Builder (join_node_id=2): - BuildRowsPartitionTime: 7.193us - BuildRowsPartitioned: 25 (25) - GetNewBlockTime: 37.939us - HashBuckets: 43 (43) - HashCollisions: 0 (0) - HashTablesBuildTime: 87.342us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1066800) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=3):(Total: 49.471us, non-child: 49.471us, % non-child: 100.00%) - BytesReceived: 182.00 B (182) - ConvertRowBatchTime: 6.783us - DeserializeRowBatchTimer: 45.561us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 25 (25) - RowsReturnedRate: 516.52 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns KUDU_SCAN_NODE (id=0):(Total: 4.108ms, non-child: 4.108ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 741.00 KB (758784) - RowsRead: 66.67K (66666) - RowsReturned: 66.67K (66666) - RowsReturnedRate: 18.62 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 18.432ms - MaterializeTupleTime(*): 1.667ms - ScannerThreadsSysTime: 1.333ms - ScannerThreadsUserTime: 1.333ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalKuduScanRoundTrips: 3 (3) - TotalReadThroughput: 0.00 /sec BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 16 (16) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7171057152) - PeakMemoryUsage: 688.00 B (688) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns Fragment F00: Instance 5a408a9e1cf90692:874f81bf00000005 (host=mikeb-desktop:22001):(Total: 220.838ms, non-child: 7.799ms, % non-child: 3.53%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 1.35 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.81 MB (1899965) - PerHostPeakMemUsage: 1.81 MB (1899965) - RowsProduced: 66.53K (66529) - TotalNetworkReceiveTime: 14.150us - TotalNetworkSendTime: 256.749us - TotalStorageWaitTime: 2.650ms - TotalThreadsInvoluntaryContextSwitches: 40 (40) - TotalThreadsTotalWallClockTime: 206.956ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 176.000ms - TotalThreadsVoluntaryContextSwitches: 21 (21) Fragment Instance Lifecycle Timings: - ExecTime: 34.095ms - ExecTreeExecTime: 5.173ms - OpenTime: 149.192ms - ExecTreeOpenTime: 5.780ms - PrepareTime: 37.506ms - ExecTreePrepareTime: 176.261us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 16 (16) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7171057152) - PeakMemoryUsage: 688.00 B (688) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 35.396ms, non-child: 35.396ms, % non-child: 100.00%) - BytesSent: 717.17 KB (734377) - NetworkThroughput(*): 97.21 MB/sec - OverallThroughput: 19.79 MB/sec - PeakMemoryUsage: 36.56 KB (37440) - RowsReturned: 66.53K (66529) - SerializeBatchTime: 28.158ms - TransmitDataRPCTime: 7.204ms - UncompressedRowBatchSize: 906.58 KB (928339) CodeGen:(Total: 166.484ms, non-child: 166.484ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 12.302ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2061900) - NumFunctions: 59 (59) - NumInstructions: 2.52K (2518) - OptimizationTime: 130.102ms - PeakMemoryUsage: 1.23 MB (1289216) - PrepareTime: 23.530ms HASH_JOIN_NODE (id=2):(Total: 11.157ms, non-child: 4.792ms, % non-child: 42.95%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 25 (25) - BuildTime: 259.606us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.06 MB (1116416) - ProbeRows: 66.53K (66529) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.219ms - RowsReturned: 66.53K (66529) - RowsReturnedRate: 5.96 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 8.839us - BuildRowsPartitioned: 25 (25) - GetNewBlockTime: 40.330us - HashBuckets: 43 (43) - HashCollisions: 0 (0) - HashTablesBuildTime: 97.492us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1066800) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=3):(Total: 52.670us, non-child: 52.670us, % non-child: 100.00%) BytesReceived(500.000ms): 182.00 B - BytesReceived: 182.00 B (182) - ConvertRowBatchTime: 7.489us - DeserializeRowBatchTimer: 53.351us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 25 (25) - RowsReturnedRate: 474.65 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns KUDU_SCAN_NODE (id=0):(Total: 6.368ms, non-child: 6.368ms, % non-child: 100.00%) BytesRead(500.000ms): 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 715.00 KB (732160) - RowsRead: 66.53K (66529) - RowsReturned: 66.53K (66529) - RowsReturnedRate: 10.45 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 18.022ms - MaterializeTupleTime(*): 467.345us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalKuduScanRoundTrips: 3 (3) - TotalReadThroughput: 0.00 /sec Instance 5a408a9e1cf90692:874f81bf00000006 (host=mikeb-desktop:22000):(Total: 214.390ms, non-child: 5.050ms, % non-child: 2.36%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 1.35 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.81 MB (1899965) - PerHostPeakMemUsage: 4.96 MB (5206007) - RowsProduced: 66.40K (66403) - TotalNetworkReceiveTime: 10.954us - TotalNetworkSendTime: 534.126us - TotalStorageWaitTime: 6.265ms - TotalThreadsInvoluntaryContextSwitches: 43 (43) - TotalThreadsTotalWallClockTime: 201.898ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 180.000ms - TotalThreadsVoluntaryContextSwitches: 26 (26) Fragment Instance Lifecycle Timings: - ExecTime: 34.171ms - ExecTreeExecTime: 5.297ms - OpenTime: 147.189ms - ExecTreeOpenTime: 1.956ms - PrepareTime: 32.982ms - ExecTreePrepareTime: 202.597us DataStreamSender (dst_id=4):(Total: 36.361ms, non-child: 36.361ms, % non-child: 100.00%) - BytesSent: 715.92 KB (733101) - NetworkThroughput(*): 80.04 MB/sec - OverallThroughput: 19.23 MB/sec - PeakMemoryUsage: 36.56 KB (37440) - RowsReturned: 66.40K (66403) - SerializeBatchTime: 27.595ms - TransmitDataRPCTime: 8.734ms - UncompressedRowBatchSize: 904.61 KB (926325) CodeGen:(Total: 165.458ms, non-child: 165.458ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 11.904ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2061900) - NumFunctions: 59 (59) - NumInstructions: 2.52K (2518) - OptimizationTime: 132.148ms - PeakMemoryUsage: 1.23 MB (1289216) - PrepareTime: 20.897ms HASH_JOIN_NODE (id=2):(Total: 7.519ms, non-child: 4.892ms, % non-child: 65.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 25 (25) - BuildTime: 236.405us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.06 MB (1116416) - ProbeRows: 66.40K (66403) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.302ms - RowsReturned: 66.40K (66403) - RowsReturnedRate: 8.83 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 5.628us - BuildRowsPartitioned: 25 (25) - GetNewBlockTime: 40.109us - HashBuckets: 43 (43) - HashCollisions: 0 (0) - HashTablesBuildTime: 94.506us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1066800) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=3):(Total: 39.813us, non-child: 39.813us, % non-child: 100.00%) BytesReceived(500.000ms): 182.00 B - BytesReceived: 182.00 B (182) - ConvertRowBatchTime: 5.324us - DeserializeRowBatchTimer: 45.823us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 25 (25) - RowsReturnedRate: 627.93 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns KUDU_SCAN_NODE (id=0):(Total: 2.630ms, non-child: 2.630ms, % non-child: 100.00%) BytesRead(500.000ms): 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 715.00 KB (732160) - RowsRead: 66.40K (66403) - RowsReturned: 66.40K (66403) - RowsReturnedRate: 25.24 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 15 (15) - ScannerThreadsTotalWallClockTime: 20.141ms - MaterializeTupleTime(*): 1.937ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalKuduScanRoundTrips: 3 (3) - TotalReadThroughput: 0.00 /sec Instance 5a408a9e1cf90692:874f81bf00000004 (host=mikeb-desktop:22002):(Total: 214.331ms, non-child: 2.287ms, % non-child: 1.07%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 1.35 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.89 MB (1979837) - PerHostPeakMemUsage: 1.89 MB (1979837) - RowsProduced: 67.07K (67068) - TotalNetworkReceiveTime: 14.261us - TotalNetworkSendTime: 1.399ms - TotalStorageWaitTime: 2.494ms - TotalThreadsInvoluntaryContextSwitches: 70 (70) - TotalThreadsTotalWallClockTime: 203.111ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 184.000ms - TotalThreadsVoluntaryContextSwitches: 35 (35) Fragment Instance Lifecycle Timings: - ExecTime: 35.769ms - ExecTreeExecTime: 4.931ms - OpenTime: 149.812ms - ExecTreeOpenTime: 2.695ms - PrepareTime: 28.687ms - ExecTreePrepareTime: 156.602us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 16 (16) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7171057152) - PeakMemoryUsage: 688.00 B (688) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=4):(Total: 37.834ms, non-child: 37.834ms, % non-child: 100.00%) - BytesSent: 722.99 KB (740345) - NetworkThroughput(*): 80.13 MB/sec - OverallThroughput: 18.66 MB/sec - PeakMemoryUsage: 36.56 KB (37440) - RowsReturned: 67.07K (67068) - SerializeBatchTime: 28.991ms - TransmitDataRPCTime: 8.811ms - UncompressedRowBatchSize: 913.95 KB (935888) CodeGen:(Total: 166.406ms, non-child: 166.406ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 11.701ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2061900) - NumFunctions: 59 (59) - NumInstructions: 2.52K (2518) - OptimizationTime: 134.426ms - PeakMemoryUsage: 1.23 MB (1289216) - PrepareTime: 19.745ms HASH_JOIN_NODE (id=2):(Total: 7.803ms, non-child: 4.480ms, % non-child: 57.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 25 (25) - BuildTime: 239.109us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.06 MB (1116416) - ProbeRows: 67.07K (67068) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4.045ms - RowsReturned: 67.07K (67068) - RowsReturnedRate: 8.59 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 7.112us - BuildRowsPartitioned: 25 (25) - GetNewBlockTime: 33.380us - HashBuckets: 43 (43) - HashCollisions: 0 (0) - HashTablesBuildTime: 70.030us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.02 MB (1066800) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=3):(Total: 55.931us, non-child: 55.931us, % non-child: 100.00%) BytesReceived(500.000ms): 182.00 B - BytesReceived: 182.00 B (182) - ConvertRowBatchTime: 7.537us - DeserializeRowBatchTimer: 37.510us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 25 (25) - RowsReturnedRate: 446.98 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns KUDU_SCAN_NODE (id=0):(Total: 3.325ms, non-child: 3.325ms, % non-child: 100.00%) BytesRead(500.000ms): 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 793.00 KB (812032) - RowsRead: 67.07K (67068) - RowsReturned: 67.07K (67068) - RowsReturnedRate: 20.17 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 17.134ms - MaterializeTupleTime(*): 2.596ms - ScannerThreadsSysTime: 4.000ms - ScannerThreadsUserTime: 4.000ms - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalKuduScanRoundTrips: 3 (3) - TotalReadThroughput: 0.00 /sec Averaged Fragment F01:(Total: 38.809ms, non-child: 34.617us, % non-child: 0.09%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:37.978ms max:42.455ms mean: 39.494ms stddev:2.093ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 3 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 216.00 KB (221184) - PerHostPeakMemUsage: 1.14 MB (1192943) - RowsProduced: 8 (8) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 503.876us - TotalStorageWaitTime: 16.553ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 32.835ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 21 (21) Fragment Instance Lifecycle Timings: - ExecTime: 7.305ms - ExecTreeExecTime: 6.578ms - OpenTime: 7.552ms - ExecTreeOpenTime: 7.538ms - PrepareTime: 23.900ms - ExecTreePrepareTime: 54.243us DataStreamSender (dst_id=3):(Total: 123.563us, non-child: 123.563us, % non-child: 100.00%) - BytesSent: 182.00 B (182) - NetworkThroughput(*): 2.15 MB/sec - OverallThroughput: 1.38 MB/sec - PeakMemoryUsage: 192.00 KB (196608) - RowsReturned: 8 (8) - SerializeBatchTime: 21.074us - TransmitDataRPCTime: 80.136us - UncompressedRowBatchSize: 182.00 B (182) CodeGen:(Total: 17.433ms, non-child: 17.433ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2061900) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 16.921ms KUDU_SCAN_NODE (id=1):(Total: 21.218ms, non-child: 21.218ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 16.00 KB (16384) - RowsRead: 8 (8) - RowsReturned: 8 (8) - RowsReturnedRate: 405.00 /sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 17.990ms - MaterializeTupleTime(*): 6.569ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalKuduScanRoundTrips: 2 (2) - TotalReadThroughput: 0.00 /sec Fragment F01: Instance 5a408a9e1cf90692:874f81bf00000003 (host=mikeb-desktop:22000):(Total: 41.946ms, non-child: 8.571ms, % non-child: 20.43%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 212.00 KB (217088) - PerHostPeakMemUsage: 1.56 MB (1640542) - RowsProduced: 9 (9) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.233ms - TotalStorageWaitTime: 18.726ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 34.055ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 23 (23) Fragment Instance Lifecycle Timings: - ExecTime: 7.935ms - ExecTreeExecTime: 6.511ms - OpenTime: 5.395ms - ExecTreeOpenTime: 5.386ms - PrepareTime: 28.564ms - ExecTreePrepareTime: 51.814us DataStreamSender (dst_id=3):(Total: 140.841us, non-child: 140.841us, % non-child: 100.00%) - BytesSent: 198.00 B (198) - NetworkThroughput(*): 1.92 MB/sec - OverallThroughput: 1.34 MB/sec - PeakMemoryUsage: 192.00 KB (196608) - RowsReturned: 9 (9) - SerializeBatchTime: 23.732us - TransmitDataRPCTime: 98.224us - UncompressedRowBatchSize: 198.00 B (198) CodeGen:(Total: 16.440ms, non-child: 16.440ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2061900) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 15.930ms KUDU_SCAN_NODE (id=1):(Total: 16.794ms, non-child: 16.794ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 12.00 KB (12288) - RowsRead: 9 (9) - RowsReturned: 9 (9) - RowsReturnedRate: 535.00 /sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 13 (13) - ScannerThreadsTotalWallClockTime: 20.738ms - MaterializeTupleTime(*): 6.501ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalKuduScanRoundTrips: 3 (3) - TotalReadThroughput: 0.00 /sec Instance 5a408a9e1cf90692:874f81bf00000001 (host=mikeb-desktop:22002):(Total: 37.483ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 212.00 KB (217088) - PerHostPeakMemUsage: 1.54 MB (1611696) - RowsProduced: 11 (11) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 119.919us - TotalStorageWaitTime: 18.492ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 35.906ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 20 (20) Fragment Instance Lifecycle Timings: - ExecTime: 8.356ms - ExecTreeExecTime: 7.980ms - OpenTime: 7.906ms - ExecTreeOpenTime: 7.895ms - PrepareTime: 21.161ms - ExecTreePrepareTime: 50.519us DataStreamSender (dst_id=3):(Total: 127.943us, non-child: 127.943us, % non-child: 100.00%) - BytesSent: 234.00 B (234) - NetworkThroughput(*): 2.77 MB/sec - OverallThroughput: 1.74 MB/sec - PeakMemoryUsage: 192.00 KB (196608) - RowsReturned: 11 (11) - SerializeBatchTime: 23.121us - TransmitDataRPCTime: 80.548us - UncompressedRowBatchSize: 234.00 B (234) CodeGen:(Total: 19.148ms, non-child: 19.148ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2061900) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 18.481ms KUDU_SCAN_NODE (id=1):(Total: 23.614ms, non-child: 23.614ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 12.00 KB (12288) - RowsRead: 11 (11) - RowsReturned: 11 (11) - RowsReturnedRate: 465.00 /sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 19.654ms - MaterializeTupleTime(*): 7.972ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalKuduScanRoundTrips: 3 (3) - TotalReadThroughput: 0.00 /sec Instance 5a408a9e1cf90692:874f81bf00000002 (host=mikeb-desktop:22001):(Total: 36.999ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 224.00 KB (229376) - PerHostPeakMemUsage: 318.94 KB (326592) - RowsProduced: 5 (5) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 158.230us - TotalStorageWaitTime: 12.440ms - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 28.544ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 22 (22) Fragment Instance Lifecycle Timings: - ExecTime: 5.623ms - ExecTreeExecTime: 5.244ms - OpenTime: 9.355ms - ExecTreeOpenTime: 9.332ms - PrepareTime: 21.975ms - ExecTreePrepareTime: 60.398us DataStreamSender (dst_id=3):(Total: 101.906us, non-child: 101.906us, % non-child: 100.00%) - BytesSent: 114.00 B (114) - NetworkThroughput(*): 1.76 MB/sec - OverallThroughput: 1.07 MB/sec - PeakMemoryUsage: 192.00 KB (196608) - RowsReturned: 5 (5) - SerializeBatchTime: 16.370us - TransmitDataRPCTime: 61.637us - UncompressedRowBatchSize: 114.00 B (114) CodeGen:(Total: 16.711ms, non-child: 16.711ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2061900) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 16.352ms KUDU_SCAN_NODE (id=1):(Total: 23.246ms, non-child: 23.246ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 3 (3) - PeakMemoryUsage: 24.00 KB (24576) - RowsRead: 5 (5) - RowsReturned: 5 (5) - RowsReturnedRate: 215.00 /sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 13.578ms - MaterializeTupleTime(*): 5.235ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalKuduScanRoundTrips: 2 (2) - TotalReadThroughput: 0.00 /sec