Query (id=b481c184e74f807:78f45efd00000000): Summary: Session ID: 434447a20ade3870:4ee8afce3cc7594 Session Type: BEESWAX Start Time: 2017-04-12 02:16:54.834000000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.9.0-SNAPSHOT RELEASE (build 924ddc6e935aa6e6d2a07c4926cbb26ea0df0b4e) User: jenkins Connected User: jenkins Delegated User: Network Address: 127.0.0.1:46440 Default Db: tpch_nested_parquet Sql Statement: select o_orderkey, sum(l_extendedprice * (1 - l_discount)) as revenue, o_orderdate, o_shippriority from customer c, c.c_orders o, o.o_lineitems l where c_mktsegment = 'BUILDING' and o_orderdate < '1995-03-15' and l_shipdate > '1995-03-15' group by o_orderkey, o_orderdate, o_shippriority order by revenue desc, o_orderdate limit 10 Coordinator: impala-boost-static-burst-slave-1106.vpc.cloudera.com:22000 Query Options (non default): ABORT_ON_ERROR=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0 Plan: ---------------- Estimated Per-Host Requirements: Memory=432.00MB VCores=2 WARNING: The following tables are missing relevant table and/or column statistics. tpch_nested_parquet.customer PLAN-ROOT SINK | 13:MERGING-EXCHANGE [UNPARTITIONED] | order by: sum(l_extendedprice * (1 - l_discount)) DESC, o_orderdate ASC | limit: 10 | hosts=3 per-host-mem=unavailable | tuple-ids=4 row-size=44B cardinality=10 | 10:TOP-N [LIMIT=10] | order by: sum(l_extendedprice * (1 - l_discount)) DESC, o_orderdate ASC | hosts=3 per-host-mem=440B | tuple-ids=4 row-size=44B cardinality=10 | 12:AGGREGATE [FINALIZE] | output: sum:merge(l_extendedprice * (1 - l_discount)) | group by: o_orderkey, o_orderdate, o_shippriority | hosts=3 per-host-mem=128.00MB | tuple-ids=3 row-size=44B cardinality=3000000 | 11:EXCHANGE [HASH(o_orderkey,o_orderdate,o_shippriority)] | hosts=3 per-host-mem=0B | tuple-ids=3 row-size=44B cardinality=3000000 | 09:AGGREGATE [STREAMING] | output: sum(l_extendedprice * (1 - l_discount)) | group by: o_orderkey, o_orderdate, o_shippriority | hosts=3 per-host-mem=128.00MB | tuple-ids=3 row-size=44B cardinality=3000000 | 01:SUBPLAN | hosts=3 per-host-mem=0B | tuple-ids=2,1,0 row-size=117B cardinality=3000000 | |--08:NESTED LOOP JOIN [CROSS JOIN] | | hosts=3 per-host-mem=41B | | tuple-ids=2,1,0 row-size=117B cardinality=100 | | | |--02:SINGULAR ROW SRC | | parent-subplan=01 | | hosts=3 per-host-mem=0B | | tuple-ids=0 row-size=41B cardinality=1 | | | 04:SUBPLAN | | hosts=3 per-host-mem=0B | | tuple-ids=2,1 row-size=76B cardinality=100 | | | |--07:NESTED LOOP JOIN [CROSS JOIN] | | | hosts=3 per-host-mem=44B | | | tuple-ids=2,1 row-size=76B cardinality=10 | | | | | |--05:SINGULAR ROW SRC | | | parent-subplan=04 | | | hosts=3 per-host-mem=0B | | | tuple-ids=1 row-size=44B cardinality=1 | | | | | 06:UNNEST [o.o_lineitems l] | | parent-subplan=04 | | hosts=3 per-host-mem=0B | | tuple-ids=2 row-size=0B cardinality=10 | | | 03:UNNEST [c.c_orders o] | parent-subplan=01 | hosts=3 per-host-mem=0B | tuple-ids=1 row-size=0B cardinality=10 | 00:SCAN HDFS [tpch_nested_parquet.customer c, RANDOM] partitions=1/1 files=4 size=292.36MB predicates: c_mktsegment = 'BUILDING', !empty(c.c_orders) predicates on o: !empty(o.o_lineitems), o_orderdate < '1995-03-15' predicates on l: l_shipdate > '1995-03-15' table stats: 150000 rows total columns missing stats: c_orders parquet statistics predicates: c_mktsegment = 'BUILDING' parquet dictionary predicates: c_mktsegment = 'BUILDING' hosts=3 per-host-mem=176.00MB tuple-ids=0 row-size=41B cardinality=30000 ---------------- Estimated Per-Host Mem: 452984917 Estimated Per-Host VCores: 2 Tables Missing Stats: tpch_nested_parquet.customer Request Pool: default-pool Admission result: Admitted immediately Planner Timeline: 17.871ms - Analysis finished: 12.148ms (12.148ms) - Equivalence classes computed: 12.328ms (180.519us) - Single node plan created: 16.447ms (4.119ms) - Runtime filters computed: 16.492ms (44.366us) - Distributed plan created: 16.650ms (158.704us) - Planning finished: 17.871ms (1.220ms) Query Timeline: 61h39m - Query submitted: 0.000ns (0.000ns) - Planning finished: 20.000ms (20.000ms) - Submit for admission: 21.000ms (1.000ms) - Completed admission: 21.000ms (0.000ns) - Ready to start 7 fragment instances: 22.000ms (1.000ms) - All 7 fragment instances started: 42.000ms (20.000ms) - ComputeScanRangeAssignmentTimer: 0.000ns ImpalaServer: - ClientFetchWaitTimer: 0.000ns - RowMaterializationTimer: 0.000ns Execution Profile b481c184e74f807:78f45efd00000000:(Total: 98.001ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 7, min / max: 5ms / 16ms, 25th %-ile: 9ms, 50th %-ile: 10ms, 75th %-ile: 12ms, 90th %-ile: 12ms, 95th %-ile: 16ms, 99.9th %-ile: 16ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F02: Instance b481c184e74f807:78f45efd00000000 (host=impala-boost-static-burst-slave-1106.vpc.cloudera.com:22000):(Total: 86.001ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1h8m): 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB, 8.36 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 304.50 KB (311808) - PerHostPeakMemUsage: 68.25 MB (71564291) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 86.001ms - ExecTreePrepareTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 255.003ms, non-child: 255.003ms, % non-child: 100.00%) - CodegenTime: 1.000ms - CompileTime: 17.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 29 (29) - NumInstructions: 593 (593) - OptimizationTime: 151.002ms - PeakMemoryUsage: 296.50 KB (303616) - PrepareTime: 87.001ms EXCHANGE_NODE (id=13): ExecOption: Codegen Enabled BytesReceived(1h8m): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - MergeGetNext: 0.000ns - MergeGetNextBatch: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F01:(Total: 83.001ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3669472) - PerHostPeakMemUsage: 41.16 MB (43157055) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 772.677ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 83.001ms - ExecTreePrepareTime: 4.333ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 48 (48) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 14.31 GB (15365329920) - PeakMemoryUsage: 794.67 KB (813738) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 333.338us, non-child: 333.338us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 2.84 KB (2912) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s005ms, non-child: 1s005ms, % non-child: 100.00%) - CodegenTime: 9.000ms - CompileTime: 523.007ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 118 (118) - NumInstructions: 2.45K (2451) - OptimizationTime: 420.672ms - PeakMemoryUsage: 1.20 MB (1254912) - PrepareTime: 52.667ms SORT_NODE (id=10):(Total: 4.333ms, non-child: 0.000ns, % non-child: 0.00%) - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 4.333ms, non-child: 0.000ns, % non-child: 0.00%) - BuildTime: 1.666ms - GetNewBlockTime: 666.676us - GetResultsTime: 0.000ns - HTResizeTime: 1.333ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.61 MB (2735107) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=11):(Total: 768.677ms, non-child: 768.677ms, % non-child: 100.00%) - BytesReceived: 73.68 KB (75453) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 2.000ms - FirstBatchArrivalWaitTime: 526.674ms - PeakMemoryUsage: 0 - RowsReturned: 2.73K (2730) - RowsReturnedRate: 1.59 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F01: Instance b481c184e74f807:78f45efd00000004 (host=impala-boost-static-burst-slave-1106.vpc.cloudera.com:22002):(Total: 83.001ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1h8m): 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB ThreadUsage(1h8m): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3669472) - PerHostPeakMemUsage: 48.67 MB (51036732) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s153ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 83.001ms - ExecTreePrepareTime: 6.000ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 48 (48) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 14.31 GB (15365329920) - PeakMemoryUsage: 784.00 KB (802816) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 2.84 KB (2912) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 619.009ms, non-child: 619.009ms, % non-child: 100.00%) - CodegenTime: 5.000ms - CompileTime: 120.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 118 (118) - NumInstructions: 2.45K (2451) - OptimizationTime: 436.006ms - PeakMemoryUsage: 1.20 MB (1254912) - PrepareTime: 48.000ms SORT_NODE (id=10):(Total: 6.000ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 6.000ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 1.000ms - GetNewBlockTime: 1.000ms - GetResultsTime: 0.000ns - HTResizeTime: 1.000ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.61 MB (2733522) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=11):(Total: 1s149ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1h8m): 73.01 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB, 73.04 KB - BytesReceived: 73.04 KB (74796) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 786.011ms - PeakMemoryUsage: 0 - RowsReturned: 2.71K (2705) - RowsReturnedRate: 2.35 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b481c184e74f807:78f45efd00000005 (host=impala-boost-static-burst-slave-1106.vpc.cloudera.com:22001):(Total: 93.001ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1h8m): 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB, 2.61 MB ThreadUsage(1h8m): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3669472) - PerHostPeakMemUsage: 6.55 MB (6870144) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 93.001ms - ExecTreePrepareTime: 4.000ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 48 (48) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 14.31 GB (15365329920) - PeakMemoryUsage: 784.00 KB (802816) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13):(Total: 1.000ms, non-child: 1.000ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 2.84 KB (2912) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s783ms, non-child: 1s783ms, % non-child: 100.00%) - CodegenTime: 4.000ms - CompileTime: 1s315ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 118 (118) - NumInstructions: 2.45K (2451) - OptimizationTime: 394.005ms - PeakMemoryUsage: 1.20 MB (1254912) - PrepareTime: 63.000ms SORT_NODE (id=10):(Total: 4.000ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 4.000ms, non-child: 4.000ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 3.000ms - GetNewBlockTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 2.000ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.61 MB (2737948) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=11): BytesReceived(1h8m): 72.60 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB, 72.63 KB - BytesReceived: 72.63 KB (74373) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 6.000ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 2.69K (2690) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b481c184e74f807:78f45efd00000006 (host=impala-boost-static-burst-slave-1106.vpc.cloudera.com:22000):(Total: 73.001ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1h8m): 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB, 2.62 MB ThreadUsage(1h8m): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.50 MB (3669472) - PerHostPeakMemUsage: 68.25 MB (71564291) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s165ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 73.001ms - ExecTreePrepareTime: 3.000ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 48 (48) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 14.31 GB (15365329920) - PeakMemoryUsage: 816.00 KB (835584) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=13): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 2.84 KB (2912) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 614.008ms, non-child: 614.008ms, % non-child: 100.00%) - CodegenTime: 18.000ms - CompileTime: 134.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 118 (118) - NumInstructions: 2.45K (2451) - OptimizationTime: 432.006ms - PeakMemoryUsage: 1.20 MB (1254912) - PrepareTime: 47.000ms SORT_NODE (id=10):(Total: 3.000ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 AGGREGATION_NODE (id=12):(Total: 3.000ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 1.000ms - GetNewBlockTime: 1.000ms - GetResultsTime: 0.000ns - HTResizeTime: 1.000ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.61 MB (2733852) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=11):(Total: 1s157ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1h8m): 75.35 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB, 75.38 KB - BytesReceived: 75.38 KB (77190) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 794.011ms - PeakMemoryUsage: 0 - RowsReturned: 2.79K (2795) - RowsReturnedRate: 2.42 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 1s263ms, non-child: 234.003ms, % non-child: 18.52%) split sizes: min: 86.18 MB, max: 119.98 MB, avg: 97.45 MB, stddev: 15.93 MB - AverageThreadTokens: 1.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 38.45 MB (40315247) - PerHostPeakMemUsage: 41.16 MB (43157055) - RowsProduced: 2.73K (2730) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 178.002ms - TotalStorageWaitTime: 93.334ms - TotalThreadsInvoluntaryContextSwitches: 659 (659) - TotalThreadsTotalWallClockTime: 1s916ms - TotalThreadsSysTime: 146.310ms - TotalThreadsUserTime: 654.233ms - TotalThreadsVoluntaryContextSwitches: 152 (152) Fragment Instance Lifecycle Timings: - ExecTime: 1s211ms - ExecTreeExecTime: 937.513ms - OpenTime: 330.338ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 125.668ms - ExecTreePrepareTime: 13.666ms DataStreamSender (dst_id=11):(Total: 1.333ms, non-child: 1.333ms, % non-child: 100.00%) - BytesSent: 73.68 KB (75453) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 43.68 MB/sec - PeakMemoryUsage: 64.53 KB (66080) - RowsReturned: 2.73K (2730) - SerializeBatchTime: 1.333ms - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 157.33 KB (161104) CodeGen:(Total: 389.339ms, non-child: 389.339ms, % non-child: 100.00%) - CodegenTime: 31.000ms - CompileTime: 83.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 135 (135) - NumInstructions: 3.46K (3460) - OptimizationTime: 371.338ms - PeakMemoryUsage: 1.69 MB (1771520) - PrepareTime: 66.334ms AGGREGATION_NODE (id=9):(Total: 638.675ms, non-child: 46.000ms, % non-child: 7.20%) - GetNewBlockTime: 666.676us - GetResultsTime: 0.000ns - HTResizeTime: 333.338us - HashBuckets: 21.84K (21845) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.11 MB (13742686) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 2.73K (2730) - RowsReturnedRate: 2.86 K/sec - StreamingTime: 39.000ms - UnpinTime: 0.000ns SUBPLAN_NODE (id=1):(Total: 592.675ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 11.64 MB (12202120) - RowsReturned: 0 (0) - RowsReturnedRate: 0 NESTED_LOOP_JOIN_NODE (id=8):(Total: 17.000ms, non-child: 13.000ms, % non-child: 76.47%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 29.33 KB (30037) - ProbeRows: 7.13K (7132) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Nested Loop Join Builder: - PeakMemoryUsage: 5.33 KB (5461) SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 SUBPLAN_NODE (id=4):(Total: 4.000ms, non-child: 1.000ms, % non-child: 25.00%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 NESTED_LOOP_JOIN_NODE (id=7):(Total: 3.000ms, non-child: 2.000ms, % non-child: 66.67%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 21.33 KB (21845) - ProbeRows: 7.13K (7132) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Nested Loop Join Builder: - PeakMemoryUsage: 5.33 KB (5461) SINGULAR_ROW_SRC_NODE (id=5): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=6):(Total: 1.000ms, non-child: 1.000ms, % non-child: 100.00%) - AvgCollectionSize: 1.75 - MaxCollectionSize: 4 (4) - MinCollectionSize: 0 (0) - NumCollections: 2.73K (2730) - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3): - AvgCollectionSize: 0.90 - MaxCollectionSize: 3 (3) - MinCollectionSize: 0 (0) - NumCollections: 2.02K (2023) - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 HDFS_SCAN_NODE (id=0):(Total: 583.675ms, non-child: 583.675ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.25 - BytesRead: 15.06 MB (15787066) - BytesReadDataNodeCache: 0 - BytesReadLocal: 22.58 MB (23680600) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 22.58 MB (23680600) - DecompressionTime: 107.501ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 35.80 MB (37542376) - PerReadThreadRawHdfsThroughput: 885.17 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 575.008ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.80M (1798390) - RowsReturned: 2.02K (2023) - RowsReturnedRate: 2.31 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 466 (466) - ScannerThreadsTotalWallClockTime: 779.011ms - MaterializeTupleTime(*): 605.675ms - ScannerThreadsSysTime: 104.317ms - ScannerThreadsUserTime: 472.594ms - ScannerThreadsVoluntaryContextSwitches: 129 (129) - TotalRawHdfsReadTime(*): 240.003ms - TotalReadThroughput: 10.04 MB/sec Fragment F00: Instance b481c184e74f807:78f45efd00000003 (host=impala-boost-static-burst-slave-1106.vpc.cloudera.com:22000):(Total: 1s817ms, non-child: 214.003ms, % non-child: 11.78%) Hdfs split stats (:<# splits>/): 0:1/33.79 MB 1:1/86.19 MB MemoryUsage(500.000ms): 3.05 MB, 64.94 MB, 31.79 MB ThreadUsage(500.000ms): 1, 3, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 65.93 MB (69132033) - PerHostPeakMemUsage: 68.25 MB (71564291) - RowsProduced: 4.83K (4831) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 162.002ms - TotalStorageWaitTime: 262.003ms - TotalThreadsInvoluntaryContextSwitches: 1.16K (1157) - TotalThreadsTotalWallClockTime: 3s183ms - TotalThreadsSysTime: 244.962ms - TotalThreadsUserTime: 1s118ms - TotalThreadsVoluntaryContextSwitches: 258 (258) Fragment Instance Lifecycle Timings: - ExecTime: 1s181ms - ExecTreeExecTime: 1s008ms - OpenTime: 529.007ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 107.001ms - ExecTreePrepareTime: 19.000ms DataStreamSender (dst_id=11):(Total: 3.000ms, non-child: 3.000ms, % non-child: 100.00%) - BytesSent: 130.30 KB (133430) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 42.42 MB/sec - PeakMemoryUsage: 92.53 KB (94752) - RowsReturned: 4.83K (4831) - SerializeBatchTime: 3.000ms - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 278.41 KB (285089) CodeGen:(Total: 573.008ms, non-child: 573.008ms, % non-child: 100.00%) - CodegenTime: 25.000ms - CompileTime: 145.002ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 135 (135) - NumInstructions: 3.46K (3460) - OptimizationTime: 366.005ms - PeakMemoryUsage: 1.69 MB (1771520) - PrepareTime: 61.000ms AGGREGATION_NODE (id=9):(Total: 1s027ms, non-child: 86.001ms, % non-child: 8.37%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.000ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 19.01 MB (19936957) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 4.83K (4831) - RowsReturnedRate: 4.70 K/sec - StreamingTime: 67.000ms - UnpinTime: 0.000ns SUBPLAN_NODE (id=1):(Total: 941.013ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 17.45 MB (18299453) - RowsReturned: 0 (0) - RowsReturnedRate: 0 NESTED_LOOP_JOIN_NODE (id=8):(Total: 10.000ms, non-child: 4.000ms, % non-child: 40.00%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 32.00 KB (32768) - ProbeRows: 12.47K (12475) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Nested Loop Join Builder: - PeakMemoryUsage: 8.00 KB (8192) SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 SUBPLAN_NODE (id=4):(Total: 6.000ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 NESTED_LOOP_JOIN_NODE (id=7):(Total: 6.000ms, non-child: 4.000ms, % non-child: 66.67%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 24.00 KB (24576) - ProbeRows: 12.47K (12475) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Nested Loop Join Builder: - PeakMemoryUsage: 8.00 KB (8192) SINGULAR_ROW_SRC_NODE (id=5): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=6):(Total: 2.000ms, non-child: 2.000ms, % non-child: 100.00%) - AvgCollectionSize: 2.58 - MaxCollectionSize: 7 (7) - MinCollectionSize: 1 (1) - NumCollections: 4.83K (4831) - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3): - AvgCollectionSize: 1.35 - MaxCollectionSize: 6 (6) - MinCollectionSize: 1 (1) - NumCollections: 3.58K (3576) - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 HDFS_SCAN_NODE (id=0):(Total: 932.013ms, non-child: 932.013ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/33.79 MB 1:1/86.19 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:14 BytesRead(500.000ms): 0, 26.31 MB, 26.31 MB - FooterProcessingTime: (Avg: 1.500ms ; Min: 1.000ms ; Max: 2.000ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.50 - BytesRead: 26.31 MB (27588293) - BytesReadDataNodeCache: 0 - BytesReadLocal: 26.31 MB (27588293) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 26.31 MB (27588293) - DecompressionTime: 128.001ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 63.28 MB (66351090) - PerReadThreadRawHdfsThroughput: 56.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 916.013ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3.14M (3139104) - RowsReturned: 3.58K (3576) - RowsReturnedRate: 3.84 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 822 (822) - ScannerThreadsTotalWallClockTime: 1s473ms - MaterializeTupleTime(*): 1s062ms - ScannerThreadsSysTime: 174.972ms - ScannerThreadsUserTime: 839.872ms - ScannerThreadsVoluntaryContextSwitches: 219 (219) - TotalRawHdfsReadTime(*): 469.006ms - TotalReadThroughput: 17.54 MB/sec Instance b481c184e74f807:78f45efd00000001 (host=impala-boost-static-burst-slave-1106.vpc.cloudera.com:22002):(Total: 1s812ms, non-child: 426.006ms, % non-child: 23.51%) Hdfs split stats (:<# splits>/): 1:1/86.21 MB MemoryUsage(500.000ms): 3.05 MB, 35.20 MB, 36.53 MB, 703.76 KB ThreadUsage(500.000ms): 1, 2, 2, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 46.36 MB (48613038) - PerHostPeakMemUsage: 48.67 MB (51036732) - RowsProduced: 3.36K (3359) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 372.005ms - TotalStorageWaitTime: 18.000ms - TotalThreadsInvoluntaryContextSwitches: 820 (820) - TotalThreadsTotalWallClockTime: 2s567ms - TotalThreadsSysTime: 193.970ms - TotalThreadsUserTime: 843.872ms - TotalThreadsVoluntaryContextSwitches: 200 (200) Fragment Instance Lifecycle Timings: - ExecTime: 1s241ms - ExecTreeExecTime: 867.012ms - OpenTime: 462.006ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 109.001ms - ExecTreePrepareTime: 1.000ms DataStreamSender (dst_id=11):(Total: 1.000ms, non-child: 1.000ms, % non-child: 100.00%) - BytesSent: 90.75 KB (92929) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 88.62 MB/sec - PeakMemoryUsage: 92.53 KB (94752) - RowsReturned: 3.36K (3359) - SerializeBatchTime: 1.000ms - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 193.58 KB (198225) CodeGen:(Total: 517.007ms, non-child: 517.007ms, % non-child: 100.00%) - CodegenTime: 25.000ms - CompileTime: 104.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 135 (135) - NumInstructions: 3.46K (3460) - OptimizationTime: 354.005ms - PeakMemoryUsage: 1.69 MB (1771520) - PrepareTime: 58.000ms AGGREGATION_NODE (id=9):(Total: 868.012ms, non-child: 51.000ms, % non-child: 5.88%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1.000ms - GetResultsTime: 0.000ns - HTResizeTime: 1.000ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 19.01 MB (19936221) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 3.36K (3359) - RowsReturnedRate: 3.87 K/sec - StreamingTime: 50.000ms - UnpinTime: 0.000ns SUBPLAN_NODE (id=1):(Total: 817.011ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 17.45 MB (18298717) - RowsReturned: 0 (0) - RowsReturnedRate: 0 NESTED_LOOP_JOIN_NODE (id=8):(Total: 7.000ms, non-child: 1.000ms, % non-child: 14.29%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 32.00 KB (32768) - ProbeRows: 8.92K (8923) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Nested Loop Join Builder: - PeakMemoryUsage: 8.00 KB (8192) SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 SUBPLAN_NODE (id=4):(Total: 6.000ms, non-child: 3.000ms, % non-child: 50.00%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 NESTED_LOOP_JOIN_NODE (id=7):(Total: 3.000ms, non-child: 2.000ms, % non-child: 66.67%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 24.00 KB (24576) - ProbeRows: 8.92K (8923) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Nested Loop Join Builder: - PeakMemoryUsage: 8.00 KB (8192) SINGULAR_ROW_SRC_NODE (id=5): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=6):(Total: 1.000ms, non-child: 1.000ms, % non-child: 100.00%) - AvgCollectionSize: 2.66 - MaxCollectionSize: 7 (7) - MinCollectionSize: 1 (1) - NumCollections: 3.36K (3359) - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3): - AvgCollectionSize: 1.35 - MaxCollectionSize: 5 (5) - MinCollectionSize: 1 (1) - NumCollections: 2.50K (2495) - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 HDFS_SCAN_NODE (id=0):(Total: 810.011ms, non-child: 810.011ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/86.21 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:7 BytesRead(500.000ms): 0, 18.86 MB, 18.86 MB - FooterProcessingTime: (Avg: 1.000ms ; Min: 1.000ms ; Max: 1.000ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 18.86 MB (19772907) - BytesReadDataNodeCache: 0 - BytesReadLocal: 18.86 MB (19772907) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 18.86 MB (19772907) - DecompressionTime: 87.001ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 44.13 MB (46276038) - PerReadThreadRawHdfsThroughput: 1.67 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 809.011ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.26M (2256068) - RowsReturned: 2.50K (2495) - RowsReturnedRate: 3.08 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 578 (578) - ScannerThreadsTotalWallClockTime: 864.012ms - MaterializeTupleTime(*): 755.011ms - ScannerThreadsSysTime: 137.979ms - ScannerThreadsUserTime: 577.912ms - ScannerThreadsVoluntaryContextSwitches: 170 (170) - TotalRawHdfsReadTime(*): 11.000ms - TotalReadThroughput: 12.57 MB/sec Instance b481c184e74f807:78f45efd00000002 (host=impala-boost-static-burst-slave-1106.vpc.cloudera.com:22001):(Total: 161.002ms, non-child: 62.000ms, % non-child: 38.51%) Hdfs split stats (:<# splits>/): 0:1/86.18 MB MemoryUsage(1h8m): 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB, 1.36 MB ThreadUsage(1h8m): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.05 MB (3200672) - PerHostPeakMemUsage: 6.55 MB (6870144) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - PrepareTime: 161.002ms - ExecTreePrepareTime: 21.000ms DataStreamSender (dst_id=11): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 8.53 KB (8736) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 78.001ms, non-child: 78.001ms, % non-child: 100.00%) - CodegenTime: 43.000ms - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 135 (135) - NumInstructions: 3.46K (3460) - OptimizationTime: 394.005ms - PeakMemoryUsage: 1.69 MB (1771520) - PrepareTime: 80.001ms AGGREGATION_NODE (id=9):(Total: 21.000ms, non-child: 1.000ms, % non-child: 4.76%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.29 MB (1354880) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns - UnpinTime: 0.000ns SUBPLAN_NODE (id=1):(Total: 20.000ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 NESTED_LOOP_JOIN_NODE (id=8):(Total: 34.000ms, non-child: 34.000ms, % non-child: 100.00%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 24.00 KB (24576) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Nested Loop Join Builder: - PeakMemoryUsage: 0 SINGULAR_ROW_SRC_NODE (id=2): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 SUBPLAN_NODE (id=4): - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 NESTED_LOOP_JOIN_NODE (id=7): - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Nested Loop Join Builder: - PeakMemoryUsage: 0 SINGULAR_ROW_SRC_NODE (id=5): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=6): - AvgCollectionSize: 0.00 - MaxCollectionSize: 0 (0) - MinCollectionSize: 0 (0) - NumCollections: 0 (0) - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 UNNEST_NODE (id=3): - AvgCollectionSize: 0.00 - MaxCollectionSize: 0 (0) - MinCollectionSize: 0 (0) - NumCollections: 0 (0) - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 HDFS_SCAN_NODE (id=0):(Total: 9.000ms, non-child: 9.000ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/86.18 MB ExecOption: PARQUET Codegen Enabled BytesRead(1h8m): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - PeakMemoryUsage: 0 - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalReadThroughput: 0.00 /sec