Query (id=e945a9bc83511e50:c6fd99ea00000000) DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. Summary Session ID: 6844b76231da7325:a43977f43e27a4bd Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2019-10-26 04:34:32.461753000 End Time: 2019-10-26 04:34:51.422369000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 3.4.0-SNAPSHOT DEBUG (build 0f70ade0d78a9eb3afafdfd1a3e36cc8a5563cb4) User: jenkins Connected User: jenkins Delegated User: Network Address: ::1:48758 Default Db: functional_parquet Sql Statement: select id, bigint_col from alltypestiny union all select sum(int_col), bigint_col from alltypes where year=2009 and month=2 group by bigint_col union all select a.id, a.bigint_col from alltypestiny a inner join alltypestiny b on (a.id = b.id) union all select 1000, 2000 Coordinator: impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22000 Query Options (set by configuration): ABORT_ON_ERROR=1,BATCH_SIZE=10,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,DISABLE_CODEGEN_ROWS_THRESHOLD=0,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=query_test/test_queries.py::TestQueries::()::test_union[protocol:hs2|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_threshold':0}|table_format:parquet/none] Query Options (set by configuration and planner): ABORT_ON_ERROR=1,BATCH_SIZE=10,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,MT_DOP=0,DISABLE_CODEGEN_ROWS_THRESHOLD=0,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=query_test/test_queries.py::TestQueries::()::test_union[protocol:hs2|exec_option:{'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':False;'abort_on_error':1;'exec_single_node_rows_threshold':0}|table_format:parquet/none] Plan: ---------------- Max Per-Host Resource Reservation: Memory=70.04MB Threads=9 Per-Host Resource Estimates: Memory=338MB WARNING: The following tables are missing relevant table and/or column statistics. functional_parquet.alltypes, functional_parquet.alltypestiny Analyzed query: SELECT id, bigint_col FROM functional_parquet.alltypestiny UNION ALL SELECT sum(CAST(int_col AS BIGINT)), bigint_col FROM functional_parquet.alltypes WHERE `year` = CAST(2009 AS INT) AND `month` = CAST(2 AS INT) GROUP BY bigint_col UNION ALL SELECT a.id, a.bigint_col FROM functional_parquet.alltypestiny a INNER JOIN functional_parquet.alltypestiny b ON (a.id = b.id) UNION ALL SELECT CAST(1000 AS BIGINT), CAST(2000 AS BIGINT) F07:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=16.00KB mem-reservation=0B thread-reservation=1 PLAN-ROOT SINK | output exprs: id, bigint_col | mem-estimate=0B mem-reservation=0B thread-reservation=0 | 11:EXCHANGE [UNPARTITIONED] | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 | tuple-ids=5 row-size=16B cardinality=2.01K | in pipelines: 01(GETNEXT), 08(GETNEXT), 04(GETNEXT) | F06:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 Per-Host Resources: mem-estimate=129.02MB mem-reservation=35.00MB thread-reservation=2 runtime-filters-memory=1.00MB 00:UNION | constant-operands=1 | mem-estimate=0B mem-reservation=0B thread-reservation=0 | tuple-ids=5 row-size=16B cardinality=2.01K | in pipelines: 01(GETNEXT), 08(GETNEXT), 04(GETNEXT) | |--06:HASH JOIN [INNER JOIN, PARTITIONED] | | hash predicates: a.id = b.id | | fk/pk conjuncts: assumed fk/pk | | runtime filters: RF000[bloom] <- b.id | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 | | tuple-ids=3,4 row-size=16B cardinality=758 | | in pipelines: 04(GETNEXT), 05(OPEN) | | | |--10:EXCHANGE [HASH(b.id)] | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 | | | tuple-ids=4 row-size=4B cardinality=758 | | | in pipelines: 05(GETNEXT) | | | | | F04:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 | | Per-Host Resources: mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=2 | | 05:SCAN HDFS [functional_parquet.alltypestiny b, RANDOM] | | HDFS partitions=4/4 files=4 size=11.92KB | | stored statistics: | | table: rows=unavailable size=unavailable | | partitions: 0/4 rows=unavailable | | columns: unavailable | | extrapolated-rows=disabled max-scan-range-rows=unavailable | | mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=1 | | tuple-ids=4 row-size=4B cardinality=758 | | in pipelines: 05(GETNEXT) | | | 09:EXCHANGE [HASH(a.id)] | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 | | tuple-ids=3 row-size=12B cardinality=758 | | in pipelines: 04(GETNEXT) | | | F03:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 | Per-Host Resources: mem-estimate=33.00MB mem-reservation=1.02MB thread-reservation=2 runtime-filters-memory=1.00MB | 04:SCAN HDFS [functional_parquet.alltypestiny a, RANDOM] | HDFS partitions=4/4 files=4 size=11.92KB | runtime filters: RF000[bloom] -> a.id | stored statistics: | table: rows=unavailable size=unavailable | partitions: 0/4 rows=unavailable | columns: unavailable | extrapolated-rows=disabled max-scan-range-rows=unavailable | mem-estimate=32.00MB mem-reservation=16.00KB thread-reservation=1 | tuple-ids=3 row-size=12B cardinality=758 | in pipelines: 04(GETNEXT) | |--08:AGGREGATE [FINALIZE] | | output: sum:merge(int_col) | | group by: bigint_col | | mem-estimate=128.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 | | tuple-ids=2 row-size=16B cardinality=491 | | in pipelines: 08(GETNEXT), 02(OPEN) | | | 07:EXCHANGE [HASH(bigint_col)] | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 | | tuple-ids=2 row-size=16B cardinality=491 | | in pipelines: 02(GETNEXT) | | | F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | Per-Host Resources: mem-estimate=160.00MB mem-reservation=34.02MB thread-reservation=2 | 03:AGGREGATE [STREAMING] | | output: sum(CAST(int_col AS BIGINT)) | | group by: bigint_col | | mem-estimate=128.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 | | tuple-ids=2 row-size=16B cardinality=491 | | in pipelines: 02(GETNEXT) | | | 02:SCAN HDFS [functional_parquet.alltypes, RANDOM] | partition predicates: `year` = CAST(2009 AS INT), `month` = CAST(2 AS INT) | HDFS partitions=1/24 files=1 size=7.71KB | stored statistics: | table: rows=unavailable size=unavailable | partitions: 0/1 rows=unavailable | columns missing stats: int_col, bigint_col | extrapolated-rows=disabled max-scan-range-rows=unavailable | mem-estimate=32.00MB mem-reservation=16.00KB thread-reservation=1 | tuple-ids=1 row-size=12B cardinality=491 | in pipelines: 02(GETNEXT) | 01:SCAN HDFS [functional_parquet.alltypestiny, RANDOM] HDFS partitions=4/4 files=4 size=11.92KB stored statistics: table: rows=unavailable size=unavailable partitions: 0/4 rows=unavailable columns: unavailable extrapolated-rows=disabled max-scan-range-rows=unavailable mem-estimate=32.00MB mem-reservation=16.00KB thread-reservation=1 tuple-ids=0 row-size=12B cardinality=758 in pipelines: 01(GETNEXT) ---------------- Estimated Per-Host Mem: 354451456 Tables Missing Stats: functional_parquet.alltypes,functional_parquet.alltypestiny Request Pool: default-pool Per Host Min Memory Reservation: impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22001(36.02 MB) impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22002(36.02 MB) impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22000(70.04 MB) Per Host Number of Fragment Instances: impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22001(3) impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22002(3) impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22000(5) Admission result: Admitted immediately Cluster Memory Admitted: 1014.09 MB Executor Group: default ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------------------------------------------- F07:ROOT 1 0.000ns 0.000ns 0 0 11:EXCHANGE 1 0.000ns 0.000ns 16 2.01K 24.00 KB 16.00 KB UNPARTITIONED F06:EXCHANGE SENDER 3 14.666ms 39.998ms 7.52 KB 0 00:UNION 3 0.000ns 0.000ns 16 2.01K 8.08 KB 0 |--08:AGGREGATE 3 21.665ms 35.998ms 5 491 34.01 MB 128.00 MB FINALIZE | 07:EXCHANGE 3 0.000ns 0.000ns 5 491 16.00 KB 16.00 KB HASH(bigint_col) | F01:EXCHANGE SENDER 1 5.999ms 5.999ms 34.57 KB 0 | 03:AGGREGATE 1 293.989ms 293.989ms 10 491 34.01 MB 128.00 MB STREAMING | 02:SCAN HDFS 1 161.994ms 161.994ms 280 491 142.30 KB 32.00 MB functional_parquet.alltypes |--06:HASH JOIN 3 31.998ms 61.997ms 6 758 1.94 MB 1.94 MB INNER JOIN, PARTITIONED | |--10:EXCHANGE 3 333.321us 999.964us 6 758 32.00 KB 16.00 KB HASH(b.id) | | F04:EXCHANGE SENDER 3 2.999ms 3.999ms 84.78 KB 0 | | 05:SCAN HDFS 3 176.660ms 408.985ms 8 758 28.09 KB 16.00 MB functional_parquet.alltypestiny b | 09:EXCHANGE 3 0.000ns 0.000ns 6 758 32.00 KB 16.00 KB HASH(a.id) | F03:EXCHANGE SENDER 3 1.999ms 2.999ms 37.53 KB 0 | 04:SCAN HDFS 3 81.997ms 101.996ms 8 758 32.00 KB 32.00 MB functional_parquet.alltypestiny a 01:SCAN HDFS 3 48.664ms 86.996ms 4 758 28.10 KB 32.00 MB functional_parquet.alltypestiny Errors: - AdmissionControlTimeSinceLastUpdate: 24ms (24000000) - ComputeScanRangeAssignmentTimer: 4ms (4999819) - InactiveTotalTime: 0ns (0) - TotalTime: 0ns (0) Query Compilation Metadata of all 2 tables cached: 691.87us (691869) Analysis finished: 1ms (1246997) Authorization finished (noop): 1ms (1266727) Value transfer graph computed: 1ms (1735789) Single node plan created: 3ms (3379613) Runtime filters computed: 3ms (3563867) Distributed plan created: 3ms (3582570) Planning finished: 5ms (5104995) Query Timeline Query submitted: 1ms (1999927) Planning finished: 10ms (10999601) Submit for admission: 32ms (32998802) Completed admission: 44ms (44998367) Ready to start on 3 backends: 56ms (56997931) All 3 execution backends (11 fragment instances) started: 156ms (156994302) Rows available: 5.64s (5636795404) First dynamic filter received: 5.71s (5711792682) First row fetched: 6.58s (6581761105) Execution cancelled: 18.16s (18162340772) Released admission control resources: 18.96s (18960311808) Unregister query: 19.14s (19136305420) Frontend - InactiveTotalTime: 0ns (0) - TotalTime: 0ns (0) ImpalaServer - ClientFetchWaitTimer: 2.59s (2588906032) - InactiveTotalTime: 0ns (0) - NumRowsFetched: 10 (10) - NumRowsFetchedFromCache: 0 (0) - RowMaterializationRate: 0 per second (0) - RowMaterializationTimer: 10.91s (10910603984) - TotalTime: 0ns (0) Execution Profile e945a9bc83511e50:c6fd99ea00000000 Number of filters: 1 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- 0 6 4 REMOTE false 3 (3) N/A N/A true Backend startup latencies: Count: 3, min / max: 35ms / 82ms, 25th %-ile: 35ms, 50th %-ile: 58ms, 75th %-ile: 58ms, 90th %-ile: 82ms, 95th %-ile: 82ms, 99.9th %-ile: 82ms Slowest backend to start up: impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22002 Final filter table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- 0 6 4 REMOTE false 1 (3) 5s711ms N/A true Per Node Peak Memory Usage: impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22001(38.71 MB) impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22002(38.72 MB) impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22000(73.36 MB) Per Node Bytes Read: impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22001(9.20 KB) impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22002(9.20 KB) impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22000(20.19 KB) Per Node User Time: impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22001(5s749ms) impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22002(5s824ms) impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22000(5s910ms) Per Node System Time: impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22001(54.286ms) impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22002(57.519ms) impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22000(115.046ms) - ExchangeScanRatio: 0.01 (0.014170757629434688) - FiltersReceived: 2 (2) - FinalizationTimer: 0ns (0) - InactiveTotalTime: 0ns (0) - InnerNodeSelectivityRatio: 0.00 (0.0) - NumBackends: 3 (3) - NumCompletedBackends: 2 (2) - NumFragmentInstances: 11 (11) - NumFragments: 5 (5) - TotalBytesRead: 38.6 KiB (39518) - TotalBytesSent: 560 B (560) - TotalCpuTime: 17.71s (17711230000) - TotalInnerBytesSent: 0 B (0) - TotalScanBytesSent: 560 B (560) - TotalTime: 16.49s (16494401312) Per Node Profiles impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22001 - AdmissionSlots: 1 (1) - InactiveTotalTime: 0ns (0) - ScratchBytesRead: 0 B (0) - ScratchBytesWritten: 0 B (0) - ScratchFileUsedBytes: 0 B (0) - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0ns (0) - TotalReadBlockTime: 0ns (0) - TotalTime: 0ns (0) impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22002 - AdmissionSlots: 1 (1) - InactiveTotalTime: 0ns (0) - ScratchBytesRead: 0 B (0) - ScratchBytesWritten: 0 B (0) - ScratchFileUsedBytes: 0 B (0) - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0ns (0) - TotalReadBlockTime: 0ns (0) - TotalTime: 0ns (0) impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22000 - AdmissionSlots: 1 (1) - InactiveTotalTime: 0ns (0) - ScratchBytesRead: 0 B (0) - ScratchBytesWritten: 0 B (0) - ScratchFileUsedBytes: 0 B (0) - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0ns (0) - TotalReadBlockTime: 0ns (0) - TotalTime: 0ns (0) Averaged Fragment F07 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:18s865ms max:18s865ms mean: 18s865ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 (0.0) - BloomFilterBytes: 0 B (0) - ExchangeScanRatio: 0.00 (0.0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 24.3 KiB (24838) - PeakReservation: 0 B (0) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 73.4 MiB (76921438) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 5.28s (5279808362) - TotalNetworkSendTime: 0ns (0) - TotalStorageWaitTime: 0ns (0) - TotalThreadsInvoluntaryContextSwitches: 142 (142) - TotalThreadsTotalWallClockTime: 5.47s (5474801284) - TotalThreadsSysTime: 0ns (0) - TotalThreadsUserTime: 567ms (567340000) - TotalThreadsVoluntaryContextSwitches: 4 (4) - TotalTime: 5.49s (5494800558) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 0 B (0) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 0 B (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 0ns (0) - ExecTreeExecTime: 940ms (940965846) - InactiveTotalTime: 0ns (0) - OpenTime: 5.47s (5474801284) - ExecTreeOpenTime: 4.32s (4324843024) - PrepareTime: 18ms (18999310) - ExecTreePrepareTime: 13ms (13999492) - TotalTime: 0ns (0) PLAN_ROOT_SINK - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 0 B (0) - RowsSent: 10 (10) - RowsSentRate: 0 per second (0) - TotalTime: 0ns (0) EXCHANGE_NODE (id=11) - ConvertRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 24.0 KiB (24576) - RowsReturned: 16 (16) - RowsReturnedRate: 3 per second (3) - TotalTime: 5.26s (5265808870) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 48.0 KiB (49152) - CumulativeAllocations: 6 (6) - InactiveTotalTime: 0ns (0) - PeakReservation: 24.0 KiB (24576) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 24.0 KiB (24576) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Dequeue - FirstBatchWaitTime: 4.32s (4324843024) - InactiveTotalTime: 0ns (0) - TotalBytesDequeued: 400 B (400) - TotalGetBatchTime: 5.28s (5279808362) - DataWaitTime: 5.28s (5278808398) - TotalTime: 0ns (0) Enqueue - DeserializeRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 196 B (196) - TotalEarlySenders: 0 (0) - TotalEosReceived: 2 (2) - TotalHasDeferredRPCsTime: 0ns (0) - TotalRPCsDeferred: 0 (0) - TotalTime: 0ns (0) CodeGen - CodegenInvoluntaryContextSwitches: 142 (142) - CodegenTotalWallClockTime: 1.15s (1145958406) - CodegenSysTime: 0ns (0) - CodegenUserTime: 563ms (563214000) - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 50ms (50998149) - InactiveTotalTime: 0ns (0) - IrGenerationTime: 2ms (2999891) - LoadTime: 0ns (0) - ModuleBitcodeSize: 2.4 MiB (2560172) - NumFunctions: 2 (2) - NumInstructions: 36 (36) - OptimizationTime: 165ms (165993975) - PeakMemoryUsage: 18.0 KiB (18432) - PrepareTime: 883ms (883967915) - TotalTime: 1.15s (1145958406) Coordinator Fragment F07 Instance e945a9bc83511e50:c6fd99ea00000000 (host=impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22000) Last report received time: 2019-10-26 04:34:48.441 - AverageThreadTokens: 0.00 (0.0) - BloomFilterBytes: 0 B (0) - ExchangeScanRatio: 0.00 (0.0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 24.3 KiB (24838) - PeakReservation: 0 B (0) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 73.4 MiB (76921438) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 5.28s (5279808362) - TotalNetworkSendTime: 0ns (0) - TotalStorageWaitTime: 0ns (0) - TotalThreadsInvoluntaryContextSwitches: 142 (142) - TotalThreadsTotalWallClockTime: 5.47s (5474801284) - TotalThreadsSysTime: 0ns (0) - TotalThreadsUserTime: 567ms (567340000) - TotalThreadsVoluntaryContextSwitches: 4 (4) - TotalTime: 5.49s (5494800558) Fragment Instance Lifecycle Event Timeline Prepare Finished: 31ms (31998839) Open Finished: 5.51s (5506800123) First Batch Produced: 6.45s (6447765969) First Batch Sent: 6.45s (6447765969) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 0 B (0) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 0 B (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 0ns (0) - ExecTreeExecTime: 940ms (940965846) - InactiveTotalTime: 0ns (0) - OpenTime: 5.47s (5474801284) - ExecTreeOpenTime: 4.32s (4324843024) - PrepareTime: 18ms (18999310) - ExecTreePrepareTime: 13ms (13999492) - TotalTime: 0ns (0) PLAN_ROOT_SINK - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 0 B (0) - RowsSent: 10 (10) - RowsSentRate: 0 per second (0) - TotalTime: 0ns (0) EXCHANGE_NODE (id=11) - ConvertRowBatchTime: 0ns (0) - InactiveTotalTime: 5.28s (5278808398) - PeakMemoryUsage: 24.0 KiB (24576) - RowsReturned: 16 (16) - RowsReturnedRate: 3 per second (3) - TotalTime: 5.26s (5265808870) Node Lifecycle Event Timeline Open Started: 1.18s (1181957099) Open Finished: 5.51s (5506800123) First Batch Requested: 5.51s (5506800123) First Batch Returned: 6.45s (6447765969) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 48.0 KiB (49152) - CumulativeAllocations: 6 (6) - InactiveTotalTime: 0ns (0) - PeakReservation: 24.0 KiB (24576) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 24.0 KiB (24576) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Dequeue - FirstBatchWaitTime: 4.32s (4324843024) - InactiveTotalTime: 0ns (0) - TotalBytesDequeued: 400 B (400) - TotalGetBatchTime: 5.28s (5279808362) - DataWaitTime: 5.28s (5278808398) - TotalTime: 0ns (0) Enqueue - DeserializeRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 196 B (196) - TotalEarlySenders: 0 (0) - TotalEosReceived: 2 (2) - TotalHasDeferredRPCsTime: 0ns (0) - TotalRPCsDeferred: 0 (0) - TotalTime: 0ns (0) CodeGen - CodegenInvoluntaryContextSwitches: 142 (142) - CodegenTotalWallClockTime: 1.15s (1145958406) - CodegenSysTime: 0ns (0) - CodegenUserTime: 563ms (563214000) - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 50ms (50998149) - InactiveTotalTime: 0ns (0) - IrGenerationTime: 2ms (2999891) - LoadTime: 0ns (0) - ModuleBitcodeSize: 2.4 MiB (2560172) - NumFunctions: 2 (2) - NumInstructions: 36 (36) - OptimizationTime: 165ms (165993975) - PeakMemoryUsage: 18.0 KiB (18432) - PrepareTime: 883ms (883967915) - TotalTime: 1.15s (1145958406) Averaged Fragment F06 split sizes: min: 2.98 KB, max: 5.96 KB, avg: 3.97 KB, stddev: 1.40 KB completion times: min:5s523ms max:18s863ms mean: 10s284ms stddev:6s078ms execution rates: min:323.00 B/sec max:552.00 B/sec mean:448.67 B/sec stddev:94.27 B/sec num instances: 3 - AverageThreadTokens: 1.00 (1.0) - BloomFilterBytes: 682.7 KiB (699050) - ExchangeScanRatio: 0.02 (0.020668564800168723) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 24.4 MiB (25626491) - PeakReservation: 23.7 MiB (24816298) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 50.3 MiB (52703811) - RowsProduced: 5 (5) - TotalNetworkReceiveTime: 93ms (93329945) - TotalNetworkSendTime: 12ms (12666207) - TotalStorageWaitTime: 3ms (3666533) - TotalThreadsInvoluntaryContextSwitches: 391 (391) - TotalThreadsTotalWallClockTime: 3.96s (3956856380) - TotalThreadsSysTime: 21ms (21785666) - TotalThreadsUserTime: 2.59s (2588809666) - TotalThreadsVoluntaryContextSwitches: 10 (10) - TotalTime: 3.99s (3989521861) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 682.7 KiB (699050) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 1.0 MiB (1048576) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 682.7 KiB (699050) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 1.0 MiB (1048576) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 243ms (243491162) - ExecTreeExecTime: 222ms (222991906) - InactiveTotalTime: 0ns (0) - OpenTime: 3.77s (3772863058) - ExecTreeOpenTime: 2ms (2999891) - PrepareTime: 52ms (52998076) - ExecTreePrepareTime: 30ms (30665553) - TotalTime: 0ns (0) KrpcDataStreamSender (dst_id=11) - EosSent: 0 (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 7.5 KiB (7704) - RowsSent: 5 (5) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0ns (0) - TotalBytesSent: 65 B (65) - TotalTime: 27ms (27332341) - UncompressedRowBatchSize: 133 B (133) UNION_NODE (id=0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 5.4 KiB (5514) - RowsReturned: 5 (5) - RowsReturnedRate: 29 per second (29) - TotalTime: 181ms (181326751) AGGREGATION_NODE (id=8) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 22.7 MiB (23774687) - RowsReturned: 1 (1) - RowsReturnedRate: 73 per second (73) - TotalTime: 114ms (114995826) GroupingAggregator 0 - BuildTime: 999.96us (999963) - GetResultsTime: 333.32us (333321) - HTResizeTime: 0ns (0) - InactiveTotalTime: 0ns (0) - LargestPartitionPercent: 27 (27) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 10 (10) - PeakMemoryUsage: 22.7 MiB (23774687) - PeakReservation: 22.7 MiB (23767722) - PeakUsedReservation: 0 B (0) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - SpilledPartitions: 0 (0) - TotalTime: 0ns (0) Buffer pool - AllocTime: 999.96us (999963) - CumulativeAllocationBytes: 7.0 MiB (7340032) - CumulativeAllocations: 3 (3) - InactiveTotalTime: 0ns (0) - PeakReservation: 34.0 MiB (35651584) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 7.0 MiB (7340032) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 999.96us (999963) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Hash Table - HashBuckets: 1,706 (1706) - HashCollisions: 0 (0) - InactiveTotalTime: 0ns (0) - Probes: 1 (1) - Resizes: 0 (0) - TotalTime: 0ns (0) - Travel: 0 (0) EXCHANGE_NODE (id=7) - ConvertRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 16.0 KiB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 2 per second (2) - TotalTime: 93ms (93329945) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 16.0 KiB (16384) - CumulativeAllocations: 2 (2) - InactiveTotalTime: 0ns (0) - PeakReservation: 16.0 KiB (16384) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 16.0 KiB (16384) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Dequeue - FirstBatchWaitTime: 91ms (91330018) - InactiveTotalTime: 0ns (0) - TotalBytesDequeued: 41 B (41) - TotalGetBatchTime: 93ms (93329945) - DataWaitTime: 93ms (93329945) - TotalTime: 0ns (0) Enqueue - DeserializeRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 55 B (55) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0ns (0) - TotalRPCsDeferred: 0 (0) - TotalTime: 0ns (0) HASH_JOIN_NODE (id=6) - BuildRows: 2 (2) - BuildTime: 8ms (8666352) - InactiveTotalTime: 0ns (0) - LocalTime: 31ms (31998838) - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.3 MiB (1354820) - ProbeRows: 2 (2) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns (0) - RowsReturned: 2 (2) - RowsReturnedRate: 64 per second (64) - TotalTime: 31ms (31998838) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 256.0 KiB (262144) - CumulativeAllocations: 4 (4) - InactiveTotalTime: 0ns (0) - PeakReservation: 1.9 MiB (2031616) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 256.0 KiB (262144) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Hash Join Builder (join_node_id=6) - BuildRowsPartitionTime: 333.32us (333321) - BuildRowsPartitioned: 2 (2) - HashTablesBuildTime: 666.64us (666642) - InactiveTotalTime: 0ns (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 10 (10) - PeakMemoryUsage: 151 B (151) - RepartitionTime: 0ns (0) - SpilledPartitions: 0 (0) - TotalTime: 0ns (0) Hash Table - HashBuckets: 2 (2) - HashCollisions: 0 (0) - InactiveTotalTime: 0ns (0) - Probes: 4 (4) - Resizes: 0 (0) - TotalTime: 0ns (0) - Travel: 0 (0) EXCHANGE_NODE (id=10) - ConvertRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 32.0 KiB (32768) - RowsReturned: 2 (2) - RowsReturnedRate: 1333 per second (1333) - TotalTime: 333.32us (333321) Buffer pool - AllocTime: 666.64us (666642) - CumulativeAllocationBytes: 32.0 KiB (32768) - CumulativeAllocations: 4 (4) - InactiveTotalTime: 0ns (0) - PeakReservation: 32.0 KiB (32768) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 32.0 KiB (32768) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 333.32us (333321) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Dequeue - FirstBatchWaitTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBytesDequeued: 26 B (26) - TotalGetBatchTime: 0ns (0) - DataWaitTime: 0ns (0) - TotalTime: 0ns (0) Enqueue - DeserializeRowBatchTime: 999.96us (999964) - InactiveTotalTime: 0ns (0) - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 24 B (24) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0ns (0) - TotalRPCsDeferred: 0 (0) - TotalTime: 0ns (0) EXCHANGE_NODE (id=9) - ConvertRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 32.0 KiB (32768) - RowsReturned: 2 (2) - RowsReturnedRate: 0 per second (0) - TotalTime: 0ns (0) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 32.0 KiB (32768) - CumulativeAllocations: 4 (4) - InactiveTotalTime: 0ns (0) - PeakReservation: 32.0 KiB (32768) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 32.0 KiB (32768) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Dequeue - FirstBatchWaitTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBytesDequeued: 42 B (42) - TotalGetBatchTime: 0ns (0) - DataWaitTime: 0ns (0) - TotalTime: 0ns (0) Enqueue - DeserializeRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 41 B (41) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0ns (0) - TotalRPCsDeferred: 0 (0) - TotalTime: 0ns (0) HDFS_SCAN_NODE (id=1) - AverageHdfsReadThreadConcurrency: 0.00 (0.0) - AverageScannerThreadConcurrency: 0.00 (0.0) - BytesRead: 2.1 KiB (2107) - BytesReadDataNodeCache: 0 B (0) - BytesReadLocal: 3.1 KiB (3161) - BytesReadRemoteUnexpected: 0 B (0) - BytesReadShortCircuit: 3.1 KiB (3161) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 B (0) - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 B (0) - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0ns (0) - InactiveTotalTime: 0ns (0) - MaterializeTupleTime(*): 0ns (0) - MaxCompressedTextFileLength: 0 B (0) - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 2 (2) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 18.7 KiB (19184) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0 B/s (0) - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 2.7 KiB (2730) - RowBatchQueueGetWaitTime: 11ms (11666243) - RowBatchQueuePeakMemoryUsage: 2.8 KiB (2890) - RowBatchQueuePutWaitTime: 0ns (0) - RowBatchesEnqueued: 2 (2) - RowsRead: 1 (1) - RowsReturned: 1 (1) - RowsReturnedRate: 20 per second (20) - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 5ms (5499800) - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 11ms (11332922) - ScannerThreadsSysTime: 0ns (0) - ScannerThreadsUserTime: 4ms (4850333) - ScannerThreadsVoluntaryContextSwitches: 2 (2) - TotalRawHdfsOpenFileTime(*): 499.98us (499981) - TotalRawHdfsReadTime(*): 0ns (0) - TotalReadThroughput: 0 B/s (0) - TotalTime: 48ms (48664900) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 24.0 KiB (24576) - CumulativeAllocations: 3 (3) - InactiveTotalTime: 0ns (0) - PeakReservation: 16.0 KiB (16384) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 16.0 KiB (16384) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) CodeGen - CodegenInvoluntaryContextSwitches: 416 (416) - CodegenTotalWallClockTime: 4.20s (4195181063) - CodegenSysTime: 7ms (7265666) - CodegenUserTime: 2.75s (2755739333) - CodegenVoluntaryContextSwitches: 4 (4) - CompileTime: 127ms (127995354) - InactiveTotalTime: 0ns (0) - IrGenerationTime: 277ms (277323267) - LoadTime: 0ns (0) - ModuleBitcodeSize: 2.4 MiB (2560172) - NumFunctions: 101 (101) - NumInstructions: 4,052 (4052) - OptimizationTime: 2.97s (2972892094) - PeakMemoryUsage: 2.0 MiB (2074624) - PrepareTime: 805ms (805304103) - TotalTime: 4.20s (4195181063) Fragment F06 Instance e945a9bc83511e50:c6fd99ea00000008 (host=impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22002) Last report received time: 2019-10-26 04:34:39.084 Hdfs split stats (:<# splits>/): 2:1/2.98 KB - AverageThreadTokens: 1.00 (1.0) - BloomFilterBytes: 1.0 MiB (1048576) - ExchangeScanRatio: 0.03 (0.03321733628598545) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 35.1 MiB (36830990) - PeakReservation: 35.0 MiB (36700160) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 38.7 MiB (40603190) - RowsProduced: 8 (8) - TotalNetworkReceiveTime: 0ns (0) - TotalNetworkSendTime: 25ms (25999056) - TotalStorageWaitTime: 9ms (9999638) - TotalThreadsInvoluntaryContextSwitches: 641 (641) - TotalThreadsTotalWallClockTime: 6.41s (6407767421) - TotalThreadsSysTime: 31ms (31787000) - TotalThreadsUserTime: 3.87s (3873646000) - TotalThreadsVoluntaryContextSwitches: 21 (21) - TotalTime: 6.40s (6404767529) Fragment Instance Lifecycle Event Timeline Prepare Finished: 70ms (70997423) Open Finished: 6.32s (6321770542) First Batch Produced: 6.42s (6415767130) First Batch Sent: 6.42s (6415767130) ExecInternal Finished: 6.44s (6444766078) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 1.0 MiB (1048576) - CumulativeAllocations: 1 (1) - InactiveTotalTime: 0ns (0) - PeakReservation: 1.0 MiB (1048576) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 1.0 MiB (1048576) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 1.0 MiB (1048576) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 120ms (120995608) - ExecTreeExecTime: 93ms (93996588) - InactiveTotalTime: 0ns (0) - OpenTime: 6.25s (6250773119) - ExecTreeOpenTime: 2ms (2999891) - PrepareTime: 31ms (31998839) - ExecTreePrepareTime: 23ms (23999129) - TotalTime: 0ns (0) KrpcDataStreamSender (dst_id=11) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - EosSent: 1 (1) - InactiveTotalTime: 25ms (25999056) - PeakMemoryUsage: 7.5 KiB (7704) - RowsSent: 8 (8) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0ns (0) - TotalBytesSent: 105 B (105) - TotalTime: 26ms (26999020) - UncompressedRowBatchSize: 200 B (200) UNION_NODE (id=0) ExecOption: Codegen Enabled - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 8.1 KiB (8272) - RowsReturned: 8 (8) - RowsReturnedRate: 66 per second (66) - TotalTime: 120ms (120995608) Node Lifecycle Event Timeline Open Started: 6.32s (6318770651) Open Finished: 6.32s (6321770542) First Batch Requested: 6.32s (6321770542) First Batch Returned: 6.42s (6415767130) Last Batch Returned: 6.42s (6415767130) Closed: 6.44s (6443766114) AGGREGATION_NODE (id=8) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 34.0 MiB (35659914) - RowsReturned: 3 (3) - RowsReturnedRate: 214 per second (214) - TotalTime: 13ms (13999492) Node Lifecycle Event Timeline Open Started: 6.36s (6364768981) Open Finished: 6.37s (6374768619) First Batch Requested: 6.37s (6374768619) First Batch Returned: 6.37s (6374768619) Last Batch Returned: 6.38s (6375768582) Closed: 6.38s (6385768219) GroupingAggregator 0 ExecOption: Codegen Enabled - BuildTime: 999.96us (999963) - GetResultsTime: 999.96us (999963) - HTResizeTime: 0ns (0) - InactiveTotalTime: 0ns (0) - LargestPartitionPercent: 33 (33) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.0 MiB (35659914) - PeakReservation: 34.0 MiB (35651584) - PeakUsedReservation: 0 B (0) - RowsRepartitioned: 0 (0) - RowsReturned: 3 (3) - SpilledPartitions: 0 (0) - TotalTime: 0ns (0) Buffer pool - AllocTime: 999.96us (999963) - CumulativeAllocationBytes: 8.0 MiB (8388608) - CumulativeAllocations: 4 (4) - InactiveTotalTime: 0ns (0) - PeakReservation: 34.0 MiB (35651584) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 8.0 MiB (8388608) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 999.96us (999963) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Hash Table - HashBuckets: 3,072 (3072) - HashCollisions: 0 (0) - InactiveTotalTime: 0ns (0) - Probes: 3 (3) - Resizes: 0 (0) - TotalTime: 0ns (0) - Travel: 0 (0) EXCHANGE_NODE (id=7) - ConvertRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 16.0 KiB (16384) - RowsReturned: 3 (3) - RowsReturnedRate: 0 per second (0) - TotalTime: 0ns (0) Node Lifecycle Event Timeline Open Started: 6.36s (6364768981) Open Finished: 6.36s (6364768981) First Batch Requested: 6.37s (6370768764) First Batch Returned: 6.37s (6370768764) Last Batch Returned: 6.37s (6370768764) Closed: 6.37s (6371768727) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 16.0 KiB (16384) - CumulativeAllocations: 2 (2) - InactiveTotalTime: 0ns (0) - PeakReservation: 16.0 KiB (16384) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 16.0 KiB (16384) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Dequeue - FirstBatchWaitTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBytesDequeued: 75 B (75) - TotalGetBatchTime: 0ns (0) - DataWaitTime: 0ns (0) - TotalTime: 0ns (0) Enqueue - DeserializeRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 53 B (53) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0ns (0) - TotalRPCsDeferred: 0 (0) - TotalTime: 0ns (0) HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 12ms (12999528) - InactiveTotalTime: 0ns (0) - LocalTime: 61ms (61997750) - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.9 MiB (2032052) - ProbeRows: 2 (2) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns (0) - RowsReturned: 2 (2) - RowsReturnedRate: 32 per second (32) - TotalTime: 61ms (61997750) Node Lifecycle Event Timeline Open Started: 6.39s (6386768183) Open Finished: 6.41s (6414767167) First Batch Requested: 6.41s (6414767167) First Batch Returned: 6.41s (6414767167) Last Batch Returned: 6.41s (6414767167) Closed: 6.42s (6415767130) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 192.0 KiB (196608) - CumulativeAllocations: 3 (3) - InactiveTotalTime: 0ns (0) - PeakReservation: 1.9 MiB (2031616) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 192.0 KiB (196608) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0ns (0) - BuildRowsPartitioned: 2 (2) - HashTablesBuildTime: 0ns (0) - InactiveTotalTime: 0ns (0) - LargestPartitionPercent: 50 (50) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 178 B (178) - RepartitionTime: 0ns (0) - SpilledPartitions: 0 (0) - TotalTime: 0ns (0) Hash Table - HashBuckets: 2 (2) - HashCollisions: 0 (0) - InactiveTotalTime: 0ns (0) - Probes: 4 (4) - Resizes: 0 (0) - TotalTime: 0ns (0) - Travel: 0 (0) EXCHANGE_NODE (id=10) - ConvertRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 32.0 KiB (32768) - RowsReturned: 2 (2) - RowsReturnedRate: 0 per second (0) - TotalTime: 0ns (0) Node Lifecycle Event Timeline Open Started: 6.39s (6395767856) Open Finished: 6.39s (6395767856) First Batch Requested: 6.40s (6402767602) First Batch Returned: 6.40s (6402767602) Last Batch Returned: 6.40s (6402767602) Closed: 6.41s (6410767312) Buffer pool - AllocTime: 999.96us (999964) - CumulativeAllocationBytes: 32.0 KiB (32768) - CumulativeAllocations: 4 (4) - InactiveTotalTime: 0ns (0) - PeakReservation: 32.0 KiB (32768) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 32.0 KiB (32768) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Dequeue - FirstBatchWaitTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBytesDequeued: 26 B (26) - TotalGetBatchTime: 0ns (0) - DataWaitTime: 0ns (0) - TotalTime: 0ns (0) Enqueue - DeserializeRowBatchTime: 999.96us (999964) - InactiveTotalTime: 0ns (0) - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 18 B (18) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0ns (0) - TotalRPCsDeferred: 0 (0) - TotalTime: 0ns (0) EXCHANGE_NODE (id=9) - ConvertRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 32.0 KiB (32768) - RowsReturned: 2 (2) - RowsReturnedRate: 0 per second (0) - TotalTime: 0ns (0) Node Lifecycle Event Timeline Open Started: 6.40s (6397767784) Open Finished: 6.40s (6397767784) First Batch Requested: 6.41s (6414767167) First Batch Returned: 6.41s (6414767167) Last Batch Returned: 6.41s (6414767167) Closed: 6.42s (6415767130) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 32.0 KiB (32768) - CumulativeAllocations: 4 (4) - InactiveTotalTime: 0ns (0) - PeakReservation: 32.0 KiB (32768) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 32.0 KiB (32768) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Dequeue - FirstBatchWaitTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBytesDequeued: 42 B (42) - TotalGetBatchTime: 0ns (0) - DataWaitTime: 0ns (0) - TotalTime: 0ns (0) Enqueue - DeserializeRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 34 B (34) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0ns (0) - TotalRPCsDeferred: 0 (0) - TotalTime: 0ns (0) HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 2:1/2.98 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:1 - AverageHdfsReadThreadConcurrency: 0.00 (0.0) - AverageScannerThreadConcurrency: 0.00 (0.0) - BytesRead: 3.1 KiB (3161) - BytesReadDataNodeCache: 0 B (0) - BytesReadLocal: 3.1 KiB (3161) - BytesReadRemoteUnexpected: 0 B (0) - BytesReadShortCircuit: 3.1 KiB (3161) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 B (0) - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 B (0) - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0ns (0) - InactiveTotalTime: 0ns (0) - MaterializeTupleTime(*): 0ns (0) - MaxCompressedTextFileLength: 0 B (0) - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 2 (2) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 28.1 KiB (28776) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0 B/s (0) - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 4.0 KiB (4096) - RowBatchQueueGetWaitTime: 20ms (20999238) - RowBatchQueuePeakMemoryUsage: 4.2 KiB (4336) - RowBatchQueuePutWaitTime: 0ns (0) - RowBatchesEnqueued: 3 (3) - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 39 per second (39) - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 9ms (9999638) - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 20ms (20999238) - ScannerThreadsSysTime: 0ns (0) - ScannerThreadsUserTime: 7ms (7293000) - ScannerThreadsVoluntaryContextSwitches: 3 (3) - TotalRawHdfsOpenFileTime(*): 0ns (0) - TotalRawHdfsReadTime(*): 0ns (0) - TotalReadThroughput: 0 B/s (0) - TotalTime: 50ms (50998149) Node Lifecycle Event Timeline Open Started: 6.32s (6318770651) Open Finished: 6.32s (6321770542) First Batch Requested: 6.32s (6321770542) First Batch Returned: 6.36s (6363769018) Last Batch Returned: 6.36s (6363769018) Closed: 6.36s (6364768981) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 24.0 KiB (24576) - CumulativeAllocations: 3 (3) - InactiveTotalTime: 0ns (0) - PeakReservation: 16.0 KiB (16384) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 16.0 KiB (16384) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) CodeGen - CodegenInvoluntaryContextSwitches: 626 (626) - CodegenTotalWallClockTime: 6.25s (6246773264) - CodegenSysTime: 10ms (10908000) - CodegenUserTime: 3.83s (3833084000) - CodegenVoluntaryContextSwitches: 12 (12) - CompileTime: 199ms (199992741) - InactiveTotalTime: 0ns (0) - IrGenerationTime: 259ms (259990563) - LoadTime: 0ns (0) - ModuleBitcodeSize: 2.4 MiB (2560172) - NumFunctions: 101 (101) - NumInstructions: 4,052 (4052) - OptimizationTime: 4.95s (4952820230) - PeakMemoryUsage: 2.0 MiB (2074624) - PrepareTime: 815ms (815970383) - TotalTime: 6.25s (6246773264) Instance e945a9bc83511e50:c6fd99ea00000009 (host=impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22001) Last report received time: 2019-10-26 04:34:38.087 Hdfs split stats (:<# splits>/): 0:1/2.98 KB - AverageThreadTokens: 1.00 (1.0) - BloomFilterBytes: 1.0 MiB (1048576) - ExchangeScanRatio: 0.03 (0.028788358114520723) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 35.1 MiB (36830990) - PeakReservation: 35.0 MiB (36700160) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 38.7 MiB (40586806) - RowsProduced: 8 (8) - TotalNetworkReceiveTime: 279ms (279989837) - TotalNetworkSendTime: 11ms (11999565) - TotalStorageWaitTime: 999.96us (999963) - TotalThreadsInvoluntaryContextSwitches: 534 (534) - TotalThreadsTotalWallClockTime: 5.46s (5462801719) - TotalThreadsSysTime: 33ms (33570000) - TotalThreadsUserTime: 3.89s (3892783000) - TotalThreadsVoluntaryContextSwitches: 9 (9) - TotalTime: 5.46s (5464801647) Fragment Instance Lifecycle Event Timeline Prepare Finished: 32ms (32998802) Open Finished: 5.10s (5100814858) First Batch Produced: 5.45s (5452802082) First Batch Sent: 5.45s (5453802046) ExecInternal Finished: 5.47s (5468801502) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 1.0 MiB (1048576) - CumulativeAllocations: 1 (1) - InactiveTotalTime: 0ns (0) - PeakReservation: 1.0 MiB (1048576) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 1.0 MiB (1048576) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 1.0 MiB (1048576) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 365ms (365986716) - ExecTreeExecTime: 351ms (351987224) - InactiveTotalTime: 0ns (0) - OpenTime: 5.07s (5067816056) - ExecTreeOpenTime: 2ms (2999891) - PrepareTime: 29ms (29998911) - ExecTreePrepareTime: 21ms (21999202) - TotalTime: 0ns (0) KrpcDataStreamSender (dst_id=11) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - EosSent: 1 (1) - InactiveTotalTime: 11ms (11999565) - PeakMemoryUsage: 7.5 KiB (7704) - RowsSent: 8 (8) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0ns (0) - TotalBytesSent: 91 B (91) - TotalTime: 14ms (14999456) - UncompressedRowBatchSize: 200 B (200) UNION_NODE (id=0) ExecOption: Codegen Enabled - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 8.1 KiB (8272) - RowsReturned: 8 (8) - RowsReturnedRate: 21 per second (21) - TotalTime: 376ms (376986317) Node Lifecycle Event Timeline Open Started: 5.10s (5097814967) Open Finished: 5.10s (5100814858) First Batch Requested: 5.10s (5100814858) First Batch Returned: 5.45s (5452802082) Last Batch Returned: 5.45s (5452802082) Closed: 5.47s (5467801538) AGGREGATION_NODE (id=8) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 34.0 MiB (35659914) - RowsReturned: 2 (2) - RowsReturnedRate: 6 per second (6) - TotalTime: 294ms (294989294) Node Lifecycle Event Timeline Open Started: 5.14s (5140813406) Open Finished: 5.43s (5431802844) First Batch Requested: 5.43s (5431802844) First Batch Returned: 5.43s (5431802844) Last Batch Returned: 5.43s (5433802772) Closed: 5.43s (5433802772) GroupingAggregator 0 ExecOption: Codegen Enabled - BuildTime: 1ms (1999927) - GetResultsTime: 0ns (0) - HTResizeTime: 0ns (0) - InactiveTotalTime: 0ns (0) - LargestPartitionPercent: 50 (50) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.0 MiB (35659914) - PeakReservation: 34.0 MiB (35651584) - PeakUsedReservation: 0 B (0) - RowsRepartitioned: 0 (0) - RowsReturned: 2 (2) - SpilledPartitions: 0 (0) - TotalTime: 0ns (0) Buffer pool - AllocTime: 999.96us (999963) - CumulativeAllocationBytes: 6.0 MiB (6291456) - CumulativeAllocations: 3 (3) - InactiveTotalTime: 0ns (0) - PeakReservation: 34.0 MiB (35651584) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 6.0 MiB (6291456) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 999.96us (999963) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Hash Table - HashBuckets: 2,048 (2048) - HashCollisions: 0 (0) - InactiveTotalTime: 0ns (0) - Probes: 2 (2) - Resizes: 0 (0) - TotalTime: 0ns (0) - Travel: 0 (0) EXCHANGE_NODE (id=7) - ConvertRowBatchTime: 0ns (0) - InactiveTotalTime: 279ms (279989837) - PeakMemoryUsage: 16.0 KiB (16384) - RowsReturned: 2 (2) - RowsReturnedRate: 7 per second (7) - TotalTime: 279ms (279989837) Node Lifecycle Event Timeline Open Started: 5.14s (5140813406) Open Finished: 5.41s (5414803461) First Batch Requested: 5.42s (5420803244) First Batch Returned: 5.43s (5426803026) Last Batch Returned: 5.43s (5426803026) Closed: 5.43s (5428802953) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 16.0 KiB (16384) - CumulativeAllocations: 2 (2) - InactiveTotalTime: 0ns (0) - PeakReservation: 16.0 KiB (16384) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 16.0 KiB (16384) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Dequeue - FirstBatchWaitTime: 273ms (273990055) - InactiveTotalTime: 0ns (0) - TotalBytesDequeued: 50 B (50) - TotalGetBatchTime: 279ms (279989837) - DataWaitTime: 279ms (279989837) - TotalTime: 0ns (0) Enqueue - DeserializeRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 36 B (36) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0ns (0) - TotalRPCsDeferred: 0 (0) - TotalTime: 0ns (0) HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 4 (4) - BuildTime: 12ms (12999528) - InactiveTotalTime: 0ns (0) - LocalTime: 24ms (24999092) - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.9 MiB (2032052) - ProbeRows: 4 (4) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns (0) - RowsReturned: 4 (4) - RowsReturnedRate: 160 per second (160) - TotalTime: 24ms (24999092) Node Lifecycle Event Timeline Open Started: 5.43s (5433802772) Open Finished: 5.45s (5451802119) First Batch Requested: 5.45s (5451802119) First Batch Returned: 5.45s (5452802082) Last Batch Returned: 5.45s (5452802082) Closed: 5.45s (5452802082) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 320.0 KiB (327680) - CumulativeAllocations: 5 (5) - InactiveTotalTime: 0ns (0) - PeakReservation: 1.9 MiB (2031616) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 320.0 KiB (327680) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 999.96us (999964) - BuildRowsPartitioned: 4 (4) - HashTablesBuildTime: 1ms (1999927) - InactiveTotalTime: 0ns (0) - LargestPartitionPercent: 25 (25) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 178 B (178) - RepartitionTime: 0ns (0) - SpilledPartitions: 0 (0) - TotalTime: 0ns (0) Hash Table - HashBuckets: 4 (4) - HashCollisions: 0 (0) - InactiveTotalTime: 0ns (0) - Probes: 8 (8) - Resizes: 0 (0) - TotalTime: 0ns (0) - Travel: 0 (0) EXCHANGE_NODE (id=10) - ConvertRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 32.0 KiB (32768) - RowsReturned: 4 (4) - RowsReturnedRate: 4000 per second (4000) - TotalTime: 999.96us (999964) Node Lifecycle Event Timeline Open Started: 5.43s (5434802736) Open Finished: 5.43s (5434802736) First Batch Requested: 5.44s (5441802481) First Batch Returned: 5.44s (5442802445) Last Batch Returned: 5.44s (5442802445) Closed: 5.45s (5450802155) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 32.0 KiB (32768) - CumulativeAllocations: 4 (4) - InactiveTotalTime: 0ns (0) - PeakReservation: 32.0 KiB (32768) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 32.0 KiB (32768) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Dequeue - FirstBatchWaitTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBytesDequeued: 52 B (52) - TotalGetBatchTime: 0ns (0) - DataWaitTime: 0ns (0) - TotalTime: 0ns (0) Enqueue - DeserializeRowBatchTime: 999.96us (999964) - InactiveTotalTime: 0ns (0) - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 36 B (36) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0ns (0) - TotalRPCsDeferred: 0 (0) - TotalTime: 0ns (0) EXCHANGE_NODE (id=9) - ConvertRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 32.0 KiB (32768) - RowsReturned: 4 (4) - RowsReturnedRate: 0 per second (0) - TotalTime: 0ns (0) Node Lifecycle Event Timeline Open Started: 5.45s (5449802191) Open Finished: 5.45s (5449802191) First Batch Requested: 5.45s (5451802119) First Batch Returned: 5.45s (5451802119) Last Batch Returned: 5.45s (5451802119) Closed: 5.45s (5452802082) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 32.0 KiB (32768) - CumulativeAllocations: 4 (4) - InactiveTotalTime: 0ns (0) - PeakReservation: 32.0 KiB (32768) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 32.0 KiB (32768) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Dequeue - FirstBatchWaitTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBytesDequeued: 84 B (84) - TotalGetBatchTime: 0ns (0) - DataWaitTime: 0ns (0) - TotalTime: 0ns (0) Enqueue - DeserializeRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 57 B (57) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0ns (0) - TotalRPCsDeferred: 0 (0) - TotalTime: 0ns (0) HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 0:1/2.98 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:1 - AverageHdfsReadThreadConcurrency: 0.00 (0.0) - AverageScannerThreadConcurrency: 0.00 (0.0) - BytesRead: 3.1 KiB (3161) - BytesReadDataNodeCache: 0 B (0) - BytesReadLocal: 3.1 KiB (3161) - BytesReadRemoteUnexpected: 0 B (0) - BytesReadShortCircuit: 3.1 KiB (3161) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 B (0) - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 B (0) - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0ns (0) - InactiveTotalTime: 0ns (0) - MaterializeTupleTime(*): 0ns (0) - MaxCompressedTextFileLength: 0 B (0) - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 2 (2) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 28.1 KiB (28776) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0 B/s (0) - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 4.0 KiB (4096) - RowBatchQueueGetWaitTime: 13ms (13999492) - RowBatchQueuePeakMemoryUsage: 4.2 KiB (4336) - RowBatchQueuePutWaitTime: 0ns (0) - RowBatchesEnqueued: 3 (3) - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 22 per second (22) - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 999.96us (999963) - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 12ms (12999528) - ScannerThreadsSysTime: 0ns (0) - ScannerThreadsUserTime: 7ms (7258000) - ScannerThreadsVoluntaryContextSwitches: 3 (3) - TotalRawHdfsOpenFileTime(*): 999.96us (999963) - TotalRawHdfsReadTime(*): 0ns (0) - TotalReadThroughput: 0 B/s (0) - TotalTime: 86ms (86996843) Node Lifecycle Event Timeline Open Started: 5.10s (5097814967) Open Finished: 5.10s (5100814858) First Batch Requested: 5.10s (5100814858) First Batch Returned: 5.14s (5139813443) Last Batch Returned: 5.14s (5139813443) Closed: 5.14s (5140813406) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 24.0 KiB (24576) - CumulativeAllocations: 3 (3) - InactiveTotalTime: 0ns (0) - PeakReservation: 16.0 KiB (16384) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 16.0 KiB (16384) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) CodeGen - CodegenInvoluntaryContextSwitches: 505 (505) - CodegenTotalWallClockTime: 5.06s (5063816201) - CodegenSysTime: 9ms (9892000) - CodegenUserTime: 3.85s (3850508000) - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 183ms (183993322) - InactiveTotalTime: 0ns (0) - IrGenerationTime: 241ms (241991216) - LoadTime: 0ns (0) - ModuleBitcodeSize: 2.4 MiB (2560172) - NumFunctions: 101 (101) - NumInstructions: 4,052 (4052) - OptimizationTime: 3.96s (3965856053) - PeakMemoryUsage: 2.0 MiB (2074624) - PrepareTime: 654ms (654976227) - TotalTime: 5.06s (5063816201) Instance e945a9bc83511e50:c6fd99ea0000000a (host=impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22000) Last report received time: 2019-10-26 04:34:48.439 Hdfs split stats (:<# splits>/): 2:1/2.98 KB 1:1/2.98 KB - AverageThreadTokens: 1.00 (1.0) - BloomFilterBytes: 0 B (0) - ExchangeScanRatio: 0.00 (0.0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 3.1 MiB (3217494) - PeakReservation: 1.0 MiB (1048576) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 73.4 MiB (76921438) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0ns (0) - TotalNetworkSendTime: 0ns (0) - TotalStorageWaitTime: 0ns (0) - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0ns (0) - TotalThreadsSysTime: 0ns (0) - TotalThreadsUserTime: 0ns (0) - TotalThreadsVoluntaryContextSwitches: 0 (0) - TotalTime: 98ms (98996407) Fragment Instance Lifecycle Event Timeline Prepare Finished: 146ms (146994665) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 1.0 MiB (1048576) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 1.0 MiB (1048576) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - InactiveTotalTime: 0ns (0) - OpenTime: 0ns (0) - PrepareTime: 96ms (96996479) - ExecTreePrepareTime: 45ms (45998330) - TotalTime: 0ns (0) KrpcDataStreamSender (dst_id=11) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - EosSent: 0 (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 7.5 KiB (7704) - RowsSent: 0 (0) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0ns (0) - TotalBytesSent: 0 B (0) - TotalTime: 39ms (39998548) - UncompressedRowBatchSize: 0 B (0) UNION_NODE (id=0) ExecOption: Codegen Enabled - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 0 B (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 per second (0) - TotalTime: 45ms (45998330) Node Lifecycle Event Timeline AGGREGATION_NODE (id=8) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 4.1 KiB (4234) - RowsReturned: 0 (0) - RowsReturnedRate: 0 per second (0) - TotalTime: 35ms (35998693) Node Lifecycle Event Timeline GroupingAggregator 0 ExecOption: Codegen Enabled - BuildTime: 0ns (0) - GetResultsTime: 0ns (0) - HTResizeTime: 0ns (0) - InactiveTotalTime: 0ns (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 4.1 KiB (4234) - PeakReservation: 0 B (0) - PeakUsedReservation: 0 B (0) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - SpilledPartitions: 0 (0) - TotalTime: 0ns (0) Hash Table - HashBuckets: 0 (0) - HashCollisions: 0 (0) - InactiveTotalTime: 0ns (0) - Probes: 0 (0) - Resizes: 0 (0) - TotalTime: 0ns (0) - Travel: 0 (0) EXCHANGE_NODE (id=7) - ConvertRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 16.0 KiB (16384) - RowsReturned: 0 (0) - RowsReturnedRate: 0 per second (0) - TotalTime: 0ns (0) Node Lifecycle Event Timeline Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 16.0 KiB (16384) - CumulativeAllocations: 2 (2) - InactiveTotalTime: 0ns (0) - PeakReservation: 16.0 KiB (16384) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 16.0 KiB (16384) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Dequeue - FirstBatchWaitTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBytesDequeued: 0 B (0) - TotalGetBatchTime: 0ns (0) - DataWaitTime: 0ns (0) - TotalTime: 0ns (0) Enqueue - DeserializeRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 78 B (78) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0ns (0) - TotalRPCsDeferred: 0 (0) - TotalTime: 0ns (0) HASH_JOIN_NODE (id=6) ExecOption: Probe Side Codegen Enabled - BuildRows: 0 (0) - BuildTime: 0ns (0) - InactiveTotalTime: 0ns (0) - LocalTime: 8ms (8999674) - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 356 B (356) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0ns (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 per second (0) - TotalTime: 8ms (8999674) Node Lifecycle Event Timeline Hash Join Builder (join_node_id=6) ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0ns (0) - BuildRowsPartitioned: 0 (0) - HashTablesBuildTime: 0ns (0) - InactiveTotalTime: 0ns (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 98 B (98) - RepartitionTime: 0ns (0) - SpilledPartitions: 0 (0) - TotalTime: 0ns (0) Hash Table - HashBuckets: 0 (0) - HashCollisions: 0 (0) - InactiveTotalTime: 0ns (0) - Probes: 0 (0) - Resizes: 0 (0) - TotalTime: 0ns (0) - Travel: 0 (0) EXCHANGE_NODE (id=10) - ConvertRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 32.0 KiB (32768) - RowsReturned: 0 (0) - RowsReturnedRate: 0 per second (0) - TotalTime: 0ns (0) Node Lifecycle Event Timeline Buffer pool - AllocTime: 999.96us (999964) - CumulativeAllocationBytes: 32.0 KiB (32768) - CumulativeAllocations: 4 (4) - InactiveTotalTime: 0ns (0) - PeakReservation: 32.0 KiB (32768) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 32.0 KiB (32768) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 999.96us (999964) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Dequeue - FirstBatchWaitTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBytesDequeued: 0 B (0) - TotalGetBatchTime: 0ns (0) - DataWaitTime: 0ns (0) - TotalTime: 0ns (0) Enqueue - DeserializeRowBatchTime: 999.96us (999964) - InactiveTotalTime: 0ns (0) - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 18 B (18) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0ns (0) - TotalRPCsDeferred: 0 (0) - TotalTime: 0ns (0) EXCHANGE_NODE (id=9) - ConvertRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 32.0 KiB (32768) - RowsReturned: 0 (0) - RowsReturnedRate: 0 per second (0) - TotalTime: 0ns (0) Node Lifecycle Event Timeline Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 32.0 KiB (32768) - CumulativeAllocations: 4 (4) - InactiveTotalTime: 0ns (0) - PeakReservation: 32.0 KiB (32768) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 32.0 KiB (32768) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Dequeue - FirstBatchWaitTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBytesDequeued: 0 B (0) - TotalGetBatchTime: 0ns (0) - DataWaitTime: 0ns (0) - TotalTime: 0ns (0) Enqueue - DeserializeRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 34 B (34) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0ns (0) - TotalRPCsDeferred: 0 (0) - TotalTime: 0ns (0) HDFS_SCAN_NODE (id=1) Hdfs split stats (:<# splits>/): 2:1/2.98 KB 1:1/2.98 KB ExecOption: PARQUET Codegen Enabled - BytesRead: 0 B (0) - InactiveTotalTime: 0ns (0) - MaterializeTupleTime(*): 0ns (0) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 0 (0) - PeakMemoryUsage: 0 B (0) - RowBatchBytesEnqueued: 0 B (0) - RowBatchQueueGetWaitTime: 0ns (0) - RowBatchQueuePeakMemoryUsage: 0 B (0) - RowBatchQueuePutWaitTime: 0ns (0) - RowBatchesEnqueued: 0 (0) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 per second (0) - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0ns (0) - ScannerThreadsSysTime: 0ns (0) - ScannerThreadsUserTime: 0ns (0) - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalReadThroughput: 0 B/s (0) - TotalTime: 7ms (7999710) Node Lifecycle Event Timeline CodeGen - CodegenInvoluntaryContextSwitches: 118 (118) - CodegenTotalWallClockTime: 1.27s (1274953724) - CodegenSysTime: 997.00us (997000) - CodegenUserTime: 583ms (583626000) - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 0ns (0) - InactiveTotalTime: 0ns (0) - IrGenerationTime: 329ms (329988023) - LoadTime: 0ns (0) - ModuleBitcodeSize: 2.4 MiB (2560172) - NumFunctions: 101 (101) - NumInstructions: 4,052 (4052) - OptimizationTime: 0ns (0) - PeakMemoryUsage: 2.0 MiB (2074624) - PrepareTime: 944ms (944965701) - TotalTime: 1.27s (1274953724) Averaged Fragment F01 split sizes: min: 7.71 KB, max: 7.71 KB, avg: 7.71 KB, stddev: 0 completion times: min:10s599ms max:10s599ms mean: 10s599ms stddev:0.000ns execution rates: min:744.00 B/sec max:744.00 B/sec mean:744.00 B/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.10 (1.1) - BloomFilterBytes: 0 B (0) - ExchangeScanRatio: 0.02 (0.02050589390962672) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 34.2 MiB (35834845) - PeakReservation: 34.0 MiB (35667968) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 73.4 MiB (76921438) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 0ns (0) - TotalNetworkSendTime: 73ms (73997313) - TotalStorageWaitTime: 13ms (13999492) - TotalThreadsInvoluntaryContextSwitches: 582 (582) - TotalThreadsTotalWallClockTime: 5.36s (5363805313) - TotalThreadsSysTime: 24ms (24633000) - TotalThreadsUserTime: 2.51s (2507464000) - TotalThreadsVoluntaryContextSwitches: 46 (46) - TotalTime: 5.37s (5367805167) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 0 B (0) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 0 B (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 472ms (472982832) - ExecTreeExecTime: 377ms (377986280) - InactiveTotalTime: 0ns (0) - OpenTime: 4.86s (4859823606) - ExecTreeOpenTime: 54ms (54998004) - PrepareTime: 32ms (32998802) - ExecTreePrepareTime: 22ms (22999165) - TotalTime: 0ns (0) KrpcDataStreamSender (dst_id=7) - EosSent: 3 (3) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 34.6 KiB (35400) - RowsSent: 10 (10) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0ns (0) - TotalBytesSent: 167 B (167) - TotalTime: 79ms (79997096) - UncompressedRowBatchSize: 250 B (250) AGGREGATION_NODE (id=3) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 34.0 MiB (35659994) - RowsReturned: 10 (10) - RowsReturnedRate: 21 per second (21) - TotalTime: 455ms (455983449) GroupingAggregator 0 - BuildTime: 0ns (0) - GetResultsTime: 6ms (6999746) - HTResizeTime: 0ns (0) - InactiveTotalTime: 0ns (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.0 MiB (35655818) - PeakReservation: 34.0 MiB (35651584) - PeakUsedReservation: 0 B (0) - ReductionFactorEstimate: 0.00 (0.0) - ReductionFactorThresholdToExpand: 0.00 (0.0) - RowsPassedThrough: 0 (0) - RowsReturned: 10 (10) - StreamingTime: 196ms (196992850) - TotalTime: 0ns (0) Buffer pool - AllocTime: 196ms (196992851) - CumulativeAllocationBytes: 22.0 MiB (23068672) - CumulativeAllocations: 11 (11) - InactiveTotalTime: 0ns (0) - PeakReservation: 34.0 MiB (35651584) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 22.0 MiB (23068672) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 196ms (196992851) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Hash Table - HashBuckets: 10,240 (10240) - HashCollisions: 0 (0) - InactiveTotalTime: 0ns (0) - Probes: 280 (280) - Resizes: 0 (0) - TotalTime: 0ns (0) - Travel: 0 (0) HDFS_SCAN_NODE (id=2) - AverageHdfsReadThreadConcurrency: 0.00 (0.0) - AverageScannerThreadConcurrency: 0.00 (0.0) - BytesRead: 8.0 KiB (8144) - BytesReadDataNodeCache: 0 B (0) - BytesReadLocal: 8.0 KiB (8144) - BytesReadRemoteUnexpected: 0 B (0) - BytesReadShortCircuit: 8.0 KiB (8144) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 B (0) - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 B (0) - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0ns (0) - InactiveTotalTime: 0ns (0) - MaterializeTupleTime(*): 1ms (1999927) - MaxCompressedTextFileLength: 0 B (0) - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 2 (2) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 142.3 KiB (145720) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0 B/s (0) - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 116.0 KiB (118784) - RowBatchQueueGetWaitTime: 27ms (27998984) - RowBatchQueuePeakMemoryUsage: 114.3 KiB (117088) - RowBatchQueuePutWaitTime: 0ns (0) - RowBatchesEnqueued: 31 (31) - RowsRead: 280 (280) - RowsReturned: 280 (280) - RowsReturnedRate: 1728 per second (1728) - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 13ms (13999492) - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 30ms (30998875) - ScannerThreadsSysTime: 0ns (0) - ScannerThreadsUserTime: 12ms (12362000) - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsOpenFileTime(*): 0ns (0) - TotalRawHdfsReadTime(*): 0ns (0) - TotalReadThroughput: 0 B/s (0) - TotalTime: 161ms (161994121) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 24.0 KiB (24576) - CumulativeAllocations: 3 (3) - InactiveTotalTime: 0ns (0) - PeakReservation: 16.0 KiB (16384) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 16.0 KiB (16384) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) CodeGen - CodegenInvoluntaryContextSwitches: 555 (555) - CodegenTotalWallClockTime: 4.80s (4801825710) - CodegenSysTime: 1ms (1975000) - CodegenUserTime: 2.44s (2443094000) - CodegenVoluntaryContextSwitches: 14 (14) - CompileTime: 312ms (312988640) - InactiveTotalTime: 0ns (0) - IrGenerationTime: 156ms (156994301) - LoadTime: 0ns (0) - ModuleBitcodeSize: 2.4 MiB (2560172) - NumFunctions: 51 (51) - NumInstructions: 1,216 (1216) - OptimizationTime: 3.35s (3345878557) - PeakMemoryUsage: 608.0 KiB (622592) - PrepareTime: 974ms (974964612) - TotalTime: 4.80s (4801825710) Fragment F01 Instance e945a9bc83511e50:c6fd99ea00000001 (host=impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22000) Last report received time: 2019-10-26 04:34:43.194 Hdfs split stats (:<# splits>/): 0:1/7.71 KB - AverageThreadTokens: 1.10 (1.1) - BloomFilterBytes: 0 B (0) - ExchangeScanRatio: 0.02 (0.02050589390962672) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 34.2 MiB (35834845) - PeakReservation: 34.0 MiB (35667968) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 73.4 MiB (76921438) - RowsProduced: 10 (10) - TotalNetworkReceiveTime: 0ns (0) - TotalNetworkSendTime: 73ms (73997313) - TotalStorageWaitTime: 13ms (13999492) - TotalThreadsInvoluntaryContextSwitches: 582 (582) - TotalThreadsTotalWallClockTime: 5.36s (5363805313) - TotalThreadsSysTime: 24ms (24633000) - TotalThreadsUserTime: 2.51s (2507464000) - TotalThreadsVoluntaryContextSwitches: 46 (46) - TotalTime: 5.37s (5367805167) Fragment Instance Lifecycle Event Timeline Prepare Finished: 87ms (87996806) Open Finished: 4.95s (4947820412) First Batch Produced: 5.30s (5298807672) First Batch Sent: 5.30s (5298807672) ExecInternal Finished: 5.46s (5457801901) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 0 B (0) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 0 B (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 472ms (472982832) - ExecTreeExecTime: 377ms (377986280) - InactiveTotalTime: 0ns (0) - OpenTime: 4.86s (4859823606) - ExecTreeOpenTime: 54ms (54998004) - PrepareTime: 32ms (32998802) - ExecTreePrepareTime: 22ms (22999165) - TotalTime: 0ns (0) KrpcDataStreamSender (dst_id=7) ExecOption: Hash Partitioned Sender Codegen Enabled - EosSent: 3 (3) - InactiveTotalTime: 73ms (73997313) - PeakMemoryUsage: 34.6 KiB (35400) - RowsSent: 10 (10) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0ns (0) - TotalBytesSent: 167 B (167) - TotalTime: 79ms (79997096) - UncompressedRowBatchSize: 250 B (250) AGGREGATION_NODE (id=3) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 34.0 MiB (35659994) - RowsReturned: 10 (10) - RowsReturnedRate: 21 per second (21) - TotalTime: 455ms (455983449) Node Lifecycle Event Timeline Open Started: 4.89s (4892822408) Open Finished: 4.95s (4947820412) First Batch Requested: 4.95s (4947820412) First Batch Returned: 5.30s (5298807672) Last Batch Returned: 5.34s (5343806039) Closed: 5.42s (5422803172) GroupingAggregator 0 ExecOption: Streaming Preaggregation, Codegen Enabled - BuildTime: 0ns (0) - GetResultsTime: 6ms (6999746) - HTResizeTime: 0ns (0) - InactiveTotalTime: 0ns (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.0 MiB (35655818) - PeakReservation: 34.0 MiB (35651584) - PeakUsedReservation: 0 B (0) - ReductionFactorEstimate: 0.00 (0.0) - ReductionFactorThresholdToExpand: 0.00 (0.0) - RowsPassedThrough: 0 (0) - RowsReturned: 10 (10) - StreamingTime: 196ms (196992850) - TotalTime: 0ns (0) Buffer pool - AllocTime: 196ms (196992851) - CumulativeAllocationBytes: 22.0 MiB (23068672) - CumulativeAllocations: 11 (11) - InactiveTotalTime: 0ns (0) - PeakReservation: 34.0 MiB (35651584) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 22.0 MiB (23068672) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 196ms (196992851) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Hash Table - HashBuckets: 10,240 (10240) - HashCollisions: 0 (0) - InactiveTotalTime: 0ns (0) - Probes: 280 (280) - Resizes: 0 (0) - TotalTime: 0ns (0) - Travel: 0 (0) HDFS_SCAN_NODE (id=2) Hdfs split stats (:<# splits>/): 0:1/7.71 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:1 - AverageHdfsReadThreadConcurrency: 0.00 (0.0) - AverageScannerThreadConcurrency: 0.00 (0.0) - BytesRead: 8.0 KiB (8144) - BytesReadDataNodeCache: 0 B (0) - BytesReadLocal: 8.0 KiB (8144) - BytesReadRemoteUnexpected: 0 B (0) - BytesReadShortCircuit: 8.0 KiB (8144) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 B (0) - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 B (0) - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0ns (0) - InactiveTotalTime: 0ns (0) - MaterializeTupleTime(*): 1ms (1999927) - MaxCompressedTextFileLength: 0 B (0) - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 2 (2) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 142.3 KiB (145720) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0 B/s (0) - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 116.0 KiB (118784) - RowBatchQueueGetWaitTime: 27ms (27998984) - RowBatchQueuePeakMemoryUsage: 114.3 KiB (117088) - RowBatchQueuePutWaitTime: 0ns (0) - RowBatchesEnqueued: 31 (31) - RowsRead: 280 (280) - RowsReturned: 280 (280) - RowsReturnedRate: 1728 per second (1728) - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 13ms (13999492) - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 30ms (30998875) - ScannerThreadsSysTime: 0ns (0) - ScannerThreadsUserTime: 12ms (12362000) - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsOpenFileTime(*): 0ns (0) - TotalRawHdfsReadTime(*): 0ns (0) - TotalReadThroughput: 0 B/s (0) - TotalTime: 161ms (161994121) Node Lifecycle Event Timeline Open Started: 4.89s (4892822408) Open Finished: 4.90s (4897822227) First Batch Requested: 4.95s (4947820412) First Batch Returned: 5.09s (5093815113) Last Batch Returned: 5.29s (5294807817) Closed: 5.29s (5294807817) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 24.0 KiB (24576) - CumulativeAllocations: 3 (3) - InactiveTotalTime: 0ns (0) - PeakReservation: 16.0 KiB (16384) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 16.0 KiB (16384) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) CodeGen - CodegenInvoluntaryContextSwitches: 555 (555) - CodegenTotalWallClockTime: 4.80s (4801825710) - CodegenSysTime: 1ms (1975000) - CodegenUserTime: 2.44s (2443094000) - CodegenVoluntaryContextSwitches: 14 (14) - CompileTime: 312ms (312988640) - InactiveTotalTime: 0ns (0) - IrGenerationTime: 156ms (156994301) - LoadTime: 0ns (0) - ModuleBitcodeSize: 2.4 MiB (2560172) - NumFunctions: 51 (51) - NumInstructions: 1,216 (1216) - OptimizationTime: 3.35s (3345878557) - PeakMemoryUsage: 608.0 KiB (622592) - PrepareTime: 974ms (974964612) - TotalTime: 4.80s (4801825710) Averaged Fragment F03 split sizes: min: 2.98 KB, max: 5.96 KB, avg: 3.97 KB, stddev: 1.40 KB completion times: min:5s105ms max:5s352ms mean: 5s251ms stddev:105.454ms execution rates: min:569.00 B/sec max:1.12 KB/sec mean:772.67 B/sec stddev:268.76 B/sec num instances: 3 - AverageThreadTokens: 1.11 (1.111111111111111) - BloomFilterBytes: 0 B (0) - ExchangeScanRatio: 0.01 (0.010176104608246335) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 1.4 MiB (1468016) - PeakReservation: 1.0 MiB (1070421) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 50.3 MiB (52703811) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 0ns (0) - TotalNetworkSendTime: 71ms (71330744) - TotalStorageWaitTime: 4ms (4999818) - TotalThreadsInvoluntaryContextSwitches: 999 (999) - TotalThreadsTotalWallClockTime: 1.83s (1834266755) - TotalThreadsSysTime: 15ms (15475666) - TotalThreadsUserTime: 1.15s (1148841333) - TotalThreadsVoluntaryContextSwitches: 11 (11) - TotalTime: 1.81s (1810267626) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 1.0 MiB (1048576) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 1.0 MiB (1048576) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 137ms (137994991) - ExecTreeExecTime: 65ms (65330962) - InactiveTotalTime: 0ns (0) - OpenTime: 1.66s (1656939858) - ExecTreeOpenTime: 3ms (3999855) - PrepareTime: 13ms (13999492) - ExecTreePrepareTime: 6ms (6666424) - TotalTime: 0ns (0) KrpcDataStreamSender (dst_id=9) - EosSent: 3 (3) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 37.5 KiB (38432) - RowsSent: 2 (2) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 333.32us (333321) - TotalBytesSent: 41 B (41) - TotalTime: 73ms (73330671) - UncompressedRowBatchSize: 56 B (56) HDFS_SCAN_NODE (id=4) - AverageHdfsReadThreadConcurrency: 0.00 (0.0) - AverageScannerThreadConcurrency: 0.00 (0.0) - BytesRead: 4.1 KiB (4214) - BytesReadDataNodeCache: 0 B (0) - BytesReadLocal: 4.1 KiB (4214) - BytesReadRemoteUnexpected: 0 B (0) - BytesReadShortCircuit: 4.1 KiB (4214) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 B (0) - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 B (0) - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0ns (0) - InactiveTotalTime: 0ns (0) - MaterializeTupleTime(*): 0ns (0) - MaxCompressedTextFileLength: 0 B (0) - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 2 (2) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 29.4 KiB (30106) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 1.0 MiB/s (1053705) - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 5.3 KiB (5461) - RowBatchQueueGetWaitTime: 17ms (17332704) - RowBatchQueuePeakMemoryUsage: 4.2 KiB (4336) - RowBatchQueuePutWaitTime: 0ns (0) - RowBatchesEnqueued: 4 (4) - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 32 per second (32) - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 4ms (4999818) - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 39ms (39331905) - ScannerThreadsSysTime: 344.67us (344666) - ScannerThreadsUserTime: 11ms (11613333) - ScannerThreadsVoluntaryContextSwitches: 3 (3) - TotalRawHdfsOpenFileTime(*): 0ns (0) - TotalRawHdfsReadTime(*): 666.64us (666642) - TotalReadThroughput: 0 B/s (0) - TotalTime: 81ms (81997023) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 32.0 KiB (32768) - CumulativeAllocations: 4 (4) - InactiveTotalTime: 0ns (0) - PeakReservation: 21.3 KiB (21845) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 16.0 KiB (16384) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Filter 0 (1.00 MB) - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - InactiveTotalTime: 0ns (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 2 (2) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) - TotalTime: 0ns (0) CodeGen - CodegenInvoluntaryContextSwitches: 986 (986) - CodegenTotalWallClockTime: 1.65s (1650940076) - CodegenSysTime: 2ms (2296000) - CodegenUserTime: 1.12s (1125592666) - CodegenVoluntaryContextSwitches: 2 (2) - CompileTime: 92ms (92663303) - InactiveTotalTime: 0ns (0) - IrGenerationTime: 51ms (51998113) - LoadTime: 0ns (0) - ModuleBitcodeSize: 2.4 MiB (2560172) - NumFunctions: 32 (32) - NumInstructions: 760 (760) - OptimizationTime: 860ms (860635429) - PeakMemoryUsage: 380.0 KiB (389120) - PrepareTime: 636ms (636643558) - TotalTime: 1.65s (1650940076) Fragment F03 Instance e945a9bc83511e50:c6fd99ea00000002 (host=impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22000) Last report received time: 2019-10-26 04:34:37.889 Hdfs split stats (:<# splits>/): 2:1/2.98 KB 1:1/2.98 KB - AverageThreadTokens: 1.00 (1.0) - BloomFilterBytes: 0 B (0) - ExchangeScanRatio: 0.01 (0.009016134134767479) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 1.4 MiB (1468016) - PeakReservation: 1.0 MiB (1081344) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 73.4 MiB (76921438) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0ns (0) - TotalNetworkSendTime: 76ms (76997205) - TotalStorageWaitTime: 14ms (14999455) - TotalThreadsInvoluntaryContextSwitches: 408 (408) - TotalThreadsTotalWallClockTime: 2.68s (2677902802) - TotalThreadsSysTime: 2ms (2976000) - TotalThreadsUserTime: 1.44s (1444663000) - TotalThreadsVoluntaryContextSwitches: 12 (12) - TotalTime: 2.66s (2664903273) Fragment Instance Lifecycle Event Timeline Prepare Finished: 112ms (112995899) Open Finished: 2.61s (2606905379) First Batch Produced: 2.66s (2662903346) First Batch Sent: 2.66s (2662903346) ExecInternal Finished: 2.91s (2908894418) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 1.0 MiB (1048576) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 1.0 MiB (1048576) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 144ms (144994737) - ExecTreeExecTime: 66ms (66997568) - InactiveTotalTime: 0ns (0) - OpenTime: 2.49s (2493909480) - ExecTreeOpenTime: 4ms (4999819) - PrepareTime: 23ms (23999129) - ExecTreePrepareTime: 14ms (14999455) - TotalTime: 0ns (0) KrpcDataStreamSender (dst_id=9) ExecOption: Hash Partitioned Sender Codegen Enabled - EosSent: 3 (3) - InactiveTotalTime: 76ms (76997205) - PeakMemoryUsage: 37.5 KiB (38432) - RowsSent: 4 (4) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0ns (0) - TotalBytesSent: 57 B (57) - TotalTime: 78ms (78997132) - UncompressedRowBatchSize: 84 B (84) HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 2:1/2.98 KB 1:1/2.98 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Runtime filters: Not all filters arrived (arrived: [], missing [0]), waited for 0. Arrival delay: 2s516ms. Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.00 (0.0) - AverageScannerThreadConcurrency: 0.00 (0.0) - BytesRead: 6.2 KiB (6322) - BytesReadDataNodeCache: 0 B (0) - BytesReadLocal: 6.2 KiB (6322) - BytesReadRemoteUnexpected: 0 B (0) - BytesReadShortCircuit: 6.2 KiB (6322) - CachedFileHandlesHitCount: 6 (6) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 B (0) - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 B (0) - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0ns (0) - InactiveTotalTime: 0ns (0) - MaterializeTupleTime(*): 0ns (0) - MaxCompressedTextFileLength: 0 B (0) - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 4 (4) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 32.0 KiB (32768) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 3.0 MiB/s (3161115) - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 8.0 KiB (8192) - RowBatchQueueGetWaitTime: 37ms (37998620) - RowBatchQueuePeakMemoryUsage: 4.2 KiB (4336) - RowBatchQueuePutWaitTime: 0ns (0) - RowBatchesEnqueued: 6 (6) - RowsRead: 4 (4) - RowsReturned: 4 (4) - RowsReturnedRate: 39 per second (39) - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 14ms (14999455) - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 38ms (38998585) - ScannerThreadsSysTime: 0ns (0) - ScannerThreadsUserTime: 20ms (20807000) - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsOpenFileTime(*): 0ns (0) - TotalRawHdfsReadTime(*): 1ms (1999927) - TotalReadThroughput: 0 B/s (0) - TotalTime: 101ms (101996296) Node Lifecycle Event Timeline Open Started: 2.60s (2601905560) Open Finished: 2.61s (2606905379) First Batch Requested: 2.61s (2606905379) First Batch Returned: 2.66s (2662903346) Last Batch Returned: 2.67s (2673902947) Closed: 2.75s (2752900080) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 48.0 KiB (49152) - CumulativeAllocations: 6 (6) - InactiveTotalTime: 0ns (0) - PeakReservation: 32.0 KiB (32768) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 16.0 KiB (16384) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Filter 0 (1.00 MB) - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - InactiveTotalTime: 0ns (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 4 (4) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) - TotalTime: 0ns (0) CodeGen - CodegenInvoluntaryContextSwitches: 394 (394) - CodegenTotalWallClockTime: 2.48s (2484909806) - CodegenSysTime: 0ns (0) - CodegenUserTime: 1.41s (1407004000) - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 167ms (167993902) - InactiveTotalTime: 0ns (0) - IrGenerationTime: 101ms (101996298) - LoadTime: 0ns (0) - ModuleBitcodeSize: 2.4 MiB (2560172) - NumFunctions: 32 (32) - NumInstructions: 760 (760) - OptimizationTime: 1.24s (1241954922) - PeakMemoryUsage: 380.0 KiB (389120) - PrepareTime: 961ms (961965084) - TotalTime: 2.48s (2484909806) Instance e945a9bc83511e50:c6fd99ea00000003 (host=impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22002) Last report received time: 2019-10-26 04:34:37.970 Hdfs split stats (:<# splits>/): 2:1/2.98 KB - AverageThreadTokens: 1.00 (1.0) - BloomFilterBytes: 0 B (0) - ExchangeScanRatio: 0.01 (0.010756089844985764) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 1.4 MiB (1468016) - PeakReservation: 1.0 MiB (1064960) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 38.7 MiB (40603190) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 0ns (0) - TotalNetworkSendTime: 74ms (74997278) - TotalStorageWaitTime: 0ns (0) - TotalThreadsInvoluntaryContextSwitches: 2,345 (2345) - TotalThreadsTotalWallClockTime: 1.53s (1527944541) - TotalThreadsSysTime: 24ms (24722000) - TotalThreadsUserTime: 1.04s (1039706000) - TotalThreadsVoluntaryContextSwitches: 15 (15) - TotalTime: 1.48s (1477946356) Fragment Instance Lifecycle Event Timeline Prepare Finished: 141ms (141994846) Open Finished: 1.45s (1449947372) First Batch Produced: 1.53s (1532944360) First Batch Sent: 1.53s (1533944323) ExecInternal Finished: 1.61s (1611941492) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 1.0 MiB (1048576) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 1.0 MiB (1048576) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 159ms (159994193) - ExecTreeExecTime: 82ms (82996988) - InactiveTotalTime: 0ns (0) - OpenTime: 1.31s (1307952526) - ExecTreeOpenTime: 3ms (3999855) - PrepareTime: 8ms (8999673) - ExecTreePrepareTime: 1ms (1999927) - TotalTime: 0ns (0) KrpcDataStreamSender (dst_id=9) ExecOption: Hash Partitioned Sender Codegen Enabled - EosSent: 3 (3) - InactiveTotalTime: 74ms (74997278) - PeakMemoryUsage: 37.5 KiB (38432) - RowsSent: 2 (2) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0ns (0) - TotalBytesSent: 34 B (34) - TotalTime: 77ms (77997168) - UncompressedRowBatchSize: 42 B (42) HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 2:1/2.98 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [], missing [0]), waited for 0. Arrival delay: 1s315ms. Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:1 - AverageHdfsReadThreadConcurrency: 0.00 (0.0) - AverageScannerThreadConcurrency: 0.00 (0.0) - BytesRead: 3.1 KiB (3161) - BytesReadDataNodeCache: 0 B (0) - BytesReadLocal: 3.1 KiB (3161) - BytesReadRemoteUnexpected: 0 B (0) - BytesReadShortCircuit: 3.1 KiB (3161) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 B (0) - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 B (0) - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0ns (0) - InactiveTotalTime: 0ns (0) - MaterializeTupleTime(*): 0ns (0) - MaxCompressedTextFileLength: 0 B (0) - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 2 (2) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 28.1 KiB (28776) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0 B/s (0) - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 4.0 KiB (4096) - RowBatchQueueGetWaitTime: 0ns (0) - RowBatchQueuePeakMemoryUsage: 4.2 KiB (4336) - RowBatchQueuePutWaitTime: 0ns (0) - RowBatchesEnqueued: 3 (3) - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 22 per second (22) - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0ns (0) - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 59ms (59997822) - ScannerThreadsSysTime: 0ns (0) - ScannerThreadsUserTime: 7ms (7828000) - ScannerThreadsVoluntaryContextSwitches: 3 (3) - TotalRawHdfsOpenFileTime(*): 0ns (0) - TotalRawHdfsReadTime(*): 0ns (0) - TotalReadThroughput: 0 B/s (0) - TotalTime: 89ms (89996733) Node Lifecycle Event Timeline Open Started: 1.45s (1445947517) Open Finished: 1.45s (1448947408) First Batch Requested: 1.45s (1449947372) First Batch Returned: 1.53s (1532944360) Last Batch Returned: 1.53s (1533944323) Closed: 1.61s (1610941529) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 24.0 KiB (24576) - CumulativeAllocations: 3 (3) - InactiveTotalTime: 0ns (0) - PeakReservation: 16.0 KiB (16384) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 16.0 KiB (16384) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Filter 0 (1.00 MB) - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - InactiveTotalTime: 0ns (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 2 (2) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) - TotalTime: 0ns (0) CodeGen - CodegenInvoluntaryContextSwitches: 2,331 (2331) - CodegenTotalWallClockTime: 1.30s (1302952707) - CodegenSysTime: 1ms (1976000) - CodegenUserTime: 1.02s (1021289000) - CodegenVoluntaryContextSwitches: 6 (6) - CompileTime: 52ms (52998076) - InactiveTotalTime: 0ns (0) - IrGenerationTime: 25ms (25999057) - LoadTime: 0ns (0) - ModuleBitcodeSize: 2.4 MiB (2560172) - NumFunctions: 32 (32) - NumInstructions: 760 (760) - OptimizationTime: 692ms (692974848) - PeakMemoryUsage: 380.0 KiB (389120) - PrepareTime: 522ms (522981017) - TotalTime: 1.30s (1302952707) Instance e945a9bc83511e50:c6fd99ea00000004 (host=impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22001) Last report received time: 2019-10-26 04:34:37.669 Hdfs split stats (:<# splits>/): 0:1/2.98 KB - AverageThreadTokens: 1.33 (1.3333333333333333) - BloomFilterBytes: 0 B (0) - ExchangeScanRatio: 0.01 (0.010756089844985764) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 1.4 MiB (1468016) - PeakReservation: 1.0 MiB (1064960) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 38.7 MiB (40586806) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 0ns (0) - TotalNetworkSendTime: 61ms (61997750) - TotalStorageWaitTime: 0ns (0) - TotalThreadsInvoluntaryContextSwitches: 244 (244) - TotalThreadsTotalWallClockTime: 1.30s (1296952924) - TotalThreadsSysTime: 18ms (18729000) - TotalThreadsUserTime: 962ms (962155000) - TotalThreadsVoluntaryContextSwitches: 8 (8) - TotalTime: 1.29s (1287953251) Fragment Instance Lifecycle Event Timeline Prepare Finished: 37ms (37998621) Open Finished: 1.21s (1206956191) First Batch Produced: 1.25s (1251954558) First Batch Sent: 1.25s (1251954558) ExecInternal Finished: 1.32s (1317952163) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 1.0 MiB (1048576) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 1.0 MiB (1048576) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 108ms (108996044) - ExecTreeExecTime: 45ms (45998331) - InactiveTotalTime: 0ns (0) - OpenTime: 1.17s (1168957570) - ExecTreeOpenTime: 2ms (2999891) - PrepareTime: 8ms (8999674) - ExecTreePrepareTime: 2ms (2999891) - TotalTime: 0ns (0) KrpcDataStreamSender (dst_id=9) ExecOption: Hash Partitioned Sender Codegen Enabled - EosSent: 3 (3) - InactiveTotalTime: 61ms (61997750) - PeakMemoryUsage: 37.5 KiB (38432) - RowsSent: 2 (2) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 999.96us (999963) - TotalBytesSent: 34 B (34) - TotalTime: 62ms (62997713) - UncompressedRowBatchSize: 42 B (42) HDFS_SCAN_NODE (id=4) Hdfs split stats (:<# splits>/): 0:1/2.98 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Not all filters arrived (arrived: [], missing [0]), waited for 0. Arrival delay: 1s176ms. Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:1 - AverageHdfsReadThreadConcurrency: 0.00 (0.0) - AverageScannerThreadConcurrency: 0.00 (0.0) - BytesRead: 3.1 KiB (3161) - BytesReadDataNodeCache: 0 B (0) - BytesReadLocal: 3.1 KiB (3161) - BytesReadRemoteUnexpected: 0 B (0) - BytesReadShortCircuit: 3.1 KiB (3161) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 B (0) - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 B (0) - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0ns (0) - InactiveTotalTime: 0ns (0) - MaterializeTupleTime(*): 0ns (0) - MaxCompressedTextFileLength: 0 B (0) - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 2 (2) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 28.1 KiB (28776) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0 B/s (0) - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 4.0 KiB (4096) - RowBatchQueueGetWaitTime: 13ms (13999492) - RowBatchQueuePeakMemoryUsage: 4.2 KiB (4336) - RowBatchQueuePutWaitTime: 0ns (0) - RowBatchesEnqueued: 3 (3) - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 37 per second (37) - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0ns (0) - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 18ms (18999310) - ScannerThreadsSysTime: 1ms (1034000) - ScannerThreadsUserTime: 6ms (6205000) - ScannerThreadsVoluntaryContextSwitches: 2 (2) - TotalRawHdfsOpenFileTime(*): 0ns (0) - TotalRawHdfsReadTime(*): 0ns (0) - TotalReadThroughput: 0 B/s (0) - TotalTime: 53ms (53998040) Node Lifecycle Event Timeline Open Started: 1.20s (1203956300) Open Finished: 1.21s (1205956228) First Batch Requested: 1.21s (1206956191) First Batch Returned: 1.25s (1251954558) Last Batch Returned: 1.25s (1252954522) Closed: 1.32s (1316952199) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 24.0 KiB (24576) - CumulativeAllocations: 3 (3) - InactiveTotalTime: 0ns (0) - PeakReservation: 16.0 KiB (16384) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 16.0 KiB (16384) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Filter 0 (1.00 MB) - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - InactiveTotalTime: 0ns (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 2 (2) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) - TotalTime: 0ns (0) CodeGen - CodegenInvoluntaryContextSwitches: 235 (235) - CodegenTotalWallClockTime: 1.16s (1164957716) - CodegenSysTime: 4ms (4912000) - CodegenUserTime: 948ms (948485000) - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 56ms (56997931) - InactiveTotalTime: 0ns (0) - IrGenerationTime: 27ms (27998984) - LoadTime: 0ns (0) - ModuleBitcodeSize: 2.4 MiB (2560172) - NumFunctions: 32 (32) - NumInstructions: 760 (760) - OptimizationTime: 646ms (646976518) - PeakMemoryUsage: 380.0 KiB (389120) - PrepareTime: 424ms (424984575) - TotalTime: 1.16s (1164957716) Averaged Fragment F04 split sizes: min: 2.98 KB, max: 5.96 KB, avg: 3.97 KB, stddev: 1.40 KB completion times: min:5s101ms max:5s348ms mean: 5s245ms stddev:104.789ms execution rates: min:570.00 B/sec max:1.13 KB/sec mean:774.00 B/sec stddev:269.22 B/sec num instances: 3 - AverageThreadTokens: 1.06 (1.0555555555555556) - BloomFilterBytes: 0 B (0) - ExchangeScanRatio: 0.01 (0.005802707930367505) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 299.9 KiB (307056) - PeakReservation: 10.7 KiB (10922) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 50.3 MiB (52703811) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 0ns (0) - TotalNetworkSendTime: 41ms (41331833) - TotalStorageWaitTime: 7ms (7333067) - TotalThreadsInvoluntaryContextSwitches: 8,801 (8801) - TotalThreadsTotalWallClockTime: 2.50s (2501575867) - TotalThreadsSysTime: 30ms (30144666) - TotalThreadsUserTime: 1.06s (1065540666) - TotalThreadsVoluntaryContextSwitches: 19 (19) - TotalTime: 2.44s (2444577936) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 0 B (0) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 0 B (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 208ms (208992414) - ExecTreeExecTime: 165ms (165660654) - InactiveTotalTime: 0ns (0) - OpenTime: 2.23s (2226252528) - ExecTreeOpenTime: 5ms (5333139) - PrepareTime: 8ms (8333030) - ExecTreePrepareTime: 2ms (2999890) - TotalTime: 0ns (0) KrpcDataStreamSender (dst_id=10) - EosSent: 3 (3) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 84.8 KiB (86816) - RowsSent: 2 (2) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0ns (0) - TotalBytesSent: 24 B (24) - TotalTime: 44ms (44331724) - UncompressedRowBatchSize: 34 B (34) HDFS_SCAN_NODE (id=5) - AverageHdfsReadThreadConcurrency: 0.00 (0.0) - AverageScannerThreadConcurrency: 0.00 (0.0) - BytesRead: 4.0 KiB (4136) - BytesReadDataNodeCache: 0 B (0) - BytesReadLocal: 4.0 KiB (4136) - BytesReadRemoteUnexpected: 0 B (0) - BytesReadShortCircuit: 4.0 KiB (4136) - CachedFileHandlesHitCount: 2 (2) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 B (0) - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 B (0) - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0ns (0) - InactiveTotalTime: 0ns (0) - MaterializeTupleTime(*): 0ns (0) - MaxCompressedTextFileLength: 0 B (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 1 (1) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 22.8 KiB (23298) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0 B/s (0) - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 5.3 KiB (5461) - RowBatchQueueGetWaitTime: 14ms (14666134) - RowBatchQueuePeakMemoryUsage: 4.2 KiB (4282) - RowBatchQueuePutWaitTime: 0ns (0) - RowBatchesEnqueued: 4 (4) - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 24 per second (24) - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 7ms (7333067) - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 66ms (66330925) - ScannerThreadsSysTime: 99.67us (99666) - ScannerThreadsUserTime: 10ms (10033000) - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsOpenFileTime(*): 0ns (0) - TotalRawHdfsReadTime(*): 0ns (0) - TotalReadThroughput: 0 B/s (0) - TotalTime: 176ms (176660253) Buffer pool - AllocTime: 7ms (7333067) - CumulativeAllocationBytes: 21.3 KiB (21845) - CumulativeAllocations: 2 (2) - InactiveTotalTime: 0ns (0) - PeakReservation: 10.7 KiB (10922) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 8.0 KiB (8192) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) CodeGen - CodegenInvoluntaryContextSwitches: 235 (235) - CodegenTotalWallClockTime: 2.21s (2211586393) - CodegenSysTime: 1ms (1332333) - CodegenUserTime: 1.04s (1043775666) - CodegenVoluntaryContextSwitches: 2 (2) - CompileTime: 81ms (81663702) - InactiveTotalTime: 0ns (0) - IrGenerationTime: 47ms (47331615) - LoadTime: 0ns (0) - ModuleBitcodeSize: 2.4 MiB (2560172) - NumFunctions: 20 (20) - NumInstructions: 446 (446) - OptimizationTime: 1.43s (1433947952) - PeakMemoryUsage: 223.0 KiB (228352) - PrepareTime: 618ms (618977533) - TotalTime: 2.21s (2211586393) Fragment F04 Instance e945a9bc83511e50:c6fd99ea00000005 (host=impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22000) Last report received time: 2019-10-26 04:34:37.880 Hdfs split stats (:<# splits>/): 2:1/2.98 KB 1:1/2.98 KB - AverageThreadTokens: 1.17 (1.1666666666666667) - BloomFilterBytes: 0 B (0) - ExchangeScanRatio: 0.01 (0.005802707930367505) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 299.9 KiB (307056) - PeakReservation: 16.0 KiB (16384) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 73.4 MiB (76921438) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0ns (0) - TotalNetworkSendTime: 54ms (54998003) - TotalStorageWaitTime: 8ms (8999673) - TotalThreadsInvoluntaryContextSwitches: 26,000 (26000) - TotalThreadsTotalWallClockTime: 3.27s (3267881387) - TotalThreadsSysTime: 87ms (87437000) - TotalThreadsUserTime: 1.39s (1391139000) - TotalThreadsVoluntaryContextSwitches: 39 (39) - TotalTime: 3.13s (3130886360) Fragment Instance Lifecycle Event Timeline Prepare Finished: 135ms (135995064) Open Finished: 2.81s (2805898156) First Batch Produced: 3.19s (3187884291) First Batch Sent: 3.19s (3187884291) ExecInternal Finished: 3.26s (3262881569) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 0 B (0) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 0 B (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 447ms (447983740) - ExecTreeExecTime: 390ms (390985809) - InactiveTotalTime: 0ns (0) - OpenTime: 2.67s (2669903092) - ExecTreeOpenTime: 9ms (9999637) - PrepareTime: 10ms (10999600) - ExecTreePrepareTime: 3ms (3999854) - TotalTime: 0ns (0) KrpcDataStreamSender (dst_id=10) ExecOption: Hash Partitioned Sender Codegen Enabled - EosSent: 3 (3) - InactiveTotalTime: 54ms (54998003) - PeakMemoryUsage: 84.8 KiB (86816) - RowsSent: 4 (4) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0ns (0) - TotalBytesSent: 36 B (36) - TotalTime: 57ms (57997895) - UncompressedRowBatchSize: 52 B (52) HDFS_SCAN_NODE (id=5) Hdfs split stats (:<# splits>/): 2:1/2.98 KB 1:1/2.98 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.00 (0.0) - AverageScannerThreadConcurrency: 0.00 (0.0) - BytesRead: 6.1 KiB (6204) - BytesReadDataNodeCache: 0 B (0) - BytesReadLocal: 6.1 KiB (6204) - BytesReadRemoteUnexpected: 0 B (0) - BytesReadShortCircuit: 6.1 KiB (6204) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 B (0) - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 B (0) - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0ns (0) - InactiveTotalTime: 0ns (0) - MaterializeTupleTime(*): 0ns (0) - MaxCompressedTextFileLength: 0 B (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 2 (2) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 28.1 KiB (28760) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 0 B/s (0) - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 8.0 KiB (8192) - RowBatchQueueGetWaitTime: 7ms (7999710) - RowBatchQueuePeakMemoryUsage: 4.2 KiB (4336) - RowBatchQueuePutWaitTime: 0ns (0) - RowBatchesEnqueued: 6 (6) - RowsRead: 4 (4) - RowsReturned: 4 (4) - RowsReturnedRate: 9 per second (9) - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 8ms (8999673) - ScannerThreadWorklessLoops: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 149ms (149994555) - ScannerThreadsSysTime: 299.00us (299000) - ScannerThreadsUserTime: 18ms (18227000) - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsOpenFileTime(*): 0ns (0) - TotalRawHdfsReadTime(*): 0ns (0) - TotalReadThroughput: 0 B/s (0) - TotalTime: 408ms (408985154) Node Lifecycle Event Timeline Open Started: 2.79s (2795898519) Open Finished: 2.81s (2805898156) First Batch Requested: 2.81s (2805898156) First Batch Returned: 3.19s (3187884291) Last Batch Returned: 3.20s (3196883965) Closed: 3.25s (3254881860) Buffer pool - AllocTime: 21ms (21999202) - CumulativeAllocationBytes: 32.0 KiB (32768) - CumulativeAllocations: 4 (4) - InactiveTotalTime: 0ns (0) - PeakReservation: 16.0 KiB (16384) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 8.0 KiB (8192) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) CodeGen - CodegenInvoluntaryContextSwitches: 310 (310) - CodegenTotalWallClockTime: 2.66s (2657903527) - CodegenSysTime: 1ms (1003000) - CodegenUserTime: 1.36s (1356050000) - CodegenVoluntaryContextSwitches: 8 (8) - CompileTime: 99ms (99996370) - InactiveTotalTime: 0ns (0) - IrGenerationTime: 79ms (79997096) - LoadTime: 0ns (0) - ModuleBitcodeSize: 2.4 MiB (2560172) - NumFunctions: 20 (20) - NumInstructions: 446 (446) - OptimizationTime: 1.78s (1780935358) - PeakMemoryUsage: 223.0 KiB (228352) - PrepareTime: 662ms (662975936) - TotalTime: 2.66s (2657903527) Instance e945a9bc83511e50:c6fd99ea00000006 (host=impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22002) Last report received time: 2019-10-26 04:34:37.966 Hdfs split stats (:<# splits>/): 2:1/2.98 KB - AverageThreadTokens: 1.00 (1.0) - BloomFilterBytes: 0 B (0) - ExchangeScanRatio: 0.01 (0.005802707930367505) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 299.9 KiB (307056) - PeakReservation: 8.0 KiB (8192) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 38.7 MiB (40603190) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 0ns (0) - TotalNetworkSendTime: 26ms (26999019) - TotalStorageWaitTime: 3ms (3999855) - TotalThreadsInvoluntaryContextSwitches: 135 (135) - TotalThreadsTotalWallClockTime: 2.27s (2265917754) - TotalThreadsSysTime: 1ms (1010000) - TotalThreadsUserTime: 910ms (910738000) - TotalThreadsVoluntaryContextSwitches: 9 (9) - TotalTime: 2.25s (2249918335) Fragment Instance Lifecycle Event Timeline Prepare Finished: 301ms (301989039) Open Finished: 2.46s (2463910569) First Batch Produced: 2.51s (2513908754) First Batch Sent: 2.51s (2513908754) ExecInternal Finished: 2.54s (2544907629) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 0 B (0) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 0 B (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 78ms (78997132) - ExecTreeExecTime: 50ms (50998149) - InactiveTotalTime: 0ns (0) - OpenTime: 2.16s (2161921530) - ExecTreeOpenTime: 2ms (2999891) - PrepareTime: 7ms (7999710) - ExecTreePrepareTime: 2ms (2999891) - TotalTime: 0ns (0) KrpcDataStreamSender (dst_id=10) ExecOption: Hash Partitioned Sender Codegen Enabled - EosSent: 3 (3) - InactiveTotalTime: 26ms (26999019) - PeakMemoryUsage: 84.8 KiB (86816) - RowsSent: 2 (2) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0ns (0) - TotalBytesSent: 18 B (18) - TotalTime: 28ms (28998946) - UncompressedRowBatchSize: 26 B (26) HDFS_SCAN_NODE (id=5) Hdfs split stats (:<# splits>/): 2:1/2.98 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:1 - AverageHdfsReadThreadConcurrency: 0.00 (0.0) - AverageScannerThreadConcurrency: 0.00 (0.0) - BytesRead: 3.0 KiB (3102) - BytesReadDataNodeCache: 0 B (0) - BytesReadLocal: 3.0 KiB (3102) - BytesReadRemoteUnexpected: 0 B (0) - BytesReadShortCircuit: 3.0 KiB (3102) - CachedFileHandlesHitCount: 2 (2) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 B (0) - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 B (0) - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0ns (0) - InactiveTotalTime: 0ns (0) - MaterializeTupleTime(*): 0ns (0) - MaxCompressedTextFileLength: 0 B (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 1 (1) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 20.1 KiB (20568) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0 B/s (0) - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 4.0 KiB (4096) - RowBatchQueueGetWaitTime: 21ms (21999202) - RowBatchQueuePeakMemoryUsage: 4.2 KiB (4336) - RowBatchQueuePutWaitTime: 0ns (0) - RowBatchesEnqueued: 3 (3) - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 33 per second (33) - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 3ms (3999855) - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 24ms (24999092) - ScannerThreadsSysTime: 0ns (0) - ScannerThreadsUserTime: 6ms (6076000) - ScannerThreadsVoluntaryContextSwitches: 2 (2) - TotalRawHdfsOpenFileTime(*): 0ns (0) - TotalRawHdfsReadTime(*): 0ns (0) - TotalReadThroughput: 0 B/s (0) - TotalTime: 59ms (59997821) Node Lifecycle Event Timeline Open Started: 2.46s (2460910678) Open Finished: 2.46s (2463910569) First Batch Requested: 2.46s (2463910569) First Batch Returned: 2.51s (2513908754) Last Batch Returned: 2.51s (2514908718) Closed: 2.54s (2543907665) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 16.0 KiB (16384) - CumulativeAllocations: 2 (2) - InactiveTotalTime: 0ns (0) - PeakReservation: 8.0 KiB (8192) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 8.0 KiB (8192) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) CodeGen - CodegenInvoluntaryContextSwitches: 133 (133) - CodegenTotalWallClockTime: 2.15s (2145922110) - CodegenSysTime: 1ms (1010000) - CodegenUserTime: 895ms (895476000) - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 68ms (68997495) - InactiveTotalTime: 0ns (0) - IrGenerationTime: 35ms (35998693) - LoadTime: 0ns (0) - ModuleBitcodeSize: 2.4 MiB (2560172) - NumFunctions: 20 (20) - NumInstructions: 446 (446) - OptimizationTime: 1.34s (1341951292) - PeakMemoryUsage: 223.0 KiB (228352) - PrepareTime: 690ms (690974920) - TotalTime: 2.15s (2145922110) Instance e945a9bc83511e50:c6fd99ea00000007 (host=impala-ec2-centos74-r4-4xlarge-ondemand-0fda.vpc.cloudera.com:22001) Last report received time: 2019-10-26 04:34:37.665 Hdfs split stats (:<# splits>/): 0:1/2.98 KB - AverageThreadTokens: 1.00 (1.0) - BloomFilterBytes: 0 B (0) - ExchangeScanRatio: 0.01 (0.005802707930367505) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 299.9 KiB (307056) - PeakReservation: 8.0 KiB (8192) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 38.7 MiB (40586806) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 0ns (0) - TotalNetworkSendTime: 41ms (41998477) - TotalStorageWaitTime: 8ms (8999673) - TotalThreadsInvoluntaryContextSwitches: 270 (270) - TotalThreadsTotalWallClockTime: 1.97s (1970928461) - TotalThreadsSysTime: 1ms (1987000) - TotalThreadsUserTime: 894ms (894745000) - TotalThreadsVoluntaryContextSwitches: 10 (10) - TotalTime: 1.95s (1952929115) Fragment Instance Lifecycle Event Timeline Prepare Finished: 37ms (37998621) Open Finished: 1.88s (1884931583) First Batch Produced: 1.94s (1937929660) First Batch Sent: 1.94s (1937929660) ExecInternal Finished: 1.99s (1986927881) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 0 B (0) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 0 B (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 99ms (99996371) - ExecTreeExecTime: 54ms (54998004) - InactiveTotalTime: 0ns (0) - OpenTime: 1.85s (1846932962) - ExecTreeOpenTime: 2ms (2999891) - PrepareTime: 5ms (5999782) - ExecTreePrepareTime: 1ms (1999927) - TotalTime: 0ns (0) KrpcDataStreamSender (dst_id=10) ExecOption: Hash Partitioned Sender Codegen Enabled - EosSent: 3 (3) - InactiveTotalTime: 41ms (41998477) - PeakMemoryUsage: 84.8 KiB (86816) - RowsSent: 2 (2) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0ns (0) - TotalBytesSent: 18 B (18) - TotalTime: 45ms (45998331) - UncompressedRowBatchSize: 26 B (26) HDFS_SCAN_NODE (id=5) Hdfs split stats (:<# splits>/): 0:1/2.98 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:1 - AverageHdfsReadThreadConcurrency: 0.00 (0.0) - AverageScannerThreadConcurrency: 0.00 (0.0) - BytesRead: 3.0 KiB (3102) - BytesReadDataNodeCache: 0 B (0) - BytesReadLocal: 3.0 KiB (3102) - BytesReadRemoteUnexpected: 0 B (0) - BytesReadShortCircuit: 3.0 KiB (3102) - CachedFileHandlesHitCount: 2 (2) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 B (0) - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 B (0) - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0ns (0) - InactiveTotalTime: 0ns (0) - MaterializeTupleTime(*): 0ns (0) - MaxCompressedTextFileLength: 0 B (0) - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 1 (1) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 20.1 KiB (20568) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0 B/s (0) - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 4.0 KiB (4096) - RowBatchQueueGetWaitTime: 13ms (13999492) - RowBatchQueuePeakMemoryUsage: 4.1 KiB (4176) - RowBatchQueuePutWaitTime: 0ns (0) - RowBatchesEnqueued: 3 (3) - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 32 per second (32) - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 8ms (8999673) - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 23ms (23999128) - ScannerThreadsSysTime: 0ns (0) - ScannerThreadsUserTime: 5ms (5796000) - ScannerThreadsVoluntaryContextSwitches: 2 (2) - TotalRawHdfsOpenFileTime(*): 0ns (0) - TotalRawHdfsReadTime(*): 0ns (0) - TotalReadThroughput: 0 B/s (0) - TotalTime: 60ms (60997786) Node Lifecycle Event Timeline Open Started: 1.88s (1881931692) Open Finished: 1.88s (1884931583) First Batch Requested: 1.88s (1884931583) First Batch Returned: 1.94s (1937929660) Last Batch Returned: 1.94s (1939929587) Closed: 1.99s (1985927918) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 16.0 KiB (16384) - CumulativeAllocations: 2 (2) - InactiveTotalTime: 0ns (0) - PeakReservation: 8.0 KiB (8192) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 8.0 KiB (8192) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) CodeGen - CodegenInvoluntaryContextSwitches: 263 (263) - CodegenTotalWallClockTime: 1.83s (1830933544) - CodegenSysTime: 1ms (1984000) - CodegenUserTime: 879ms (879801000) - CodegenVoluntaryContextSwitches: 0 (0) - CompileTime: 75ms (75997241) - InactiveTotalTime: 0ns (0) - IrGenerationTime: 25ms (25999057) - LoadTime: 0ns (0) - ModuleBitcodeSize: 2.4 MiB (2560172) - NumFunctions: 20 (20) - NumInstructions: 446 (446) - OptimizationTime: 1.18s (1178957208) - PeakMemoryUsage: 223.0 KiB (228352) - PrepareTime: 502ms (502981744) - TotalTime: 1.83s (1830933544)