query_test/test_spilling.py:78: in test_spilling_aggs self.run_test_case('QueryTest/spilling-aggs', vector) common/impala_test_suite.py:715: in run_test_case update_section=pytest.config.option.update_results) common/test_result_verifier.py:612: in verify_runtime_profile actual)) E AssertionError: Did not find matches for lines in runtime profile: E EXPECTED LINES: E row_regex: .*SpilledPartitions: .* \([1-9][0-9]*\) E E ACTUAL PROFILE: E Query (id=6b478dd792c1178a:3586d9df00000000): E DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. E Summary: E Session ID: 9549c652a8a5ac96:b2062b6d6a186ba4 E Session Type: BEESWAX E Start Time: 2020-02-20 01:59:22.105282000 E End Time: 2020-02-20 01:59:31.878595000 E Query Type: QUERY E Query State: FINISHED E Impala Query State: FINISHED E Query Status: OK E Impala Version: impalad version 3.4.0-SNAPSHOT DEBUG (build 0bb056e525794fca41cd333bc2896098566945bb) E User: jenkins E Connected User: jenkins E Delegated User: E Network Address: ::1:35278 E Default Db: tpch_parquet E Sql Statement: select l_orderkey, count(*) E from lineitem E group by 1 E order by 1 limit 10 E Coordinator: impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22000 E Query Options (set by configuration): BUFFER_POOL_LIMIT=35651584,MT_DOP=0,DEFAULT_SPILLABLE_BUFFER_SIZE=262144,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=query_test/test_spilling.py::TestSpillingDebugActionDimensions::()::test_spilling_aggs[protocol:beeswax|exec_option:{'mt_dop':0;'debug_action':None;'default_spillable_buffer_size':'256k'}|table_format:parquet/none] E Query Options (set by configuration and planner): BUFFER_POOL_LIMIT=35651584,MT_DOP=0,DEFAULT_SPILLABLE_BUFFER_SIZE=262144,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=query_test/test_spilling.py::TestSpillingDebugActionDimensions::()::test_spilling_aggs[protocol:beeswax|exec_option:{'mt_dop':0;'debug_action':None;'default_spillable_buffer_size':'256k'}|table_format:parquet/none] E Plan: E ---------------- E Max Per-Host Resource Reservation: Memory=13.75MB Threads=4 E Per-Host Resource Estimates: Memory=124MB E Analyzed query: SELECT l_orderkey, count(*) FROM tpch_parquet.lineitem GROUP BY E l_orderkey ORDER BY CAST(1 AS TINYINT) ASC LIMIT CAST(10 AS TINYINT) E E F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 E | Per-Host Resources: mem-estimate=16.00KB mem-reservation=0B thread-reservation=1 E PLAN-ROOT SINK E | output exprs: l_orderkey, count(*) E | mem-estimate=0B mem-reservation=0B thread-reservation=0 E | E 05:MERGING-EXCHANGE [UNPARTITIONED] E | order by: l_orderkey ASC E | limit: 10 E | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 E | tuple-ids=2 row-size=16B cardinality=10 E | in pipelines: 02(GETNEXT) E | E F01:PLAN FRAGMENT [HASH(l_orderkey)] hosts=3 instances=3 E Per-Host Resources: mem-estimate=18.01MB mem-reservation=4.75MB thread-reservation=1 E 02:TOP-N [LIMIT=10] E | order by: l_orderkey ASC E | mem-estimate=160B mem-reservation=0B thread-reservation=0 E | tuple-ids=2 row-size=16B cardinality=10 E | in pipelines: 02(GETNEXT), 04(OPEN) E | E 04:AGGREGATE [FINALIZE] E | output: count:merge(*) E | group by: l_orderkey E | mem-estimate=10.00MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0 E | tuple-ids=1 row-size=16B cardinality=1.56M E | in pipelines: 04(GETNEXT), 00(OPEN) E | E 03:EXCHANGE [HASH(l_orderkey)] E | mem-estimate=8.01MB mem-reservation=0B thread-reservation=0 E | tuple-ids=1 row-size=16B cardinality=1.56M E | in pipelines: 00(GETNEXT) E | E F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 E Per-Host Resources: mem-estimate=106.24MB mem-reservation=9.00MB thread-reservation=2 E 01:AGGREGATE [STREAMING] E | output: count(*) E | group by: l_orderkey E | mem-estimate=26.24MB mem-reservation=5.00MB spill-buffer=256.00KB thread-reservation=0 E | tuple-ids=1 row-size=16B cardinality=1.56M E | in pipelines: 00(GETNEXT) E | E 00:SCAN HDFS [tpch_parquet.lineitem, RANDOM] E HDFS partitions=1/1 files=3 size=193.99MB E stored statistics: E table: rows=6.00M size=193.99MB E columns: all E extrapolated-rows=disabled max-scan-range-rows=2.14M E mem-estimate=80.00MB mem-reservation=4.00MB thread-reservation=1 E tuple-ids=0 row-size=8B cardinality=6.00M E in pipelines: 00(GETNEXT) E ---------------- E Estimated Per-Host Mem: 130304508 E Request Pool: default-pool E Per Host Min Memory Reservation: impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22001(13.75 MB) impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22002(13.75 MB) impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22000(13.75 MB) E Per Host Number of Fragment Instances: impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22001(2) impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22002(2) impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22000(3) E Admission result: Admitted immediately E Cluster Memory Admitted: 372.80 MB E Executor Group: default E ExecSummary: E Operator #Hosts #Inst Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail E ------------------------------------------------------------------------------------------------------------------------------ E F02:ROOT 1 1 0.000ns 0.000ns 0 0 E 05:MERGING-EXCHANGE 1 1 999.998us 999.998us 10 10 48.00 KB 16.00 KB UNPARTITIONED E F01:EXCHANGE SENDER 3 3 1.999ms 3.999ms 7.52 KB 0 E 02:TOP-N 3 3 72.666ms 127.999ms 30 10 16.00 KB 160.00 B E 04:AGGREGATE 3 3 1s069ms 1s336ms 1.50M 1.56M 28.27 MB 10.00 MB FINALIZE E 03:EXCHANGE 3 3 448.999ms 653.998ms 1.67M 1.56M 6.05 MB 8.01 MB HASH(l_orderkey) E F00:EXCHANGE SENDER 3 3 866.331ms 1s078ms 106.57 KB 0 E 01:AGGREGATE 3 3 1s259ms 1s566ms 1.67M 1.56M 25.28 MB 26.24 MB STREAMING E 00:SCAN HDFS 3 3 570.332ms 837.998ms 6.00M 6.00M 5.23 MB 80.00 MB tpch_parquet.lineitem E Errors: E Query Compilation: 33.154ms E - Metadata of all 1 tables cached: 469.123us (469.123us) E - Analysis finished: 3.494ms (3.025ms) E - Authorization finished (noop): 3.511ms (16.792us) E - Value transfer graph computed: 4.009ms (497.712us) E - Single node plan created: 4.283ms (274.182us) E - Runtime filters computed: 4.339ms (56.723us) E - Distributed plan created: 4.351ms (11.933us) E - Planning finished: 33.154ms (28.802ms) E Query Timeline: 9s823ms E - Query submitted: 1.999ms (1.999ms) E - Planning finished: 37.999ms (35.999ms) E - Submit for admission: 55.999ms (17.999ms) E - Completed admission: 61.999ms (5.999ms) E - Ready to start on 3 backends: 91.999ms (29.999ms) E - All 3 execution backends (7 fragment instances) started: 167.999ms (75.999ms) E - Rows available: 9s661ms (9s493ms) E - First row fetched: 9s705ms (43.999ms) E - Last row fetched: 9s705ms (0.000ns) E - Released admission control resources: 9s772ms (66.999ms) E - AdmissionControlTimeSinceLastUpdate: 22.000ms E - ComputeScanRangeAssignmentTimer: 1.999ms E Frontend: E ImpalaServer: E - ClientFetchWaitTimer: 33.999ms E - NumRowsFetched: 10 (10) E - NumRowsFetchedFromCache: 0 (0) E - RowMaterializationRate: 93.00 /sec E - RowMaterializationTimer: 106.999ms E Execution Profile 6b478dd792c1178a:3586d9df00000000:(Total: 9s693ms, non-child: 0.000ns, % non-child: 0.00%) E Number of filters: 0 E Filter routing table: E ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled E ------------------------------------------------------------------------------------------------------------------- E Backend startup latencies: Count: 3, min / max: 41ms / 61ms, 25th %-ile: 41ms, 50th %-ile: 42ms, 75th %-ile: 42ms, 90th %-ile: 61ms, 95th %-ile: 61ms, 99.9th %-ile: 61ms E Slowest backend to start up: impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22000 E Per Node Peak Memory Usage: impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22001(34.59 MB) impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22002(38.55 MB) impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22000(40.42 MB) E Per Node Bytes Read: impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22001(2.81 MB) impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22002(3.43 MB) impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22000(3.42 MB) E Per Node User Time: impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22001(5s303ms) impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22002(6s792ms) impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22000(7s909ms) E Per Node System Time: impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22001(116.218ms) impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22002(171.933ms) impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22000(175.183ms) E - ExchangeScanRatio: 1.81 E - FiltersReceived: 0 (0) E - FinalizationTimer: 0.000ns E - InnerNodeSelectivityRatio: 0.00 E - NumBackends: 3 (3) E - NumCompletedBackends: 3 (3) E - NumFragmentInstances: 7 (7) E - NumFragments: 3 (3) E - TotalBytesRead: 9.65 MB (10123848) E - TotalBytesSent: 17.49 MB (18338191) E - TotalCpuTime: 20s468ms E - TotalInnerBytesSent: 415.00 B (415) E - TotalScanBytesSent: 17.49 MB (18337776) E Per Node Profiles: E impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22001: E - AdmissionSlots: 1 (1) E - BloomFilterBytes: 0 E - ScratchBytesRead: 0 E - ScratchBytesWritten: 0 E - ScratchFileUsedBytes: 0 E - ScratchReads: 0 (0) E - ScratchWrites: 0 (0) E - TotalEncryptionTime: 0.000ns E - TotalReadBlockTime: 0.000ns E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 0 E - CumulativeAllocations: 0 (0) E - PeakReservation: 0 E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 0 E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - ReservationLimit: 0 E - SystemAllocTime: 0.000ns E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22002: E - AdmissionSlots: 1 (1) E - BloomFilterBytes: 0 E - ScratchBytesRead: 0 E - ScratchBytesWritten: 0 E - ScratchFileUsedBytes: 0 E - ScratchReads: 0 (0) E - ScratchWrites: 0 (0) E - TotalEncryptionTime: 0.000ns E - TotalReadBlockTime: 0.000ns E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 0 E - CumulativeAllocations: 0 (0) E - PeakReservation: 0 E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 0 E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - ReservationLimit: 0 E - SystemAllocTime: 0.000ns E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22000: E - AdmissionSlots: 1 (1) E - BloomFilterBytes: 0 E - ScratchBytesRead: 0 E - ScratchBytesWritten: 0 E - ScratchFileUsedBytes: 0 E - ScratchReads: 0 (0) E - ScratchWrites: 0 (0) E - TotalEncryptionTime: 0.000ns E - TotalReadBlockTime: 0.000ns E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 0 E - CumulativeAllocations: 0 (0) E - PeakReservation: 0 E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 0 E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - ReservationLimit: 0 E - SystemAllocTime: 0.000ns E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Averaged Fragment F02:(Total: 9s523ms, non-child: 11.999ms, % non-child: 0.13%) E split sizes: min: 0, max: 0, avg: 0, stddev: 0 E completion times: min:9s604ms max:9s604ms mean: 9s604ms stddev:0.000ns E execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec E num instances: 1 E - AverageThreadTokens: 0.00 E - ExchangeScanRatio: 0.00 E - PeakMemoryUsage: 356.50 KB (365056) E - PeakReservation: 0 E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 40.42 MB (42381305) E - RowsProduced: 10 (10) E - TotalNetworkReceiveTime: 0.000ns E - TotalNetworkSendTime: 0.000ns E - TotalStorageWaitTime: 0.000ns E - TotalThreadsInvoluntaryContextSwitches: 98 (98) E - TotalThreadsTotalWallClockTime: 9s514ms E - TotalThreadsSysTime: 0.000ns E - TotalThreadsUserTime: 519.312ms E - TotalThreadsVoluntaryContextSwitches: 3 (3) E Fragment Instance Lifecycle Timings: E - ExecTime: 39.999ms E - ExecTreeExecTime: 20.999ms E - OpenTime: 9s474ms E - ExecTreeOpenTime: 8s637ms E - PrepareTime: 6.999ms E - ExecTreePrepareTime: 4.999ms E PLAN_ROOT_SINK:(Total: 17.999ms, non-child: 17.999ms, % non-child: 100.00%) E - PeakMemoryUsage: 0 E - RowsSent: 10 (10) E - RowsSentRate: 555.00 /sec E EXCHANGE_NODE (id=5):(Total: 8s658ms, non-child: 8s658ms, % non-child: 100.00%) E - ConvertRowBatchTime: 0.000ns E - MergeGetNext: 19.999ms E - MergeGetNextBatch: 19.999ms E - PeakMemoryUsage: 48.00 KB (49152) E - RowsReturned: 10 (10) E - RowsReturnedRate: 1.00 /sec E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 48.00 KB (49152) E - CumulativeAllocations: 6 (6) E - PeakReservation: 48.00 KB (49152) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 48.00 KB (49152) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 0.000ns E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Dequeue: E - FirstBatchWaitTime: 8s637ms E - TotalBytesDequeued: 750.00 B (750) E - TotalGetBatchTime: 8s657ms E - DataWaitTime: 8s657ms E Enqueue: E - DeserializeRowBatchTime: 0.000ns E - TotalBatchesEnqueued: 3 (3) E - TotalBatchesReceived: 3 (3) E - TotalBytesReceived: 415.00 B (415) E - TotalEarlySenders: 0 (0) E - TotalEosReceived: 3 (3) E - TotalHasDeferredRPCsTime: 0.000ns E - TotalRPCsDeferred: 0 (0) E CodeGen:(Total: 834.998ms, non-child: 834.998ms, % non-child: 100.00%) E - CodegenInvoluntaryContextSwitches: 98 (98) E - CodegenTotalWallClockTime: 834.998ms E - CodegenSysTime: 0.000ns E - CodegenUserTime: 515.001ms E - CodegenVoluntaryContextSwitches: 0 (0) E - CompileTime: 30.999ms E - IrGenerationTime: 16.999ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 2.53 MB (2655448) E - NumFunctions: 19 (19) E - NumInstructions: 697 (697) E - OptimizationTime: 133.999ms E - PeakMemoryUsage: 348.50 KB (356864) E - PrepareTime: 644.998ms E Coordinator Fragment F02: E Instance 6b478dd792c1178a:3586d9df00000000 (host=impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22000):(Total: 9s523ms, non-child: 11.999ms, % non-child: 0.13%) E Last report received time: 2020-02-20 01:59:31.876 E Fragment Instance Lifecycle Event Timeline: 9s548ms E - Prepare Finished: 32.999ms (32.999ms) E - Open Finished: 9s507ms (9s474ms) E - First Batch Produced: 9s528ms (20.999ms) E - First Batch Sent: 9s546ms (17.999ms) E - ExecInternal Finished: 9s548ms (1.999ms) E - MemoryUsage (500.000ms): 8.00 KB, 8.00 KB, 8.46 KB, 8.46 KB, 8.46 KB, 8.46 KB, 8.46 KB, 8.46 KB, 8.46 KB, 8.46 KB, 8.46 KB, 8.46 KB, 8.46 KB, 8.46 KB, 8.46 KB, 8.46 KB, 8.46 KB, 8.46 KB, 8.46 KB E - AverageThreadTokens: 0.00 E - ExchangeScanRatio: 0.00 E - PeakMemoryUsage: 356.50 KB (365056) E - PeakReservation: 0 E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 40.42 MB (42381305) E - RowsProduced: 10 (10) E - TotalNetworkReceiveTime: 0.000ns E - TotalNetworkSendTime: 0.000ns E - TotalStorageWaitTime: 0.000ns E - TotalThreadsInvoluntaryContextSwitches: 98 (98) E - TotalThreadsTotalWallClockTime: 9s514ms E - TotalThreadsSysTime: 0.000ns E - TotalThreadsUserTime: 519.312ms E - TotalThreadsVoluntaryContextSwitches: 3 (3) E Fragment Instance Lifecycle Timings: E - ExecTime: 39.999ms E - ExecTreeExecTime: 20.999ms E - OpenTime: 9s474ms E - ExecTreeOpenTime: 8s637ms E - PrepareTime: 6.999ms E - ExecTreePrepareTime: 4.999ms E PLAN_ROOT_SINK:(Total: 17.999ms, non-child: 0.000ns, % non-child: 0.00%) E - PeakMemoryUsage: 0 E - RowsSent: 10 (10) E - RowsSentRate: 555.00 /sec E EXCHANGE_NODE (id=5):(Total: 8s658ms, non-child: 999.998us, % non-child: 0.01%) E ExecOption: Codegen Enabled E Node Lifecycle Event Timeline: 9s547ms E - Open Started: 869.998ms (869.998ms) E - Open Finished: 9s507ms (8s637ms) E - First Batch Requested: 9s507ms (0.000ns) E - First Batch Returned: 9s528ms (20.999ms) E - Last Batch Returned: 9s528ms (0.000ns) E - Closed: 9s547ms (18.999ms) E - ConvertRowBatchTime: 0.000ns E - MergeGetNext: 19.999ms E - MergeGetNextBatch: 19.999ms E - PeakMemoryUsage: 48.00 KB (49152) E - RowsReturned: 10 (10) E - RowsReturnedRate: 1.00 /sec E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 48.00 KB (49152) E - CumulativeAllocations: 6 (6) E - PeakReservation: 48.00 KB (49152) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 48.00 KB (49152) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 0.000ns E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Dequeue: E - BytesDequeued (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - FirstBatchWaitTime: 8s637ms E - TotalBytesDequeued: 750.00 B (750) E - TotalGetBatchTime: 8s657ms E - DataWaitTime: 8s657ms E Enqueue: E - BytesReceived (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - DeferredQueueSize (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - DispatchTime: (Avg: -2363488.000ns ; Min: -5763338.000ns ; Max: -376872.000ns ; Number of samples: 3) E - DeserializeRowBatchTime: 0.000ns E - TotalBatchesEnqueued: 3 (3) E - TotalBatchesReceived: 3 (3) E - TotalBytesReceived: 415.00 B (415) E - TotalEarlySenders: 0 (0) E - TotalEosReceived: 3 (3) E - TotalHasDeferredRPCsTime: 0.000ns E - TotalRPCsDeferred: 0 (0) E CodeGen:(Total: 834.998ms, non-child: 834.998ms, % non-child: 100.00%) E - CodegenInvoluntaryContextSwitches: 98 (98) E - CodegenTotalWallClockTime: 834.998ms E - CodegenSysTime: 0.000ns E - CodegenUserTime: 515.001ms E - CodegenVoluntaryContextSwitches: 0 (0) E - CompileTime: 30.999ms E - IrGenerationTime: 16.999ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 2.53 MB (2655448) E - NumFunctions: 19 (19) E - NumInstructions: 697 (697) E - OptimizationTime: 133.999ms E - PeakMemoryUsage: 348.50 KB (356864) E - PrepareTime: 644.998ms E Averaged Fragment F01:(Total: 9s504ms, non-child: 7.666ms, % non-child: 0.08%) E split sizes: min: 0, max: 0, avg: 0, stddev: 0 E completion times: min:9s548ms max:9s602ms mean: 9s584ms stddev:24.997ms E execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec E num instances: 3 E - AverageThreadTokens: 1.00 E - ExchangeScanRatio: 0.00 E - PeakMemoryUsage: 32.23 MB (33799299) E - PeakReservation: 28.17 MB (29534890) E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 37.85 MB (39691408) E - RowsProduced: 10 (10) E - TotalNetworkReceiveTime: 3s374ms E - TotalNetworkSendTime: 28.666ms E - TotalStorageWaitTime: 0.000ns E - TotalThreadsInvoluntaryContextSwitches: 493 (493) E - TotalThreadsTotalWallClockTime: 9s483ms E - TotalThreadsSysTime: 63.830ms E - TotalThreadsUserTime: 3s244ms E - TotalThreadsVoluntaryContextSwitches: 282 (282) E Fragment Instance Lifecycle Timings: E - ExecTime: 30.333ms E - ExecTreeExecTime: 0.000ns E - OpenTime: 9s453ms E - ExecTreeOpenTime: 4s920ms E - PrepareTime: 19.333ms E - ExecTreePrepareTime: 14.666ms E KrpcDataStreamSender (dst_id=5):(Total: 30.666ms, non-child: 30.666ms, % non-child: 100.00%) E - EosSent: 1 (1) E - PeakMemoryUsage: 7.52 KB (7704) E - RowsSent: 10 (10) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 0.000ns E - TotalBytesSent: 138.00 B (138) E - UncompressedRowBatchSize: 250.00 B (250) E SORT_NODE (id=2):(Total: 4s935ms, non-child: 72.666ms, % non-child: 1.47%) E - InsertBatchTime: 54.999ms E - PeakMemoryUsage: 16.00 KB (16384) E - RowsReturned: 10 (10) E - RowsReturnedRate: 1.00 /sec E - TuplePoolReclamations: 3 (3) E AGGREGATION_NODE (id=4):(Total: 4s862ms, non-child: 1s069ms, % non-child: 22.00%) E - PeakMemoryUsage: 28.19 MB (29560618) E - RowsReturned: 500.00K (500000) E - RowsReturnedRate: 114.45 K/sec E GroupingAggregator 0: E - BuildTime: 655.665ms E - GetResultsTime: 333.665ms E - HTResizeTime: 162.666ms E - LargestPartitionPercent: 5 (5) E - MaxPartitionLevel: 0 (0) E - NumRepartitions: 0 (0) E - PartitionsCreated: 16 (16) E - PeakMemoryUsage: 28.18 MB (29552426) E - PeakReservation: 28.17 MB (29534890) E - PeakUsedReservation: 0 E - RowsRepartitioned: 0 (0) E - RowsReturned: 500.00K (500000) E - SpilledPartitions: 0 (0) E Buffer pool: E - AllocTime: 57.999ms E - CumulativeAllocationBytes: 41.08 MB (43078997) E - CumulativeAllocations: 100 (100) E - PeakReservation: 28.17 MB (29534890) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 28.17 MB (29534890) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 56.666ms E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Hash Table: E - HashBuckets: 1.05M (1048576) E - HashCollisions: 0 (0) E - Probes: 1.27M (1269692) E - Resizes: 96 (96) E - Travel: 597.80K (597801) E EXCHANGE_NODE (id=3):(Total: 3s793ms, non-child: 3s793ms, % non-child: 100.00%) E - ConvertRowBatchTime: 391.332ms E - PeakMemoryUsage: 4.01 MB (4207957) E - RowsReturned: 556.44K (556438) E - RowsReturnedRate: 180.59 K/sec E Buffer pool: E - AllocTime: 7.999ms E - CumulativeAllocationBytes: 13.56 MB (14221312) E - CumulativeAllocations: 1.16K (1158) E - PeakReservation: 4.01 MB (4207957) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 4.01 MB (4207957) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 4.333ms E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Dequeue: E - FirstBatchWaitTime: 574.332ms E - TotalBytesDequeued: 13.27 MB (13910958) E - TotalGetBatchTime: 3s374ms E - DataWaitTime: 3s344ms E Enqueue: E - DeserializeRowBatchTime: 49.666ms E - TotalBatchesEnqueued: 579 (579) E - TotalBatchesReceived: 579 (579) E - TotalBytesReceived: 5.83 MB (6112592) E - TotalEarlySenders: 0 (0) E - TotalEosReceived: 3 (3) E - TotalHasDeferredRPCsTime: 0.000ns E - TotalRPCsDeferred: 0 (0) E CodeGen:(Total: 4s530ms, non-child: 4s530ms, % non-child: 100.00%) E - CodegenInvoluntaryContextSwitches: 400 (400) E - CodegenTotalWallClockTime: 4s530ms E - CodegenSysTime: 2.995ms E - CodegenUserTime: 2s389ms E - CodegenVoluntaryContextSwitches: 6 (6) E - CompileTime: 173.332ms E - IrGenerationTime: 137.666ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 2.53 MB (2655448) E - NumFunctions: 88 (88) E - NumInstructions: 2.46K (2460) E - OptimizationTime: 3s687ms E - PeakMemoryUsage: 1.20 MB (1259520) E - PrepareTime: 520.665ms E Fragment F01: E Instance 6b478dd792c1178a:3586d9df00000006 (host=impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22001):(Total: 9s529ms, non-child: 7.999ms, % non-child: 0.08%) E Last report received time: 2020-02-20 01:59:31.791 E Fragment Instance Lifecycle Event Timeline: 9s530ms E - Prepare Finished: 17.999ms (17.999ms) E - Open Finished: 9s504ms (9s486ms) E - First Batch Produced: 9s505ms (999.998us) E - First Batch Sent: 9s505ms (0.000ns) E - ExecInternal Finished: 9s530ms (24.999ms) E - MemoryUsage (500.000ms): 32.65 KB, 1.23 MB, 1.23 MB, 1.23 MB, 47.13 KB, 47.13 KB, 47.13 KB, 47.13 KB, 5.37 MB, 6.12 MB, 7.39 MB, 10.16 MB, 13.66 MB, 16.91 MB, 19.91 MB, 21.91 MB, 25.41 MB, 26.91 MB, 12.06 MB E - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 E - AverageThreadTokens: 1.00 E - ExchangeScanRatio: 0.00 E - PeakMemoryUsage: 28.16 MB (29531267) E - PeakReservation: 28.00 MB (29360128) E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 34.59 MB (36271126) E - RowsProduced: 10 (10) E - TotalNetworkReceiveTime: 6s183ms E - TotalNetworkSendTime: 23.999ms E - TotalStorageWaitTime: 0.000ns E - TotalThreadsInvoluntaryContextSwitches: 316 (316) E - TotalThreadsTotalWallClockTime: 9s511ms E - TotalThreadsSysTime: 63.541ms E - TotalThreadsUserTime: 2s765ms E - TotalThreadsVoluntaryContextSwitches: 459 (459) E Fragment Instance Lifecycle Timings: E - ExecTime: 24.999ms E - ExecTreeExecTime: 0.000ns E - OpenTime: 9s486ms E - ExecTreeOpenTime: 7s329ms E - PrepareTime: 16.999ms E - ExecTreePrepareTime: 11.999ms E KrpcDataStreamSender (dst_id=5):(Total: 24.999ms, non-child: 999.998us, % non-child: 4.00%) E ExecOption: Unpartitioned Sender Codegen Disabled: not needed E - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - NetworkThroughput: (Avg: 10.18 KB/sec ; Min: 10.18 KB/sec ; Max: 10.18 KB/sec ; Number of samples: 1) E - RpcNetworkTime: (Avg: 15.119ms ; Min: 12.656ms ; Max: 17.581ms ; Number of samples: 2) E - RpcRecvrTime: (Avg: -3127529.000ns ; Min: -5906631.000ns ; Max: -348428.000ns ; Number of samples: 2) E - EosSent: 1 (1) E - PeakMemoryUsage: 7.52 KB (7704) E - RowsSent: 10 (10) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 0.000ns E - TotalBytesSent: 132.00 B (132) E - UncompressedRowBatchSize: 250.00 B (250) E SORT_NODE (id=2):(Total: 7s341ms, non-child: 31.999ms, % non-child: 0.44%) E SortType: TopN E ExecOption: Codegen Enabled E Node Lifecycle Event Timeline: 9s505ms E - Open Started: 2s174ms (2s174ms) E - Open Finished: 9s504ms (7s329ms) E - First Batch Requested: 9s504ms (0.000ns) E - First Batch Returned: 9s504ms (0.000ns) E - Last Batch Returned: 9s504ms (0.000ns) E - Closed: 9s505ms (999.998us) E - InsertBatchTime: 23.999ms E - PeakMemoryUsage: 16.00 KB (16384) E - RowsReturned: 10 (10) E - RowsReturnedRate: 1.00 /sec E - TuplePoolReclamations: 3 (3) E AGGREGATION_NODE (id=4):(Total: 7s309ms, non-child: 819.998ms, % non-child: 11.22%) E Node Lifecycle Event Timeline: 9s504ms E - Open Started: 2s174ms (2s174ms) E - Open Finished: 9s083ms (6s908ms) E - First Batch Requested: 9s083ms (0.000ns) E - First Batch Returned: 9s084ms (999.998us) E - Last Batch Returned: 9s503ms (418.999ms) E - Closed: 9s504ms (999.998us) E - PeakMemoryUsage: 28.02 MB (29385856) E - RowsReturned: 498.77K (498771) E - RowsReturnedRate: 68.23 K/sec E GroupingAggregator 0: E ExecOption: Codegen Enabled E - BuildTime: 383.999ms E - GetResultsTime: 365.999ms E - HTResizeTime: 94.999ms E - LargestPartitionPercent: 5 (5) E - MaxPartitionLevel: 0 (0) E - NumRepartitions: 0 (0) E - PartitionsCreated: 16 (16) E - PeakMemoryUsage: 28.02 MB (29377664) E - PeakReservation: 28.00 MB (29360128) E - PeakUsedReservation: 0 E - RowsRepartitioned: 0 (0) E - RowsReturned: 498.77K (498771) E - SpilledPartitions: 0 (0) E Buffer pool: E - AllocTime: 5.999ms E - CumulativeAllocationBytes: 41.50 MB (43515904) E - CumulativeAllocations: 102 (102) E - PeakReservation: 28.00 MB (29360128) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 28.00 MB (29360128) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 4.999ms E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Hash Table: E - HashBuckets: 1.05M (1048576) E - HashCollisions: 0 (0) E - Probes: 1.27M (1268949) E - Resizes: 96 (96) E - Travel: 596.59K (596585) E EXCHANGE_NODE (id=3):(Total: 6s489ms, non-child: 334.999ms, % non-child: 5.16%) E Node Lifecycle Event Timeline: 9s083ms E - Open Started: 2s174ms (2s174ms) E - Open Finished: 3s897ms (1s722ms) E - First Batch Requested: 3s925ms (27.999ms) E - First Batch Returned: 3s926ms (999.998us) E - Last Batch Returned: 9s083ms (5s156ms) E - Closed: 9s083ms (0.000ns) E - ConvertRowBatchTime: 274.999ms E - PeakMemoryUsage: 112.00 KB (114688) E - RowsReturned: 556.05K (556048) E - RowsReturnedRate: 85.68 K/sec E Buffer pool: E - AllocTime: 4.999ms E - CumulativeAllocationBytes: 13.55 MB (14213120) E - CumulativeAllocations: 1.16K (1158) E - PeakReservation: 112.00 KB (114688) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 112.00 KB (114688) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 999.998us E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Dequeue: E - BytesDequeued (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 493.73 KB, 1.63 MB, 3.38 MB, 5.51 MB, 7.42 MB, 8.80 MB, 9.88 MB, 11.08 MB, 12.17 MB, 12.84 MB E - FirstBatchWaitTime: 1s722ms E - TotalBytesDequeued: 13.26 MB (13901200) E - TotalGetBatchTime: 6s183ms E - DataWaitTime: 6s154ms E Enqueue: E - BytesReceived (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 230.22 KB, 661.37 KB, 1.25 MB, 2.16 MB, 3.06 MB, 3.71 MB, 4.22 MB, 4.79 MB, 5.31 MB, 5.62 MB E - DeferredQueueSize (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - DispatchTime: (Avg: -1119322.000ns ; Min: -17059783.000ns ; Max: -129380.000ns ; Number of samples: 579) E - DeserializeRowBatchTime: 42.999ms E - TotalBatchesEnqueued: 579 (579) E - TotalBatchesReceived: 579 (579) E - TotalBytesReceived: 5.82 MB (6102289) E - TotalEarlySenders: 0 (0) E - TotalEosReceived: 3 (3) E - TotalHasDeferredRPCsTime: 0.000ns E - TotalRPCsDeferred: 0 (0) E CodeGen:(Total: 2s154ms, non-child: 2s154ms, % non-child: 100.00%) E - CodegenInvoluntaryContextSwitches: 267 (267) E - CodegenTotalWallClockTime: 2s154ms E - CodegenSysTime: 67.000us E - CodegenUserTime: 1s900ms E - CodegenVoluntaryContextSwitches: 0 (0) E - CompileTime: 129.999ms E - IrGenerationTime: 56.999ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 2.53 MB (2655448) E - NumFunctions: 88 (88) E - NumInstructions: 2.46K (2460) E - OptimizationTime: 1s662ms E - PeakMemoryUsage: 1.20 MB (1259520) E - PrepareTime: 297.999ms E Instance 6b478dd792c1178a:3586d9df00000004 (host=impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22002):(Total: 9s513ms, non-child: 7.999ms, % non-child: 0.08%) E Last report received time: 2020-02-20 01:59:31.845 E Fragment Instance Lifecycle Event Timeline: 9s557ms E - Prepare Finished: 60.999ms (60.999ms) E - Open Finished: 9s516ms (9s455ms) E - First Batch Produced: 9s516ms (0.000ns) E - First Batch Sent: 9s516ms (0.000ns) E - ExecInternal Finished: 9s557ms (40.999ms) E - MemoryUsage (500.000ms): 32.65 KB, 32.65 KB, 1.23 MB, 1.23 MB, 1.23 MB, 1.23 MB, 1.23 MB, 1.23 MB, 2.05 MB, 3.41 MB, 5.29 MB, 11.44 MB, 18.94 MB, 22.69 MB, 25.69 MB, 28.69 MB, 31.19 MB, 33.44 MB, 4.81 MB E - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 E - AverageThreadTokens: 1.00 E - ExchangeScanRatio: 0.00 E - PeakMemoryUsage: 34.19 MB (35847299) E - PeakReservation: 28.25 MB (29622272) E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 38.55 MB (40421794) E - RowsProduced: 10 (10) E - TotalNetworkReceiveTime: 2s207ms E - TotalNetworkSendTime: 38.999ms E - TotalStorageWaitTime: 0.000ns E - TotalThreadsInvoluntaryContextSwitches: 492 (492) E - TotalThreadsTotalWallClockTime: 9s493ms E - TotalThreadsSysTime: 69.472ms E - TotalThreadsUserTime: 3s376ms E - TotalThreadsVoluntaryContextSwitches: 208 (208) E Fragment Instance Lifecycle Timings: E - ExecTime: 39.999ms E - ExecTreeExecTime: 0.000ns E - OpenTime: 9s454ms E - ExecTreeOpenTime: 3s711ms E - PrepareTime: 17.999ms E - ExecTreePrepareTime: 12.999ms E KrpcDataStreamSender (dst_id=5):(Total: 39.999ms, non-child: 999.998us, % non-child: 2.50%) E ExecOption: Unpartitioned Sender Codegen Disabled: not needed E - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - NetworkThroughput: (Avg: 7.84 KB/sec ; Min: 7.84 KB/sec ; Max: 7.84 KB/sec ; Number of samples: 1) E - RpcNetworkTime: (Avg: 20.417ms ; Min: 18.678ms ; Max: 22.157ms ; Number of samples: 2) E - RpcRecvrTime: (Avg: -3222128.000ns ; Min: -5362836.000ns ; Max: -1081420.000ns ; Number of samples: 2) E - EosSent: 1 (1) E - PeakMemoryUsage: 7.52 KB (7704) E - RowsSent: 10 (10) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 0.000ns E - TotalBytesSent: 150.00 B (150) E - UncompressedRowBatchSize: 250.00 B (250) E SORT_NODE (id=2):(Total: 3s724ms, non-child: 127.999ms, % non-child: 3.44%) E SortType: TopN E ExecOption: Codegen Enabled E Node Lifecycle Event Timeline: 9s516ms E - Open Started: 5s803ms (5s803ms) E - Open Finished: 9s515ms (3s711ms) E - First Batch Requested: 9s516ms (999.998us) E - First Batch Returned: 9s516ms (0.000ns) E - Last Batch Returned: 9s516ms (0.000ns) E - Closed: 9s516ms (0.000ns) E - InsertBatchTime: 87.999ms E - PeakMemoryUsage: 16.00 KB (16384) E - RowsReturned: 10 (10) E - RowsReturnedRate: 2.00 /sec E - TuplePoolReclamations: 4 (4) E AGGREGATION_NODE (id=4):(Total: 3s596ms, non-child: 1s051ms, % non-child: 29.25%) E Node Lifecycle Event Timeline: 9s515ms E - Open Started: 5s804ms (5s804ms) E - Open Finished: 9s072ms (3s267ms) E - First Batch Requested: 9s072ms (0.000ns) E - First Batch Returned: 9s073ms (999.998us) E - Last Batch Returned: 9s514ms (440.999ms) E - Closed: 9s515ms (999.998us) E - PeakMemoryUsage: 28.27 MB (29648000) E - RowsReturned: 499.90K (499902) E - RowsReturnedRate: 138.98 K/sec E GroupingAggregator 0: E ExecOption: Codegen Enabled E - BuildTime: 700.998ms E - GetResultsTime: 286.999ms E - HTResizeTime: 88.999ms E - LargestPartitionPercent: 5 (5) E - MaxPartitionLevel: 0 (0) E - NumRepartitions: 0 (0) E - PartitionsCreated: 16 (16) E - PeakMemoryUsage: 28.27 MB (29639808) E - PeakReservation: 28.25 MB (29622272) E - PeakUsedReservation: 0 E - RowsRepartitioned: 0 (0) E - RowsReturned: 499.90K (499902) E - SpilledPartitions: 0 (0) E Buffer pool: E - AllocTime: 16.999ms E - CumulativeAllocationBytes: 41.00 MB (42991616) E - CumulativeAllocations: 100 (100) E - PeakReservation: 28.25 MB (29622272) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 28.25 MB (29622272) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 14.999ms E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Hash Table: E - HashBuckets: 1.05M (1048576) E - HashCollisions: 0 (0) E - Probes: 1.27M (1270869) E - Resizes: 96 (96) E - Travel: 602.19K (602189) E EXCHANGE_NODE (id=3):(Total: 2s544ms, non-child: 357.999ms, % non-child: 14.07%) E Node Lifecycle Event Timeline: 9s072ms E - Open Started: 5s804ms (5s804ms) E - Open Finished: 5s804ms (0.000ns) E - First Batch Requested: 5s820ms (15.999ms) E - First Batch Returned: 5s820ms (0.000ns) E - Last Batch Returned: 9s071ms (3s250ms) E - Closed: 9s072ms (999.998us) E - ConvertRowBatchTime: 310.999ms E - PeakMemoryUsage: 5.88 MB (6168576) E - RowsReturned: 556.25K (556255) E - RowsReturnedRate: 218.57 K/sec E Buffer pool: E - AllocTime: 8.999ms E - CumulativeAllocationBytes: 13.55 MB (14213120) E - CumulativeAllocations: 1.16K (1158) E - PeakReservation: 5.88 MB (6168576) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 5.88 MB (6168576) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 4.999ms E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Dequeue: E - BytesDequeued (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 822.88 KB, 6.59 MB, 8.92 MB, 10.20 MB, 11.49 MB, 12.37 MB, 13.10 MB E - FirstBatchWaitTime: 0.000ns E - TotalBytesDequeued: 13.26 MB (13906375) E - TotalGetBatchTime: 2s206ms E - DataWaitTime: 2s186ms E Enqueue: E - BytesReceived (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 366.86 KB, 842.00 KB, 1.49 MB, 2.43 MB, 3.37 MB, 3.77 MB, 4.41 MB, 5.00 MB, 5.41 MB, 5.75 MB E - DeferredQueueSize (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - DispatchTime: (Avg: -1328304.000ns ; Min: -16344540.000ns ; Max: -180106.000ns ; Number of samples: 579) E - DeserializeRowBatchTime: 52.999ms E - TotalBatchesEnqueued: 579 (579) E - TotalBatchesReceived: 579 (579) E - TotalBytesReceived: 5.83 MB (6110627) E - TotalEarlySenders: 0 (0) E - TotalEosReceived: 3 (3) E - TotalHasDeferredRPCsTime: 0.000ns E - TotalRPCsDeferred: 0 (0) E CodeGen:(Total: 5s740ms, non-child: 5s740ms, % non-child: 100.00%) E - CodegenInvoluntaryContextSwitches: 411 (411) E - CodegenTotalWallClockTime: 5s740ms E - CodegenSysTime: 5.950ms E - CodegenUserTime: 2s551ms E - CodegenVoluntaryContextSwitches: 16 (16) E - CompileTime: 192.999ms E - IrGenerationTime: 174.999ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 2.53 MB (2655448) E - NumFunctions: 88 (88) E - NumInstructions: 2.46K (2460) E - OptimizationTime: 4s752ms E - PeakMemoryUsage: 1.20 MB (1259520) E - PrepareTime: 612.998ms E Instance 6b478dd792c1178a:3586d9df00000005 (host=impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22000):(Total: 9s469ms, non-child: 6.999ms, % non-child: 0.07%) E Last report received time: 2020-02-20 01:59:31.874 E Fragment Instance Lifecycle Event Timeline: 9s522ms E - Prepare Finished: 76.999ms (76.999ms) E - Open Finished: 9s494ms (9s417ms) E - First Batch Produced: 9s494ms (0.000ns) E - First Batch Sent: 9s496ms (1.999ms) E - ExecInternal Finished: 9s522ms (25.999ms) E - MemoryUsage (500.000ms): 32.65 KB, 32.65 KB, 1.23 MB, 1.23 MB, 1.23 MB, 1.23 MB, 1.23 MB, 1.23 MB, 1.96 MB, 3.27 MB, 5.24 MB, 11.35 MB, 16.10 MB, 20.85 MB, 26.10 MB, 28.85 MB, 31.35 MB, 33.60 MB, 5.31 MB E - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 E - AverageThreadTokens: 1.00 E - ExchangeScanRatio: 0.00 E - PeakMemoryUsage: 34.35 MB (36019331) E - PeakReservation: 28.25 MB (29622272) E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 40.42 MB (42381305) E - RowsProduced: 10 (10) E - TotalNetworkReceiveTime: 1s731ms E - TotalNetworkSendTime: 22.999ms E - TotalStorageWaitTime: 0.000ns E - TotalThreadsInvoluntaryContextSwitches: 672 (672) E - TotalThreadsTotalWallClockTime: 9s444ms E - TotalThreadsSysTime: 58.479ms E - TotalThreadsUserTime: 3s592ms E - TotalThreadsVoluntaryContextSwitches: 179 (179) E Fragment Instance Lifecycle Timings: E - ExecTime: 25.999ms E - ExecTreeExecTime: 0.000ns E - OpenTime: 9s418ms E - ExecTreeOpenTime: 3s720ms E - PrepareTime: 22.999ms E - ExecTreePrepareTime: 18.999ms E KrpcDataStreamSender (dst_id=5):(Total: 26.999ms, non-child: 3.999ms, % non-child: 14.81%) E ExecOption: Unpartitioned Sender Codegen Disabled: not needed E - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - NetworkThroughput: (Avg: 59.73 KB/sec ; Min: 59.73 KB/sec ; Max: 59.73 KB/sec ; Number of samples: 1) E - RpcNetworkTime: (Avg: 4.350ms ; Min: 2.174ms ; Max: 6.526ms ; Number of samples: 2) E - RpcRecvrTime: (Avg: -400828.000ns ; Min: -505419.000ns ; Max: -296237.000ns ; Number of samples: 2) E - EosSent: 1 (1) E - PeakMemoryUsage: 7.52 KB (7704) E - RowsSent: 10 (10) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 0.000ns E - TotalBytesSent: 133.00 B (133) E - UncompressedRowBatchSize: 250.00 B (250) E SORT_NODE (id=2):(Total: 3s739ms, non-child: 57.999ms, % non-child: 1.55%) E SortType: TopN E ExecOption: Codegen Enabled E Node Lifecycle Event Timeline: 9s496ms E - Open Started: 5s773ms (5s773ms) E - Open Finished: 9s494ms (3s720ms) E - First Batch Requested: 9s494ms (0.000ns) E - First Batch Returned: 9s494ms (0.000ns) E - Last Batch Returned: 9s494ms (0.000ns) E - Closed: 9s496ms (1.999ms) E - InsertBatchTime: 52.999ms E - PeakMemoryUsage: 16.00 KB (16384) E - RowsReturned: 10 (10) E - RowsReturnedRate: 2.00 /sec E - TuplePoolReclamations: 3 (3) E AGGREGATION_NODE (id=4):(Total: 3s681ms, non-child: 1s336ms, % non-child: 36.31%) E Node Lifecycle Event Timeline: 9s494ms E - Open Started: 5s773ms (5s773ms) E - Open Finished: 9s065ms (3s291ms) E - First Batch Requested: 9s065ms (0.000ns) E - First Batch Returned: 9s066ms (999.998us) E - Last Batch Returned: 9s492ms (425.999ms) E - Closed: 9s494ms (1.999ms) E - PeakMemoryUsage: 28.27 MB (29648000) E - RowsReturned: 501.33K (501327) E - RowsReturnedRate: 136.16 K/sec E GroupingAggregator 0: E ExecOption: Codegen Enabled E - BuildTime: 881.998ms E - GetResultsTime: 347.999ms E - HTResizeTime: 303.999ms E - LargestPartitionPercent: 5 (5) E - MaxPartitionLevel: 0 (0) E - NumRepartitions: 0 (0) E - PartitionsCreated: 16 (16) E - PeakMemoryUsage: 28.27 MB (29639808) E - PeakReservation: 28.25 MB (29622272) E - PeakUsedReservation: 0 E - RowsRepartitioned: 0 (0) E - RowsReturned: 501.33K (501327) E - SpilledPartitions: 0 (0) E Buffer pool: E - AllocTime: 150.999ms E - CumulativeAllocationBytes: 40.75 MB (42729472) E - CumulativeAllocations: 99 (99) E - PeakReservation: 28.25 MB (29622272) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 28.25 MB (29622272) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 149.999ms E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Hash Table: E - HashBuckets: 1.05M (1048576) E - HashCollisions: 0 (0) E - Probes: 1.27M (1269258) E - Resizes: 96 (96) E - Travel: 594.63K (594631) E EXCHANGE_NODE (id=3):(Total: 2s344ms, non-child: 653.998ms, % non-child: 27.89%) E Node Lifecycle Event Timeline: 9s065ms E - Open Started: 5s773ms (5s773ms) E - Open Finished: 5s773ms (0.000ns) E - First Batch Requested: 5s827ms (53.999ms) E - First Batch Returned: 5s827ms (0.000ns) E - Last Batch Returned: 9s064ms (3s236ms) E - Closed: 9s065ms (999.998us) E - ConvertRowBatchTime: 587.998ms E - PeakMemoryUsage: 6.05 MB (6340608) E - RowsReturned: 557.01K (557012) E - RowsReturnedRate: 237.53 K/sec E Buffer pool: E - AllocTime: 9.999ms E - CumulativeAllocationBytes: 13.58 MB (14237696) E - CumulativeAllocations: 1.16K (1160) E - PeakReservation: 6.05 MB (6340608) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 6.05 MB (6340608) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 6.999ms E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Dequeue: E - BytesDequeued (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 376.17 KB, 5.21 MB, 8.06 MB, 10.22 MB, 11.46 MB, 12.31 MB, 13.06 MB E - FirstBatchWaitTime: 0.000ns E - TotalBytesDequeued: 13.28 MB (13925300) E - TotalGetBatchTime: 1s731ms E - DataWaitTime: 1s690ms E Enqueue: E - BytesReceived (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 334.15 KB, 798.54 KB, 1.48 MB, 2.40 MB, 3.34 MB, 3.76 MB, 4.40 MB, 4.99 MB, 5.39 MB, 5.74 MB E - DeferredQueueSize (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - DispatchTime: (Avg: -1316273.000ns ; Min: -16764400.000ns ; Max: -196793.000ns ; Number of samples: 580) E - DeserializeRowBatchTime: 52.999ms E - TotalBatchesEnqueued: 580 (580) E - TotalBatchesReceived: 580 (580) E - TotalBytesReceived: 5.84 MB (6124860) E - TotalEarlySenders: 0 (0) E - TotalEosReceived: 3 (3) E - TotalHasDeferredRPCsTime: 0.000ns E - TotalRPCsDeferred: 0 (0) E CodeGen:(Total: 5s695ms, non-child: 5s695ms, % non-child: 100.00%) E - CodegenInvoluntaryContextSwitches: 524 (524) E - CodegenTotalWallClockTime: 5s695ms E - CodegenSysTime: 2.969ms E - CodegenUserTime: 2s716ms E - CodegenVoluntaryContextSwitches: 3 (3) E - CompileTime: 196.999ms E - IrGenerationTime: 180.999ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 2.53 MB (2655448) E - NumFunctions: 88 (88) E - NumInstructions: 2.46K (2460) E - OptimizationTime: 4s646ms E - PeakMemoryUsage: 1.20 MB (1259520) E - PrepareTime: 650.998ms E Averaged Fragment F00:(Total: 7s813ms, non-child: 10.666ms, % non-child: 0.14%) E split sizes: min: 55.81 MB, max: 69.23 MB, avg: 64.66 MB, stddev: 6.26 MB E completion times: min:9s547ms max:9s601ms mean: 9s583ms stddev:24.997ms E execution rates: min:5.85 MB/sec max:7.21 MB/sec mean:6.75 MB/sec stddev:651.90 KB/sec E num instances: 3 E - AverageThreadTokens: 1.23 E - ExchangeScanRatio: 1.80 E - PeakMemoryUsage: 30.36 MB (31837416) E - PeakReservation: 29.00 MB (30408704) E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 37.85 MB (39691408) E - RowsProduced: 556.44K (556438) E - TotalNetworkReceiveTime: 0.000ns E - TotalNetworkSendTime: 2s309ms E - TotalStorageWaitTime: 8.333ms E - TotalThreadsInvoluntaryContextSwitches: 1.07K (1066) E - TotalThreadsTotalWallClockTime: 9s592ms E - TotalThreadsSysTime: 90.614ms E - TotalThreadsUserTime: 3s250ms E - TotalThreadsVoluntaryContextSwitches: 813 (813) E Fragment Instance Lifecycle Timings: E - ExecTime: 4s977ms E - ExecTreeExecTime: 1s797ms E - OpenTime: 2s823ms E - ExecTreeOpenTime: 25.666ms E - PrepareTime: 10.999ms E - ExecTreePrepareTime: 6.333ms E KrpcDataStreamSender (dst_id=3):(Total: 3s176ms, non-child: 3s176ms, % non-child: 100.00%) E - EosSent: 3 (3) E - PeakMemoryUsage: 106.57 KB (109128) E - RowsSent: 556.44K (556438) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 284.332ms E - TotalBytesSent: 5.83 MB (6112592) E - UncompressedRowBatchSize: 13.27 MB (13910958) E AGGREGATION_NODE (id=1):(Total: 1s829ms, non-child: 1s259ms, % non-child: 68.83%) E - PeakMemoryUsage: 25.03 MB (26249344) E - RowsReturned: 556.44K (556438) E - RowsReturnedRate: 314.13 K/sec E GroupingAggregator 0: E - BuildTime: 0.000ns E - GetResultsTime: 189.666ms E - HTResizeTime: 202.999ms E - LargestPartitionPercent: 1 (1) E - PartitionsCreated: 16 (16) E - PeakMemoryUsage: 25.02 MB (26231936) E - PeakReservation: 25.00 MB (26214400) E - PeakUsedReservation: 0 E - ReductionFactorEstimate: 10.01 E - ReductionFactorThresholdToExpand: 2.00 E - RowsPassedThrough: 75.20K (75201) E - RowsReturned: 556.44K (556438) E - StreamingTime: 942.664ms E Buffer pool: E - AllocTime: 4.333ms E - CumulativeAllocationBytes: 39.08 MB (40981845) E - CumulativeAllocations: 92 (92) E - PeakReservation: 25.00 MB (26214400) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 25.00 MB (26214400) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 3.999ms E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Hash Table: E - HashBuckets: 1.05M (1048576) E - HashCollisions: 0 (0) E - Probes: 2.68M (2681085) E - Resizes: 96 (96) E - Travel: 991.58K (991580) E HDFS_SCAN_NODE (id=0):(Total: 570.332ms, non-child: 570.332ms, % non-child: 100.00%) E - AverageHdfsReadThreadConcurrency: 0.00 E - AverageScannerThreadConcurrency: 0.92 E - BytesRead: 3.22 MB (3374616) E - BytesReadDataNodeCache: 0 E - BytesReadLocal: 3.22 MB (3374616) E - BytesReadRemoteUnexpected: 0 E - BytesReadShortCircuit: 3.22 MB (3374616) E - CachedFileHandlesHitCount: 2 (2) E - CachedFileHandlesMissCount: 0 (0) E - CollectionItemsRead: 0 (0) E - DataCacheHitBytes: 0 E - DataCacheHitCount: 0 (0) E - DataCacheMissBytes: 0 E - DataCacheMissCount: 0 (0) E - DataCachePartialHitCount: 0 (0) E - DecompressionTime: 14.333ms E - MaterializeTupleTime: 67.666ms E - MaxCompressedTextFileLength: 0 E - NumColumns: 1 (1) E - NumDictFilteredRowGroups: 0 (0) E - NumDisksAccessed: 1 (1) E - NumPages: 230 (230) E - NumRowGroups: 1 (1) E - NumRowGroupsWithPageIndex: 1 (1) E - NumScannerThreadMemUnavailable: 0 (0) E - NumScannerThreadReservationsDenied: 0 (0) E - NumScannerThreadsStarted: 1 (1) E - NumScannersWithNoReads: 0 (0) E - NumStatsFilteredPages: 0 (0) E - NumStatsFilteredRowGroups: 0 (0) E - PeakMemoryUsage: 5.23 MB (5489160) E - PeakScannerThreadConcurrency: 1 (1) E - PerReadThreadRawHdfsThroughput: 1.11 GB/sec E - RemoteScanRanges: 0 (0) E - RowBatchBytesEnqueued: 17.17 MB (18008064) E - RowBatchQueueGetWaitTime: 25.333ms E - RowBatchQueuePeakMemoryUsage: 884.00 KB (905216) E - RowBatchQueuePutWaitTime: 1s538ms E - RowBatchesEnqueued: 1.96K (1956) E - RowsRead: 2.00M (2000405) E - RowsReturned: 2.00M (2000405) E - RowsReturnedRate: 4.01 M/sec E - ScanRangesComplete: 1 (1) E - ScannerIoWaitTime: 8.333ms E - ScannerThreadWorklessLoops: 0 (0) E - ScannerThreadsInvoluntaryContextSwitches: 1 (1) E - ScannerThreadsTotalWallClockTime: 1s790ms E - ScannerThreadsSysTime: 3.876ms E - ScannerThreadsUserTime: 195.257ms E - ScannerThreadsVoluntaryContextSwitches: 599 (599) E - TotalRawHdfsOpenFileTime: 0.000ns E - TotalRawHdfsReadTime: 2.999ms E - TotalReadThroughput: 682.76 KB/sec E Buffer pool: E - AllocTime: 333.332us E - CumulativeAllocationBytes: 4.12 MB (4325376) E - CumulativeAllocations: 2 (2) E - PeakReservation: 4.00 MB (4194304) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 4.00 MB (4194304) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 333.332us E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E CodeGen:(Total: 2s796ms, non-child: 2s796ms, % non-child: 100.00%) E - CodegenInvoluntaryContextSwitches: 313 (313) E - CodegenTotalWallClockTime: 2s796ms E - CodegenSysTime: 2.653ms E - CodegenUserTime: 1s461ms E - CodegenVoluntaryContextSwitches: 0 (0) E - CompileTime: 80.666ms E - IrGenerationTime: 101.333ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 2.53 MB (2655448) E - NumFunctions: 46 (46) E - NumInstructions: 1.12K (1119) E - OptimizationTime: 2s004ms E - PeakMemoryUsage: 559.50 KB (572928) E - PrepareTime: 595.998ms E Fragment F00: E Instance 6b478dd792c1178a:3586d9df00000002 (host=impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22000):(Total: 9s010ms, non-child: 11.999ms, % non-child: 0.13%) E Last report received time: 2020-02-20 01:59:31.873 E Hdfs split stats (:<# splits>/): 0:1/68.95 MB E Fragment Instance Lifecycle Event Timeline: 9s088ms E - Prepare Finished: 87.999ms (87.999ms) E - Open Finished: 2s992ms (2s904ms) E - First Batch Produced: 4s804ms (1s811ms) E - First Batch Sent: 4s804ms (0.000ns) E - ExecInternal Finished: 9s088ms (4s283ms) E - MemoryUsage (500.000ms): 47.70 KB, 47.70 KB, 607.20 KB, 607.20 KB, 607.20 KB, 607.20 KB, 11.54 MB, 17.54 MB, 24.79 MB, 30.58 MB, 30.12 MB, 23.85 MB, 20.86 MB, 17.36 MB, 12.60 MB, 11.11 MB, 6.35 MB, 5.12 MB E - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1 E - AverageThreadTokens: 1.28 E - ExchangeScanRatio: 1.82 E - PeakMemoryUsage: 30.65 MB (32135059) E - PeakReservation: 29.25 MB (30670848) E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 40.42 MB (42381305) E - RowsProduced: 616.00K (616000) E - TotalNetworkReceiveTime: 0.000ns E - TotalNetworkSendTime: 2s762ms E - TotalStorageWaitTime: 4.999ms E - TotalThreadsInvoluntaryContextSwitches: 1.51K (1511) E - TotalThreadsTotalWallClockTime: 11s405ms E - TotalThreadsSysTime: 116.704ms E - TotalThreadsUserTime: 3s797ms E - TotalThreadsVoluntaryContextSwitches: 1.05K (1051) E Fragment Instance Lifecycle Timings: E - ExecTime: 6s093ms E - ExecTreeExecTime: 2s383ms E - OpenTime: 2s903ms E - ExecTreeOpenTime: 14.999ms E - PrepareTime: 11.999ms E - ExecTreePrepareTime: 6.999ms E KrpcDataStreamSender (dst_id=3):(Total: 3s706ms, non-child: 943.998ms, % non-child: 25.47%) E ExecOption: Hash Partitioned Sender Codegen Enabled E - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 435.14 KB, 1.11 MB, 1.94 MB, 2.65 MB, 3.41 MB, 4.07 MB, 4.89 MB, 5.91 MB E - NetworkThroughput: (Avg: 1.73 MB/sec ; Min: 51.23 KB/sec ; Max: 10.54 MB/sec ; Number of samples: 641) E - RpcNetworkTime: (Avg: 10.180ms ; Min: 1.017ms ; Max: 213.282ms ; Number of samples: 644) E - RpcRecvrTime: (Avg: -1271817.000ns ; Min: -16910189.000ns ; Max: -230425.000ns ; Number of samples: 644) E - EosSent: 3 (3) E - PeakMemoryUsage: 106.57 KB (109128) E - RowsSent: 616.00K (616000) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 342.999ms E - TotalBytesSent: 6.23 MB (6534830) E - UncompressedRowBatchSize: 14.69 MB (15400000) E AGGREGATION_NODE (id=1):(Total: 2s404ms, non-child: 1s566ms, % non-child: 65.16%) E Node Lifecycle Event Timeline: 9s030ms E - Open Started: 2s976ms (2s976ms) E - Open Finished: 2s991ms (14.999ms) E - First Batch Requested: 2s992ms (999.998us) E - First Batch Returned: 4s803ms (1s810ms) E - Last Batch Returned: 9s029ms (4s225ms) E - Closed: 9s030ms (999.998us) E - PeakMemoryUsage: 25.28 MB (26511488) E - RowsReturned: 616.00K (616000) E - RowsReturnedRate: 256.13 K/sec E GroupingAggregator 0: E ExecOption: Streaming Preaggregation, Codegen Enabled E - BuildTime: 0.000ns E - GetResultsTime: 214.999ms E - HTResizeTime: 275.999ms E - LargestPartitionPercent: 1 (1) E - PartitionsCreated: 16 (16) E - PeakMemoryUsage: 25.27 MB (26494080) E - PeakReservation: 25.25 MB (26476544) E - PeakUsedReservation: 0 E - ReductionFactorEstimate: 10.01 E - ReductionFactorThresholdToExpand: 2.00 E - RowsPassedThrough: 110.08K (110080) E - RowsReturned: 616.00K (616000) E - StreamingTime: 1s126ms E Buffer pool: E - AllocTime: 1.999ms E - CumulativeAllocationBytes: 39.50 MB (41418752) E - CumulativeAllocations: 94 (94) E - PeakReservation: 25.25 MB (26476544) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 25.25 MB (26476544) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 1.999ms E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Hash Table: E - HashBuckets: 1.05M (1048576) E - HashCollisions: 0 (0) E - Probes: 2.81M (2814834) E - Resizes: 96 (96) E - Travel: 1.07M (1069209) E HDFS_SCAN_NODE (id=0):(Total: 837.998ms, non-child: 837.998ms, % non-child: 100.00%) E Table Name: tpch_parquet.lineitem E Hdfs split stats (:<# splits>/): 0:1/68.95 MB E ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 E Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% E File Formats: PARQUET/SNAPPY:1 E Node Lifecycle Event Timeline: 5s546ms E - Open Started: 2s976ms (2s976ms) E - Open Finished: 2s980ms (3.999ms) E - First Batch Requested: 2s992ms (11.999ms) E - First Batch Returned: 3s037ms (44.999ms) E - Last Batch Returned: 5s546ms (2s508ms) E - Closed: 5s546ms (0.000ns) E - BytesReadSeries (500.000ms): 0, 0, 0, 0, 0, 0, 3.42 MB, 3.42 MB, 3.42 MB, 3.42 MB, 3.42 MB E - FooterProcessingTime: (Avg: 1.999ms ; Min: 1.999ms ; Max: 1.999ms ; Number of samples: 1) E - InitialRangeActualReservation: (Avg: 4.00 MB (4194304) ; Min: 4.00 MB (4194304) ; Max: 4.00 MB (4194304) ; Number of samples: 1) E - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) E - PageIndexProcessingTime: 0.000ns (Number of samples: 0) E - ParquetCompressedBytesReadPerColumn: (Avg: 3.16 MB (3313126) ; Min: 3.16 MB (3313126) ; Max: 3.16 MB (3313126) ; Number of samples: 1) E - ParquetCompressedPageSize: (Avg: 13.15 KB (13467) ; Min: 11.90 KB (12186) ; Max: 63.99 KB (65530) ; Number of samples: 246) E - ParquetRowGroupActualReservation: (Avg: 4.00 MB (4194304) ; Min: 4.00 MB (4194304) ; Max: 4.00 MB (4194304) ; Number of samples: 1) E - ParquetRowGroupIdealReservation: (Avg: 4.00 MB (4194304) ; Min: 4.00 MB (4194304) ; Max: 4.00 MB (4194304) ; Number of samples: 1) E - ParquetUncompressedBytesReadPerColumn: (Avg: 15.35 MB (16094978) ; Min: 15.35 MB (16094978) ; Max: 15.35 MB (16094978) ; Number of samples: 1) E - ParquetUncompressedPageSize: (Avg: 63.89 KB (65426) ; Min: 40.46 KB (41427) ; Max: 64.01 KB (65544) ; Number of samples: 246) E - AverageHdfsReadThreadConcurrency: 0.00 E - AverageScannerThreadConcurrency: 1.00 E - BytesRead: 3.42 MB (3580967) E - BytesReadDataNodeCache: 0 E - BytesReadLocal: 3.42 MB (3580967) E - BytesReadRemoteUnexpected: 0 E - BytesReadShortCircuit: 3.42 MB (3580967) E - CachedFileHandlesHitCount: 2 (2) E - CachedFileHandlesMissCount: 0 (0) E - CollectionItemsRead: 0 (0) E - DataCacheHitBytes: 0 E - DataCacheHitCount: 0 (0) E - DataCacheMissBytes: 0 E - DataCacheMissCount: 0 (0) E - DataCachePartialHitCount: 0 (0) E - DecompressionTime: 15.999ms E - MaterializeTupleTime: 81.999ms E - MaxCompressedTextFileLength: 0 E - NumColumns: 1 (1) E - NumDictFilteredRowGroups: 0 (0) E - NumDisksAccessed: 1 (1) E - NumPages: 246 (246) E - NumRowGroups: 1 (1) E - NumRowGroupsWithPageIndex: 1 (1) E - NumScannerThreadMemUnavailable: 0 (0) E - NumScannerThreadReservationsDenied: 0 (0) E - NumScannerThreadsStarted: 1 (1) E - NumScannersWithNoReads: 0 (0) E - NumStatsFilteredPages: 0 (0) E - NumStatsFilteredRowGroups: 0 (0) E - PeakMemoryUsage: 5.23 MB (5489160) E - PeakScannerThreadConcurrency: 1 (1) E - PerReadThreadRawHdfsThroughput: 1.11 GB/sec E - RemoteScanRanges: 0 (0) E - RowBatchBytesEnqueued: 18.32 MB (19206144) E - RowBatchQueueGetWaitTime: 17.999ms E - RowBatchQueuePeakMemoryUsage: 884.00 KB (905216) E - RowBatchQueuePutWaitTime: 2s086ms E - RowBatchesEnqueued: 2.09K (2086) E - RowsRead: 2.13M (2133979) E - RowsReturned: 2.13M (2133979) E - RowsReturnedRate: 2.55 M/sec E - ScanRangesComplete: 1 (1) E - ScannerIoWaitTime: 4.999ms E - ScannerThreadWorklessLoops: 0 (0) E - ScannerThreadsInvoluntaryContextSwitches: 0 (0) E - ScannerThreadsTotalWallClockTime: 2s407ms E - ScannerThreadsSysTime: 5.050ms E - ScannerThreadsUserTime: 226.257ms E - ScannerThreadsVoluntaryContextSwitches: 808 (808) E - TotalRawHdfsOpenFileTime: 0.000ns E - TotalRawHdfsReadTime: 2.999ms E - TotalReadThroughput: 631.69 KB/sec E Buffer pool: E - AllocTime: 999.998us E - CumulativeAllocationBytes: 4.12 MB (4325376) E - CumulativeAllocations: 2 (2) E - PeakReservation: 4.00 MB (4194304) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 4.00 MB (4194304) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 999.998us E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E CodeGen:(Total: 2s886ms, non-child: 2s886ms, % non-child: 100.00%) E - CodegenInvoluntaryContextSwitches: 410 (410) E - CodegenTotalWallClockTime: 2s886ms E - CodegenSysTime: 999.000us E - CodegenUserTime: 1s740ms E - CodegenVoluntaryContextSwitches: 0 (0) E - CompileTime: 59.999ms E - IrGenerationTime: 101.999ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 2.53 MB (2655448) E - NumFunctions: 46 (46) E - NumInstructions: 1.12K (1119) E - OptimizationTime: 1s948ms E - PeakMemoryUsage: 559.50 KB (572928) E - PrepareTime: 747.998ms E Instance 6b478dd792c1178a:3586d9df00000001 (host=impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22002):(Total: 8s120ms, non-child: 12.999ms, % non-child: 0.16%) E Last report received time: 2020-02-20 01:59:31.844 E Hdfs split stats (:<# splits>/): 0:1/69.23 MB E Fragment Instance Lifecycle Event Timeline: 8s194ms E - Prepare Finished: 84.999ms (84.999ms) E - Open Finished: 3s216ms (3s131ms) E - First Batch Produced: 4s298ms (1s081ms) E - First Batch Sent: 4s298ms (0.000ns) E - ExecInternal Finished: 8s194ms (3s895ms) E - MemoryUsage (500.000ms): 47.70 KB, 47.70 KB, 607.20 KB, 607.20 KB, 607.20 KB, 607.20 KB, 11.45 MB, 21.29 MB, 30.61 MB, 30.06 MB, 23.61 MB, 19.11 MB, 14.38 MB, 12.61 MB, 7.85 MB, 5.12 MB E - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1 E - AverageThreadTokens: 1.19 E - ExchangeScanRatio: 1.89 E - PeakMemoryUsage: 30.65 MB (32135059) E - PeakReservation: 29.25 MB (30670848) E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 38.55 MB (40421794) E - RowsProduced: 622.08K (622080) E - TotalNetworkReceiveTime: 0.000ns E - TotalNetworkSendTime: 2s420ms E - TotalStorageWaitTime: 13.999ms E - TotalThreadsInvoluntaryContextSwitches: 589 (589) E - TotalThreadsTotalWallClockTime: 9s740ms E - TotalThreadsSysTime: 102.461ms E - TotalThreadsUserTime: 3s416ms E - TotalThreadsVoluntaryContextSwitches: 479 (479) E Fragment Instance Lifecycle Timings: E - ExecTime: 4s975ms E - ExecTreeExecTime: 1s469ms E - OpenTime: 3s131ms E - ExecTreeOpenTime: 29.999ms E - PrepareTime: 11.999ms E - ExecTreePrepareTime: 6.999ms E KrpcDataStreamSender (dst_id=3):(Total: 3s499ms, non-child: 1s078ms, % non-child: 30.83%) E ExecOption: Hash Partitioned Sender Codegen Enabled E - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 54.55 KB, 489.52 KB, 1.18 MB, 2.30 MB, 3.33 MB, 3.89 MB, 4.96 MB, 6.13 MB E - NetworkThroughput: (Avg: 1.90 MB/sec ; Min: 54.87 KB/sec ; Max: 9.74 MB/sec ; Number of samples: 647) E - RpcNetworkTime: (Avg: 9.856ms ; Min: 1.138ms ; Max: 206.968ms ; Number of samples: 650) E - RpcRecvrTime: (Avg: -1444090.000ns ; Min: -15733910.000ns ; Max: -209436.000ns ; Number of samples: 650) E - EosSent: 3 (3) E - PeakMemoryUsage: 106.57 KB (109128) E - RowsSent: 622.08K (622080) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 311.999ms E - TotalBytesSent: 6.47 MB (6782752) E - UncompressedRowBatchSize: 14.83 MB (15552000) E AGGREGATION_NODE (id=1):(Total: 1s506ms, non-child: 1s161ms, % non-child: 77.11%) E Node Lifecycle Event Timeline: 8s154ms E - Open Started: 3s186ms (3s186ms) E - Open Finished: 3s216ms (29.999ms) E - First Batch Requested: 3s216ms (0.000ns) E - First Batch Returned: 4s298ms (1s081ms) E - Last Batch Returned: 8s154ms (3s855ms) E - Closed: 8s154ms (0.000ns) E - PeakMemoryUsage: 25.28 MB (26511488) E - RowsReturned: 622.08K (622080) E - RowsReturnedRate: 412.79 K/sec E GroupingAggregator 0: E ExecOption: Streaming Preaggregation, Codegen Enabled E - BuildTime: 0.000ns E - GetResultsTime: 195.999ms E - HTResizeTime: 97.999ms E - LargestPartitionPercent: 1 (1) E - PartitionsCreated: 16 (16) E - PeakMemoryUsage: 25.27 MB (26494080) E - PeakReservation: 25.25 MB (26476544) E - PeakUsedReservation: 0 E - ReductionFactorEstimate: 10.02 E - ReductionFactorThresholdToExpand: 2.00 E - RowsPassedThrough: 115.52K (115523) E - RowsReturned: 622.08K (622080) E - StreamingTime: 888.998ms E Buffer pool: E - AllocTime: 2.999ms E - CumulativeAllocationBytes: 39.50 MB (41418752) E - CumulativeAllocations: 94 (94) E - PeakReservation: 25.25 MB (26476544) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 25.25 MB (26476544) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 2.999ms E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Hash Table: E - HashBuckets: 1.05M (1048576) E - HashCollisions: 0 (0) E - Probes: 2.82M (2823338) E - Resizes: 96 (96) E - Travel: 711.93K (711932) E HDFS_SCAN_NODE (id=0):(Total: 344.999ms, non-child: 344.999ms, % non-child: 100.00%) E Table Name: tpch_parquet.lineitem E Hdfs split stats (:<# splits>/): 0:1/69.23 MB E ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 E Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% E File Formats: PARQUET/SNAPPY:1 E Node Lifecycle Event Timeline: 5s075ms E - Open Started: 3s186ms (3s186ms) E - Open Finished: 3s206ms (19.999ms) E - First Batch Requested: 3s216ms (9.999ms) E - First Batch Returned: 3s279ms (62.999ms) E - Last Batch Returned: 5s075ms (1s795ms) E - Closed: 5s075ms (0.000ns) E - BytesReadSeries (500.000ms): 0, 0, 0, 0, 0, 0, 3.43 MB, 3.43 MB, 3.43 MB, 3.43 MB E - FooterProcessingTime: (Avg: 7.999ms ; Min: 7.999ms ; Max: 7.999ms ; Number of samples: 1) E - InitialRangeActualReservation: (Avg: 4.00 MB (4194304) ; Min: 4.00 MB (4194304) ; Max: 4.00 MB (4194304) ; Number of samples: 1) E - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) E - PageIndexProcessingTime: 0.000ns (Number of samples: 0) E - ParquetCompressedBytesReadPerColumn: (Avg: 3.18 MB (3329544) ; Min: 3.18 MB (3329544) ; Max: 3.18 MB (3329544) ; Number of samples: 1) E - ParquetCompressedPageSize: (Avg: 13.16 KB (13479) ; Min: 12.24 KB (12529) ; Max: 63.99 KB (65530) ; Number of samples: 247) E - ParquetRowGroupActualReservation: (Avg: 4.00 MB (4194304) ; Min: 4.00 MB (4194304) ; Max: 4.00 MB (4194304) ; Number of samples: 1) E - ParquetRowGroupIdealReservation: (Avg: 4.00 MB (4194304) ; Min: 4.00 MB (4194304) ; Max: 4.00 MB (4194304) ; Number of samples: 1) E - ParquetUncompressedBytesReadPerColumn: (Avg: 15.41 MB (16163258) ; Min: 15.41 MB (16163258) ; Max: 15.41 MB (16163258) ; Number of samples: 1) E - ParquetUncompressedPageSize: (Avg: 63.90 KB (65438) ; Min: 40.53 KB (41507) ; Max: 64.01 KB (65544) ; Number of samples: 247) E - AverageHdfsReadThreadConcurrency: 0.00 E - AverageScannerThreadConcurrency: 0.75 E - BytesRead: 3.43 MB (3597423) E - BytesReadDataNodeCache: 0 E - BytesReadLocal: 3.43 MB (3597423) E - BytesReadRemoteUnexpected: 0 E - BytesReadShortCircuit: 3.43 MB (3597423) E - CachedFileHandlesHitCount: 2 (2) E - CachedFileHandlesMissCount: 0 (0) E - CollectionItemsRead: 0 (0) E - DataCacheHitBytes: 0 E - DataCacheHitCount: 0 (0) E - DataCacheMissBytes: 0 E - DataCacheMissCount: 0 (0) E - DataCachePartialHitCount: 0 (0) E - DecompressionTime: 12.999ms E - MaterializeTupleTime: 68.999ms E - MaxCompressedTextFileLength: 0 E - NumColumns: 1 (1) E - NumDictFilteredRowGroups: 0 (0) E - NumDisksAccessed: 1 (1) E - NumPages: 247 (247) E - NumRowGroups: 1 (1) E - NumRowGroupsWithPageIndex: 1 (1) E - NumScannerThreadMemUnavailable: 0 (0) E - NumScannerThreadReservationsDenied: 0 (0) E - NumScannerThreadsStarted: 1 (1) E - NumScannersWithNoReads: 0 (0) E - NumStatsFilteredPages: 0 (0) E - NumStatsFilteredRowGroups: 0 (0) E - PeakMemoryUsage: 5.23 MB (5489160) E - PeakScannerThreadConcurrency: 1 (1) E - PerReadThreadRawHdfsThroughput: 857.69 MB/sec E - RemoteScanRanges: 0 (0) E - RowBatchBytesEnqueued: 18.40 MB (19289088) E - RowBatchQueueGetWaitTime: 32.999ms E - RowBatchQueuePeakMemoryUsage: 884.00 KB (905216) E - RowBatchQueuePutWaitTime: 1s342ms E - RowBatchesEnqueued: 2.10K (2095) E - RowsRead: 2.14M (2142543) E - RowsReturned: 2.14M (2142543) E - RowsReturnedRate: 6.21 M/sec E - ScanRangesComplete: 1 (1) E - ScannerIoWaitTime: 13.999ms E - ScannerThreadWorklessLoops: 0 (0) E - ScannerThreadsInvoluntaryContextSwitches: 5 (5) E - ScannerThreadsTotalWallClockTime: 1s632ms E - ScannerThreadsSysTime: 4.337ms E - ScannerThreadsUserTime: 211.448ms E - ScannerThreadsVoluntaryContextSwitches: 253 (253) E - TotalRawHdfsOpenFileTime: 0.000ns E - TotalRawHdfsReadTime: 3.999ms E - TotalReadThroughput: 698.01 KB/sec E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 4.12 MB (4325376) E - CumulativeAllocations: 2 (2) E - PeakReservation: 4.00 MB (4194304) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 4.00 MB (4194304) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 0.000ns E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E CodeGen:(Total: 3s100ms, non-child: 3s100ms, % non-child: 100.00%) E - CodegenInvoluntaryContextSwitches: 240 (240) E - CodegenTotalWallClockTime: 3s100ms E - CodegenSysTime: 5.961ms E - CodegenUserTime: 1s487ms E - CodegenVoluntaryContextSwitches: 0 (0) E - CompileTime: 106.999ms E - IrGenerationTime: 98.999ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 2.53 MB (2655448) E - NumFunctions: 46 (46) E - NumInstructions: 1.12K (1119) E - OptimizationTime: 2s277ms E - PeakMemoryUsage: 559.50 KB (572928) E - PrepareTime: 609.998ms E Instance 6b478dd792c1178a:3586d9df00000003 (host=impala-ec2-centos74-r5-4xlarge-ondemand-1046.vpc.cloudera.com:22001):(Total: 6s307ms, non-child: 6.999ms, % non-child: 0.11%) E Last report received time: 2020-02-20 01:59:31.790 E Hdfs split stats (:<# splits>/): 0:1/55.81 MB E Fragment Instance Lifecycle Event Timeline: 6s338ms E - Prepare Finished: 38.999ms (38.999ms) E - Open Finished: 2s473ms (2s434ms) E - First Batch Produced: 3s850ms (1s376ms) E - First Batch Sent: 3s850ms (0.000ns) E - ExecInternal Finished: 6s338ms (2s487ms) E - MemoryUsage (500.000ms): 47.70 KB, 607.20 KB, 607.20 KB, 607.20 KB, 607.20 KB, 11.25 MB, 17.54 MB, 29.79 MB, 21.11 MB, 16.62 MB, 12.13 MB, 6.12 MB, 5.12 MB E - ThreadUsage (500.000ms): 1, 1, 1, 1, 1, 2, 2, 2, 1, 1, 1, 1, 1 E - AverageThreadTokens: 1.23 E - ExchangeScanRatio: 1.70 E - PeakMemoryUsage: 29.79 MB (31242131) E - PeakReservation: 28.50 MB (29884416) E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 34.59 MB (36271126) E - RowsProduced: 431.24K (431235) E - TotalNetworkReceiveTime: 0.000ns E - TotalNetworkSendTime: 1s745ms E - TotalStorageWaitTime: 5.999ms E - TotalThreadsInvoluntaryContextSwitches: 1.10K (1098) E - TotalThreadsTotalWallClockTime: 7s629ms E - TotalThreadsSysTime: 52.677ms E - TotalThreadsUserTime: 2s537ms E - TotalThreadsVoluntaryContextSwitches: 911 (911) E Fragment Instance Lifecycle Timings: E - ExecTime: 3s862ms E - ExecTreeExecTime: 1s539ms E - OpenTime: 2s434ms E - ExecTreeOpenTime: 31.999ms E - PrepareTime: 8.999ms E - ExecTreePrepareTime: 4.999ms E KrpcDataStreamSender (dst_id=3):(Total: 2s321ms, non-child: 575.998ms, % non-child: 24.81%) E ExecOption: Hash Partitioned Sender Codegen Enabled E - BytesSent (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 679.12 KB, 1.61 MB, 2.53 MB, 3.66 MB, 4.59 MB E - NetworkThroughput: (Avg: 1.93 MB/sec ; Min: 203.54 KB/sec ; Max: 9.60 MB/sec ; Number of samples: 450) E - RpcNetworkTime: (Avg: 9.311ms ; Min: 1.116ms ; Max: 39.750ms ; Number of samples: 453) E - RpcRecvrTime: (Avg: -1496933.000ns ; Min: -17208778.000ns ; Max: -216917.000ns ; Number of samples: 453) E - EosSent: 3 (3) E - PeakMemoryUsage: 106.57 KB (109128) E - RowsSent: 431.24K (431235) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 197.999ms E - TotalBytesSent: 4.79 MB (5020194) E - UncompressedRowBatchSize: 10.28 MB (10780875) E AGGREGATION_NODE (id=1):(Total: 1s576ms, non-child: 1s048ms, % non-child: 66.52%) E Node Lifecycle Event Timeline: 6s317ms E - Open Started: 2s441ms (2s441ms) E - Open Finished: 2s473ms (31.999ms) E - First Batch Requested: 2s473ms (0.000ns) E - First Batch Returned: 3s850ms (1s376ms) E - Last Batch Returned: 6s316ms (2s465ms) E - Closed: 6s317ms (999.998us) E - PeakMemoryUsage: 24.53 MB (25725056) E - RowsReturned: 431.24K (431235) E - RowsReturnedRate: 273.45 K/sec E GroupingAggregator 0: E ExecOption: Streaming Preaggregation, Codegen Enabled E - BuildTime: 0.000ns E - GetResultsTime: 157.999ms E - HTResizeTime: 234.999ms E - LargestPartitionPercent: 1 (1) E - PartitionsCreated: 16 (16) E - PeakMemoryUsage: 24.52 MB (25707648) E - PeakReservation: 24.50 MB (25690112) E - PeakUsedReservation: 0 E - ReductionFactorEstimate: 10.01 E - ReductionFactorThresholdToExpand: 2.00 E - RowsPassedThrough: 0 (0) E - RowsReturned: 431.24K (431235) E - StreamingTime: 811.998ms E Buffer pool: E - AllocTime: 7.999ms E - CumulativeAllocationBytes: 38.25 MB (40108032) E - CumulativeAllocations: 89 (89) E - PeakReservation: 24.50 MB (25690112) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 24.50 MB (25690112) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 6.999ms E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Hash Table: E - HashBuckets: 1.05M (1048576) E - HashCollisions: 0 (0) E - Probes: 2.41M (2405085) E - Resizes: 96 (96) E - Travel: 1.19M (1193601) E HDFS_SCAN_NODE (id=0):(Total: 527.998ms, non-child: 527.998ms, % non-child: 100.00%) E Table Name: tpch_parquet.lineitem E Hdfs split stats (:<# splits>/): 0:1/55.81 MB E ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 E Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% E File Formats: PARQUET/SNAPPY:1 E Node Lifecycle Event Timeline: 3s850ms E - Open Started: 2s441ms (2s441ms) E - Open Finished: 2s444ms (2.999ms) E - First Batch Requested: 2s473ms (28.999ms) E - First Batch Returned: 2s518ms (44.999ms) E - Last Batch Returned: 3s849ms (1s330ms) E - Closed: 3s850ms (999.998us) E - BytesReadSeries (500.000ms): 0, 0, 0, 0, 0, 2.81 MB, 2.81 MB, 2.81 MB E - FooterProcessingTime: (Avg: 1.999ms ; Min: 1.999ms ; Max: 1.999ms ; Number of samples: 1) E - InitialRangeActualReservation: (Avg: 4.00 MB (4194304) ; Min: 4.00 MB (4194304) ; Max: 4.00 MB (4194304) ; Number of samples: 1) E - InitialRangeIdealReservation: (Avg: 128.00 KB (131072) ; Min: 128.00 KB (131072) ; Max: 128.00 KB (131072) ; Number of samples: 1) E - PageIndexProcessingTime: 0.000ns (Number of samples: 0) E - ParquetCompressedBytesReadPerColumn: (Avg: 2.55 MB (2678740) ; Min: 2.55 MB (2678740) ; Max: 2.55 MB (2678740) ; Number of samples: 1) E - ParquetCompressedPageSize: (Avg: 13.28 KB (13597) ; Min: 698.00 B (698) ; Max: 63.99 KB (65530) ; Number of samples: 197) E - ParquetRowGroupActualReservation: (Avg: 4.00 MB (4194304) ; Min: 4.00 MB (4194304) ; Max: 4.00 MB (4194304) ; Number of samples: 1) E - ParquetRowGroupIdealReservation: (Avg: 4.00 MB (4194304) ; Min: 4.00 MB (4194304) ; Max: 4.00 MB (4194304) ; Number of samples: 1) E - ParquetUncompressedBytesReadPerColumn: (Avg: 12.23 MB (12823872) ; Min: 12.23 MB (12823872) ; Max: 12.23 MB (12823872) ; Number of samples: 1) E - ParquetUncompressedPageSize: (Avg: 63.57 KB (65095) ; Min: 3.38 KB (3463) ; Max: 64.01 KB (65544) ; Number of samples: 197) E - AverageHdfsReadThreadConcurrency: 0.00 E - AverageScannerThreadConcurrency: 1.00 E - BytesRead: 2.81 MB (2945458) E - BytesReadDataNodeCache: 0 E - BytesReadLocal: 2.81 MB (2945458) E - BytesReadRemoteUnexpected: 0 E - BytesReadShortCircuit: 2.81 MB (2945458) E - CachedFileHandlesHitCount: 2 (2) E - CachedFileHandlesMissCount: 0 (0) E - CollectionItemsRead: 0 (0) E - DataCacheHitBytes: 0 E - DataCacheHitCount: 0 (0) E - DataCacheMissBytes: 0 E - DataCacheMissCount: 0 (0) E - DataCachePartialHitCount: 0 (0) E - DecompressionTime: 13.999ms E - MaterializeTupleTime: 51.999ms E - MaxCompressedTextFileLength: 0 E - NumColumns: 1 (1) E - NumDictFilteredRowGroups: 0 (0) E - NumDisksAccessed: 1 (1) E - NumPages: 197 (197) E - NumRowGroups: 1 (1) E - NumRowGroupsWithPageIndex: 1 (1) E - NumScannerThreadMemUnavailable: 0 (0) E - NumScannerThreadReservationsDenied: 0 (0) E - NumScannerThreadsStarted: 1 (1) E - NumScannersWithNoReads: 0 (0) E - NumStatsFilteredPages: 0 (0) E - NumStatsFilteredRowGroups: 0 (0) E - PeakMemoryUsage: 5.23 MB (5489160) E - PeakScannerThreadConcurrency: 1 (1) E - PerReadThreadRawHdfsThroughput: 1.37 GB/sec E - RemoteScanRanges: 0 (0) E - RowBatchBytesEnqueued: 14.81 MB (15528960) E - RowBatchQueueGetWaitTime: 24.999ms E - RowBatchQueuePeakMemoryUsage: 884.00 KB (905216) E - RowBatchQueuePutWaitTime: 1s185ms E - RowBatchesEnqueued: 1.69K (1687) E - RowsRead: 1.72M (1724693) E - RowsReturned: 1.72M (1724693) E - RowsReturnedRate: 3.27 M/sec E - ScanRangesComplete: 1 (1) E - ScannerIoWaitTime: 5.999ms E - ScannerThreadWorklessLoops: 0 (0) E - ScannerThreadsInvoluntaryContextSwitches: 0 (0) E - ScannerThreadsTotalWallClockTime: 1s331ms E - ScannerThreadsSysTime: 2.243ms E - ScannerThreadsUserTime: 148.066ms E - ScannerThreadsVoluntaryContextSwitches: 738 (738) E - TotalRawHdfsOpenFileTime: 0.000ns E - TotalRawHdfsReadTime: 1.999ms E - TotalReadThroughput: 718.57 KB/sec E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 4.12 MB (4325376) E - CumulativeAllocations: 2 (2) E - PeakReservation: 4.00 MB (4194304) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 4.00 MB (4194304) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - SystemAllocTime: 0.000ns E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E CodeGen:(Total: 2s401ms, non-child: 2s401ms, % non-child: 100.00%) E - CodegenInvoluntaryContextSwitches: 290 (290) E - CodegenTotalWallClockTime: 2s401ms E - CodegenSysTime: 1.000ms E - CodegenUserTime: 1s155ms E - CodegenVoluntaryContextSwitches: 0 (0) E - CompileTime: 74.999ms E - IrGenerationTime: 102.999ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 2.53 MB (2655448) E - NumFunctions: 46 (46) E - NumInstructions: 1.12K (1119) E - OptimizationTime: 1s787ms E - PeakMemoryUsage: 559.50 KB (572928) E - PrepareTime: 429.999ms