Query (id=6947c43a9ae7670a:15b38efc00000000): Summary: Session ID: e74416b9e7a12f10:2a8ba0a01789c3b7 Session Type: BEESWAX Start Time: 2018-05-13 19:06:02.213453000 End Time: 2018-05-13 19:06:03.146960000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.12.0-cdh5.15.0 RELEASE (build 2f9498d5c2f980aa7ff9505c56654c8e59e026ca) User: mmokhtar Connected User: mmokhtar Delegated User: Network Address: ::ffff:10.17.234.27:45692 Default Db: tpch_300_parquet Sql Statement: select * FROM ( SELECT o.*, ROW_NUMBER() OVER(ORDER BY evt_ts DESC) AS rn FROM ( SELECT l_orderkey,l_partkey,l_linenumber,l_quantity, cast (l_shipdate as string) evt_ts FROM lineitem WHERE l_shipdate BETWEEN '1992-01-01 00:00:00' AND '1992-01-15 00:00:00' union all SELECT l_orderkey,l_partkey,l_linenumber,l_quantity, cast (l_shipdate as string) evt_ts FROM lineitem limit 0 ) o ) r WHERE rn BETWEEN 1 AND 101 ORDER BY rn Coordinator: vd1317.foo.com:22000 Query Options (set by configuration): EXPLAIN_LEVEL=2 Query Options (set by configuration and planner): EXPLAIN_LEVEL=2,MT_DOP=0 Plan: ---------------- Max Per-Host Resource Reservation: Memory=28.00MB Per-Host Resource Estimates: Memory=568.00MB F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=36.00MB mem-reservation=16.00MB PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 05:SORT | order by: rn ASC | mem-estimate=32.00MB mem-reservation=12.00MB spill-buffer=2.00MB | tuple-ids=6 row-size=56B cardinality=17999891 | 04:SELECT | predicates: row_number() <= 101, row_number() >= 1 | mem-estimate=0B mem-reservation=0B | tuple-ids=9,8 row-size=56B cardinality=17999891 | 03:ANALYTIC | functions: row_number() | order by: evt_ts DESC | window: ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW | mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB | tuple-ids=9,8 row-size=56B cardinality=179998909 | 06:MERGING-EXCHANGE [UNPARTITIONED] | order by: evt_ts DESC | mem-estimate=0B mem-reservation=0B | tuple-ids=9 row-size=48B cardinality=179998909 | F01:PLAN FRAGMENT [RANDOM] hosts=7 instances=7 Per-Host Resources: mem-estimate=532.00MB mem-reservation=12.00MB 02:SORT | order by: evt_ts DESC | mem-estimate=92.00MB mem-reservation=12.00MB spill-buffer=2.00MB | tuple-ids=9 row-size=48B cardinality=179998909 | 00:UNION | mem-estimate=0B mem-reservation=0B | tuple-ids=2 row-size=48B cardinality=179998909 | 01:SCAN HDFS [tpch_300_parquet.lineitem, RANDOM] partitions=1/1 files=266 size=64.56GB predicates: l_shipdate <= TIMESTAMP '1992-01-15 00:00:00', l_shipdate >= TIMESTAMP '1992-01-01 00:00:00' stored statistics: table: rows=1799989091 size=64.56GB columns: all extrapolated-rows=disabled parquet statistics predicates: l_shipdate <= TIMESTAMP '1992-01-15 00:00:00', l_shipdate >= TIMESTAMP '1992-01-01 00:00:00' parquet dictionary predicates: l_shipdate <= TIMESTAMP '1992-01-15 00:00:00', l_shipdate >= TIMESTAMP '1992-01-01 00:00:00' mem-estimate=440.00MB mem-reservation=0B tuple-ids=0 row-size=48B cardinality=179998909 ---------------- Estimated Per-Host Mem: 595591168 Per Host Min Reservation: vd1317.foo.com:22000(28.00 MB) vd1318.foo.com:22000(12.00 MB) vd1319.foo.com:22000(12.00 MB) vd1321.foo.com:22000(12.00 MB) vd1322.foo.com:22000(12.00 MB) vd1323.foo.com:22000(12.00 MB) vd1324.foo.com:22000(12.00 MB) Request Pool: root.mmokhtar Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------------------------------- 05:SORT 1 1.255ms 1.255ms 101 18.00M 20.01 MB 32.00 MB 04:SELECT 1 1.975ms 1.975ms 101 18.00M 8.02 MB 0 03:ANALYTIC 1 99.135ms 99.135ms 648.97K 180.00M 13.25 MB 4.00 MB 06:MERGING-EXCHANGE 1 664.203ms 664.203ms 648.97K 180.00M 10.50 MB 0 UNPARTITIONED 02:SORT 7 33.081ms 64.507ms 648.97K 180.00M 16.15 MB 92.00 MB 00:UNION 7 224.430ms 457.696ms 648.97K 180.00M 85.00 KB 0 01:SCAN HDFS 7 64.978ms 158.318ms 648.97K 180.00M 128.71 MB 440.00 MB tpch_300_parquet.lineitem Errors: Query Compilation: 18.082ms - Metadata of all 1 tables cached: 1.582ms (1.582ms) - Analysis finished: 9.181ms (7.599ms) - Value transfer graph computed: 9.740ms (558.710us) - Single node plan created: 13.336ms (3.596ms) - Runtime filters computed: 13.565ms (229.277us) - Distributed plan created: 13.621ms (55.888us) - Lineage info computed: 14.037ms (415.770us) - Planning finished: 18.082ms (4.045ms) Query Timeline: 937.111ms - Query submitted: 96.138us (96.138us) - Planning finished: 21.329ms (21.233ms) - Submit for admission: 22.750ms (1.421ms) - Completed admission: 22.894ms (144.718us) - Ready to start on 7 backends: 23.354ms (459.584us) - All 7 execution backends (8 fragment instances) started: 24.947ms (1.592ms) - Rows available: 871.996ms (847.049ms) - First row fetched: 930.033ms (58.037ms) - Last row fetched: 930.726ms (692.542us) - Released admission control resources: 931.035ms (309.228us) - Unregister query: 933.507ms (2.472ms) - ComputeScanRangeAssignmentTimer: 613.884us ImpalaServer: - ClientFetchWaitTimer: 59.923ms - RowMaterializationTimer: 1.571ms Execution Profile 6947c43a9ae7670a:15b38efc00000000:(Total: 850.406ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 7, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms Per Node Peak Memory Usage: vd1317.foo.com:22000(34.55 MB) vd1318.foo.com:22000(140.91 MB) vd1319.foo.com:22000(77.86 MB) vd1321.foo.com:22000(77.97 MB) vd1322.foo.com:22000(13.92 MB) vd1323.foo.com:22000(77.81 MB) vd1324.foo.com:22000(140.96 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns - NumBackends: 7 (7) - NumFragmentInstances: 8 (8) - NumFragments: 2 (2) Averaged Fragment F02:(Total: 904.861ms, non-child: 60.156ms, % non-child: 6.65%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:905.997ms max:905.997ms mean: 905.997ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 34.55 MB (36223322) - PeakReservation: 16.00 MB (16777216) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 34.55 MB (36223322) - RowsProduced: 101 (101) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 904.309ms - TotalThreadsSysTime: 18.896ms - TotalThreadsUserTime: 198.244ms - TotalThreadsVoluntaryContextSwitches: 218 (218) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 58.268ms - ExecTreeExecTime: 7.579us - OpenTime: 846.045ms - ExecTreeOpenTime: 766.409ms - PrepareTime: 508.379us - ExecTreePrepareTime: 156.514us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 SORT_NODE (id=5):(Total: 766.570ms, non-child: 1.255ms, % non-child: 0.16%) - InMemorySortTime: 12.298us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 20.01 MB (20983808) - RowsReturned: 101 (101) - RowsReturnedRate: 131.00 /sec - SortDataSize: 7.50 KB (7676) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) Buffer pool: - AllocTime: 23.907us - CumulativeAllocationBytes: 6.00 MB (6291456) - CumulativeAllocations: 3 (3) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 6.00 MB (6291456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns SELECT_NODE (id=4):(Total: 765.314ms, non-child: 1.975ms, % non-child: 0.26%) - PeakMemoryUsage: 8.02 MB (8404992) - RowsReturned: 101 (101) - RowsReturnedRate: 131.00 /sec ANALYTIC_EVAL_NODE (id=3):(Total: 763.338ms, non-child: 99.135ms, % non-child: 12.99%) - EvaluationTime: 96.351ms - PeakMemoryUsage: 13.25 MB (13889536) - RowsReturned: 648.97K (648967) - RowsReturnedRate: 850.17 K/sec Buffer pool: - AllocTime: 43.666us - CumulativeAllocationBytes: 44.00 MB (46137344) - CumulativeAllocations: 22 (22) - PeakReservation: 4.00 MB (4194304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 4.00 MB (4194304) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=6):(Total: 664.203ms, non-child: 664.203ms, % non-child: 100.00%) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 10.50 MB (11013920) - RowsReturned: 648.97K (648967) - RowsReturnedRate: 977.06 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: - BytesReceived: 16.94 MB (17767954) - DeserializeRowBatchTimer: 52.892ms - FirstBatchArrivalWaitTime: 617.273ms - MergeGetNext: 46.638ms - MergeGetNextBatch: 13.546ms - PeakMemoryUsage: 10.50 MB (11013920) - SendersBlockedTimer: 252.240ms - SendersBlockedTotalTimer(*): 675.439ms CodeGen:(Total: 78.135ms, non-child: 78.135ms, % non-child: 100.00%) - CodegenTime: 2.326ms - CompileTime: 13.056ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039864) - NumFunctions: 59 (59) - NumInstructions: 1.01K (1009) - OptimizationTime: 46.245ms - PeakMemoryUsage: 504.50 KB (516608) - PrepareTime: 18.240ms Coordinator Fragment F02: Instance 6947c43a9ae7670a:15b38efc00000000 (host=vd1317.foo.com:22000):(Total: 904.861ms, non-child: 60.156ms, % non-child: 6.65%) Fragment Instance Lifecycle Event Timeline: 905.073ms - Prepare Finished: 750.766us (750.766us) - Open Finished: 846.806ms (846.056ms) - First Batch Produced: 846.812ms (5.805us) - First Batch Sent: 905.066ms (58.254ms) - ExecInternal Finished: 905.073ms (6.341us) MemoryUsage(500.000ms): 17.01 KB, 10.07 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 34.55 MB (36223322) - PeakReservation: 16.00 MB (16777216) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 34.55 MB (36223322) - RowsProduced: 101 (101) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 904.309ms - TotalThreadsSysTime: 18.896ms - TotalThreadsUserTime: 198.244ms - TotalThreadsVoluntaryContextSwitches: 218 (218) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 58.268ms - ExecTreeExecTime: 7.579us - OpenTime: 846.045ms - ExecTreeOpenTime: 766.409ms - PrepareTime: 508.379us - ExecTreePrepareTime: 156.514us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 SORT_NODE (id=5):(Total: 766.570ms, non-child: 1.255ms, % non-child: 0.16%) SortType: Total ExecOption: Codegen Enabled - NumRowsPerRun: (Avg: 101 (101) ; Min: 101 (101) ; Max: 101 (101) ; Number of samples: 1) - InMemorySortTime: 12.298us - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 20.01 MB (20983808) - RowsReturned: 101 (101) - RowsReturnedRate: 131.00 /sec - SortDataSize: 7.50 KB (7676) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) Buffer pool: - AllocTime: 23.907us - CumulativeAllocationBytes: 6.00 MB (6291456) - CumulativeAllocations: 3 (3) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 6.00 MB (6291456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns SELECT_NODE (id=4):(Total: 765.314ms, non-child: 1.975ms, % non-child: 0.26%) ExecOption: Codegen Enabled - PeakMemoryUsage: 8.02 MB (8404992) - RowsReturned: 101 (101) - RowsReturnedRate: 131.00 /sec ANALYTIC_EVAL_NODE (id=3):(Total: 763.338ms, non-child: 99.135ms, % non-child: 12.99%) - EvaluationTime: 96.351ms - PeakMemoryUsage: 13.25 MB (13889536) - RowsReturned: 648.97K (648967) - RowsReturnedRate: 850.17 K/sec Buffer pool: - AllocTime: 43.666us - CumulativeAllocationBytes: 44.00 MB (46137344) - CumulativeAllocations: 22 (22) - PeakReservation: 4.00 MB (4194304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 4.00 MB (4194304) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=6):(Total: 664.203ms, non-child: 664.203ms, % non-child: 100.00%) ExecOption: Codegen Enabled - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 10.50 MB (11013920) - RowsReturned: 648.97K (648967) - RowsReturnedRate: 977.06 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(500.000ms): 0, 3.67 MB - BytesReceived: 16.94 MB (17767954) - DeserializeRowBatchTimer: 52.892ms - FirstBatchArrivalWaitTime: 617.273ms - MergeGetNext: 46.638ms - MergeGetNextBatch: 13.546ms - PeakMemoryUsage: 10.50 MB (11013920) - SendersBlockedTimer: 252.240ms - SendersBlockedTotalTimer(*): 675.439ms CodeGen:(Total: 78.135ms, non-child: 78.135ms, % non-child: 100.00%) - CodegenTime: 2.326ms - CompileTime: 13.056ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039864) - NumFunctions: 59 (59) - NumInstructions: 1.01K (1009) - OptimizationTime: 46.245ms - PeakMemoryUsage: 504.50 KB (516608) - PrepareTime: 18.240ms Averaged Fragment F01:(Total: 565.734ms, non-child: 107.679ms, % non-child: 19.03%) split sizes: min: 9.06 GB, max: 9.40 GB, avg: 9.22 GB, stddev: 98.87 MB completion times: min:117.197ms max:825.330ms mean: 566.720ms stddev:291.558ms execution rates: min:11.10 GB/sec max:78.94 GB/sec mean:29.10 GB/sec stddev:26.17 GB/sec num instances: 7 - AverageThreadTokens: 1.64 - BloomFilterBytes: 0 - PeakMemoryUsage: 77.58 MB (81351193) - PeakReservation: 13.14 MB (13781284) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.87 MB (83750427) - RowsProduced: 92.71K (92709) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 107.364ms - TotalStorageWaitTime: 64.556ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 1s154ms - TotalThreadsSysTime: 19.600ms - TotalThreadsUserTime: 725.971ms - TotalThreadsVoluntaryContextSwitches: 401 (401) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 121.588ms - ExecTreeExecTime: 401.349us - OpenTime: 443.408ms - ExecTreeOpenTime: 321.843ms - PrepareTime: 701.015us - ExecTreePrepareTime: 274.003us DataStreamSender (dst_id=6):(Total: 15.469ms, non-child: 15.469ms, % non-child: 100.00%) - BytesSent: 2.42 MB (2538279) - NetworkThroughput(*): 968.05 MB/sec - OverallThroughput: 112.39 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 92.71K (92709) - SerializeBatchTime: 13.421ms - TransmitDataRPCTime: 1.934ms - UncompressedRowBatchSize: 6.72 MB (7045927) SORT_NODE (id=2):(Total: 322.483ms, non-child: 33.081ms, % non-child: 10.26%) - InMemorySortTime: 22.141ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 13.27 MB (13911332) - RowsReturned: 92.71K (92709) - RowsReturnedRate: 201.15 K/sec - SortDataSize: 6.01 MB (6304250) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) Buffer pool: - AllocTime: 55.359us - CumulativeAllocationBytes: 10.57 MB (11084946) - CumulativeAllocations: 5 (5) - PeakReservation: 13.14 MB (13781284) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 10.57 MB (11084946) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns UNION_NODE (id=0):(Total: 289.401ms, non-child: 224.422ms, % non-child: 77.55%) - PeakMemoryUsage: 63.00 KB (64512) - RowsReturned: 92.71K (92709) - RowsReturnedRate: 224.51 K/sec HDFS_SCAN_NODE (id=1):(Total: 64.978ms, non-child: 64.978ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.29 - AverageScannerThreadConcurrency: 1.14 - BytesRead: 81.59 MB (85552883) - BytesReadDataNodeCache: 0 - BytesReadLocal: 81.59 MB (85552883) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 81.59 MB (85552883) - CachedFileHandlesHitCount: 51 (51) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 117.761ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 38 (38) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 37 (37) - PeakMemoryUsage: 65.38 MB (68559614) - PerReadThreadRawHdfsThroughput: 971.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 61.949ms - RowBatchQueuePutWaitTime: 67.264ms - RowsRead: 6.87M (6868414) - RowsReturned: 92.71K (92709) - RowsReturnedRate: 1.57 M/sec - ScanRangesComplete: 38 (38) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 589.785ms - MaterializeTupleTime(*): 214.463ms - ScannerThreadsSysTime: 12.100ms - ScannerThreadsUserTime: 338.062ms - ScannerThreadsVoluntaryContextSwitches: 236 (236) - TotalRawHdfsOpenFileTime(*): 319.444us - TotalRawHdfsReadTime(*): 71.125ms - TotalReadThroughput: 77.83 MB/sec CodeGen:(Total: 120.102ms, non-child: 120.102ms, % non-child: 100.00%) - CodegenTime: 3.222ms - CompileTime: 22.380ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039864) - NumFunctions: 133 (133) - NumInstructions: 1.90K (1895) - OptimizationTime: 81.458ms - PeakMemoryUsage: 947.50 KB (970240) - PrepareTime: 15.732ms Fragment F01: Instance 6947c43a9ae7670a:15b38efc00000001 (host=vd1324.foo.com:22000):(Total: 824.188ms, non-child: 98.966ms, % non-child: 12.01%) Hdfs split stats (:<# splits>/): 7:2/506.69 MB 2:7/1.73 GB 6:2/506.67 MB 1:9/2.23 GB 4:5/1.24 GB 0:1/253.32 MB 3:5/1.24 GB 5:7/1.73 GB Fragment Instance Lifecycle Event Timeline: 824.440ms - Prepare Finished: 990.420us (990.420us) - Open Finished: 697.244ms (696.253ms) - First Batch Produced: 697.252ms (8.463us) - First Batch Sent: 697.418ms (165.197us) - ExecInternal Finished: 824.440ms (127.022ms) MemoryUsage(500.000ms): 958.11 KB, 83.82 MB ThreadUsage(500.000ms): 1, 3 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 140.96 MB (147802597) - PeakReservation: 16.00 MB (16777216) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 140.96 MB (147802597) - RowsProduced: 185.91K (185905) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 101.041ms - TotalStorageWaitTime: 101.933ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 1s990ms - TotalThreadsSysTime: 30.602ms - TotalThreadsUserTime: 1s355ms - TotalThreadsVoluntaryContextSwitches: 523 (523) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 127.197ms - ExecTreeExecTime: 868.657us - OpenTime: 696.246ms - ExecTreeOpenTime: 572.069ms - PrepareTime: 711.909us - ExecTreePrepareTime: 239.214us DataStreamSender (dst_id=6):(Total: 29.366ms, non-child: 29.366ms, % non-child: 100.00%) - BytesSent: 4.85 MB (5088193) - NetworkThroughput(*): 1007.18 MB/sec - OverallThroughput: 165.24 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 185.91K (185905) - SerializeBatchTime: 24.447ms - TransmitDataRPCTime: 4.817ms - UncompressedRowBatchSize: 13.47 MB (14128780) SORT_NODE (id=2):(Total: 573.120ms, non-child: 64.507ms, % non-child: 11.26%) SortType: Total ExecOption: Codegen Enabled - NumRowsPerRun: (Avg: 185.91K (185905) ; Min: 185.91K (185905) ; Max: 185.91K (185905) ; Number of samples: 1) - InMemorySortTime: 42.160ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 16.15 MB (16935936) - RowsReturned: 185.91K (185905) - RowsReturnedRate: 324.37 K/sec - SortDataSize: 12.06 MB (12641540) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) Buffer pool: - AllocTime: 78.997us - CumulativeAllocationBytes: 16.00 MB (16777216) - CumulativeAllocations: 8 (8) - PeakReservation: 16.00 MB (16777216) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 MB (16777216) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns UNION_NODE (id=0):(Total: 508.613ms, non-child: 457.696ms, % non-child: 89.99%) ExecOption: Codegen Enabled - PeakMemoryUsage: 85.00 KB (87040) - RowsReturned: 185.91K (185905) - RowsReturnedRate: 365.51 K/sec HDFS_SCAN_NODE (id=1):(Total: 50.916ms, non-child: 50.916ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:2/506.69 MB 2:7/1.73 GB 6:2/506.67 MB 1:9/2.23 GB 4:5/1.24 GB 0:1/253.32 MB 3:5/1.24 GB 5:7/1.73 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 38 out of 38 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:36 PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 159.46 MB - FooterProcessingTime: (Avg: 1.652ms ; Min: 474.868us ; Max: 25.457ms ; Number of samples: 38) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 159.46 MB (167209012) - BytesReadDataNodeCache: 0 - BytesReadLocal: 159.46 MB (167209012) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 159.46 MB (167209012) - CachedFileHandlesHitCount: 64 (64) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 247.367ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 38 (38) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 36 (36) - PeakMemoryUsage: 128.71 MB (134959818) - PerReadThreadRawHdfsThroughput: 975.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 47.592ms - RowBatchQueuePutWaitTime: 233.813ms - RowsRead: 13.74M (13736408) - RowsReturned: 185.91K (185905) - RowsReturnedRate: 3.65 M/sec - ScanRangesComplete: 38 (38) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 1s167ms - MaterializeTupleTime(*): 437.062ms - ScannerThreadsSysTime: 13.611ms - ScannerThreadsUserTime: 697.634ms - ScannerThreadsVoluntaryContextSwitches: 272 (272) - TotalRawHdfsOpenFileTime(*): 175.393us - TotalRawHdfsReadTime(*): 163.512ms - TotalReadThroughput: 159.46 MB/sec CodeGen:(Total: 122.735ms, non-child: 122.735ms, % non-child: 100.00%) - CodegenTime: 3.262ms - CompileTime: 23.731ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039864) - NumFunctions: 133 (133) - NumInstructions: 1.90K (1895) - OptimizationTime: 83.099ms - PeakMemoryUsage: 947.50 KB (970240) - PrepareTime: 15.396ms Instance 6947c43a9ae7670a:15b38efc00000003 (host=vd1318.foo.com:22000):(Total: 814.845ms, non-child: 172.192ms, % non-child: 21.13%) Hdfs split stats (:<# splits>/): 1:5/1.24 GB 2:3/760.00 MB 7:3/575.89 MB 3:3/591.53 MB 4:6/1.48 GB 6:7/1.73 GB 0:6/1.48 GB 5:5/1.24 GB Fragment Instance Lifecycle Event Timeline: 815.059ms - Prepare Finished: 799.211us (799.211us) - Open Finished: 610.898ms (610.099ms) - First Batch Produced: 610.920ms (21.720us) - First Batch Sent: 611.097ms (177.230us) - ExecInternal Finished: 815.059ms (203.961ms) MemoryUsage(500.000ms): 139.68 MB, 12.02 MB ThreadUsage(500.000ms): 3, 1 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 140.91 MB (147755411) - PeakReservation: 16.00 MB (16777216) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 140.91 MB (147755411) - RowsProduced: 185.53K (185527) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 173.916ms - TotalStorageWaitTime: 80.688ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 1s874ms - TotalThreadsSysTime: 22.963ms - TotalThreadsUserTime: 1s240ms - TotalThreadsVoluntaryContextSwitches: 537 (537) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 204.161ms - ExecTreeExecTime: 835.100us - OpenTime: 610.091ms - ExecTreeOpenTime: 505.665ms - PrepareTime: 560.113us - ExecTreePrepareTime: 223.885us DataStreamSender (dst_id=6):(Total: 32.805ms, non-child: 32.805ms, % non-child: 100.00%) - BytesSent: 4.84 MB (5079768) - NetworkThroughput(*): 1.21 GB/sec - OverallThroughput: 147.67 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 185.53K (185527) - SerializeBatchTime: 28.753ms - TransmitDataRPCTime: 3.919ms - UncompressedRowBatchSize: 13.45 MB (14100052) SORT_NODE (id=2):(Total: 506.624ms, non-child: 59.969ms, % non-child: 11.84%) SortType: Total ExecOption: Codegen Enabled - NumRowsPerRun: (Avg: 185.53K (185527) ; Min: 185.53K (185527) ; Max: 185.53K (185527) ; Number of samples: 1) - InMemorySortTime: 40.968ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 16.15 MB (16935936) - RowsReturned: 185.53K (185527) - RowsReturnedRate: 366.20 K/sec - SortDataSize: 12.03 MB (12615836) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) Buffer pool: - AllocTime: 66.755us - CumulativeAllocationBytes: 16.00 MB (16777216) - CumulativeAllocations: 8 (8) - PeakReservation: 16.00 MB (16777216) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 MB (16777216) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns UNION_NODE (id=0):(Total: 446.655ms, non-child: 408.096ms, % non-child: 91.37%) ExecOption: Codegen Enabled - PeakMemoryUsage: 85.00 KB (87040) - RowsReturned: 185.53K (185527) - RowsReturnedRate: 415.37 K/sec HDFS_SCAN_NODE (id=1):(Total: 38.559ms, non-child: 38.559ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:5/1.24 GB 2:3/760.00 MB 7:3/575.89 MB 3:3/591.53 MB 4:6/1.48 GB 6:7/1.73 GB 0:6/1.48 GB 5:5/1.24 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 38 out of 38 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:36 PARQUET/SNAPPY:2 BytesRead(500.000ms): 122.53 MB - FooterProcessingTime: (Avg: 1.584ms ; Min: 292.526us ; Max: 13.575ms ; Number of samples: 38) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 159.47 MB (167217737) - BytesReadDataNodeCache: 0 - BytesReadLocal: 159.47 MB (167217737) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 159.47 MB (167217737) - CachedFileHandlesHitCount: 64 (64) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 216.290ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 38 (38) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 36 (36) - PeakMemoryUsage: 128.66 MB (134912632) - PerReadThreadRawHdfsThroughput: 1.69 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 36.160ms - RowBatchQueuePutWaitTime: 237.038ms - RowsRead: 13.74M (13737052) - RowsReturned: 185.53K (185527) - RowsReturnedRate: 4.81 M/sec - ScanRangesComplete: 38 (38) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 1s060ms - MaterializeTupleTime(*): 420.447ms - ScannerThreadsSysTime: 16.908ms - ScannerThreadsUserTime: 642.026ms - ScannerThreadsVoluntaryContextSwitches: 276 (276) - TotalRawHdfsOpenFileTime(*): 544.627us - TotalRawHdfsReadTime(*): 92.229ms - TotalReadThroughput: 245.06 MB/sec CodeGen:(Total: 103.222ms, non-child: 103.222ms, % non-child: 100.00%) - CodegenTime: 2.714ms - CompileTime: 19.957ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039864) - NumFunctions: 133 (133) - NumInstructions: 1.90K (1895) - OptimizationTime: 69.262ms - PeakMemoryUsage: 947.50 KB (970240) - PrepareTime: 13.560ms Instance 6947c43a9ae7670a:15b38efc00000004 (host=vd1321.foo.com:22000):(Total: 789.239ms, non-child: 232.861ms, % non-child: 29.50%) Hdfs split stats (:<# splits>/): 0:6/1.48 GB 3:3/759.89 MB 7:6/1.48 GB 5:4/1013.36 MB 1:3/759.90 MB 6:7/1.73 GB 2:2/341.40 MB 4:7/1.73 GB Fragment Instance Lifecycle Event Timeline: 789.510ms - Prepare Finished: 933.332us (933.332us) - Open Finished: 542.762ms (541.828ms) - First Batch Produced: 542.770ms (7.982us) - First Batch Sent: 542.957ms (187.242us) - ExecInternal Finished: 789.510ms (246.552ms) MemoryUsage(500.000ms): 10.61 KB, 12.02 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 77.97 MB (81760343) - PeakReservation: 12.00 MB (12582912) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 77.97 MB (81760343) - RowsProduced: 92.28K (92275) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 232.517ms - TotalStorageWaitTime: 45.442ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 1s328ms - TotalThreadsSysTime: 19.568ms - TotalThreadsUserTime: 773.584ms - TotalThreadsVoluntaryContextSwitches: 393 (393) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 246.750ms - ExecTreeExecTime: 333.845us - OpenTime: 541.821ms - ExecTreeOpenTime: 423.757ms - PrepareTime: 634.896us - ExecTreePrepareTime: 272.893us DataStreamSender (dst_id=6):(Total: 15.326ms, non-child: 15.326ms, % non-child: 100.00%) - BytesSent: 2.41 MB (2526545) - NetworkThroughput(*): 1.41 GB/sec - OverallThroughput: 157.22 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 92.28K (92275) - SerializeBatchTime: 13.576ms - TransmitDataRPCTime: 1.670ms - UncompressedRowBatchSize: 6.69 MB (7012900) SORT_NODE (id=2):(Total: 424.330ms, non-child: 34.957ms, % non-child: 8.24%) SortType: Total ExecOption: Codegen Enabled - NumRowsPerRun: (Avg: 92.28K (92275) ; Min: 92.28K (92275) ; Max: 92.28K (92275) ; Number of samples: 1) - InMemorySortTime: 24.237ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 12.15 MB (12741632) - RowsReturned: 92.28K (92275) - RowsReturnedRate: 217.46 K/sec - SortDataSize: 5.98 MB (6274700) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) Buffer pool: - AllocTime: 76.816us - CumulativeAllocationBytes: 10.00 MB (10485760) - CumulativeAllocations: 5 (5) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 10.00 MB (10485760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns UNION_NODE (id=0):(Total: 389.373ms, non-child: 231.055ms, % non-child: 59.34%) ExecOption: Codegen Enabled - PeakMemoryUsage: 85.00 KB (87040) - RowsReturned: 92.28K (92275) - RowsReturnedRate: 236.98 K/sec HDFS_SCAN_NODE (id=1):(Total: 158.318ms, non-child: 158.318ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:6/1.48 GB 3:3/759.89 MB 7:6/1.48 GB 5:4/1013.36 MB 1:3/759.90 MB 6:7/1.73 GB 2:2/341.40 MB 4:7/1.73 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 38 out of 38 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:37 PARQUET/SNAPPY:1 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 1.009ms ; Min: 363.419us ; Max: 2.130ms ; Number of samples: 38) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 81.59 MB (85553427) - BytesReadDataNodeCache: 0 - BytesReadLocal: 81.59 MB (85553427) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 81.59 MB (85553427) - CachedFileHandlesHitCount: 51 (51) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 134.248ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 38 (38) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 37 (37) - PeakMemoryUsage: 65.72 MB (68917564) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 155.081ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 6.87M (6868463) - RowsReturned: 92.28K (92275) - RowsReturnedRate: 582.85 K/sec - ScanRangesComplete: 38 (38) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 540.138ms - MaterializeTupleTime(*): 242.161ms - ScannerThreadsSysTime: 10.557ms - ScannerThreadsUserTime: 381.853ms - ScannerThreadsVoluntaryContextSwitches: 227 (227) - TotalRawHdfsOpenFileTime(*): 263.749us - TotalRawHdfsReadTime(*): 53.906ms - TotalReadThroughput: 0.00 /sec CodeGen:(Total: 116.721ms, non-child: 116.721ms, % non-child: 100.00%) - CodegenTime: 2.701ms - CompileTime: 22.617ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039864) - NumFunctions: 133 (133) - NumInstructions: 1.90K (1895) - OptimizationTime: 79.805ms - PeakMemoryUsage: 947.50 KB (970240) - PrepareTime: 13.843ms Instance 6947c43a9ae7670a:15b38efc00000006 (host=vd1323.foo.com:22000):(Total: 761.534ms, non-child: 234.498ms, % non-child: 30.79%) Hdfs split stats (:<# splits>/): 1:3/760.07 MB 2:7/1.73 GB 0:3/331.17 MB 3:4/1013.24 MB 5:7/1.73 GB 7:8/1.98 GB 4:3/760.12 MB 6:4/1013.41 MB Fragment Instance Lifecycle Event Timeline: 761.755ms - Prepare Finished: 1.018ms (1.018ms) - Open Finished: 513.119ms (512.101ms) - First Batch Produced: 513.128ms (8.758us) - First Batch Sent: 513.394ms (266.133us) - ExecInternal Finished: 761.755ms (248.360ms) MemoryUsage(500.000ms): 40.84 MB, 12.02 MB ThreadUsage(500.000ms): 4, 1 - AverageThreadTokens: 2.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 77.81 MB (81585239) - PeakReservation: 12.00 MB (12582912) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 77.81 MB (81585239) - RowsProduced: 92.36K (92355) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 233.843ms - TotalStorageWaitTime: 107.091ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 1s358ms - TotalThreadsSysTime: 24.900ms - TotalThreadsUserTime: 741.287ms - TotalThreadsVoluntaryContextSwitches: 377 (377) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 248.652ms - ExecTreeExecTime: 392.901us - OpenTime: 512.079ms - ExecTreeOpenTime: 386.813ms - PrepareTime: 772.088us - ExecTreePrepareTime: 322.530us DataStreamSender (dst_id=6):(Total: 15.770ms, non-child: 15.770ms, % non-child: 100.00%) - BytesSent: 2.41 MB (2529546) - NetworkThroughput(*): 1.48 GB/sec - OverallThroughput: 152.96 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 92.36K (92355) - SerializeBatchTime: 14.007ms - TransmitDataRPCTime: 1.593ms - UncompressedRowBatchSize: 6.69 MB (7018980) SORT_NODE (id=2):(Total: 387.501ms, non-child: 36.711ms, % non-child: 9.47%) SortType: Total ExecOption: Codegen Enabled - NumRowsPerRun: (Avg: 92.36K (92355) ; Min: 92.36K (92355) ; Max: 92.36K (92355) ; Number of samples: 1) - InMemorySortTime: 24.355ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 12.15 MB (12741632) - RowsReturned: 92.36K (92355) - RowsReturnedRate: 238.33 K/sec - SortDataSize: 5.99 MB (6280140) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) Buffer pool: - AllocTime: 61.994us - CumulativeAllocationBytes: 10.00 MB (10485760) - CumulativeAllocations: 5 (5) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 10.00 MB (10485760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns UNION_NODE (id=0):(Total: 350.790ms, non-child: 236.544ms, % non-child: 67.43%) ExecOption: Codegen Enabled - PeakMemoryUsage: 85.00 KB (87040) - RowsReturned: 92.36K (92355) - RowsReturnedRate: 263.28 K/sec HDFS_SCAN_NODE (id=1):(Total: 114.245ms, non-child: 114.245ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:3/760.07 MB 2:7/1.73 GB 0:3/331.17 MB 3:4/1013.24 MB 5:7/1.73 GB 7:8/1.98 GB 4:3/760.12 MB 6:4/1013.41 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 39 out of 39 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:38 PARQUET/SNAPPY:1 BytesRead(500.000ms): 27.02 MB - FooterProcessingTime: (Avg: 2.383ms ; Min: 556.146us ; Max: 20.432ms ; Number of samples: 39) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 3.00 - BytesRead: 81.69 MB (85658158) - BytesReadDataNodeCache: 0 - BytesReadLocal: 81.69 MB (85658158) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 81.69 MB (85658158) - CachedFileHandlesHitCount: 52 (52) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 124.806ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 39 (39) - NumScannerThreadsStarted: 39 (39) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 38 (38) - PeakMemoryUsage: 65.56 MB (68742460) - PerReadThreadRawHdfsThroughput: 965.32 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 110.970ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 6.87M (6868554) - RowsReturned: 92.36K (92355) - RowsReturnedRate: 808.39 K/sec - ScanRangesComplete: 39 (39) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 598.355ms - MaterializeTupleTime(*): 205.998ms - ScannerThreadsSysTime: 15.806ms - ScannerThreadsUserTime: 334.859ms - ScannerThreadsVoluntaryContextSwitches: 209 (209) - TotalRawHdfsOpenFileTime(*): 614.078us - TotalRawHdfsReadTime(*): 84.624ms - TotalReadThroughput: 54.04 MB/sec CodeGen:(Total: 123.763ms, non-child: 123.763ms, % non-child: 100.00%) - CodegenTime: 3.438ms - CompileTime: 23.591ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039864) - NumFunctions: 133 (133) - NumInstructions: 1.90K (1895) - OptimizationTime: 82.727ms - PeakMemoryUsage: 947.50 KB (970240) - PrepareTime: 16.815ms Instance 6947c43a9ae7670a:15b38efc00000002 (host=vd1319.foo.com:22000):(Total: 502.875ms, non-child: 10.990ms, % non-child: 2.19%) Hdfs split stats (:<# splits>/): 2:1/253.37 MB 5:2/506.72 MB 0:4/1013.36 MB 3:6/1.48 GB 4:5/1.24 GB 6:3/760.01 MB 1:6/1.48 GB 7:11/2.55 GB Fragment Instance Lifecycle Event Timeline: 503.123ms - Prepare Finished: 944.676us (944.676us) - Open Finished: 479.024ms (478.079ms) - First Batch Produced: 479.034ms (10.780us) - First Batch Sent: 479.252ms (218.132us) - ExecInternal Finished: 503.123ms (23.870ms) MemoryUsage(500.000ms): 69.92 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 77.86 MB (81643606) - PeakReservation: 12.00 MB (12582912) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 77.86 MB (81643606) - RowsProduced: 92.91K (92905) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10.233ms - TotalStorageWaitTime: 59.707ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 1s019ms - TotalThreadsSysTime: 17.910ms - TotalThreadsUserTime: 713.059ms - TotalThreadsVoluntaryContextSwitches: 379 (379) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 24.102ms - ExecTreeExecTime: 375.932us - OpenTime: 478.071ms - ExecTreeOpenTime: 354.476ms - PrepareTime: 670.871us - ExecTreePrepareTime: 245.328us DataStreamSender (dst_id=6):(Total: 14.823ms, non-child: 14.823ms, % non-child: 100.00%) - BytesSent: 2.43 MB (2543902) - NetworkThroughput(*): 1.54 GB/sec - OverallThroughput: 163.66 MB/sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 92.91K (92905) - SerializeBatchTime: 13.164ms - TransmitDataRPCTime: 1.538ms - UncompressedRowBatchSize: 6.73 MB (7060780) SORT_NODE (id=2):(Total: 355.069ms, non-child: 35.224ms, % non-child: 9.92%) SortType: Total ExecOption: Codegen Enabled - NumRowsPerRun: (Avg: 92.91K (92905) ; Min: 92.91K (92905) ; Max: 92.91K (92905) ; Number of samples: 1) - InMemorySortTime: 23.270ms - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 12.15 MB (12741632) - RowsReturned: 92.91K (92905) - RowsReturnedRate: 261.65 K/sec - SortDataSize: 6.02 MB (6317540) - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) Buffer pool: - AllocTime: 59.554us - CumulativeAllocationBytes: 10.00 MB (10485760) - CumulativeAllocations: 5 (5) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 10.00 MB (10485760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns UNION_NODE (id=0):(Total: 319.844ms, non-child: 237.511ms, % non-child: 74.26%) ExecOption: Codegen Enabled - PeakMemoryUsage: 85.00 KB (87040) - RowsReturned: 92.91K (92905) - RowsReturnedRate: 290.47 K/sec HDFS_SCAN_NODE (id=1):(Total: 82.332ms, non-child: 82.332ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/253.37 MB 5:2/506.72 MB 0:4/1013.36 MB 3:6/1.48 GB 4:5/1.24 GB 6:3/760.01 MB 1:6/1.48 GB 7:11/2.55 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 38 out of 38 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:37 PARQUET/SNAPPY:1 BytesRead(500.000ms): 43.12 MB - FooterProcessingTime: (Avg: 1.230ms ; Min: 341.188us ; Max: 2.720ms ; Number of samples: 38) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 81.59 MB (85551853) - BytesReadDataNodeCache: 0 - BytesReadLocal: 81.59 MB (85551853) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 81.59 MB (85551853) - CachedFileHandlesHitCount: 51 (51) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 101.615ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 38 (38) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 37 (37) - PeakMemoryUsage: 65.61 MB (68800827) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 78.769ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 6.87M (6868423) - RowsReturned: 92.91K (92905) - RowsReturnedRate: 1.13 M/sec - ScanRangesComplete: 38 (38) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 517.270ms - MaterializeTupleTime(*): 195.573ms - ScannerThreadsSysTime: 11.676ms - ScannerThreadsUserTime: 306.553ms - ScannerThreadsVoluntaryContextSwitches: 213 (213) - TotalRawHdfsOpenFileTime(*): 221.351us - TotalRawHdfsReadTime(*): 76.948ms - TotalReadThroughput: 86.24 MB/sec CodeGen:(Total: 121.992ms, non-child: 121.992ms, % non-child: 100.00%) - CodegenTime: 3.673ms - CompileTime: 23.259ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039864) - NumFunctions: 133 (133) - NumInstructions: 1.90K (1895) - OptimizationTime: 82.142ms - PeakMemoryUsage: 947.50 KB (970240) - PrepareTime: 16.061ms Instance 6947c43a9ae7670a:15b38efc00000007 (host=vd1317.foo.com:22000):(Total: 151.076ms, non-child: 2.213ms, % non-child: 1.47%) Hdfs split stats (:<# splits>/): 3:4/1013.32 MB 2:4/1013.52 MB 7:5/1.24 GB 1:1/253.38 MB 4:6/1.48 GB 5:5/1.24 GB 0:7/1.73 GB 6:5/1.24 GB Fragment Instance Lifecycle Event Timeline: 151.389ms - Prepare Finished: 1.096ms (1.096ms) - Open Finished: 151.310ms (150.213ms) - First Batch Produced: 151.313ms (2.763us) - First Batch Sent: 151.314ms (743.000ns) - ExecInternal Finished: 151.389ms (75.153us) MemoryUsage(500.000ms): 958.11 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.65 MB (14314267) - PeakReservation: 12.00 MB (12582912) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 29.67 MB (31108905) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 257.000ns - TotalStorageWaitTime: 25.882ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 265.946ms - TotalThreadsSysTime: 11.738ms - TotalThreadsUserTime: 145.693ms - TotalThreadsVoluntaryContextSwitches: 312 (312) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 80.971us - ExecTreeExecTime: 1.594us - OpenTime: 150.210ms - ExecTreeOpenTime: 5.058ms - PrepareTime: 741.656us - ExecTreePrepareTime: 318.712us DataStreamSender (dst_id=6):(Total: 121.774us, non-child: 121.774us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 SORT_NODE (id=2):(Total: 5.377ms, non-child: 85.753us, % non-child: 1.59%) SortType: Total ExecOption: Codegen Enabled - NumRowsPerRun: (Avg: 0 (0) ; Min: 0 (0) ; Max: 0 (0) ; Number of samples: 1) - InMemorySortTime: 334.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 12.06 MB (12641280) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) Buffer pool: - AllocTime: 11.650us - CumulativeAllocationBytes: 6.00 MB (6291456) - CumulativeAllocations: 3 (3) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 6.00 MB (6291456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns UNION_NODE (id=0):(Total: 5.291ms, non-child: 105.462us, % non-child: 1.99%) ExecOption: Codegen Enabled - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HDFS_SCAN_NODE (id=1):(Total: 5.185ms, non-child: 5.185ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:4/1013.32 MB 2:4/1013.52 MB 7:5/1.24 GB 1:1/253.38 MB 4:6/1.48 GB 5:5/1.24 GB 0:7/1.73 GB 6:5/1.24 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 37 out of 37 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:37 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 797.981us ; Min: 351.047us ; Max: 1.460ms ; Number of samples: 37) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 3.61 MB (3788800) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.61 MB (3788800) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.61 MB (3788800) - CachedFileHandlesHitCount: 37 (37) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 37 (37) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 37 (37) - PeakMemoryUsage: 1.57 MB (1650688) - PerReadThreadRawHdfsThroughput: 310.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 2.446ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 37 (37) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 115.734ms - MaterializeTupleTime(*): 2.720us - ScannerThreadsSysTime: 8.601ms - ScannerThreadsUserTime: 1.704ms - ScannerThreadsVoluntaryContextSwitches: 241 (241) - TotalRawHdfsOpenFileTime(*): 163.561us - TotalRawHdfsReadTime(*): 11.637ms - TotalReadThroughput: 0.00 /sec CodeGen:(Total: 143.363ms, non-child: 143.363ms, % non-child: 100.00%) - CodegenTime: 4.016ms - CompileTime: 23.845ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039864) - NumFunctions: 133 (133) - NumInstructions: 1.90K (1895) - OptimizationTime: 99.072ms - PeakMemoryUsage: 947.50 KB (970240) - PrepareTime: 19.857ms Instance 6947c43a9ae7670a:15b38efc00000005 (host=vd1322.foo.com:22000):(Total: 116.382ms, non-child: 2.030ms, % non-child: 1.74%) Hdfs split stats (:<# splits>/): 0:2/506.78 MB 1:2/506.70 MB 2:5/1.24 GB 7:6/1.48 GB 5:8/1.98 GB 6:5/1.24 GB 3:4/1013.41 MB 4:6/1.33 GB Fragment Instance Lifecycle Event Timeline: 116.624ms - Prepare Finished: 1.096ms (1.096ms) - Open Finished: 116.449ms (115.352ms) - First Batch Produced: 116.451ms (1.883us) - First Batch Sent: 116.451ms (773.000ns) - ExecInternal Finished: 116.624ms (172.320us) MemoryUsage(500.000ms): 958.11 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.92 MB (14596891) - PeakReservation: 12.00 MB (12582912) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 13.92 MB (14596891) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 131.000ns - TotalStorageWaitTime: 31.150ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 244.108ms - TotalThreadsSysTime: 9.520ms - TotalThreadsUserTime: 111.820ms - TotalThreadsVoluntaryContextSwitches: 292 (292) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 175.942us - ExecTreeExecTime: 1.420us - OpenTime: 115.336ms - ExecTreeOpenTime: 5.064ms - PrepareTime: 815.575us - ExecTreePrepareTime: 295.465us DataStreamSender (dst_id=6):(Total: 72.798us, non-child: 72.798us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 2.61 KB (2672) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 SORT_NODE (id=2):(Total: 5.360ms, non-child: 117.670us, % non-child: 2.20%) SortType: Total ExecOption: Codegen Enabled - NumRowsPerRun: (Avg: 0 (0) ; Min: 0 (0) ; Max: 0 (0) ; Number of samples: 1) - InMemorySortTime: 747.000ns - InitialRunsCreated: 1 (1) - PeakMemoryUsage: 12.06 MB (12641280) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SortDataSize: 0 - SpilledRuns: 0 (0) - TotalMergesPerformed: 0 (0) Buffer pool: - AllocTime: 31.749us - CumulativeAllocationBytes: 6.00 MB (6291456) - CumulativeAllocations: 3 (3) - PeakReservation: 12.00 MB (12582912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 6.00 MB (6291456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns UNION_NODE (id=0):(Total: 5.242ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HDFS_SCAN_NODE (id=1):(Total: 5.293ms, non-child: 5.293ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/506.78 MB 1:2/506.70 MB 2:5/1.24 GB 7:6/1.48 GB 5:8/1.98 GB 6:5/1.24 GB 3:4/1013.41 MB 4:6/1.33 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 38 out of 38 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/NONE:38 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 911.884us ; Min: 248.065us ; Max: 1.901ms ; Number of samples: 38) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 3.71 MB (3891200) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.71 MB (3891200) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.71 MB (3891200) - CachedFileHandlesHitCount: 38 (38) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 38 (38) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 38 (38) - PeakMemoryUsage: 1.84 MB (1933312) - PerReadThreadRawHdfsThroughput: 247.09 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 2.628ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 38 (38) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 128.655ms - MaterializeTupleTime(*): 2.057us - ScannerThreadsSysTime: 7.541ms - ScannerThreadsUserTime: 1.811ms - ScannerThreadsVoluntaryContextSwitches: 217 (217) - TotalRawHdfsOpenFileTime(*): 253.353us - TotalRawHdfsReadTime(*): 15.018ms - TotalReadThroughput: 0.00 /sec CodeGen:(Total: 108.919ms, non-child: 108.919ms, % non-child: 100.00%) - CodegenTime: 2.752ms - CompileTime: 19.657ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039864) - NumFunctions: 133 (133) - NumInstructions: 1.90K (1895) - OptimizationTime: 74.101ms - PeakMemoryUsage: 947.50 KB (970240) - PrepareTime: 14.594ms