Query (id=844a0200d7876345:20bb38b900000000): Summary: Session ID: b34dadc0b4cd9634:e123e3ca7d888199 Session Type: BEESWAX Start Time: 2018-03-12 23:22:57.366843000 End Time: Query Type: DML Query State: RUNNING Query Status: OK Impala Version: impalad version 2.11.0-SNAPSHOT RELEASE (build d0bf63a83dc4bd5effd84b52217827d5c4c5b1e3) User: systest@foo.COM Connected User: systest@foo.COM Delegated User: Network Address: 10.17.187.36:51187 Default Db: tpch_30000_kudu Sql Statement: insert INTO TABLE lineitem SELECT L_SHIPDATE, L_ORDERKEY, L_LINENUMBER, L_PARTKEY, L_SUPPKEY, L_QUANTITY, L_EXTENDEDPRICE, L_DISCOUNT, L_TAX, L_RETURNFLAG, L_LINESTATUS, L_COMMITDATE, L_RECEIPTDATE, L_SHIPINSTRUCT, L_SHIPMODE, L_COMMENT FROM tpch_30000_parquet.lineitem Coordinator: va1026.foo.com:22000 Query Options (set by configuration): Query Options (set by configuration and planner): MT_DOP=0 Plan: ---------------- Max Per-Host Resource Reservation: Memory=4.00MB Per-Host Resource Estimates: Memory=1.41GB F01:PLAN FRAGMENT [KUDU(KuduPartition(L_ORDERKEY))] hosts=129 instances=129 | Per-Host Resources: mem-estimate=128.00MB mem-reservation=4.00MB INSERT INTO KUDU [tpch_30000_kudu.lineitem] | mem-estimate=0B mem-reservation=0B | 02:PARTIAL SORT | order by: KuduPartition(L_ORDERKEY) ASC NULLS LAST, l_shipdate ASC NULLS LAST, l_orderkey ASC NULLS LAST, l_linenumber ASC NULLS LAST | materialized: KuduPartition(L_ORDERKEY) | mem-estimate=128.00MB mem-reservation=4.00MB spill-buffer=2.00MB | tuple-ids=2 row-size=260B cardinality=179999978268 | 01:EXCHANGE [KUDU(KuduPartition(L_ORDERKEY))] | mem-estimate=0B mem-reservation=0B | tuple-ids=0 row-size=256B cardinality=179999978268 | F00:PLAN FRAGMENT [RANDOM] hosts=129 instances=129 Per-Host Resources: mem-estimate=1.29GB mem-reservation=0B 00:SCAN HDFS [tpch_30000_parquet.lineitem, RANDOM] partitions=2526/2526 files=28976 size=6.89TB stored statistics: table: rows=179999978268 size=unavailable partitions: 2526/2526 rows=179999978268 columns: all extrapolated-rows=disabled mem-estimate=1.29GB mem-reservation=0B tuple-ids=0 row-size=256B cardinality=179999978268 ---------------- Estimated Per-Host Mem: 1518338048 Per Host Min Reservation: va1026.foo.com:22000(4.00 MB) va1027.foo.com:22000(4.00 MB) va1028.foo.com:22000(4.00 MB) va1029.foo.com:22000(4.00 MB) va1030.foo.com:22000(4.00 MB) va1031.foo.com:22000(4.00 MB) va1032.foo.com:22000(4.00 MB) va1033.foo.com:22000(4.00 MB) va1034.foo.com:22000(4.00 MB) va1035.foo.com:22000(4.00 MB) va1036.foo.com:22000(4.00 MB) va1037.foo.com:22000(4.00 MB) va1039.foo.com:22000(4.00 MB) va1041.foo.com:22000(4.00 MB) va1042.foo.com:22000(4.00 MB) va1043.foo.com:22000(4.00 MB) va1044.foo.com:22000(4.00 MB) va1045.foo.com:22000(4.00 MB) va1046.foo.com:22000(4.00 MB) vc1501.foo.com:22000(4.00 MB) vc1502.foo.com:22000(4.00 MB) vc1503.foo.com:22000(4.00 MB) vc1504.foo.com:22000(4.00 MB) vc1505.foo.com:22000(4.00 MB) vc1507.foo.com:22000(4.00 MB) vc1508.foo.com:22000(4.00 MB) vc1509.foo.com:22000(4.00 MB) vc1510.foo.com:22000(4.00 MB) vc1511.foo.com:22000(4.00 MB) vc1513.foo.com:22000(4.00 MB) vc1515.foo.com:22000(4.00 MB) vc1516.foo.com:22000(4.00 MB) vc1517.foo.com:22000(4.00 MB) vc1518.foo.com:22000(4.00 MB) vc1519.foo.com:22000(4.00 MB) vc1520.foo.com:22000(4.00 MB) vc1522.foo.com:22000(4.00 MB) vc1523.foo.com:22000(4.00 MB) vc1524.foo.com:22000(4.00 MB) vc1525.foo.com:22000(4.00 MB) vc1526.foo.com:22000(4.00 MB) vc1527.foo.com:22000(4.00 MB) vc1528.foo.com:22000(4.00 MB) vc1529.foo.com:22000(4.00 MB) vc1531.foo.com:22000(4.00 MB) vc1532.foo.com:22000(4.00 MB) vc1533.foo.com:22000(4.00 MB) vc1534.foo.com:22000(4.00 MB) vc1535.foo.com:22000(4.00 MB) vc1536.foo.com:22000(4.00 MB) vc1537.foo.com:22000(4.00 MB) vc1538.foo.com:22000(4.00 MB) vc1539.foo.com:22000(4.00 MB) vc1540.foo.com:22000(4.00 MB) vc1541.foo.com:22000(4.00 MB) vc1542.foo.com:22000(4.00 MB) vd1101.foo.com:22000(4.00 MB) vd1102.foo.com:22000(4.00 MB) vd1103.foo.com:22000(4.00 MB) vd1104.foo.com:22000(4.00 MB) vd1105.foo.com:22000(4.00 MB) vd1107.foo.com:22000(4.00 MB) vd1108.foo.com:22000(4.00 MB) vd1109.foo.com:22000(4.00 MB) vd1110.foo.com:22000(4.00 MB) vd1111.foo.com:22000(4.00 MB) vd1112.foo.com:22000(4.00 MB) vd1113.foo.com:22000(4.00 MB) vd1114.foo.com:22000(4.00 MB) vd1115.foo.com:22000(4.00 MB) vd1116.foo.com:22000(4.00 MB) vd1117.foo.com:22000(4.00 MB) vd1118.foo.com:22000(4.00 MB) vd1119.foo.com:22000(4.00 MB) vd1120.foo.com:22000(4.00 MB) vd1121.foo.com:22000(4.00 MB) vd1122.foo.com:22000(4.00 MB) vd1123.foo.com:22000(4.00 MB) vd1124.foo.com:22000(4.00 MB) vd1125.foo.com:22000(4.00 MB) vd1126.foo.com:22000(4.00 MB) vd1127.foo.com:22000(4.00 MB) vd1129.foo.com:22000(4.00 MB) vd1130.foo.com:22000(4.00 MB) vd1131.foo.com:22000(4.00 MB) vd1132.foo.com:22000(4.00 MB) vd1133.foo.com:22000(4.00 MB) vd1134.foo.com:22000(4.00 MB) vd1135.foo.com:22000(4.00 MB) vd1136.foo.com:22000(4.00 MB) vd1138.foo.com:22000(4.00 MB) vd1139.foo.com:22000(4.00 MB) vd1140.foo.com:22000(4.00 MB) vd1141.foo.com:22000(4.00 MB) vd1142.foo.com:22000(4.00 MB) vd1326.foo.com:22000(4.00 MB) vd1327.foo.com:22000(4.00 MB) vd1328.foo.com:22000(4.00 MB) vd1329.foo.com:22000(4.00 MB) vd1330.foo.com:22000(4.00 MB) vd1331.foo.com:22000(4.00 MB) vd1332.foo.com:22000(4.00 MB) vd1333.foo.com:22000(4.00 MB) vd1334.foo.com:22000(4.00 MB) vd1335.foo.com:22000(4.00 MB) vd1336.foo.com:22000(4.00 MB) vd1337.foo.com:22000(4.00 MB) vd1338.foo.com:22000(4.00 MB) vd1339.foo.com:22000(4.00 MB) vd1340.foo.com:22000(4.00 MB) vd1341.foo.com:22000(4.00 MB) vd1342.foo.com:22000(4.00 MB) ve1125.foo.com:22000(4.00 MB) ve1126.foo.com:22000(4.00 MB) ve1127.foo.com:22000(4.00 MB) ve1128.foo.com:22000(4.00 MB) ve1129.foo.com:22000(4.00 MB) ve1130.foo.com:22000(4.00 MB) ve1131.foo.com:22000(4.00 MB) ve1132.foo.com:22000(4.00 MB) ve1134.foo.com:22000(4.00 MB) ve1135.foo.com:22000(4.00 MB) ve1136.foo.com:22000(4.00 MB) ve1137.foo.com:22000(4.00 MB) ve1138.foo.com:22000(4.00 MB) ve1139.foo.com:22000(4.00 MB) ve1140.foo.com:22000(4.00 MB) ve1141.foo.com:22000(4.00 MB) ve1142.foo.com:22000(4.00 MB) Request Pool: root.default Admission result: Admitted immediately Query Compilation: 131.797ms - Metadata of all 2 tables cached: 1.053ms (1.053ms) - Analysis finished: 2.971ms (1.918ms) - Value transfer graph computed: 3.204ms (232.783us) - Single node plan created: 112.664ms (109.460ms) - Runtime filters computed: 112.748ms (83.895us) - Distributed plan created: 113.671ms (923.018us) - Lineage info computed: 114.099ms (428.030us) - Planning finished: 131.797ms (17.697ms) Query Timeline: 49m3s - Query submitted: 58.075us (58.075us) - Planning finished: 243.661ms (243.603ms) - Submit for admission: 320.031ms (76.370ms) - Completed admission: 320.145ms (113.463us) - Ready to start on 129 backends: 337.957ms (17.812ms) - All 129 execution backends (258 fragment instances) started: 626.366ms (288.409ms) - ComputeScanRangeAssignmentTimer: 48.666ms ImpalaServer: - ClientFetchWaitTimer: 0.000ns - RowMaterializationTimer: 0.000ns Execution Profile 844a0200d7876345:20bb38b900000000:(Total: 297.872ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 129, min / max: 25ms / 142ms, 25th %-ile: 80ms, 50th %-ile: 103ms, 75th %-ile: 120ms, 90th %-ile: 131ms, 95th %-ile: 135ms, 99.9th %-ile: 142ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns - NumBackends: 129 (129) - NumFragmentInstances: 258 (258) - NumFragments: 2 (2) Averaged Fragment F01: Fragment F01: Instance 844a0200d7876345:20bb38b9000000e4 (host=va1026.foo.com:22000):(Total: 1s291ms, non-child: 258.894ms, % non-child: 20.05%) Fragment Instance Lifecycle Event Timeline: 1s291ms - Prepare Finished: 258.176ms (258.176ms) - Open Finished: 1s291ms (1s033ms) MemoryUsage(1m4s): 4.36 GB, 12.02 GB, 17.83 GB, 21.55 GB, 24.26 GB, 26.57 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.37 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.31 GB, 53.14 GB, 54.00 GB, 54.83 GB, 55.64 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.89 GB (71825441206) - PeakReservation: 66.86 GB (71785512960) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.48 GB (86419519297) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 40m38s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s033ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 55.992ms - TotalThreadsVoluntaryContextSwitches: 9 (9) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s033ms - ExecTreeOpenTime: 975.361ms - PrepareTime: 257.673ms - ExecTreePrepareTime: 132.498us KuduTableSink:(Total: 9.468us, non-child: 9.468us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 975.491ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.86 GB (71785521152) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 51s004ms - CumulativeAllocationBytes: 66.86 GB (71785512960) - CumulativeAllocations: 34.23K (34230) - PeakReservation: 66.86 GB (71785512960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.86 GB (71785512960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 40m48s, non-child: 18s667ms, % non-child: 0.76%) - ConvertRowBatchTime: 7s690ms - PeakMemoryUsage: 19.53 MB (20482957) - RowsReturned: 262.17M (262168704) - RowsReturnedRate: 107.06 K/sec Buffer pool: - AllocTime: 4m44s - CumulativeAllocationBytes: 119.06 GB (127838453760) - CumulativeAllocations: 6.24M (6242112) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.44 GB, 12.16 GB, 18.02 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.55 GB, 37.74 GB, 38.92 GB, 40.05 GB, 41.15 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.17 GB, 46.13 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.69 GB, 54.55 GB, 55.40 GB, 56.22 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.77 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 975.255ms - TotalBytesReceived: 67.58 GB (72564351903) - TotalGetBatchTime: 40m37s - DataArrivalTimer: 40m30s SenderSide: - DeserializeRowBatchTime: 8m54s - NumBatchesArrived: 3.12M (3121056) - NumBatchesDeferred: 4.79K (4785) - NumBatchesEnqueued: 3.12M (3121056) - NumBatchesReceived: 3.12M (3121056) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 56.748ms, non-child: 56.748ms, % non-child: 100.00%) - CodegenTime: 967.576us - CompileTime: 5.104ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.275ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.849ms Instance 844a0200d7876345:20bb38b900000096 (host=va1027.foo.com:22000):(Total: 1s266ms, non-child: 162.226ms, % non-child: 12.81%) Fragment Instance Lifecycle Event Timeline: 1s266ms - Prepare Finished: 161.550ms (161.550ms) - Open Finished: 1s266ms (1s104ms) MemoryUsage(1m4s): 4.80 GB, 13.22 GB, 19.62 GB, 23.71 GB, 26.68 GB, 29.22 GB, 31.51 GB, 33.64 GB, 35.41 GB, 37.15 GB, 38.55 GB, 39.80 GB, 41.10 GB, 42.37 GB, 43.61 GB, 44.80 GB, 45.95 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.58 GB, 55.61 GB, 56.58 GB, 57.53 GB, 58.44 GB, 59.38 GB, 60.31 GB, 61.20 GB, 62.11 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.67 GB, 69.50 GB, 70.29 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.43 GB (78844608950) - PeakReservation: 73.39 GB (78804680704) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.73 GB (93124499778) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m42s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s104ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 52.992ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s104ms - ExecTreeOpenTime: 1s048ms - PrepareTime: 161.033ms - ExecTreePrepareTime: 181.498us KuduTableSink:(Total: 14.526us, non-child: 14.526us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 1s048ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.39 GB (78804688896) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m6s - CumulativeAllocationBytes: 73.39 GB (78804680704) - CumulativeAllocations: 37.58K (37577) - PeakReservation: 73.39 GB (78804680704) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.39 GB (78804680704) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m51s, non-child: 16s289ms, % non-child: 0.70%) - ConvertRowBatchTime: 6s988ms - PeakMemoryUsage: 19.53 MB (20482074) - RowsReturned: 287.81M (287809116) - RowsReturnedRate: 123.44 K/sec Buffer pool: - AllocTime: 13m32s - CumulativeAllocationBytes: 130.70 GB (140341207040) - CumulativeAllocations: 6.85M (6852598) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.81 GB, 13.33 GB, 19.79 GB, 23.93 GB, 26.93 GB, 29.50 GB, 31.81 GB, 33.97 GB, 35.76 GB, 37.51 GB, 38.93 GB, 40.19 GB, 41.50 GB, 42.80 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.67 GB, 50.73 GB, 51.73 GB, 52.93 GB, 54.00 GB, 55.14 GB, 56.18 GB, 57.15 GB, 58.11 GB, 59.04 GB, 59.99 GB, 60.92 GB, 61.83 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.57 GB, 69.38 GB, 70.21 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 1s048ms - TotalBytesReceived: 74.19 GB (79661239679) - TotalGetBatchTime: 38m42s - DataArrivalTimer: 38m35s SenderSide: - DeserializeRowBatchTime: 17m56s - NumBatchesArrived: 3.43M (3426299) - NumBatchesDeferred: 67.68K (67683) - NumBatchesEnqueued: 3.43M (3426299) - NumBatchesReceived: 3.43M (3426299) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 55.070ms, non-child: 55.070ms, % non-child: 100.00%) - CodegenTime: 917.487us - CompileTime: 5.209ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 29.513ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 19.700ms Instance 844a0200d7876345:20bb38b90000008a (host=va1028.foo.com:22000):(Total: 1s207ms, non-child: 231.225ms, % non-child: 19.15%) Fragment Instance Lifecycle Event Timeline: 1s208ms - Prepare Finished: 230.111ms (230.111ms) - Open Finished: 1s208ms (977.944ms) MemoryUsage(1m4s): 4.84 GB, 13.26 GB, 19.63 GB, 23.72 GB, 26.69 GB, 29.23 GB, 31.51 GB, 33.65 GB, 35.42 GB, 37.15 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.61 GB, 44.80 GB, 45.95 GB, 47.02 GB, 48.09 GB, 49.18 GB, 50.22 GB, 51.21 GB, 52.41 GB, 53.46 GB, 54.59 GB, 55.62 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.12 GB, 63.05 GB, 64.16 GB, 65.12 GB, 66.15 GB, 67.07 GB, 67.87 GB, 68.67 GB, 69.50 GB, 70.30 GB, 71.08 GB, 71.84 GB, 72.62 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.64 GB (79066907062) - PeakReservation: 73.60 GB (79026978816) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.91 GB (93320103740) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 36m56s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 977.929ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 60.991ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 977.932ms - ExecTreeOpenTime: 914.039ms - PrepareTime: 229.739ms - ExecTreePrepareTime: 167.730us KuduTableSink:(Total: 11.828us, non-child: 11.828us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 914.203ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.60 GB (79026987008) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 4m48s - CumulativeAllocationBytes: 73.60 GB (79026978816) - CumulativeAllocations: 37.68K (37683) - PeakReservation: 73.60 GB (79026978816) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.60 GB (79026978816) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m6s, non-child: 18s092ms, % non-child: 0.81%) - ConvertRowBatchTime: 7s779ms - PeakMemoryUsage: 19.53 MB (20482008) - RowsReturned: 288.62M (288624756) - RowsReturnedRate: 129.63 K/sec Buffer pool: - AllocTime: 15m44s - CumulativeAllocationBytes: 131.07 GB (140738928640) - CumulativeAllocations: 6.87M (6872018) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.86 GB, 13.36 GB, 19.81 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.97 GB, 35.76 GB, 37.52 GB, 38.93 GB, 40.19 GB, 41.50 GB, 42.79 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.67 GB, 50.73 GB, 51.73 GB, 52.94 GB, 54.01 GB, 55.14 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.76 GB, 63.69 GB, 64.81 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.57 GB, 69.38 GB, 70.22 GB, 71.02 GB, 71.82 GB, 72.58 GB, 73.37 GB - FirstBatchArrivalWaitTime: 913.973ms - TotalBytesReceived: 74.40 GB (79887252902) - TotalGetBatchTime: 36m55s - DataArrivalTimer: 36m48s SenderSide: - DeserializeRowBatchTime: 19m30s - NumBatchesArrived: 3.44M (3436009) - NumBatchesDeferred: 63.27K (63275) - NumBatchesEnqueued: 3.44M (3436009) - NumBatchesReceived: 3.44M (3436009) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 62.303ms, non-child: 62.303ms, % non-child: 100.00%) - CodegenTime: 1.424ms - CompileTime: 4.975ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 33.221ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.347ms Instance 844a0200d7876345:20bb38b9000000ac (host=va1029.foo.com:22000):(Total: 1s179ms, non-child: 209.184ms, % non-child: 17.73%) Fragment Instance Lifecycle Event Timeline: 1s180ms - Prepare Finished: 208.345ms (208.345ms) - Open Finished: 1s180ms (971.997ms) MemoryUsage(1m4s): 4.82 GB, 13.23 GB, 19.62 GB, 23.71 GB, 26.68 GB, 29.23 GB, 31.51 GB, 33.65 GB, 35.41 GB, 37.15 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.61 GB, 44.80 GB, 45.95 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.22 GB, 51.21 GB, 52.41 GB, 53.46 GB, 54.59 GB, 55.62 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.21 GB, 62.12 GB, 63.05 GB, 64.16 GB, 65.12 GB, 66.16 GB, 67.07 GB, 67.88 GB, 68.68 GB, 69.50 GB, 70.30 GB, 71.09 GB, 71.85 GB, 72.62 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.65 GB (79081587126) - PeakReservation: 73.61 GB (79041658880) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.02 GB (93434424547) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m26s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 971.977ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 53.991ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 971.983ms - ExecTreeOpenTime: 914.259ms - PrepareTime: 207.859ms - ExecTreePrepareTime: 189.446us KuduTableSink:(Total: 14.203us, non-child: 14.203us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 914.445ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.61 GB (79041667072) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m41s - CumulativeAllocationBytes: 73.61 GB (79041658880) - CumulativeAllocations: 37.69K (37690) - PeakReservation: 73.61 GB (79041658880) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.61 GB (79041658880) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m36s, non-child: 17s974ms, % non-child: 0.78%) - ConvertRowBatchTime: 7s760ms - PeakMemoryUsage: 19.53 MB (20481595) - RowsReturned: 288.67M (288667648) - RowsReturnedRate: 124.59 K/sec Buffer pool: - AllocTime: 16m10s - CumulativeAllocationBytes: 131.11 GB (140775383040) - CumulativeAllocations: 6.87M (6873798) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.83 GB, 13.34 GB, 19.80 GB, 23.93 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.97 GB, 35.76 GB, 37.51 GB, 38.93 GB, 40.19 GB, 41.50 GB, 42.79 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.67 GB, 50.73 GB, 51.73 GB, 52.94 GB, 54.01 GB, 55.14 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.58 GB, 69.38 GB, 70.22 GB, 71.03 GB, 71.82 GB, 72.59 GB, 73.37 GB - FirstBatchArrivalWaitTime: 914.163ms - TotalBytesReceived: 74.42 GB (79907983309) - TotalGetBatchTime: 38m26s - DataArrivalTimer: 38m19s SenderSide: - DeserializeRowBatchTime: 23m9s - NumBatchesArrived: 3.44M (3436901) - NumBatchesDeferred: 26.84K (26839) - NumBatchesEnqueued: 3.44M (3436884) - NumBatchesReceived: 3.44M (3436901) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 56.258ms, non-child: 56.258ms, % non-child: 100.00%) - CodegenTime: 1.161ms - CompileTime: 4.432ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.814ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.462ms Instance 844a0200d7876345:20bb38b9000000a3 (host=va1030.foo.com:22000):(Total: 1s172ms, non-child: 200.411ms, % non-child: 17.09%) Fragment Instance Lifecycle Event Timeline: 1s173ms - Prepare Finished: 199.691ms (199.691ms) - Open Finished: 1s173ms (973.902ms) MemoryUsage(1m4s): 4.77 GB, 13.21 GB, 19.60 GB, 23.70 GB, 26.67 GB, 29.21 GB, 31.50 GB, 33.63 GB, 35.40 GB, 37.14 GB, 38.54 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.95 GB, 47.01 GB, 48.09 GB, 49.17 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.58 GB, 55.61 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.12 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.66 GB, 69.49 GB, 70.29 GB, 71.07 GB, 71.83 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.69 GB (79123530166) - PeakReservation: 73.65 GB (79083601920) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.02 GB (93435941671) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m28s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 973.873ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 55.991ms - TotalThreadsVoluntaryContextSwitches: 25 (25) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 973.876ms - ExecTreeOpenTime: 915.567ms - PrepareTime: 198.988ms - ExecTreePrepareTime: 155.134us KuduTableSink:(Total: 12.589us, non-child: 12.589us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 915.718ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.65 GB (79083610112) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m9s - CumulativeAllocationBytes: 73.65 GB (79083601920) - CumulativeAllocations: 37.71K (37710) - PeakReservation: 73.65 GB (79083601920) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.65 GB (79083601920) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m39s, non-child: 18s181ms, % non-child: 0.78%) - ConvertRowBatchTime: 7s926ms - PeakMemoryUsage: 19.53 MB (20481319) - RowsReturned: 288.83M (288830892) - RowsReturnedRate: 124.54 K/sec Buffer pool: - AllocTime: 17m12s - CumulativeAllocationBytes: 131.17 GB (140839444480) - CumulativeAllocations: 6.88M (6876926) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.87 GB, 13.37 GB, 19.82 GB, 23.95 GB, 26.95 GB, 29.52 GB, 31.82 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.20 GB, 41.51 GB, 42.80 GB, 44.05 GB, 45.26 GB, 46.42 GB, 47.49 GB, 48.58 GB, 49.68 GB, 50.74 GB, 51.74 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.19 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.84 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.57 GB, 69.38 GB, 70.22 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.37 GB - FirstBatchArrivalWaitTime: 915.459ms - TotalBytesReceived: 74.45 GB (79944017735) - TotalGetBatchTime: 38m28s - DataArrivalTimer: 38m21s SenderSide: - DeserializeRowBatchTime: 20m44s - NumBatchesArrived: 3.44M (3438463) - NumBatchesDeferred: 27.14K (27144) - NumBatchesEnqueued: 3.44M (3438463) - NumBatchesReceived: 3.44M (3438463) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 56.790ms, non-child: 56.790ms, % non-child: 100.00%) - CodegenTime: 1.452ms - CompileTime: 6.635ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.261ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 21.072ms Instance 844a0200d7876345:20bb38b900000098 (host=va1031.foo.com:22000):(Total: 1s310ms, non-child: 88.725ms, % non-child: 6.77%) Fragment Instance Lifecycle Event Timeline: 1s310ms - Prepare Finished: 87.952ms (87.952ms) - Open Finished: 1s310ms (1s222ms) MemoryUsage(1m4s): 4.77 GB, 13.20 GB, 19.60 GB, 23.70 GB, 26.67 GB, 29.21 GB, 31.50 GB, 33.63 GB, 35.41 GB, 37.14 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.94 GB, 47.01 GB, 48.09 GB, 49.18 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.58 GB, 55.61 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.12 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.67 GB, 69.50 GB, 70.30 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.63 GB (79060615606) - PeakReservation: 73.59 GB (79020687360) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.01 GB (93428332634) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m38s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s222ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 56.992ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s222ms - ExecTreeOpenTime: 1s165ms - PrepareTime: 87.598ms - ExecTreePrepareTime: 171.161us KuduTableSink:(Total: 14.099us, non-child: 14.099us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 1s165ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.59 GB (79020695552) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m22s - CumulativeAllocationBytes: 73.59 GB (79020687360) - CumulativeAllocations: 37.68K (37680) - PeakReservation: 73.59 GB (79020687360) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.59 GB (79020687360) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m48s, non-child: 18s477ms, % non-child: 0.79%) - ConvertRowBatchTime: 7s781ms - PeakMemoryUsage: 19.53 MB (20481886) - RowsReturned: 288.59M (288594944) - RowsReturnedRate: 123.94 K/sec Buffer pool: - AllocTime: 13m4s - CumulativeAllocationBytes: 131.06 GB (140724551680) - CumulativeAllocations: 6.87M (6871316) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.87 GB, 13.37 GB, 19.81 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.19 GB, 41.50 GB, 42.80 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.59 GB, 49.68 GB, 50.74 GB, 51.74 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.19 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.94 GB, 61.84 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.58 GB, 69.39 GB, 70.22 GB, 71.03 GB, 71.82 GB, 72.59 GB, 73.37 GB - FirstBatchArrivalWaitTime: 1s165ms - TotalBytesReceived: 74.39 GB (79879163229) - TotalGetBatchTime: 38m37s - DataArrivalTimer: 38m30s SenderSide: - DeserializeRowBatchTime: 16m34s - NumBatchesArrived: 3.44M (3435658) - NumBatchesDeferred: 87.91K (87905) - NumBatchesEnqueued: 3.44M (3435658) - NumBatchesReceived: 3.44M (3435658) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 56.169ms, non-child: 56.169ms, % non-child: 100.00%) - CodegenTime: 1.159ms - CompileTime: 5.163ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 30.803ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 19.636ms Instance 844a0200d7876345:20bb38b9000000d1 (host=va1032.foo.com:22000):(Total: 1s168ms, non-child: 206.872ms, % non-child: 17.71%) Fragment Instance Lifecycle Event Timeline: 1s168ms - Prepare Finished: 205.898ms (205.898ms) - Open Finished: 1s168ms (962.560ms) MemoryUsage(1m4s): 4.41 GB, 12.06 GB, 17.85 GB, 21.57 GB, 24.27 GB, 26.58 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.65 GB, 40.73 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.32 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.87 GB (71802372534) - PeakReservation: 66.83 GB (71762444288) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.29 GB (86208166294) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m17s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 962.545ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 54.992ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 962.548ms - ExecTreeOpenTime: 904.149ms - PrepareTime: 205.582ms - ExecTreePrepareTime: 182.026us KuduTableSink:(Total: 13.398us, non-child: 13.398us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 904.328ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.83 GB (71762452480) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m34s - CumulativeAllocationBytes: 66.83 GB (71762444288) - CumulativeAllocations: 34.22K (34219) - PeakReservation: 66.83 GB (71762444288) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.83 GB (71762444288) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m27s, non-child: 17s488ms, % non-child: 0.74%) - ConvertRowBatchTime: 7s695ms - PeakMemoryUsage: 19.53 MB (20482593) - RowsReturned: 262.09M (262090500) - RowsReturnedRate: 110.70 K/sec Buffer pool: - AllocTime: 10m35s - CumulativeAllocationBytes: 119.02 GB (127800320000) - CumulativeAllocations: 6.24M (6240250) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.42 GB, 12.15 GB, 18.01 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.39 GB, 36.53 GB, 37.73 GB, 38.90 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.12 GB, 49.09 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.76 GB, 61.59 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.28 GB, 65.98 GB, 66.70 GB - FirstBatchArrivalWaitTime: 904.040ms - TotalBytesReceived: 67.56 GB (72543259540) - TotalGetBatchTime: 39m16s - DataArrivalTimer: 39m10s SenderSide: - DeserializeRowBatchTime: 13m40s - NumBatchesArrived: 3.12M (3120125) - NumBatchesDeferred: 9.24K (9239) - NumBatchesEnqueued: 3.12M (3120125) - NumBatchesReceived: 3.12M (3120125) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 56.986ms, non-child: 56.986ms, % non-child: 100.00%) - CodegenTime: 1.121ms - CompileTime: 5.265ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.916ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.252ms Instance 844a0200d7876345:20bb38b900000095 (host=va1033.foo.com:22000):(Total: 1s201ms, non-child: 223.250ms, % non-child: 18.59%) Fragment Instance Lifecycle Event Timeline: 1s201ms - Prepare Finished: 222.538ms (222.538ms) - Open Finished: 1s201ms (979.007ms) MemoryUsage(1m4s): 4.82 GB, 13.24 GB, 19.63 GB, 23.72 GB, 26.69 GB, 29.22 GB, 31.51 GB, 33.64 GB, 35.41 GB, 37.14 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.79 GB, 45.94 GB, 47.01 GB, 48.09 GB, 49.17 GB, 50.21 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.58 GB, 55.61 GB, 56.58 GB, 57.53 GB, 58.44 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.11 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.67 GB, 69.49 GB, 70.29 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.57 GB (78991409590) - PeakReservation: 73.53 GB (78951481344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.87 GB (93271040023) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m32s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 978.978ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 62.991ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 978.981ms - ExecTreeOpenTime: 914.628ms - PrepareTime: 222.109ms - ExecTreePrepareTime: 175.221us KuduTableSink:(Total: 16.157us, non-child: 16.157us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 914.800ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.53 GB (78951489536) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m55s - CumulativeAllocationBytes: 73.53 GB (78951481344) - CumulativeAllocations: 37.65K (37647) - PeakReservation: 73.53 GB (78951481344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.53 GB (78951481344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m42s, non-child: 18s014ms, % non-child: 0.78%) - ConvertRowBatchTime: 7s865ms - PeakMemoryUsage: 19.53 MB (20481856) - RowsReturned: 288.35M (288346296) - RowsReturnedRate: 124.16 K/sec Buffer pool: - AllocTime: 15m55s - CumulativeAllocationBytes: 130.95 GB (140603146240) - CumulativeAllocations: 6.87M (6865388) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.84 GB, 13.35 GB, 19.80 GB, 23.93 GB, 26.94 GB, 29.50 GB, 31.81 GB, 33.97 GB, 35.76 GB, 37.51 GB, 38.93 GB, 40.18 GB, 41.49 GB, 42.79 GB, 44.03 GB, 45.24 GB, 46.40 GB, 47.48 GB, 48.57 GB, 49.67 GB, 50.72 GB, 51.73 GB, 52.93 GB, 54.00 GB, 55.14 GB, 56.18 GB, 57.15 GB, 58.11 GB, 59.04 GB, 59.99 GB, 60.92 GB, 61.83 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.57 GB, 69.37 GB, 70.21 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 914.550ms - TotalBytesReceived: 74.33 GB (79810329320) - TotalGetBatchTime: 38m31s - DataArrivalTimer: 38m24s SenderSide: - DeserializeRowBatchTime: 19m21s - NumBatchesArrived: 3.43M (3432694) - NumBatchesDeferred: 19.81K (19811) - NumBatchesEnqueued: 3.43M (3432694) - NumBatchesReceived: 3.43M (3432694) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 63.080ms, non-child: 63.080ms, % non-child: 100.00%) - CodegenTime: 977.651us - CompileTime: 5.410ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.197ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.875ms Instance 844a0200d7876345:20bb38b9000000c7 (host=va1034.foo.com:22000):(Total: 1s192ms, non-child: 212.211ms, % non-child: 17.80%) Fragment Instance Lifecycle Event Timeline: 1s192ms - Prepare Finished: 211.300ms (211.300ms) - Open Finished: 1s192ms (980.951ms) MemoryUsage(1m4s): 4.37 GB, 12.02 GB, 17.83 GB, 21.55 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.85 GB (71781401014) - PeakReservation: 66.81 GB (71741472768) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.01 GB (85905771152) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m13s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 980.916ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 51.992ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 980.930ms - ExecTreeOpenTime: 926.393ms - PrepareTime: 211.018ms - ExecTreePrepareTime: 183.538us KuduTableSink:(Total: 20.795us, non-child: 20.795us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 926.574ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.81 GB (71741480960) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m32s - CumulativeAllocationBytes: 66.81 GB (71741472768) - CumulativeAllocations: 34.21K (34209) - PeakReservation: 66.81 GB (71741472768) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.81 GB (71741472768) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m22s, non-child: 17s025ms, % non-child: 0.72%) - ConvertRowBatchTime: 7s448ms - PeakMemoryUsage: 19.53 MB (20482304) - RowsReturned: 262.01M (262008832) - RowsReturnedRate: 110.89 K/sec Buffer pool: - AllocTime: 7m11s - CumulativeAllocationBytes: 118.99 GB (127760588800) - CumulativeAllocations: 6.24M (6238310) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.44 GB, 12.17 GB, 18.02 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.74 GB, 38.91 GB, 40.05 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.77 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 926.278ms - TotalBytesReceived: 67.54 GB (72520129002) - TotalGetBatchTime: 39m12s - DataArrivalTimer: 39m6s SenderSide: - DeserializeRowBatchTime: 10m13s - NumBatchesArrived: 3.12M (3119155) - NumBatchesDeferred: 10.18K (10182) - NumBatchesEnqueued: 3.12M (3119155) - NumBatchesReceived: 3.12M (3119155) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 53.202ms, non-child: 53.202ms, % non-child: 100.00%) - CodegenTime: 1.145ms - CompileTime: 5.734ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.376ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 18.601ms Instance 844a0200d7876345:20bb38b9000000cf (host=va1035.foo.com:22000):(Total: 1s207ms, non-child: 231.690ms, % non-child: 19.19%) Fragment Instance Lifecycle Event Timeline: 1s207ms - Prepare Finished: 231.185ms (231.185ms) - Open Finished: 1s207ms (976.623ms) MemoryUsage(1m4s): 4.39 GB, 12.04 GB, 17.84 GB, 21.56 GB, 24.27 GB, 26.58 GB, 28.65 GB, 30.60 GB, 32.21 GB, 33.78 GB, 35.06 GB, 36.18 GB, 37.36 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.72 GB, 45.67 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.64 GB, 50.57 GB, 51.45 GB, 52.31 GB, 53.15 GB, 54.00 GB, 54.84 GB, 55.65 GB, 56.48 GB, 57.33 GB, 58.33 GB, 59.20 GB, 60.15 GB, 60.98 GB, 61.71 GB, 62.44 GB, 63.19 GB, 63.91 GB, 64.63 GB, 65.32 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.80 GB (71722680758) - PeakReservation: 66.76 GB (71682752512) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.08 GB (85990189818) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m6s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 976.606ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 50.992ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 976.609ms - ExecTreeOpenTime: 925.174ms - PrepareTime: 230.539ms - ExecTreePrepareTime: 195.562us KuduTableSink:(Total: 11.854us, non-child: 11.854us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 925.366ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.76 GB (71682760704) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m31s - CumulativeAllocationBytes: 66.76 GB (71682752512) - CumulativeAllocations: 34.18K (34181) - PeakReservation: 66.76 GB (71682752512) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.76 GB (71682752512) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m16s, non-child: 17s115ms, % non-child: 0.73%) - ConvertRowBatchTime: 7s542ms - PeakMemoryUsage: 19.53 MB (20483096) - RowsReturned: 261.80M (261802212) - RowsReturnedRate: 111.09 K/sec Buffer pool: - AllocTime: 8m55s - CumulativeAllocationBytes: 118.89 GB (127659745280) - CumulativeAllocations: 6.23M (6233386) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.40 GB, 12.13 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.69 GB, 54.55 GB, 55.40 GB, 56.22 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 925.105ms - TotalBytesReceived: 67.49 GB (72462616673) - TotalGetBatchTime: 39m5s - DataArrivalTimer: 38m59s SenderSide: - DeserializeRowBatchTime: 12m5s - NumBatchesArrived: 3.12M (3116693) - NumBatchesDeferred: 8.30K (8297) - NumBatchesEnqueued: 3.12M (3116693) - NumBatchesReceived: 3.12M (3116693) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 50.134ms, non-child: 50.134ms, % non-child: 100.00%) - CodegenTime: 1.042ms - CompileTime: 5.505ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 27.095ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 16.971ms Instance 844a0200d7876345:20bb38b9000000e5 (host=va1036.foo.com:22000):(Total: 1s227ms, non-child: 222.713ms, % non-child: 18.15%) Fragment Instance Lifecycle Event Timeline: 1s227ms - Prepare Finished: 221.686ms (221.686ms) - Open Finished: 1s227ms (1s005ms) MemoryUsage(1m4s): 4.35 GB, 12.01 GB, 17.82 GB, 21.55 GB, 24.25 GB, 26.56 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.04 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.65 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.32 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.76 GB (71680737718) - PeakReservation: 66.72 GB (71640809472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.03 GB (85930132603) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m41s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s005ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 60.990ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s005ms - ExecTreeOpenTime: 943.386ms - PrepareTime: 221.318ms - ExecTreePrepareTime: 151.820us KuduTableSink:(Total: 11.741us, non-child: 11.741us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 943.535ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.72 GB (71640817664) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m8s - CumulativeAllocationBytes: 66.72 GB (71640809472) - CumulativeAllocations: 34.16K (34161) - PeakReservation: 66.72 GB (71640809472) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.72 GB (71640809472) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m50s, non-child: 16s524ms, % non-child: 0.69%) - ConvertRowBatchTime: 7s166ms - PeakMemoryUsage: 19.53 MB (20482229) - RowsReturned: 261.64M (261644288) - RowsReturnedRate: 109.43 K/sec Buffer pool: - AllocTime: 6m31s - CumulativeAllocationBytes: 118.82 GB (127582822400) - CumulativeAllocations: 6.23M (6229630) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.43 GB, 12.15 GB, 18.01 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.74 GB, 38.91 GB, 40.05 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 943.319ms - TotalBytesReceived: 67.45 GB (72419673755) - TotalGetBatchTime: 39m40s - DataArrivalTimer: 39m34s SenderSide: - DeserializeRowBatchTime: 9m30s - NumBatchesArrived: 3.11M (3114815) - NumBatchesDeferred: 4.04K (4038) - NumBatchesEnqueued: 3.11M (3114815) - NumBatchesReceived: 3.11M (3114815) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 60.742ms, non-child: 60.742ms, % non-child: 100.00%) - CodegenTime: 1.213ms - CompileTime: 5.434ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 30.691ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.017ms Instance 844a0200d7876345:20bb38b90000009d (host=va1037.foo.com:22000):(Total: 1s206ms, non-child: 212.040ms, % non-child: 17.58%) Fragment Instance Lifecycle Event Timeline: 1s206ms - Prepare Finished: 211.085ms (211.085ms) - Open Finished: 1s206ms (995.716ms) MemoryUsage(1m4s): 4.83 GB, 13.26 GB, 19.64 GB, 23.72 GB, 26.69 GB, 29.23 GB, 31.52 GB, 33.65 GB, 35.42 GB, 37.15 GB, 38.56 GB, 39.80 GB, 41.10 GB, 42.38 GB, 43.61 GB, 44.81 GB, 45.95 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.23 GB, 51.22 GB, 52.41 GB, 53.46 GB, 54.59 GB, 55.62 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.12 GB, 63.05 GB, 64.16 GB, 65.12 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.67 GB, 69.50 GB, 70.30 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.43 GB (78842511798) - PeakReservation: 73.39 GB (78802583552) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.74 GB (93138793856) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m10s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 995.697ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 50.992ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 995.701ms - ExecTreeOpenTime: 940.801ms - PrepareTime: 210.704ms - ExecTreePrepareTime: 157.022us KuduTableSink:(Total: 20.367us, non-child: 20.367us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 940.955ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.39 GB (78802591744) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m57s - CumulativeAllocationBytes: 73.39 GB (78802583552) - CumulativeAllocations: 37.58K (37576) - PeakReservation: 73.39 GB (78802583552) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.39 GB (78802583552) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m20s, non-child: 18s016ms, % non-child: 0.78%) - ConvertRowBatchTime: 7s840ms - PeakMemoryUsage: 19.53 MB (20481180) - RowsReturned: 287.80M (287802564) - RowsReturnedRate: 125.09 K/sec Buffer pool: - AllocTime: 15m44s - CumulativeAllocationBytes: 130.70 GB (140338012160) - CumulativeAllocations: 6.85M (6852442) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.85 GB, 13.36 GB, 19.81 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.19 GB, 41.51 GB, 42.80 GB, 44.05 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.68 GB, 50.73 GB, 51.74 GB, 52.94 GB, 54.01 GB, 55.14 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.57 GB, 69.38 GB, 70.22 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 940.713ms - TotalBytesReceived: 74.19 GB (79659704704) - TotalGetBatchTime: 38m9s - DataArrivalTimer: 38m3s SenderSide: - DeserializeRowBatchTime: 19m25s - NumBatchesArrived: 3.43M (3426221) - NumBatchesDeferred: 32.25K (32251) - NumBatchesEnqueued: 3.43M (3426221) - NumBatchesReceived: 3.43M (3426221) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 53.451ms, non-child: 53.451ms, % non-child: 100.00%) - CodegenTime: 1.155ms - CompileTime: 5.020ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.776ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 19.060ms Instance 844a0200d7876345:20bb38b9000000b2 (host=va1039.foo.com:22000):(Total: 1s260ms, non-child: 176.721ms, % non-child: 14.02%) Fragment Instance Lifecycle Event Timeline: 1s261ms - Prepare Finished: 175.889ms (175.889ms) - Open Finished: 1s261ms (1s085ms) MemoryUsage(1m4s): 4.80 GB, 13.22 GB, 19.61 GB, 23.70 GB, 26.68 GB, 29.22 GB, 31.50 GB, 33.64 GB, 35.41 GB, 37.14 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.95 GB, 47.02 GB, 48.09 GB, 49.18 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.58 GB, 55.61 GB, 56.58 GB, 57.53 GB, 58.44 GB, 59.38 GB, 60.31 GB, 61.20 GB, 62.11 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.14 GB, 67.06 GB, 67.86 GB, 68.66 GB, 69.49 GB, 70.29 GB, 71.07 GB, 71.83 GB, 72.60 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.61 GB (79035449782) - PeakReservation: 73.57 GB (78995521536) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.00 GB (93418728475) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m7s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s085ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 62.990ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s085ms - ExecTreeOpenTime: 1s020ms - PrepareTime: 175.456ms - ExecTreePrepareTime: 152.204us KuduTableSink:(Total: 11.831us, non-child: 11.831us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 1s020ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.57 GB (78995529728) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 4m27s - CumulativeAllocationBytes: 73.57 GB (78995521536) - CumulativeAllocations: 37.67K (37668) - PeakReservation: 73.57 GB (78995521536) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.57 GB (78995521536) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m17s, non-child: 18s249ms, % non-child: 0.82%) - ConvertRowBatchTime: 7s877ms - PeakMemoryUsage: 19.53 MB (20481634) - RowsReturned: 288.51M (288505980) - RowsReturnedRate: 128.95 K/sec Buffer pool: - AllocTime: 18m5s - CumulativeAllocationBytes: 131.02 GB (140681011200) - CumulativeAllocations: 6.87M (6869190) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.82 GB, 13.33 GB, 19.79 GB, 23.92 GB, 26.93 GB, 29.50 GB, 31.81 GB, 33.96 GB, 35.75 GB, 37.51 GB, 38.93 GB, 40.19 GB, 41.50 GB, 42.79 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.67 GB, 50.73 GB, 51.73 GB, 52.93 GB, 54.00 GB, 55.14 GB, 56.18 GB, 57.15 GB, 58.11 GB, 59.04 GB, 59.99 GB, 60.92 GB, 61.82 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.56 GB, 69.37 GB, 70.21 GB, 71.01 GB, 71.80 GB, 72.57 GB, 73.36 GB - FirstBatchArrivalWaitTime: 1s020ms - TotalBytesReceived: 74.37 GB (79854313586) - TotalGetBatchTime: 37m6s - DataArrivalTimer: 36m59s SenderSide: - DeserializeRowBatchTime: 21m42s - NumBatchesArrived: 3.43M (3434595) - NumBatchesDeferred: 65.08K (65080) - NumBatchesEnqueued: 3.43M (3434595) - NumBatchesReceived: 3.43M (3434595) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 63.010ms, non-child: 63.010ms, % non-child: 100.00%) - CodegenTime: 1.371ms - CompileTime: 6.253ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 33.366ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.715ms Instance 844a0200d7876345:20bb38b9000000f9 (host=va1041.foo.com:22000):(Total: 1s218ms, non-child: 213.986ms, % non-child: 17.56%) Fragment Instance Lifecycle Event Timeline: 1s218ms - Prepare Finished: 213.150ms (213.150ms) - Open Finished: 1s218ms (1s005ms) MemoryUsage(1m4s): 4.39 GB, 12.04 GB, 17.85 GB, 21.57 GB, 24.27 GB, 26.58 GB, 28.66 GB, 30.60 GB, 32.21 GB, 33.78 GB, 35.06 GB, 36.19 GB, 37.37 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.57 GB, 51.44 GB, 52.31 GB, 53.14 GB, 54.00 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.32 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.76 GB (71680737718) - PeakReservation: 66.72 GB (71640809472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.09 GB (85997587703) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m20s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s005ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s005ms - ExecTreeOpenTime: 945.705ms - PrepareTime: 212.730ms - ExecTreePrepareTime: 147.106us KuduTableSink:(Total: 15.398us, non-child: 15.398us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 945.849ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.72 GB (71640817664) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m24s - CumulativeAllocationBytes: 66.72 GB (71640809472) - CumulativeAllocations: 34.16K (34161) - PeakReservation: 66.72 GB (71640809472) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.72 GB (71640809472) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m30s, non-child: 17s171ms, % non-child: 0.72%) - ConvertRowBatchTime: 7s498ms - PeakMemoryUsage: 19.53 MB (20483033) - RowsReturned: 261.65M (261646224) - RowsReturnedRate: 110.39 K/sec Buffer pool: - AllocTime: 13m18s - CumulativeAllocationBytes: 118.82 GB (127583682560) - CumulativeAllocations: 6.23M (6229672) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.40 GB, 12.14 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.96 GB, 52.84 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.76 GB, 61.59 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 945.641ms - TotalBytesReceived: 67.45 GB (72419692932) - TotalGetBatchTime: 39m19s - DataArrivalTimer: 39m13s SenderSide: - DeserializeRowBatchTime: 16m36s - NumBatchesArrived: 3.11M (3114836) - NumBatchesDeferred: 7.83K (7835) - NumBatchesEnqueued: 3.11M (3114836) - NumBatchesReceived: 3.11M (3114836) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 58.631ms, non-child: 58.631ms, % non-child: 100.00%) - CodegenTime: 1.471ms - CompileTime: 5.642ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.667ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 19.547ms Instance 844a0200d7876345:20bb38b9000000b7 (host=va1042.foo.com:22000):(Total: 1s240ms, non-child: 207.588ms, % non-child: 16.74%) Fragment Instance Lifecycle Event Timeline: 1s241ms - Prepare Finished: 207.026ms (207.026ms) - Open Finished: 1s241ms (1s034ms) MemoryUsage(1m4s): 4.35 GB, 12.01 GB, 17.82 GB, 21.54 GB, 24.24 GB, 26.55 GB, 28.63 GB, 30.57 GB, 32.18 GB, 33.76 GB, 35.03 GB, 36.17 GB, 37.35 GB, 38.51 GB, 39.63 GB, 40.72 GB, 41.76 GB, 42.73 GB, 43.71 GB, 44.69 GB, 45.64 GB, 46.54 GB, 47.63 GB, 48.59 GB, 49.61 GB, 50.55 GB, 51.42 GB, 52.29 GB, 53.12 GB, 53.98 GB, 54.81 GB, 55.62 GB, 56.45 GB, 57.30 GB, 58.31 GB, 59.18 GB, 60.12 GB, 60.95 GB, 61.68 GB, 62.41 GB, 63.16 GB, 63.89 GB, 64.60 GB, 65.29 GB, 65.99 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.82 GB (71747846582) - PeakReservation: 66.78 GB (71707918336) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.14 GB (86047159292) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m7s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s033ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 58.991ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s033ms - ExecTreeOpenTime: 974.276ms - PrepareTime: 206.317ms - ExecTreePrepareTime: 164.850us KuduTableSink:(Total: 13.852us, non-child: 13.852us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 974.438ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.78 GB (71707926528) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m59s - CumulativeAllocationBytes: 66.78 GB (71707918336) - CumulativeAllocations: 34.19K (34193) - PeakReservation: 66.78 GB (71707918336) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.78 GB (71707918336) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m16s, non-child: 16s776ms, % non-child: 0.73%) - ConvertRowBatchTime: 7s203ms - PeakMemoryUsage: 19.53 MB (20483293) - RowsReturned: 261.88M (261883020) - RowsReturnedRate: 114.03 K/sec Buffer pool: - AllocTime: 18m24s - CumulativeAllocationBytes: 118.93 GB (127699148800) - CumulativeAllocations: 6.24M (6235310) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.43 GB, 12.15 GB, 18.01 GB, 21.76 GB, 24.49 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.50 GB, 34.10 GB, 35.38 GB, 36.53 GB, 37.72 GB, 38.90 GB, 40.03 GB, 41.13 GB, 42.18 GB, 43.16 GB, 44.15 GB, 45.15 GB, 46.11 GB, 47.02 GB, 48.11 GB, 49.09 GB, 50.12 GB, 51.06 GB, 51.95 GB, 52.82 GB, 53.67 GB, 54.53 GB, 55.38 GB, 56.20 GB, 57.04 GB, 57.89 GB, 58.91 GB, 59.79 GB, 60.74 GB, 61.58 GB, 62.32 GB, 63.06 GB, 63.82 GB, 64.55 GB, 65.27 GB, 65.97 GB, 66.68 GB - FirstBatchArrivalWaitTime: 974.184ms - TotalBytesReceived: 67.51 GB (72485335383) - TotalGetBatchTime: 38m6s - DataArrivalTimer: 38m SenderSide: - DeserializeRowBatchTime: 21m53s - NumBatchesArrived: 3.12M (3117655) - NumBatchesDeferred: 30.74K (30740) - NumBatchesEnqueued: 3.12M (3117655) - NumBatchesReceived: 3.12M (3117655) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 58.338ms, non-child: 58.338ms, % non-child: 100.00%) - CodegenTime: 1.108ms - CompileTime: 4.763ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 29.100ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.872ms Instance 844a0200d7876345:20bb38b9000000b0 (host=va1043.foo.com:22000):(Total: 1s267ms, non-child: 169.254ms, % non-child: 13.35%) Fragment Instance Lifecycle Event Timeline: 1s267ms - Prepare Finished: 168.250ms (168.250ms) - Open Finished: 1s267ms (1s099ms) MemoryUsage(1m4s): 4.78 GB, 13.20 GB, 19.60 GB, 23.70 GB, 26.67 GB, 29.21 GB, 31.50 GB, 33.63 GB, 35.40 GB, 37.14 GB, 38.54 GB, 39.78 GB, 41.08 GB, 42.36 GB, 43.60 GB, 44.79 GB, 45.94 GB, 47.01 GB, 48.09 GB, 49.17 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.58 GB, 55.61 GB, 56.57 GB, 57.53 GB, 58.44 GB, 59.38 GB, 60.30 GB, 61.20 GB, 62.11 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.66 GB, 69.49 GB, 70.29 GB, 71.07 GB, 71.83 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.43 GB (78844608950) - PeakReservation: 73.39 GB (78804680704) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.75 GB (93147765565) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m13s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s099ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 52.992ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s099ms - ExecTreeOpenTime: 1s044ms - PrepareTime: 167.969ms - ExecTreePrepareTime: 161.740us KuduTableSink:(Total: 17.223us, non-child: 17.223us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 1s044ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.39 GB (78804688896) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m4s - CumulativeAllocationBytes: 73.39 GB (78804680704) - CumulativeAllocations: 37.58K (37577) - PeakReservation: 73.39 GB (78804680704) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.39 GB (78804680704) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m23s, non-child: 17s042ms, % non-child: 0.74%) - ConvertRowBatchTime: 7s500ms - PeakMemoryUsage: 19.53 MB (20481613) - RowsReturned: 287.81M (287809200) - RowsReturnedRate: 124.94 K/sec Buffer pool: - AllocTime: 16m55s - CumulativeAllocationBytes: 130.70 GB (140341248000) - CumulativeAllocations: 6.85M (6852600) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.86 GB, 13.37 GB, 19.81 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.97 GB, 35.76 GB, 37.51 GB, 38.93 GB, 40.19 GB, 41.50 GB, 42.80 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.68 GB, 50.73 GB, 51.73 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.76 GB, 63.70 GB, 64.81 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.57 GB, 69.38 GB, 70.22 GB, 71.02 GB, 71.82 GB, 72.58 GB, 73.37 GB - FirstBatchArrivalWaitTime: 1s044ms - TotalBytesReceived: 74.19 GB (79660953604) - TotalGetBatchTime: 38m13s - DataArrivalTimer: 38m6s SenderSide: - DeserializeRowBatchTime: 20m32s - NumBatchesArrived: 3.43M (3426301) - NumBatchesDeferred: 33.32K (33321) - NumBatchesEnqueued: 3.43M (3426300) - NumBatchesReceived: 3.43M (3426301) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 53.606ms, non-child: 53.606ms, % non-child: 100.00%) - CodegenTime: 975.524us - CompileTime: 4.679ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.277ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 20.102ms Instance 844a0200d7876345:20bb38b900000087 (host=va1044.foo.com:22000):(Total: 1s187ms, non-child: 212.992ms, % non-child: 17.94%) Fragment Instance Lifecycle Event Timeline: 1s187ms - Prepare Finished: 212.029ms (212.029ms) - Open Finished: 1s187ms (975.821ms) MemoryUsage(1m4s): 4.78 GB, 13.21 GB, 19.61 GB, 23.70 GB, 26.68 GB, 29.22 GB, 31.50 GB, 33.64 GB, 35.41 GB, 37.14 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.95 GB, 47.01 GB, 48.09 GB, 49.18 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.59 GB, 55.62 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.12 GB, 63.05 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.67 GB, 69.50 GB, 70.29 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.71 GB (79142404534) - PeakReservation: 73.67 GB (79102476288) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.10 GB (93523161316) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 36m50s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 975.802ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 60.991ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 975.805ms - ExecTreeOpenTime: 914.813ms - PrepareTime: 211.617ms - ExecTreePrepareTime: 155.127us KuduTableSink:(Total: 11.199us, non-child: 11.199us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 914.957ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.67 GB (79102484480) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 4m40s - CumulativeAllocationBytes: 73.67 GB (79102476288) - CumulativeAllocations: 37.72K (37719) - PeakReservation: 73.67 GB (79102476288) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.67 GB (79102476288) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m, non-child: 18s109ms, % non-child: 0.82%) - ConvertRowBatchTime: 7s887ms - PeakMemoryUsage: 19.53 MB (20482016) - RowsReturned: 288.89M (288891288) - RowsReturnedRate: 130.08 K/sec Buffer pool: - AllocTime: 24m20s - CumulativeAllocationBytes: 131.19 GB (140868894720) - CumulativeAllocations: 6.88M (6878364) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.87 GB, 13.38 GB, 19.82 GB, 23.95 GB, 26.95 GB, 29.52 GB, 31.82 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.20 GB, 41.51 GB, 42.80 GB, 44.05 GB, 45.26 GB, 46.42 GB, 47.49 GB, 48.59 GB, 49.68 GB, 50.73 GB, 51.74 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.19 GB, 57.17 GB, 58.13 GB, 59.06 GB, 60.01 GB, 60.94 GB, 61.84 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.58 GB, 69.38 GB, 70.22 GB, 71.03 GB, 71.82 GB, 72.59 GB, 73.37 GB - FirstBatchArrivalWaitTime: 914.741ms - TotalBytesReceived: 74.47 GB (79961124854) - TotalGetBatchTime: 36m49s - DataArrivalTimer: 36m43s SenderSide: - DeserializeRowBatchTime: 28m21s - NumBatchesArrived: 3.44M (3439182) - NumBatchesDeferred: 74.72K (74722) - NumBatchesEnqueued: 3.44M (3439182) - NumBatchesReceived: 3.44M (3439182) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 59.521ms, non-child: 59.521ms, % non-child: 100.00%) - CodegenTime: 1.173ms - CompileTime: 5.552ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.565ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 20.802ms Instance 844a0200d7876345:20bb38b9000000e2 (host=va1045.foo.com:22000):(Total: 1s249ms, non-child: 190.003ms, % non-child: 15.21%) Fragment Instance Lifecycle Event Timeline: 1s249ms - Prepare Finished: 189.154ms (189.154ms) - Open Finished: 1s249ms (1s060ms) MemoryUsage(1m4s): 4.36 GB, 12.02 GB, 17.82 GB, 21.54 GB, 24.24 GB, 26.56 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.70 GB, 45.65 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.56 GB, 51.43 GB, 52.30 GB, 53.13 GB, 53.99 GB, 54.82 GB, 55.63 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.13 GB, 60.96 GB, 61.70 GB, 62.42 GB, 63.17 GB, 63.90 GB, 64.61 GB, 65.30 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.83 GB (71760429494) - PeakReservation: 66.79 GB (71720501248) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.98 GB (85881239831) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m21s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s060ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 64.989ms - TotalThreadsVoluntaryContextSwitches: 7 (7) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s060ms - ExecTreeOpenTime: 994.998ms - PrepareTime: 188.757ms - ExecTreePrepareTime: 156.672us KuduTableSink:(Total: 12.022us, non-child: 12.022us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 995.151ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.79 GB (71720509440) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m38s - CumulativeAllocationBytes: 66.79 GB (71720501248) - CumulativeAllocations: 34.20K (34199) - PeakReservation: 66.79 GB (71720501248) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.79 GB (71720501248) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m30s, non-child: 16s983ms, % non-child: 0.72%) - ConvertRowBatchTime: 7s475ms - PeakMemoryUsage: 19.53 MB (20482320) - RowsReturned: 261.93M (261933840) - RowsReturnedRate: 110.48 K/sec Buffer pool: - AllocTime: 10m18s - CumulativeAllocationBytes: 118.95 GB (127723929600) - CumulativeAllocations: 6.24M (6236520) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.38 GB, 12.12 GB, 17.99 GB, 21.75 GB, 24.48 GB, 26.81 GB, 28.91 GB, 30.88 GB, 32.50 GB, 34.10 GB, 35.39 GB, 36.53 GB, 37.72 GB, 38.90 GB, 40.03 GB, 41.13 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.15 GB, 46.11 GB, 47.02 GB, 48.12 GB, 49.09 GB, 50.12 GB, 51.07 GB, 51.95 GB, 52.83 GB, 53.67 GB, 54.53 GB, 55.38 GB, 56.20 GB, 57.04 GB, 57.90 GB, 58.91 GB, 59.80 GB, 60.75 GB, 61.59 GB, 62.33 GB, 63.06 GB, 63.82 GB, 64.56 GB, 65.28 GB, 65.97 GB, 66.69 GB - FirstBatchArrivalWaitTime: 994.914ms - TotalBytesReceived: 67.52 GB (72499223654) - TotalGetBatchTime: 39m20s - DataArrivalTimer: 39m14s SenderSide: - DeserializeRowBatchTime: 13m28s - NumBatchesArrived: 3.12M (3118260) - NumBatchesDeferred: 6.79K (6787) - NumBatchesEnqueued: 3.12M (3118260) - NumBatchesReceived: 3.12M (3118260) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 64.384ms, non-child: 64.384ms, % non-child: 100.00%) - CodegenTime: 1.156ms - CompileTime: 8.263ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.089ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.481ms Instance 844a0200d7876345:20bb38b9000000a0 (host=va1046.foo.com:22000):(Total: 1s246ms, non-child: 193.250ms, % non-child: 15.50%) Fragment Instance Lifecycle Event Timeline: 1s247ms - Prepare Finished: 192.831ms (192.831ms) - Open Finished: 1s247ms (1s054ms) MemoryUsage(1m4s): 4.80 GB, 13.23 GB, 19.61 GB, 23.71 GB, 26.68 GB, 29.22 GB, 31.51 GB, 33.64 GB, 35.41 GB, 37.15 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.95 GB, 47.01 GB, 48.09 GB, 49.17 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.58 GB, 55.61 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.12 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.67 GB, 69.49 GB, 70.29 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.50 GB (78918009270) - PeakReservation: 73.46 GB (78878081024) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.97 GB (93383226889) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m59s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s054ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 62.990ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s054ms - ExecTreeOpenTime: 989.916ms - PrepareTime: 192.210ms - ExecTreePrepareTime: 170.452us KuduTableSink:(Total: 12.148us, non-child: 12.148us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 990.083ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.46 GB (78878089216) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m14s - CumulativeAllocationBytes: 73.46 GB (78878081024) - CumulativeAllocations: 37.61K (37612) - PeakReservation: 73.46 GB (78878081024) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.46 GB (78878081024) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m9s, non-child: 17s895ms, % non-child: 0.78%) - ConvertRowBatchTime: 7s753ms - PeakMemoryUsage: 19.53 MB (20482422) - RowsReturned: 288.07M (288070656) - RowsReturnedRate: 125.83 K/sec Buffer pool: - AllocTime: 14m50s - CumulativeAllocationBytes: 130.83 GB (140482723840) - CumulativeAllocations: 6.86M (6859508) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.82 GB, 13.33 GB, 19.79 GB, 23.92 GB, 26.93 GB, 29.50 GB, 31.81 GB, 33.97 GB, 35.76 GB, 37.51 GB, 38.93 GB, 40.19 GB, 41.50 GB, 42.79 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.48 GB, 48.57 GB, 49.67 GB, 50.72 GB, 51.73 GB, 52.93 GB, 54.00 GB, 55.14 GB, 56.18 GB, 57.15 GB, 58.11 GB, 59.04 GB, 59.99 GB, 60.93 GB, 61.83 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.57 GB, 69.37 GB, 70.21 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 989.853ms - TotalBytesReceived: 74.27 GB (79741935862) - TotalGetBatchTime: 37m58s - DataArrivalTimer: 37m51s SenderSide: - DeserializeRowBatchTime: 18m22s - NumBatchesArrived: 3.43M (3429754) - NumBatchesDeferred: 34.20K (34197) - NumBatchesEnqueued: 3.43M (3429747) - NumBatchesReceived: 3.43M (3429754) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 63.269ms, non-child: 63.269ms, % non-child: 100.00%) - CodegenTime: 1.133ms - CompileTime: 5.692ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 33.207ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.819ms Instance 844a0200d7876345:20bb38b9000000a8 (host=vc1501.foo.com:22000):(Total: 1s207ms, non-child: 224.839ms, % non-child: 18.62%) Fragment Instance Lifecycle Event Timeline: 1s208ms - Prepare Finished: 224.335ms (224.335ms) - Open Finished: 1s208ms (983.800ms) MemoryUsage(1m4s): 4.83 GB, 13.25 GB, 19.63 GB, 23.72 GB, 26.69 GB, 29.23 GB, 31.51 GB, 33.65 GB, 35.42 GB, 37.15 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.95 GB, 47.01 GB, 48.09 GB, 49.17 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.58 GB, 55.61 GB, 56.57 GB, 57.52 GB, 58.44 GB, 59.38 GB, 60.30 GB, 61.20 GB, 62.11 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.67 GB, 69.49 GB, 70.29 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.60 GB (79024964022) - PeakReservation: 73.56 GB (78985035776) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.02 GB (93442001856) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m32s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 983.787ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 53.991ms - TotalThreadsVoluntaryContextSwitches: 13 (13) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 983.790ms - ExecTreeOpenTime: 926.145ms - PrepareTime: 223.820ms - ExecTreePrepareTime: 153.916us KuduTableSink:(Total: 11.587us, non-child: 11.587us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 926.295ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.56 GB (78985043968) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m55s - CumulativeAllocationBytes: 73.56 GB (78985035776) - CumulativeAllocations: 37.66K (37663) - PeakReservation: 73.56 GB (78985035776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.56 GB (78985035776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m42s, non-child: 17s757ms, % non-child: 0.76%) - ConvertRowBatchTime: 7s745ms - PeakMemoryUsage: 19.53 MB (20480923) - RowsReturned: 288.47M (288473052) - RowsReturnedRate: 124.23 K/sec Buffer pool: - AllocTime: 10m49s - CumulativeAllocationBytes: 131.00 GB (140664954880) - CumulativeAllocations: 6.87M (6868406) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.85 GB, 13.35 GB, 19.80 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.97 GB, 35.76 GB, 37.52 GB, 38.93 GB, 40.19 GB, 41.50 GB, 42.79 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.67 GB, 50.72 GB, 51.73 GB, 52.93 GB, 54.00 GB, 55.14 GB, 56.18 GB, 57.15 GB, 58.11 GB, 59.04 GB, 59.99 GB, 60.92 GB, 61.82 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.57 GB, 69.37 GB, 70.21 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 926.058ms - TotalBytesReceived: 74.36 GB (79844589898) - TotalGetBatchTime: 38m31s - DataArrivalTimer: 38m24s SenderSide: - DeserializeRowBatchTime: 14m21s - NumBatchesArrived: 3.43M (3434203) - NumBatchesDeferred: 19.02K (19017) - NumBatchesEnqueued: 3.43M (3434203) - NumBatchesReceived: 3.43M (3434203) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 56.521ms, non-child: 56.521ms, % non-child: 100.00%) - CodegenTime: 1.098ms - CompileTime: 6.061ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 27.567ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.442ms Instance 844a0200d7876345:20bb38b900000094 (host=vc1502.foo.com:22000):(Total: 1s194ms, non-child: 212.264ms, % non-child: 17.77%) Fragment Instance Lifecycle Event Timeline: 1s194ms - Prepare Finished: 211.654ms (211.654ms) - Open Finished: 1s194ms (982.892ms) MemoryUsage(1m4s): 4.81 GB, 13.23 GB, 19.62 GB, 23.71 GB, 26.69 GB, 29.23 GB, 31.51 GB, 33.64 GB, 35.41 GB, 37.15 GB, 38.55 GB, 39.80 GB, 41.09 GB, 42.37 GB, 43.61 GB, 44.80 GB, 45.95 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.22 GB, 51.21 GB, 52.41 GB, 53.46 GB, 54.59 GB, 55.62 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.12 GB, 63.05 GB, 64.16 GB, 65.12 GB, 66.15 GB, 67.07 GB, 67.87 GB, 68.67 GB, 69.50 GB, 70.30 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.49 GB (78905426358) - PeakReservation: 73.45 GB (78865498112) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.93 GB (93337762365) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m19s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 982.866ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 10 (10) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 982.868ms - ExecTreeOpenTime: 919.730ms - PrepareTime: 211.305ms - ExecTreePrepareTime: 166.689us KuduTableSink:(Total: 88.648us, non-child: 88.648us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 919.894ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.45 GB (78865506304) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m - CumulativeAllocationBytes: 73.45 GB (78865498112) - CumulativeAllocations: 37.61K (37606) - PeakReservation: 73.45 GB (78865498112) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.45 GB (78865498112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m29s, non-child: 18s109ms, % non-child: 0.78%) - ConvertRowBatchTime: 7s888ms - PeakMemoryUsage: 19.53 MB (20481204) - RowsReturned: 288.04M (288035412) - RowsReturnedRate: 124.70 K/sec Buffer pool: - AllocTime: 14m52s - CumulativeAllocationBytes: 130.81 GB (140451553280) - CumulativeAllocations: 6.86M (6857986) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.90 GB, 13.39 GB, 19.83 GB, 23.96 GB, 26.96 GB, 29.52 GB, 31.83 GB, 33.99 GB, 35.77 GB, 37.53 GB, 38.94 GB, 40.20 GB, 41.51 GB, 42.81 GB, 44.05 GB, 45.26 GB, 46.42 GB, 47.50 GB, 48.59 GB, 49.68 GB, 50.74 GB, 51.74 GB, 52.95 GB, 54.01 GB, 55.15 GB, 56.19 GB, 57.17 GB, 58.13 GB, 59.06 GB, 60.01 GB, 60.94 GB, 61.84 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.58 GB, 69.39 GB, 70.22 GB, 71.03 GB, 71.82 GB, 72.59 GB, 73.37 GB - FirstBatchArrivalWaitTime: 919.674ms - TotalBytesReceived: 74.25 GB (79724321596) - TotalGetBatchTime: 38m18s - DataArrivalTimer: 38m11s SenderSide: - DeserializeRowBatchTime: 18m36s - NumBatchesArrived: 3.43M (3428993) - NumBatchesDeferred: 22.76K (22757) - NumBatchesEnqueued: 3.43M (3428993) - NumBatchesReceived: 3.43M (3428993) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 61.982ms, non-child: 61.982ms, % non-child: 100.00%) - CodegenTime: 978.687us - CompileTime: 6.193ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 29.938ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 25.291ms Instance 844a0200d7876345:20bb38b9000000ca (host=vc1503.foo.com:22000):(Total: 1s226ms, non-child: 216.416ms, % non-child: 17.65%) Fragment Instance Lifecycle Event Timeline: 1s226ms - Prepare Finished: 215.897ms (215.897ms) - Open Finished: 1s226ms (1s011ms) MemoryUsage(1m4s): 4.36 GB, 12.02 GB, 17.83 GB, 21.55 GB, 24.25 GB, 26.56 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.04 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.70 GB, 45.65 GB, 46.55 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.55 GB, 51.43 GB, 52.29 GB, 53.13 GB, 53.98 GB, 54.82 GB, 55.63 GB, 56.46 GB, 57.31 GB, 58.31 GB, 59.18 GB, 60.13 GB, 60.96 GB, 61.69 GB, 62.41 GB, 63.17 GB, 63.89 GB, 64.60 GB, 65.30 GB, 66.00 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.83 GB (71760429494) - PeakReservation: 66.79 GB (71720501248) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.21 GB (86124455314) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m20s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s010ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 60.991ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s011ms - ExecTreeOpenTime: 949.334ms - PrepareTime: 215.231ms - ExecTreePrepareTime: 154.473us KuduTableSink:(Total: 12.368us, non-child: 12.368us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 949.486ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.79 GB (71720509440) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m21s - CumulativeAllocationBytes: 66.79 GB (71720501248) - CumulativeAllocations: 34.20K (34199) - PeakReservation: 66.79 GB (71720501248) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.79 GB (71720501248) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m29s, non-child: 16s933ms, % non-child: 0.73%) - ConvertRowBatchTime: 7s393ms - PeakMemoryUsage: 19.53 MB (20482962) - RowsReturned: 261.94M (261939200) - RowsReturnedRate: 113.41 K/sec Buffer pool: - AllocTime: 18m46s - CumulativeAllocationBytes: 118.96 GB (127727124480) - CumulativeAllocations: 6.24M (6236676) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.44 GB, 12.16 GB, 18.02 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.39 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.12 GB, 49.09 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.67 GB, 54.54 GB, 55.38 GB, 56.20 GB, 57.04 GB, 57.90 GB, 58.91 GB, 59.80 GB, 60.75 GB, 61.59 GB, 62.33 GB, 63.06 GB, 63.82 GB, 64.55 GB, 65.27 GB, 65.97 GB, 66.68 GB - FirstBatchArrivalWaitTime: 949.242ms - TotalBytesReceived: 67.52 GB (72501206284) - TotalGetBatchTime: 38m19s - DataArrivalTimer: 38m13s SenderSide: - DeserializeRowBatchTime: 21m59s - NumBatchesArrived: 3.12M (3118338) - NumBatchesDeferred: 23.75K (23748) - NumBatchesEnqueued: 3.12M (3118338) - NumBatchesReceived: 3.12M (3118338) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 60.373ms, non-child: 60.373ms, % non-child: 100.00%) - CodegenTime: 1.312ms - CompileTime: 4.843ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.434ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.461ms Instance 844a0200d7876345:20bb38b9000000bd (host=vc1504.foo.com:22000):(Total: 1s209ms, non-child: 222.282ms, % non-child: 18.37%) Fragment Instance Lifecycle Event Timeline: 1s210ms - Prepare Finished: 221.505ms (221.505ms) - Open Finished: 1s210ms (988.718ms) MemoryUsage(1m4s): 4.40 GB, 12.05 GB, 17.85 GB, 21.57 GB, 24.27 GB, 26.58 GB, 28.66 GB, 30.60 GB, 32.21 GB, 33.78 GB, 35.06 GB, 36.18 GB, 37.37 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.72 GB, 45.67 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.64 GB, 50.57 GB, 51.45 GB, 52.31 GB, 53.15 GB, 54.00 GB, 54.84 GB, 55.65 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.15 GB, 60.98 GB, 61.71 GB, 62.44 GB, 63.19 GB, 63.92 GB, 64.63 GB, 65.32 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.79 GB (71710097846) - PeakReservation: 66.75 GB (71670169600) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.29 GB (86211654441) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m41s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 988.700ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 49.993ms - TotalThreadsVoluntaryContextSwitches: 15 (15) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 988.705ms - ExecTreeOpenTime: 920.200ms - PrepareTime: 221.128ms - ExecTreePrepareTime: 201.751us KuduTableSink:(Total: 15.315us, non-child: 15.315us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 920.398ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.75 GB (71670177792) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m52s - CumulativeAllocationBytes: 66.75 GB (71670169600) - CumulativeAllocations: 34.17K (34175) - PeakReservation: 66.75 GB (71670169600) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.75 GB (71670169600) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m51s, non-child: 17s345ms, % non-child: 0.74%) - ConvertRowBatchTime: 7s652ms - PeakMemoryUsage: 19.53 MB (20483705) - RowsReturned: 261.75M (261747276) - RowsReturnedRate: 112.26 K/sec Buffer pool: - AllocTime: 16m17s - CumulativeAllocationBytes: 118.87 GB (127632957440) - CumulativeAllocations: 6.23M (6232078) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.41 GB, 12.14 GB, 18.01 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.40 GB, 56.22 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 920.100ms - TotalBytesReceived: 67.47 GB (72447868519) - TotalGetBatchTime: 38m41s - DataArrivalTimer: 38m34s SenderSide: - DeserializeRowBatchTime: 19m40s - NumBatchesArrived: 3.12M (3116039) - NumBatchesDeferred: 23.27K (23266) - NumBatchesEnqueued: 3.12M (3116039) - NumBatchesReceived: 3.12M (3116039) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 67.199ms, non-child: 67.199ms, % non-child: 100.00%) - CodegenTime: 848.001us - CompileTime: 4.733ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 23.782ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 38.239ms Instance 844a0200d7876345:20bb38b9000000a1 (host=vc1505.foo.com:22000):(Total: 1s209ms, non-child: 227.465ms, % non-child: 18.81%) Fragment Instance Lifecycle Event Timeline: 1s209ms - Prepare Finished: 226.474ms (226.474ms) - Open Finished: 1s209ms (982.923ms) MemoryUsage(1m4s): 4.78 GB, 13.21 GB, 19.60 GB, 23.70 GB, 26.68 GB, 29.22 GB, 31.50 GB, 33.64 GB, 35.41 GB, 37.14 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.61 GB, 44.80 GB, 45.95 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.23 GB, 51.22 GB, 52.41 GB, 53.47 GB, 54.59 GB, 55.62 GB, 56.59 GB, 57.54 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.21 GB, 62.12 GB, 63.05 GB, 64.16 GB, 65.12 GB, 66.16 GB, 67.07 GB, 67.88 GB, 68.68 GB, 69.51 GB, 70.30 GB, 71.09 GB, 71.85 GB, 72.62 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.56 GB (78989312438) - PeakReservation: 73.53 GB (78949384192) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.77 GB (93168358799) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m15s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 982.907ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 60.991ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 982.910ms - ExecTreeOpenTime: 920.960ms - PrepareTime: 226.041ms - ExecTreePrepareTime: 165.799us KuduTableSink:(Total: 16.161us, non-child: 16.161us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 921.123ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.53 GB (78949392384) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m11s - CumulativeAllocationBytes: 73.53 GB (78949384192) - CumulativeAllocations: 37.65K (37646) - PeakReservation: 73.53 GB (78949384192) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.53 GB (78949384192) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m25s, non-child: 17s663ms, % non-child: 0.77%) - ConvertRowBatchTime: 7s843ms - PeakMemoryUsage: 19.53 MB (20481701) - RowsReturned: 288.34M (288339492) - RowsReturnedRate: 125.07 K/sec Buffer pool: - AllocTime: 10m8s - CumulativeAllocationBytes: 130.94 GB (140599828480) - CumulativeAllocations: 6.87M (6865226) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.87 GB, 13.37 GB, 19.81 GB, 23.95 GB, 26.95 GB, 29.51 GB, 31.82 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.20 GB, 41.51 GB, 42.81 GB, 44.05 GB, 45.26 GB, 46.42 GB, 47.50 GB, 48.59 GB, 49.69 GB, 50.74 GB, 51.75 GB, 52.95 GB, 54.02 GB, 55.16 GB, 56.19 GB, 57.17 GB, 58.13 GB, 59.06 GB, 60.01 GB, 60.94 GB, 61.84 GB, 62.77 GB, 63.71 GB, 64.83 GB, 65.80 GB, 66.85 GB, 67.77 GB, 68.59 GB, 69.39 GB, 70.23 GB, 71.04 GB, 71.83 GB, 72.60 GB, 73.38 GB - FirstBatchArrivalWaitTime: 920.868ms - TotalBytesReceived: 74.33 GB (79808243172) - TotalGetBatchTime: 38m14s - DataArrivalTimer: 38m8s SenderSide: - DeserializeRowBatchTime: 13m35s - NumBatchesArrived: 3.43M (3432613) - NumBatchesDeferred: 24.42K (24419) - NumBatchesEnqueued: 3.43M (3432613) - NumBatchesReceived: 3.43M (3432613) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 60.429ms, non-child: 60.429ms, % non-child: 100.00%) - CodegenTime: 1.628ms - CompileTime: 4.838ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 31.549ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.402ms Instance 844a0200d7876345:20bb38b90000009a (host=vc1507.foo.com:22000):(Total: 1s239ms, non-child: 187.284ms, % non-child: 15.10%) Fragment Instance Lifecycle Event Timeline: 1s240ms - Prepare Finished: 186.472ms (186.472ms) - Open Finished: 1s240ms (1s053ms) MemoryUsage(1m4s): 4.80 GB, 13.22 GB, 19.62 GB, 23.71 GB, 26.69 GB, 29.23 GB, 31.51 GB, 33.65 GB, 35.42 GB, 37.15 GB, 38.56 GB, 39.80 GB, 41.10 GB, 42.38 GB, 43.61 GB, 44.80 GB, 45.95 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.23 GB, 51.22 GB, 52.41 GB, 53.47 GB, 54.59 GB, 55.62 GB, 56.58 GB, 57.54 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.21 GB, 62.12 GB, 63.05 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.67 GB, 69.50 GB, 70.29 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.62 GB (79045935542) - PeakReservation: 73.58 GB (79006007296) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.85 GB (93253713549) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s053ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 61.990ms - TotalThreadsVoluntaryContextSwitches: 12 (12) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s053ms - ExecTreeOpenTime: 988.615ms - PrepareTime: 186.128ms - ExecTreePrepareTime: 148.111us KuduTableSink:(Total: 11.581us, non-child: 11.581us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 988.760ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.58 GB (79006015488) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m33s - CumulativeAllocationBytes: 73.58 GB (79006007296) - CumulativeAllocations: 37.67K (37673) - PeakReservation: 73.58 GB (79006007296) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.58 GB (79006007296) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m10s, non-child: 18s213ms, % non-child: 0.77%) - ConvertRowBatchTime: 7s913ms - PeakMemoryUsage: 19.53 MB (20482123) - RowsReturned: 288.55M (288545712) - RowsReturnedRate: 122.75 K/sec Buffer pool: - AllocTime: 11m52s - CumulativeAllocationBytes: 131.04 GB (140700385280) - CumulativeAllocations: 6.87M (6870136) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.83 GB, 13.34 GB, 19.80 GB, 23.93 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.97 GB, 35.76 GB, 37.52 GB, 38.94 GB, 40.19 GB, 41.51 GB, 42.80 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.68 GB, 50.73 GB, 51.74 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.76 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.76 GB, 68.57 GB, 69.38 GB, 70.21 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 988.553ms - TotalBytesReceived: 74.38 GB (79865475843) - TotalGetBatchTime: 38m59s - DataArrivalTimer: 38m52s SenderSide: - DeserializeRowBatchTime: 15m27s - NumBatchesArrived: 3.44M (3435068) - NumBatchesDeferred: 14.56K (14559) - NumBatchesEnqueued: 3.44M (3435068) - NumBatchesReceived: 3.44M (3435068) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 63.854ms, non-child: 63.854ms, % non-child: 100.00%) - CodegenTime: 1.066ms - CompileTime: 5.382ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.339ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 25.373ms Instance 844a0200d7876345:20bb38b9000000e9 (host=vc1508.foo.com:22000):(Total: 1s198ms, non-child: 227.281ms, % non-child: 18.96%) Fragment Instance Lifecycle Event Timeline: 1s199ms - Prepare Finished: 226.399ms (226.399ms) - Open Finished: 1s199ms (972.618ms) MemoryUsage(1m4s): 4.38 GB, 12.03 GB, 17.84 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.64 GB, 50.57 GB, 51.45 GB, 52.31 GB, 53.14 GB, 54.00 GB, 54.84 GB, 55.65 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.15 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.87 GB (71798178230) - PeakReservation: 66.83 GB (71758249984) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.03 GB (85935808524) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m41s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 972.603ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 58.991ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 972.606ms - ExecTreeOpenTime: 910.497ms - PrepareTime: 226.006ms - ExecTreePrepareTime: 166.277us KuduTableSink:(Total: 12.890us, non-child: 12.890us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 910.660ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.83 GB (71758258176) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m11s - CumulativeAllocationBytes: 66.83 GB (71758249984) - CumulativeAllocations: 34.22K (34217) - PeakReservation: 66.83 GB (71758249984) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.83 GB (71758249984) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m50s, non-child: 16s879ms, % non-child: 0.72%) - ConvertRowBatchTime: 7s355ms - PeakMemoryUsage: 19.53 MB (20483554) - RowsReturned: 262.08M (262075632) - RowsReturnedRate: 112.45 K/sec Buffer pool: - AllocTime: 15m18s - CumulativeAllocationBytes: 119.02 GB (127793070080) - CumulativeAllocations: 6.24M (6239896) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.39 GB, 12.13 GB, 17.99 GB, 21.75 GB, 24.48 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.10 GB, 35.39 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 910.419ms - TotalBytesReceived: 67.56 GB (72538615483) - TotalGetBatchTime: 38m40s - DataArrivalTimer: 38m33s SenderSide: - DeserializeRowBatchTime: 18m40s - NumBatchesArrived: 3.12M (3119948) - NumBatchesDeferred: 20.69K (20690) - NumBatchesEnqueued: 3.12M (3119948) - NumBatchesReceived: 3.12M (3119948) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 60.714ms, non-child: 60.714ms, % non-child: 100.00%) - CodegenTime: 1.239ms - CompileTime: 5.429ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.379ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.295ms Instance 844a0200d7876345:20bb38b9000000e0 (host=vc1509.foo.com:22000):(Total: 1s200ms, non-child: 218.340ms, % non-child: 18.19%) Fragment Instance Lifecycle Event Timeline: 1s201ms - Prepare Finished: 217.857ms (217.857ms) - Open Finished: 1s201ms (983.300ms) MemoryUsage(1m4s): 4.37 GB, 12.03 GB, 17.84 GB, 21.55 GB, 24.26 GB, 26.57 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.04 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.32 GB, 59.19 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.76 GB (71680737718) - PeakReservation: 66.72 GB (71640809472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.03 GB (85928842445) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m48s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 983.276ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 54.992ms - TotalThreadsVoluntaryContextSwitches: 21 (21) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 983.279ms - ExecTreeOpenTime: 925.269ms - PrepareTime: 217.206ms - ExecTreePrepareTime: 157.935us KuduTableSink:(Total: 12.555us, non-child: 12.555us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 925.424ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.72 GB (71640817664) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m48s - CumulativeAllocationBytes: 66.72 GB (71640809472) - CumulativeAllocations: 34.16K (34161) - PeakReservation: 66.72 GB (71640809472) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.72 GB (71640809472) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m58s, non-child: 17s098ms, % non-child: 0.73%) - ConvertRowBatchTime: 7s485ms - PeakMemoryUsage: 19.53 MB (20483732) - RowsReturned: 261.65M (261646336) - RowsReturnedRate: 111.90 K/sec Buffer pool: - AllocTime: 16m - CumulativeAllocationBytes: 118.82 GB (127583764480) - CumulativeAllocations: 6.23M (6229676) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.45 GB, 12.17 GB, 18.03 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.96 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 925.207ms - TotalBytesReceived: 67.45 GB (72419981154) - TotalGetBatchTime: 38m47s - DataArrivalTimer: 38m41s SenderSide: - DeserializeRowBatchTime: 19m20s - NumBatchesArrived: 3.11M (3114838) - NumBatchesDeferred: 19.56K (19564) - NumBatchesEnqueued: 3.11M (3114838) - NumBatchesReceived: 3.11M (3114838) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 56.759ms, non-child: 56.759ms, % non-child: 100.00%) - CodegenTime: 1.097ms - CompileTime: 5.425ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 30.350ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 20.371ms Instance 844a0200d7876345:20bb38b9000000ec (host=vc1510.foo.com:22000):(Total: 1s176ms, non-child: 209.287ms, % non-child: 17.79%) Fragment Instance Lifecycle Event Timeline: 1s176ms - Prepare Finished: 208.541ms (208.541ms) - Open Finished: 1s176ms (967.887ms) MemoryUsage(1m4s): 4.36 GB, 12.01 GB, 17.82 GB, 21.55 GB, 24.25 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.53 GB, 39.65 GB, 40.73 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.31 GB, 53.14 GB, 54.00 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.32 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 67.01 GB (71949173174) - PeakReservation: 66.97 GB (71909244928) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.31 GB (86233828569) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m6s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 967.867ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 56.991ms - TotalThreadsVoluntaryContextSwitches: 13 (13) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 967.870ms - ExecTreeOpenTime: 909.974ms - PrepareTime: 208.223ms - ExecTreePrepareTime: 246.469us KuduTableSink:(Total: 12.268us, non-child: 12.268us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 910.217ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.97 GB (71909253120) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m5s - CumulativeAllocationBytes: 66.97 GB (71909244928) - CumulativeAllocations: 34.29K (34289) - PeakReservation: 66.97 GB (71909244928) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.97 GB (71909244928) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m16s, non-child: 17s223ms, % non-child: 0.73%) - ConvertRowBatchTime: 7s555ms - PeakMemoryUsage: 19.53 MB (20482827) - RowsReturned: 262.63M (262625916) - RowsReturnedRate: 111.45 K/sec Buffer pool: - AllocTime: 16m49s - CumulativeAllocationBytes: 119.27 GB (128061399040) - CumulativeAllocations: 6.25M (6252998) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.44 GB, 12.17 GB, 18.03 GB, 21.78 GB, 24.50 GB, 26.84 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.74 GB, 38.91 GB, 40.05 GB, 41.15 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.17 GB, 46.13 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.69 GB, 54.55 GB, 55.40 GB, 56.22 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 909.903ms - TotalBytesReceived: 67.70 GB (72691155585) - TotalGetBatchTime: 39m6s - DataArrivalTimer: 38m59s SenderSide: - DeserializeRowBatchTime: 20m47s - NumBatchesArrived: 3.13M (3126499) - NumBatchesDeferred: 12.70K (12697) - NumBatchesEnqueued: 3.13M (3126499) - NumBatchesReceived: 3.13M (3126499) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 56.641ms, non-child: 56.641ms, % non-child: 100.00%) - CodegenTime: 1.076ms - CompileTime: 4.865ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 30.027ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 21.236ms Instance 844a0200d7876345:20bb38b90000008c (host=vc1511.foo.com:22000):(Total: 1s182ms, non-child: 203.082ms, % non-child: 17.17%) Fragment Instance Lifecycle Event Timeline: 1s183ms - Prepare Finished: 202.227ms (202.227ms) - Open Finished: 1s183ms (981.068ms) MemoryUsage(1m4s): 4.79 GB, 13.21 GB, 19.60 GB, 23.70 GB, 26.68 GB, 29.22 GB, 31.50 GB, 33.64 GB, 35.41 GB, 37.14 GB, 38.54 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.94 GB, 47.01 GB, 48.09 GB, 49.17 GB, 50.21 GB, 51.21 GB, 52.40 GB, 53.45 GB, 54.58 GB, 55.61 GB, 56.57 GB, 57.52 GB, 58.44 GB, 59.38 GB, 60.30 GB, 61.19 GB, 62.11 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.14 GB, 67.06 GB, 67.86 GB, 68.66 GB, 69.49 GB, 70.29 GB, 71.07 GB, 71.83 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.39 GB (78804763062) - PeakReservation: 73.36 GB (78764834816) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.61 GB (92991727960) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m23s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 981.052ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 52.992ms - TotalThreadsVoluntaryContextSwitches: 22 (22) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 981.055ms - ExecTreeOpenTime: 926.490ms - PrepareTime: 201.705ms - ExecTreePrepareTime: 152.091us KuduTableSink:(Total: 14.967us, non-child: 14.967us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 926.624ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.36 GB (78764843008) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m - CumulativeAllocationBytes: 73.36 GB (78764834816) - CumulativeAllocations: 37.56K (37558) - PeakReservation: 73.36 GB (78764834816) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.36 GB (78764834816) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m34s, non-child: 18s067ms, % non-child: 0.78%) - ConvertRowBatchTime: 7s978ms - PeakMemoryUsage: 19.53 MB (20480767) - RowsReturned: 287.66M (287657664) - RowsReturnedRate: 124.31 K/sec Buffer pool: - AllocTime: 15m50s - CumulativeAllocationBytes: 130.63 GB (140267356160) - CumulativeAllocations: 6.85M (6848992) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.89 GB, 13.39 GB, 19.83 GB, 23.95 GB, 26.95 GB, 29.52 GB, 31.83 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.93 GB, 40.19 GB, 41.50 GB, 42.80 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.67 GB, 50.73 GB, 51.73 GB, 52.94 GB, 54.01 GB, 55.14 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.57 GB, 69.38 GB, 70.21 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 926.380ms - TotalBytesReceived: 74.15 GB (79619523233) - TotalGetBatchTime: 38m23s - DataArrivalTimer: 38m16s SenderSide: - DeserializeRowBatchTime: 19m30s - NumBatchesArrived: 3.42M (3424496) - NumBatchesDeferred: 14.62K (14624) - NumBatchesEnqueued: 3.42M (3424496) - NumBatchesReceived: 3.42M (3424496) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 53.094ms, non-child: 53.094ms, % non-child: 100.00%) - CodegenTime: 1.191ms - CompileTime: 4.682ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.131ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 19.687ms Instance 844a0200d7876345:20bb38b9000000fe (host=vc1513.foo.com:22000):(Total: 1s192ms, non-child: 217.965ms, % non-child: 18.28%) Fragment Instance Lifecycle Event Timeline: 1s192ms - Prepare Finished: 217.258ms (217.258ms) - Open Finished: 1s192ms (975.544ms) MemoryUsage(1m4s): 4.35 GB, 12.01 GB, 17.82 GB, 21.54 GB, 24.25 GB, 26.56 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.04 GB, 36.17 GB, 37.35 GB, 38.51 GB, 39.63 GB, 40.72 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.70 GB, 45.65 GB, 46.55 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.55 GB, 51.43 GB, 52.30 GB, 53.13 GB, 53.99 GB, 54.82 GB, 55.63 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.13 GB, 60.96 GB, 61.70 GB, 62.42 GB, 63.17 GB, 63.90 GB, 64.61 GB, 65.30 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.99 GB (71934493110) - PeakReservation: 66.96 GB (71894564864) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.27 GB (86194442855) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m31s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 975.529ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 48.992ms - TotalThreadsVoluntaryContextSwitches: 25 (25) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 975.531ms - ExecTreeOpenTime: 921.311ms - PrepareTime: 216.873ms - ExecTreePrepareTime: 216.162us KuduTableSink:(Total: 12.065us, non-child: 12.065us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 921.525ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.96 GB (71894573056) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m45s - CumulativeAllocationBytes: 66.96 GB (71894564864) - CumulativeAllocations: 34.28K (34282) - PeakReservation: 66.96 GB (71894564864) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.96 GB (71894564864) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m41s, non-child: 17s147ms, % non-child: 0.72%) - ConvertRowBatchTime: 7s352ms - PeakMemoryUsage: 19.53 MB (20483271) - RowsReturned: 262.56M (262564932) - RowsReturnedRate: 110.25 K/sec Buffer pool: - AllocTime: 11m19s - CumulativeAllocationBytes: 119.24 GB (128031662080) - CumulativeAllocations: 6.25M (6251546) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.43 GB, 12.16 GB, 18.01 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.10 GB, 35.39 GB, 36.53 GB, 37.73 GB, 38.90 GB, 40.03 GB, 41.13 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.15 GB, 46.11 GB, 47.03 GB, 48.12 GB, 49.09 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.76 GB, 61.59 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 921.223ms - TotalBytesReceived: 67.68 GB (72674183992) - TotalGetBatchTime: 39m31s - DataArrivalTimer: 39m24s SenderSide: - DeserializeRowBatchTime: 14m51s - NumBatchesArrived: 3.13M (3125773) - NumBatchesDeferred: 14.81K (14815) - NumBatchesEnqueued: 3.13M (3125773) - NumBatchesReceived: 3.13M (3125773) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 52.956ms, non-child: 52.956ms, % non-child: 100.00%) - CodegenTime: 1.022ms - CompileTime: 4.289ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.067ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 20.091ms Instance 844a0200d7876345:20bb38b9000000b6 (host=vc1515.foo.com:22000):(Total: 1s175ms, non-child: 206.275ms, % non-child: 17.55%) Fragment Instance Lifecycle Event Timeline: 1s175ms - Prepare Finished: 205.529ms (205.529ms) - Open Finished: 1s175ms (970.122ms) MemoryUsage(1m4s): 4.35 GB, 12.01 GB, 17.83 GB, 21.55 GB, 24.26 GB, 26.56 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.31 GB, 53.14 GB, 54.00 GB, 54.83 GB, 55.64 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.94 GB (71875772854) - PeakReservation: 66.90 GB (71835844608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.20 GB (86108810508) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 40m9s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 970.109ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 13 (13) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 970.112ms - ExecTreeOpenTime: 908.526ms - PrepareTime: 205.051ms - ExecTreePrepareTime: 165.108us KuduTableSink:(Total: 13.572us, non-child: 13.572us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 908.688ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.90 GB (71835852800) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 1m41s - CumulativeAllocationBytes: 66.90 GB (71835844608) - CumulativeAllocations: 34.25K (34254) - PeakReservation: 66.90 GB (71835844608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.90 GB (71835844608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 40m19s, non-child: 17s167ms, % non-child: 0.71%) - ConvertRowBatchTime: 7s508ms - PeakMemoryUsage: 19.53 MB (20481240) - RowsReturned: 262.36M (262356192) - RowsReturnedRate: 108.43 K/sec Buffer pool: - AllocTime: 9m21s - CumulativeAllocationBytes: 119.14 GB (127929876480) - CumulativeAllocations: 6.25M (6246576) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.43 GB, 12.16 GB, 18.02 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.74 GB, 38.91 GB, 40.05 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.17 GB, 46.13 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.69 GB, 54.55 GB, 55.40 GB, 56.22 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 908.442ms - TotalBytesReceived: 67.63 GB (72616153381) - TotalGetBatchTime: 40m9s - DataArrivalTimer: 40m2s SenderSide: - DeserializeRowBatchTime: 12m17s - NumBatchesArrived: 3.12M (3123288) - NumBatchesDeferred: 4.66K (4662) - NumBatchesEnqueued: 3.12M (3123288) - NumBatchesReceived: 3.12M (3123288) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 60.240ms, non-child: 60.240ms, % non-child: 100.00%) - CodegenTime: 1.274ms - CompileTime: 4.867ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 31.441ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.335ms Instance 844a0200d7876345:20bb38b9000000c9 (host=vc1516.foo.com:22000):(Total: 1s190ms, non-child: 219.779ms, % non-child: 18.46%) Fragment Instance Lifecycle Event Timeline: 1s190ms - Prepare Finished: 218.943ms (218.943ms) - Open Finished: 1s190ms (971.898ms) MemoryUsage(1m4s): 4.37 GB, 12.03 GB, 17.84 GB, 21.56 GB, 24.26 GB, 26.58 GB, 28.66 GB, 30.60 GB, 32.21 GB, 33.79 GB, 35.06 GB, 36.19 GB, 37.37 GB, 38.54 GB, 39.66 GB, 40.74 GB, 41.79 GB, 42.76 GB, 43.74 GB, 44.72 GB, 45.67 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.64 GB, 50.57 GB, 51.45 GB, 52.31 GB, 53.15 GB, 54.00 GB, 54.84 GB, 55.65 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.15 GB, 60.98 GB, 61.71 GB, 62.43 GB, 63.19 GB, 63.91 GB, 64.63 GB, 65.32 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.98 GB (71924007350) - PeakReservation: 66.95 GB (71884079104) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.25 GB (86163302099) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m57s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 971.882ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 54.991ms - TotalThreadsVoluntaryContextSwitches: 18 (18) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 971.885ms - ExecTreeOpenTime: 914.968ms - PrepareTime: 218.540ms - ExecTreePrepareTime: 190.469us KuduTableSink:(Total: 13.675us, non-child: 13.675us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 915.156ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.95 GB (71884087296) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m57s - CumulativeAllocationBytes: 66.95 GB (71884079104) - CumulativeAllocations: 34.28K (34277) - PeakReservation: 66.95 GB (71884079104) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.95 GB (71884079104) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m6s, non-child: 17s097ms, % non-child: 0.73%) - ConvertRowBatchTime: 7s488ms - PeakMemoryUsage: 19.53 MB (20482772) - RowsReturned: 262.53M (262526712) - RowsReturnedRate: 111.86 K/sec Buffer pool: - AllocTime: 14m1s - CumulativeAllocationBytes: 119.22 GB (128013025280) - CumulativeAllocations: 6.25M (6250636) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.39 GB, 12.13 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.55 GB, 37.74 GB, 38.92 GB, 40.05 GB, 41.15 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.17 GB, 46.13 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.69 GB, 54.55 GB, 55.40 GB, 56.22 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 914.886ms - TotalBytesReceived: 67.67 GB (72663753175) - TotalGetBatchTime: 38m56s - DataArrivalTimer: 38m50s SenderSide: - DeserializeRowBatchTime: 17m21s - NumBatchesArrived: 3.13M (3125318) - NumBatchesDeferred: 17.00K (17002) - NumBatchesEnqueued: 3.13M (3125318) - NumBatchesReceived: 3.13M (3125318) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 55.534ms, non-child: 55.534ms, % non-child: 100.00%) - CodegenTime: 1.000ms - CompileTime: 5.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 29.223ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 19.716ms Instance 844a0200d7876345:20bb38b9000000e1 (host=vc1517.foo.com:22000):(Total: 1s240ms, non-child: 219.788ms, % non-child: 17.72%) Fragment Instance Lifecycle Event Timeline: 1s240ms - Prepare Finished: 219.368ms (219.368ms) - Open Finished: 1s240ms (1s021ms) MemoryUsage(1m4s): 4.34 GB, 12.01 GB, 17.82 GB, 21.55 GB, 24.26 GB, 26.57 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.53 GB, 39.65 GB, 40.73 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.57 GB, 51.45 GB, 52.31 GB, 53.14 GB, 54.00 GB, 54.84 GB, 55.65 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.15 GB, 60.98 GB, 61.71 GB, 62.44 GB, 63.19 GB, 63.91 GB, 64.63 GB, 65.32 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.96 GB (71903035830) - PeakReservation: 66.93 GB (71863107584) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.43 GB (86360199919) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 40m2s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 1s021ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 54.991ms - TotalThreadsVoluntaryContextSwitches: 13 (13) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s021ms - ExecTreeOpenTime: 964.679ms - PrepareTime: 218.832ms - ExecTreePrepareTime: 147.821us KuduTableSink:(Total: 11.984us, non-child: 11.984us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 964.824ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.93 GB (71863115776) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m4s - CumulativeAllocationBytes: 66.93 GB (71863107584) - CumulativeAllocations: 34.27K (34267) - PeakReservation: 66.93 GB (71863107584) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.93 GB (71863107584) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 40m12s, non-child: 17s282ms, % non-child: 0.72%) - ConvertRowBatchTime: 7s523ms - PeakMemoryUsage: 19.53 MB (20482278) - RowsReturned: 262.45M (262451028) - RowsReturnedRate: 108.78 K/sec Buffer pool: - AllocTime: 7m18s - CumulativeAllocationBytes: 119.19 GB (127976120320) - CumulativeAllocations: 6.25M (6248834) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.43 GB, 12.15 GB, 18.01 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.55 GB, 37.74 GB, 38.92 GB, 40.05 GB, 41.15 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.17 GB, 46.13 GB, 47.04 GB, 48.14 GB, 49.11 GB, 50.14 GB, 51.09 GB, 51.97 GB, 52.85 GB, 53.69 GB, 54.55 GB, 55.40 GB, 56.22 GB, 57.06 GB, 57.92 GB, 58.93 GB, 59.82 GB, 60.77 GB, 61.61 GB, 62.35 GB, 63.08 GB, 63.84 GB, 64.58 GB, 65.30 GB, 66.00 GB, 66.71 GB - FirstBatchArrivalWaitTime: 964.595ms - TotalBytesReceived: 67.65 GB (72642469476) - TotalGetBatchTime: 40m2s - DataArrivalTimer: 39m55s SenderSide: - DeserializeRowBatchTime: 10m28s - NumBatchesArrived: 3.12M (3124417) - NumBatchesDeferred: 2.91K (2912) - NumBatchesEnqueued: 3.12M (3124417) - NumBatchesReceived: 3.12M (3124417) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 55.810ms, non-child: 55.810ms, % non-child: 100.00%) - CodegenTime: 1.049ms - CompileTime: 5.116ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 29.886ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 20.320ms Instance 844a0200d7876345:20bb38b9000000c2 (host=vc1518.foo.com:22000):(Total: 1s188ms, non-child: 217.705ms, % non-child: 18.32%) Fragment Instance Lifecycle Event Timeline: 1s188ms - Prepare Finished: 216.999ms (216.999ms) - Open Finished: 1s188ms (971.756ms) MemoryUsage(1m4s): 4.35 GB, 12.02 GB, 17.83 GB, 21.55 GB, 24.25 GB, 26.56 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.76 GB, 35.04 GB, 36.17 GB, 37.35 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.74 GB (71659766198) - PeakReservation: 66.70 GB (71619837952) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.02 GB (85919660331) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m55s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 971.741ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 54.992ms - TotalThreadsVoluntaryContextSwitches: 11 (11) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 971.744ms - ExecTreeOpenTime: 913.703ms - PrepareTime: 216.546ms - ExecTreePrepareTime: 158.827us KuduTableSink:(Total: 12.118us, non-child: 12.118us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 913.859ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.70 GB (71619846144) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m38s - CumulativeAllocationBytes: 66.70 GB (71619837952) - CumulativeAllocations: 34.15K (34151) - PeakReservation: 66.70 GB (71619837952) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.70 GB (71619837952) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m5s, non-child: 16s964ms, % non-child: 0.72%) - ConvertRowBatchTime: 7s393ms - PeakMemoryUsage: 19.53 MB (20483116) - RowsReturned: 261.57M (261569784) - RowsReturnedRate: 111.53 K/sec Buffer pool: - AllocTime: 10m11s - CumulativeAllocationBytes: 118.79 GB (127546408960) - CumulativeAllocations: 6.23M (6227852) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.44 GB, 12.17 GB, 18.02 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.51 GB, 34.10 GB, 35.39 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.77 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 913.640ms - TotalBytesReceived: 67.43 GB (72398532024) - TotalGetBatchTime: 38m55s - DataArrivalTimer: 38m48s SenderSide: - DeserializeRowBatchTime: 13m13s - NumBatchesArrived: 3.11M (3113926) - NumBatchesDeferred: 12.03K (12028) - NumBatchesEnqueued: 3.11M (3113926) - NumBatchesReceived: 3.11M (3113926) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 56.812ms, non-child: 56.812ms, % non-child: 100.00%) - CodegenTime: 1.018ms - CompileTime: 4.923ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 31.447ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 19.873ms Instance 844a0200d7876345:20bb38b900000091 (host=vc1519.foo.com:22000):(Total: 1s177ms, non-child: 213.361ms, % non-child: 18.12%) Fragment Instance Lifecycle Event Timeline: 1s178ms - Prepare Finished: 212.498ms (212.498ms) - Open Finished: 1s178ms (965.523ms) MemoryUsage(1m4s): 4.82 GB, 13.25 GB, 19.63 GB, 23.72 GB, 26.69 GB, 29.23 GB, 31.52 GB, 33.65 GB, 35.42 GB, 37.16 GB, 38.56 GB, 39.80 GB, 41.10 GB, 42.38 GB, 43.61 GB, 44.81 GB, 45.96 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.23 GB, 51.22 GB, 52.41 GB, 53.47 GB, 54.59 GB, 55.62 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.12 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.67 GB, 69.49 GB, 70.29 GB, 71.07 GB, 71.83 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.45 GB (78865580470) - PeakReservation: 73.41 GB (78825652224) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.80 GB (93196900464) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m33s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 965.504ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 54.991ms - TotalThreadsVoluntaryContextSwitches: 18 (18) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 965.508ms - ExecTreeOpenTime: 908.174ms - PrepareTime: 212.107ms - ExecTreePrepareTime: 191.317us KuduTableSink:(Total: 19.392us, non-child: 19.392us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 908.362ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.41 GB (78825660416) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m48s - CumulativeAllocationBytes: 73.41 GB (78825652224) - CumulativeAllocations: 37.59K (37587) - PeakReservation: 73.41 GB (78825652224) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.41 GB (78825652224) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m43s, non-child: 18s547ms, % non-child: 0.82%) - ConvertRowBatchTime: 7s976ms - PeakMemoryUsage: 19.53 MB (20481651) - RowsReturned: 287.88M (287878144) - RowsReturnedRate: 127.17 K/sec Buffer pool: - AllocTime: 21m43s - CumulativeAllocationBytes: 130.73 GB (140374876160) - CumulativeAllocations: 6.85M (6854242) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.84 GB, 13.35 GB, 19.81 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.20 GB, 41.51 GB, 42.80 GB, 44.05 GB, 45.26 GB, 46.42 GB, 47.50 GB, 48.59 GB, 49.68 GB, 50.73 GB, 51.74 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.57 GB, 69.38 GB, 70.21 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 908.093ms - TotalBytesReceived: 74.21 GB (79680702179) - TotalGetBatchTime: 37m32s - DataArrivalTimer: 37m25s SenderSide: - DeserializeRowBatchTime: 25m38s - NumBatchesArrived: 3.43M (3427121) - NumBatchesDeferred: 52.42K (52416) - NumBatchesEnqueued: 3.43M (3427121) - NumBatchesReceived: 3.43M (3427121) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 55.932ms, non-child: 55.932ms, % non-child: 100.00%) - CodegenTime: 1.083ms - CompileTime: 5.822ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.371ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 21.175ms Instance 844a0200d7876345:20bb38b9000000f0 (host=vc1520.foo.com:22000):(Total: 1s211ms, non-child: 230.157ms, % non-child: 18.99%) Fragment Instance Lifecycle Event Timeline: 1s212ms - Prepare Finished: 229.327ms (229.327ms) - Open Finished: 1s212ms (982.911ms) MemoryUsage(1m4s): 4.35 GB, 12.01 GB, 17.82 GB, 21.54 GB, 24.25 GB, 26.56 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.04 GB, 36.17 GB, 37.35 GB, 38.51 GB, 39.63 GB, 40.72 GB, 41.76 GB, 42.74 GB, 43.72 GB, 44.70 GB, 45.65 GB, 46.55 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.55 GB, 51.43 GB, 52.29 GB, 53.13 GB, 53.98 GB, 54.82 GB, 55.63 GB, 56.46 GB, 57.30 GB, 58.31 GB, 59.19 GB, 60.13 GB, 60.96 GB, 61.69 GB, 62.42 GB, 63.17 GB, 63.90 GB, 64.61 GB, 65.30 GB, 66.00 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.81 GB (71741555126) - PeakReservation: 66.78 GB (71701626880) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.31 GB (86231178715) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m54s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 982.891ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 57.991ms - TotalThreadsVoluntaryContextSwitches: 9 (9) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 982.894ms - ExecTreeOpenTime: 923.203ms - PrepareTime: 228.926ms - ExecTreePrepareTime: 203.824us KuduTableSink:(Total: 16.434us, non-child: 16.434us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 923.404ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.78 GB (71701635072) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m7s - CumulativeAllocationBytes: 66.78 GB (71701626880) - CumulativeAllocations: 34.19K (34190) - PeakReservation: 66.78 GB (71701626880) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.78 GB (71701626880) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m3s, non-child: 17s004ms, % non-child: 0.73%) - ConvertRowBatchTime: 7s282ms - PeakMemoryUsage: 19.54 MB (20483939) - RowsReturned: 261.86M (261860844) - RowsReturnedRate: 111.73 K/sec Buffer pool: - AllocTime: 14m25s - CumulativeAllocationBytes: 118.92 GB (127688376320) - CumulativeAllocations: 6.23M (6234784) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.42 GB, 12.15 GB, 18.01 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.10 GB, 35.39 GB, 36.53 GB, 37.73 GB, 38.90 GB, 40.03 GB, 41.13 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.15 GB, 46.11 GB, 47.03 GB, 48.12 GB, 49.09 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.67 GB, 54.54 GB, 55.38 GB, 56.20 GB, 57.04 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.75 GB, 61.59 GB, 62.33 GB, 63.06 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 923.123ms - TotalBytesReceived: 67.50 GB (72479180481) - TotalGetBatchTime: 38m53s - DataArrivalTimer: 38m46s SenderSide: - DeserializeRowBatchTime: 17m33s - NumBatchesArrived: 3.12M (3117392) - NumBatchesDeferred: 24.55K (24549) - NumBatchesEnqueued: 3.12M (3117391) - NumBatchesReceived: 3.12M (3117392) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 58.310ms, non-child: 58.310ms, % non-child: 100.00%) - CodegenTime: 1.112ms - CompileTime: 4.947ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 29.830ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.002ms Instance 844a0200d7876345:20bb38b9000000dc (host=vc1522.foo.com:22000):(Total: 1s171ms, non-child: 197.504ms, % non-child: 16.86%) Fragment Instance Lifecycle Event Timeline: 1s171ms - Prepare Finished: 196.474ms (196.474ms) - Open Finished: 1s171ms (974.996ms) MemoryUsage(1m4s): 4.38 GB, 12.03 GB, 17.84 GB, 21.55 GB, 24.26 GB, 26.57 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.31 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.99 GB (71934493110) - PeakReservation: 66.96 GB (71894564864) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.28 GB (86203039694) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 40m41s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 974.975ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 52.992ms - TotalThreadsVoluntaryContextSwitches: 10 (10) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 974.980ms - ExecTreeOpenTime: 919.993ms - PrepareTime: 196.206ms - ExecTreePrepareTime: 178.244us KuduTableSink:(Total: 12.957us, non-child: 12.957us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 920.168ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.96 GB (71894573056) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 1m10s - CumulativeAllocationBytes: 66.96 GB (71894564864) - CumulativeAllocations: 34.28K (34282) - PeakReservation: 66.96 GB (71894564864) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.96 GB (71894564864) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 40m51s, non-child: 17s230ms, % non-child: 0.70%) - ConvertRowBatchTime: 7s514ms - PeakMemoryUsage: 19.53 MB (20480644) - RowsReturned: 262.57M (262568964) - RowsReturnedRate: 107.11 K/sec Buffer pool: - AllocTime: 7m24s - CumulativeAllocationBytes: 119.24 GB (128033628160) - CumulativeAllocations: 6.25M (6251642) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.45 GB, 12.17 GB, 18.02 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.74 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.69 GB, 54.55 GB, 55.40 GB, 56.22 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 919.888ms - TotalBytesReceived: 67.68 GB (72675067418) - TotalGetBatchTime: 40m40s - DataArrivalTimer: 40m34s SenderSide: - DeserializeRowBatchTime: 10m48s - NumBatchesArrived: 3.13M (3125821) - NumBatchesDeferred: 1.98K (1975) - NumBatchesEnqueued: 3.13M (3125821) - NumBatchesReceived: 3.13M (3125821) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 53.559ms, non-child: 53.559ms, % non-child: 100.00%) - CodegenTime: 1.106ms - CompileTime: 5.427ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 26.304ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 21.286ms Instance 844a0200d7876345:20bb38b9000000c8 (host=vc1523.foo.com:22000):(Total: 1s260ms, non-child: 220.418ms, % non-child: 17.49%) Fragment Instance Lifecycle Event Timeline: 1s260ms - Prepare Finished: 219.654ms (219.654ms) - Open Finished: 1s260ms (1s041ms) MemoryUsage(1m4s): 4.37 GB, 12.04 GB, 17.85 GB, 21.56 GB, 24.27 GB, 26.58 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.19 GB, 37.37 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.74 GB, 44.72 GB, 45.67 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.64 GB, 50.57 GB, 51.45 GB, 52.31 GB, 53.15 GB, 54.00 GB, 54.84 GB, 55.65 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.15 GB, 60.98 GB, 61.71 GB, 62.43 GB, 63.19 GB, 63.91 GB, 64.63 GB, 65.32 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.93 GB (71865287094) - PeakReservation: 66.89 GB (71825358848) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.34 GB (86265581953) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m38s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 10 (10) - TotalThreadsTotalWallClockTime: 1s041ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 58.991ms - TotalThreadsVoluntaryContextSwitches: 6 (6) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s041ms - ExecTreeOpenTime: 980.802ms - PrepareTime: 219.235ms - ExecTreePrepareTime: 155.722us KuduTableSink:(Total: 12.733us, non-child: 12.733us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 980.955ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.89 GB (71825367040) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m17s - CumulativeAllocationBytes: 66.89 GB (71825358848) - CumulativeAllocations: 34.25K (34249) - PeakReservation: 66.89 GB (71825358848) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.89 GB (71825358848) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m48s, non-child: 16s953ms, % non-child: 0.73%) - ConvertRowBatchTime: 7s503ms - PeakMemoryUsage: 19.53 MB (20483634) - RowsReturned: 262.31M (262314864) - RowsReturnedRate: 112.65 K/sec Buffer pool: - AllocTime: 13m2s - CumulativeAllocationBytes: 119.13 GB (127909724160) - CumulativeAllocations: 6.25M (6245592) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.39 GB, 12.13 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.74 GB, 38.91 GB, 40.05 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.17 GB, 46.13 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.69 GB, 54.55 GB, 55.40 GB, 56.21 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 980.732ms - TotalBytesReceived: 67.62 GB (72605087721) - TotalGetBatchTime: 38m38s - DataArrivalTimer: 38m31s SenderSide: - DeserializeRowBatchTime: 16m17s - NumBatchesArrived: 3.12M (3122796) - NumBatchesDeferred: 26.61K (26614) - NumBatchesEnqueued: 3.12M (3122796) - NumBatchesReceived: 3.12M (3122796) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 59.003ms, non-child: 59.003ms, % non-child: 100.00%) - CodegenTime: 1.138ms - CompileTime: 4.762ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.202ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 25.450ms Instance 844a0200d7876345:20bb38b90000009e (host=vc1524.foo.com:22000):(Total: 1s199ms, non-child: 230.270ms, % non-child: 19.19%) Fragment Instance Lifecycle Event Timeline: 1s200ms - Prepare Finished: 229.578ms (229.578ms) - Open Finished: 1s200ms (970.702ms) MemoryUsage(1m4s): 4.84 GB, 13.26 GB, 19.64 GB, 23.72 GB, 26.69 GB, 29.23 GB, 31.51 GB, 33.65 GB, 35.42 GB, 37.15 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.94 GB, 47.01 GB, 48.09 GB, 49.17 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.59 GB, 55.61 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.12 GB, 63.05 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.67 GB, 69.49 GB, 70.29 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.68 GB (79110947254) - PeakReservation: 73.64 GB (79071019008) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.86 GB (93270240173) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m45s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 970.672ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 8 (8) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 970.689ms - ExecTreeOpenTime: 907.150ms - PrepareTime: 229.150ms - ExecTreePrepareTime: 270.220us KuduTableSink:(Total: 12.660us, non-child: 12.660us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 907.417ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.64 GB (79071027200) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m58s - CumulativeAllocationBytes: 73.64 GB (79071019008) - CumulativeAllocations: 37.70K (37704) - PeakReservation: 73.64 GB (79071019008) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.64 GB (79071019008) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m55s, non-child: 18s598ms, % non-child: 0.80%) - ConvertRowBatchTime: 8s005ms - PeakMemoryUsage: 19.53 MB (20481153) - RowsReturned: 288.78M (288775368) - RowsReturnedRate: 123.62 K/sec Buffer pool: - AllocTime: 14m1s - CumulativeAllocationBytes: 131.14 GB (140812369920) - CumulativeAllocations: 6.88M (6875604) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.86 GB, 13.36 GB, 19.81 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.97 GB, 35.76 GB, 37.52 GB, 38.93 GB, 40.18 GB, 41.50 GB, 42.79 GB, 44.03 GB, 45.24 GB, 46.41 GB, 47.48 GB, 48.57 GB, 49.67 GB, 50.72 GB, 51.73 GB, 52.93 GB, 54.00 GB, 55.14 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.57 GB, 69.38 GB, 70.21 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 907.097ms - TotalBytesReceived: 74.44 GB (79928961812) - TotalGetBatchTime: 38m44s - DataArrivalTimer: 38m37s SenderSide: - DeserializeRowBatchTime: 17m27s - NumBatchesArrived: 3.44M (3437802) - NumBatchesDeferred: 17.98K (17977) - NumBatchesEnqueued: 3.44M (3437802) - NumBatchesReceived: 3.44M (3437802) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 62.195ms, non-child: 62.195ms, % non-child: 100.00%) - CodegenTime: 1.014ms - CompileTime: 5.424ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 30.857ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 25.317ms Instance 844a0200d7876345:20bb38b9000000cd (host=vc1525.foo.com:22000):(Total: 1s179ms, non-child: 209.925ms, % non-child: 17.80%) Fragment Instance Lifecycle Event Timeline: 1s179ms - Prepare Finished: 209.263ms (209.263ms) - Open Finished: 1s179ms (970.278ms) MemoryUsage(1m4s): 4.39 GB, 12.05 GB, 17.85 GB, 21.57 GB, 24.27 GB, 26.58 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.32 GB, 59.19 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.88 GB (71817052598) - PeakReservation: 66.85 GB (71777124352) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.26 GB (86176118037) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m14s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 970.256ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 60.991ms - TotalThreadsVoluntaryContextSwitches: 6 (6) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 970.259ms - ExecTreeOpenTime: 908.566ms - PrepareTime: 208.865ms - ExecTreePrepareTime: 163.259us KuduTableSink:(Total: 13.852us, non-child: 13.852us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 908.727ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.85 GB (71777132544) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m35s - CumulativeAllocationBytes: 66.85 GB (71777124352) - CumulativeAllocations: 34.23K (34226) - PeakReservation: 66.85 GB (71777124352) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.85 GB (71777124352) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m24s, non-child: 17s233ms, % non-child: 0.75%) - ConvertRowBatchTime: 7s571ms - PeakMemoryUsage: 19.53 MB (20482894) - RowsReturned: 262.14M (262139136) - RowsReturnedRate: 113.77 K/sec Buffer pool: - AllocTime: 16m59s - CumulativeAllocationBytes: 119.05 GB (127824035840) - CumulativeAllocations: 6.24M (6241408) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.41 GB, 12.14 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.92 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.39 GB, 36.53 GB, 37.73 GB, 38.90 GB, 40.04 GB, 41.13 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.11 GB, 47.03 GB, 48.12 GB, 49.09 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.75 GB, 61.59 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.70 GB - FirstBatchArrivalWaitTime: 908.511ms - TotalBytesReceived: 67.57 GB (72556341293) - TotalGetBatchTime: 38m13s - DataArrivalTimer: 38m7s SenderSide: - DeserializeRowBatchTime: 20m40s - NumBatchesArrived: 3.12M (3120704) - NumBatchesDeferred: 30.71K (30710) - NumBatchesEnqueued: 3.12M (3120704) - NumBatchesReceived: 3.12M (3120704) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 60.519ms, non-child: 60.519ms, % non-child: 100.00%) - CodegenTime: 1.182ms - CompileTime: 5.171ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 30.749ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.069ms Instance 844a0200d7876345:20bb38b900000100 (host=vc1526.foo.com:22000):(Total: 1s231ms, non-child: 217.379ms, % non-child: 17.65%) Fragment Instance Lifecycle Event Timeline: 1s232ms - Prepare Finished: 216.279ms (216.279ms) - Open Finished: 1s232ms (1s015ms) MemoryUsage(1m4s): 4.39 GB, 12.05 GB, 17.85 GB, 21.57 GB, 24.27 GB, 26.58 GB, 28.66 GB, 30.60 GB, 32.21 GB, 33.78 GB, 35.06 GB, 36.19 GB, 37.37 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.74 GB, 44.72 GB, 45.67 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.57 GB, 51.45 GB, 52.31 GB, 53.15 GB, 54.00 GB, 54.84 GB, 55.65 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.15 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.19 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.74 GB (71663960502) - PeakReservation: 66.71 GB (71624032256) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.06 GB (85962837349) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m21s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s015ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 53.992ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s015ms - ExecTreeOpenTime: 959.529ms - PrepareTime: 215.979ms - ExecTreePrepareTime: 159.772us KuduTableSink:(Total: 18.746us, non-child: 18.746us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 959.686ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.71 GB (71624040448) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m38s - CumulativeAllocationBytes: 66.71 GB (71624032256) - CumulativeAllocations: 34.15K (34153) - PeakReservation: 66.71 GB (71624032256) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.71 GB (71624032256) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m30s, non-child: 16s127ms, % non-child: 0.68%) - ConvertRowBatchTime: 7s002ms - PeakMemoryUsage: 19.53 MB (20483358) - RowsReturned: 261.58M (261581124) - RowsReturnedRate: 110.35 K/sec Buffer pool: - AllocTime: 12m11s - CumulativeAllocationBytes: 118.79 GB (127551938560) - CumulativeAllocations: 6.23M (6228122) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.40 GB, 12.14 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.74 GB, 38.91 GB, 40.05 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.17 GB, 46.13 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.69 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.92 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 959.430ms - TotalBytesReceived: 67.43 GB (72401880196) - TotalGetBatchTime: 39m20s - DataArrivalTimer: 39m14s SenderSide: - DeserializeRowBatchTime: 15m14s - NumBatchesArrived: 3.11M (3114061) - NumBatchesDeferred: 11.32K (11321) - NumBatchesEnqueued: 3.11M (3114061) - NumBatchesReceived: 3.11M (3114061) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 54.832ms, non-child: 54.832ms, % non-child: 100.00%) - CodegenTime: 1.009ms - CompileTime: 5.567ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 26.093ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.682ms Instance 844a0200d7876345:20bb38b9000000e8 (host=vc1527.foo.com:22000):(Total: 1s189ms, non-child: 204.232ms, % non-child: 17.17%) Fragment Instance Lifecycle Event Timeline: 1s189ms - Prepare Finished: 203.273ms (203.273ms) - Open Finished: 1s189ms (986.397ms) MemoryUsage(1m4s): 4.38 GB, 12.03 GB, 17.84 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.19 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.32 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.94 GB (71879967158) - PeakReservation: 66.91 GB (71840038912) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.04 GB (85947546693) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m27s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 986.380ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 58.991ms - TotalThreadsVoluntaryContextSwitches: 8 (8) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 986.384ms - ExecTreeOpenTime: 926.169ms - PrepareTime: 202.876ms - ExecTreePrepareTime: 161.279us KuduTableSink:(Total: 17.805us, non-child: 17.805us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 926.328ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.91 GB (71840047104) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m22s - CumulativeAllocationBytes: 66.91 GB (71840038912) - CumulativeAllocations: 34.26K (34256) - PeakReservation: 66.91 GB (71840038912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.91 GB (71840038912) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m37s, non-child: 16s861ms, % non-child: 0.71%) - ConvertRowBatchTime: 7s481ms - PeakMemoryUsage: 19.53 MB (20483351) - RowsReturned: 262.37M (262368792) - RowsReturnedRate: 110.36 K/sec Buffer pool: - AllocTime: 11m17s - CumulativeAllocationBytes: 119.15 GB (127936020480) - CumulativeAllocations: 6.25M (6246876) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.39 GB, 12.12 GB, 17.99 GB, 21.75 GB, 24.48 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.10 GB, 35.39 GB, 36.53 GB, 37.73 GB, 38.90 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.15 GB, 46.12 GB, 47.03 GB, 48.12 GB, 49.10 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 926.113ms - TotalBytesReceived: 67.63 GB (72619713190) - TotalGetBatchTime: 39m27s - DataArrivalTimer: 39m20s SenderSide: - DeserializeRowBatchTime: 14m42s - NumBatchesArrived: 3.12M (3123438) - NumBatchesDeferred: 16.24K (16244) - NumBatchesEnqueued: 3.12M (3123438) - NumBatchesReceived: 3.12M (3123438) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 58.737ms, non-child: 58.737ms, % non-child: 100.00%) - CodegenTime: 1.282ms - CompileTime: 5.420ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.972ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.738ms Instance 844a0200d7876345:20bb38b9000000b5 (host=vc1528.foo.com:22000):(Total: 1s212ms, non-child: 235.879ms, % non-child: 19.45%) Fragment Instance Lifecycle Event Timeline: 1s213ms - Prepare Finished: 235.188ms (235.188ms) - Open Finished: 1s213ms (978.010ms) MemoryUsage(1m4s): 4.39 GB, 12.05 GB, 17.86 GB, 21.57 GB, 24.27 GB, 26.58 GB, 28.66 GB, 30.60 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.19 GB, 37.37 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.72 GB, 45.67 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.57 GB, 51.44 GB, 52.31 GB, 53.14 GB, 54.00 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.84 GB (71770915254) - PeakReservation: 66.80 GB (71730987008) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.18 GB (86096192011) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 40m4s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 977.989ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 51.992ms - TotalThreadsVoluntaryContextSwitches: 15 (15) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 977.993ms - ExecTreeOpenTime: 925.724ms - PrepareTime: 234.749ms - ExecTreePrepareTime: 160.724us KuduTableSink:(Total: 12.669us, non-child: 12.669us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 925.882ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.80 GB (71730995200) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 1m41s - CumulativeAllocationBytes: 66.80 GB (71730987008) - CumulativeAllocations: 34.20K (34204) - PeakReservation: 66.80 GB (71730987008) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.80 GB (71730987008) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 40m14s, non-child: 17s287ms, % non-child: 0.72%) - ConvertRowBatchTime: 7s558ms - PeakMemoryUsage: 19.53 MB (20483126) - RowsReturned: 261.97M (261966600) - RowsReturnedRate: 108.52 K/sec Buffer pool: - AllocTime: 5m16s - CumulativeAllocationBytes: 118.97 GB (127739904000) - CumulativeAllocations: 6.24M (6237300) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.41 GB, 12.14 GB, 18.01 GB, 21.77 GB, 24.49 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.96 GB, 52.84 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.29 GB, 65.98 GB, 66.70 GB - FirstBatchArrivalWaitTime: 925.654ms - TotalBytesReceived: 67.53 GB (72508776652) - TotalGetBatchTime: 40m3s - DataArrivalTimer: 39m57s SenderSide: - DeserializeRowBatchTime: 8m19s - NumBatchesArrived: 3.12M (3118650) - NumBatchesDeferred: 2.33K (2335) - NumBatchesEnqueued: 3.12M (3118650) - NumBatchesReceived: 3.12M (3118650) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 51.023ms, non-child: 51.023ms, % non-child: 100.00%) - CodegenTime: 992.653us - CompileTime: 5.178ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 26.147ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 19.141ms Instance 844a0200d7876345:20bb38b900000101 (host=vc1529.foo.com:22000):(Total: 1s189ms, non-child: 217.092ms, % non-child: 18.25%) Fragment Instance Lifecycle Event Timeline: 1s190ms - Prepare Finished: 216.364ms (216.364ms) - Open Finished: 1s190ms (973.777ms) MemoryUsage(1m4s): 4.41 GB, 12.05 GB, 17.86 GB, 21.58 GB, 24.27 GB, 26.58 GB, 28.66 GB, 30.60 GB, 32.21 GB, 33.78 GB, 35.06 GB, 36.19 GB, 37.37 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.31 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.79 GB (71712194998) - PeakReservation: 66.75 GB (71672266752) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.13 GB (86039043395) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m49s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 973.762ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 49.992ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 973.765ms - ExecTreeOpenTime: 921.944ms - PrepareTime: 215.983ms - ExecTreePrepareTime: 165.996us KuduTableSink:(Total: 11.914us, non-child: 11.914us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 922.107ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.75 GB (71672274944) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m53s - CumulativeAllocationBytes: 66.75 GB (71672266752) - CumulativeAllocations: 34.18K (34176) - PeakReservation: 66.75 GB (71672266752) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.75 GB (71672266752) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m59s, non-child: 16s971ms, % non-child: 0.73%) - ConvertRowBatchTime: 7s514ms - PeakMemoryUsage: 19.53 MB (20483069) - RowsReturned: 261.75M (261754584) - RowsReturnedRate: 111.90 K/sec Buffer pool: - AllocTime: 9m43s - CumulativeAllocationBytes: 118.87 GB (127636520960) - CumulativeAllocations: 6.23M (6232252) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.43 GB, 12.16 GB, 18.02 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.96 GB, 52.84 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 921.883ms - TotalBytesReceived: 67.47 GB (72450126438) - TotalGetBatchTime: 38m48s - DataArrivalTimer: 38m42s SenderSide: - DeserializeRowBatchTime: 12m49s - NumBatchesArrived: 3.12M (3116126) - NumBatchesDeferred: 20.88K (20882) - NumBatchesEnqueued: 3.12M (3116126) - NumBatchesReceived: 3.12M (3116126) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 50.588ms, non-child: 50.588ms, % non-child: 100.00%) - CodegenTime: 974.848us - CompileTime: 5.406ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.117ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 16.550ms Instance 844a0200d7876345:20bb38b90000008f (host=vc1531.foo.com:22000):(Total: 1s234ms, non-child: 203.622ms, % non-child: 16.50%) Fragment Instance Lifecycle Event Timeline: 1s234ms - Prepare Finished: 202.448ms (202.448ms) - Open Finished: 1s234ms (1s032ms) MemoryUsage(1m4s): 4.81 GB, 13.23 GB, 19.61 GB, 23.70 GB, 26.67 GB, 29.21 GB, 31.51 GB, 33.64 GB, 35.41 GB, 37.14 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.95 GB, 47.01 GB, 48.09 GB, 49.17 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.58 GB, 55.61 GB, 56.57 GB, 57.52 GB, 58.44 GB, 59.38 GB, 60.30 GB, 61.20 GB, 62.11 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.14 GB, 67.06 GB, 67.86 GB, 68.66 GB, 69.49 GB, 70.29 GB, 71.07 GB, 71.83 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.39 GB (78798471606) - PeakReservation: 73.35 GB (78758543360) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.88 GB (93288972021) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m2s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 1s032ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 50.993ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s032ms - ExecTreeOpenTime: 979.145ms - PrepareTime: 202.145ms - ExecTreePrepareTime: 181.249us KuduTableSink:(Total: 14.580us, non-child: 14.580us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 979.324ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.35 GB (78758551552) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m27s - CumulativeAllocationBytes: 73.35 GB (78758543360) - CumulativeAllocations: 37.55K (37555) - PeakReservation: 73.35 GB (78758543360) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.35 GB (78758543360) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m12s, non-child: 18s058ms, % non-child: 0.79%) - ConvertRowBatchTime: 7s829ms - PeakMemoryUsage: 19.53 MB (20482115) - RowsReturned: 287.64M (287640108) - RowsReturnedRate: 125.47 K/sec Buffer pool: - AllocTime: 16m25s - CumulativeAllocationBytes: 130.63 GB (140258795520) - CumulativeAllocations: 6.85M (6848574) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.84 GB, 13.34 GB, 19.80 GB, 23.93 GB, 26.93 GB, 29.50 GB, 31.81 GB, 33.97 GB, 35.76 GB, 37.51 GB, 38.93 GB, 40.18 GB, 41.50 GB, 42.79 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.48 GB, 48.58 GB, 49.67 GB, 50.73 GB, 51.73 GB, 52.93 GB, 54.00 GB, 55.14 GB, 56.18 GB, 57.15 GB, 58.11 GB, 59.04 GB, 59.99 GB, 60.92 GB, 61.82 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.56 GB, 69.37 GB, 70.21 GB, 71.01 GB, 71.81 GB, 72.57 GB, 73.36 GB - FirstBatchArrivalWaitTime: 979.072ms - TotalBytesReceived: 74.15 GB (79614577404) - TotalGetBatchTime: 38m1s - DataArrivalTimer: 37m54s SenderSide: - DeserializeRowBatchTime: 20m5s - NumBatchesArrived: 3.42M (3424287) - NumBatchesDeferred: 35.83K (35827) - NumBatchesEnqueued: 3.42M (3424287) - NumBatchesReceived: 3.42M (3424287) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 51.343ms, non-child: 51.343ms, % non-child: 100.00%) - CodegenTime: 1.037ms - CompileTime: 5.678ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 26.732ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 18.462ms Instance 844a0200d7876345:20bb38b900000092 (host=vc1532.foo.com:22000):(Total: 1s173ms, non-child: 204.662ms, % non-child: 17.44%) Fragment Instance Lifecycle Event Timeline: 1s174ms - Prepare Finished: 203.967ms (203.967ms) - Open Finished: 1s174ms (970.418ms) MemoryUsage(1m4s): 4.82 GB, 13.25 GB, 19.63 GB, 23.72 GB, 26.69 GB, 29.23 GB, 31.52 GB, 33.65 GB, 35.42 GB, 37.16 GB, 38.56 GB, 39.80 GB, 41.10 GB, 42.38 GB, 43.61 GB, 44.81 GB, 45.96 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.23 GB, 51.22 GB, 52.41 GB, 53.47 GB, 54.59 GB, 55.62 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.12 GB, 63.05 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.67 GB, 69.50 GB, 70.29 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.43 GB (78844608950) - PeakReservation: 73.39 GB (78804680704) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.82 GB (93219941978) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m7s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 970.400ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 64.989ms - TotalThreadsVoluntaryContextSwitches: 18 (18) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 970.403ms - ExecTreeOpenTime: 904.696ms - PrepareTime: 203.315ms - ExecTreePrepareTime: 156.167us KuduTableSink:(Total: 15.429us, non-child: 15.429us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 904.849ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.39 GB (78804688896) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 4m12s - CumulativeAllocationBytes: 73.39 GB (78804680704) - CumulativeAllocations: 37.58K (37577) - PeakReservation: 73.39 GB (78804680704) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.39 GB (78804680704) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m17s, non-child: 18s243ms, % non-child: 0.82%) - ConvertRowBatchTime: 7s856ms - PeakMemoryUsage: 19.53 MB (20482320) - RowsReturned: 287.81M (287808948) - RowsReturnedRate: 128.63 K/sec Buffer pool: - AllocTime: 18m24s - CumulativeAllocationBytes: 130.70 GB (140341125120) - CumulativeAllocations: 6.85M (6852594) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.84 GB, 13.35 GB, 19.80 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.20 GB, 41.51 GB, 42.80 GB, 44.05 GB, 45.26 GB, 46.42 GB, 47.49 GB, 48.59 GB, 49.68 GB, 50.73 GB, 51.74 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.76 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.57 GB, 69.38 GB, 70.21 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 904.636ms - TotalBytesReceived: 74.19 GB (79661002903) - TotalGetBatchTime: 37m6s - DataArrivalTimer: 36m59s SenderSide: - DeserializeRowBatchTime: 22m3s - NumBatchesArrived: 3.43M (3426297) - NumBatchesDeferred: 55.82K (55818) - NumBatchesEnqueued: 3.43M (3426297) - NumBatchesReceived: 3.43M (3426297) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 64.251ms, non-child: 64.251ms, % non-child: 100.00%) - CodegenTime: 1.088ms - CompileTime: 5.578ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 33.265ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.850ms Instance 844a0200d7876345:20bb38b9000000aa (host=vc1533.foo.com:22000):(Total: 1s233ms, non-child: 222.894ms, % non-child: 18.07%) Fragment Instance Lifecycle Event Timeline: 1s233ms - Prepare Finished: 222.018ms (222.018ms) - Open Finished: 1s233ms (1s011ms) MemoryUsage(1m4s): 4.80 GB, 13.23 GB, 19.62 GB, 23.71 GB, 26.68 GB, 29.23 GB, 31.51 GB, 33.65 GB, 35.42 GB, 37.15 GB, 38.55 GB, 39.80 GB, 41.09 GB, 42.37 GB, 43.61 GB, 44.80 GB, 45.95 GB, 47.01 GB, 48.09 GB, 49.18 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.59 GB, 55.61 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.12 GB, 63.05 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.67 GB, 69.50 GB, 70.29 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.68 GB (79113044406) - PeakReservation: 73.64 GB (79073116160) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.05 GB (93472727069) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m15s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 1s011ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 50.992ms - TotalThreadsVoluntaryContextSwitches: 11 (11) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s011ms - ExecTreeOpenTime: 960.343ms - PrepareTime: 221.726ms - ExecTreePrepareTime: 160.832us KuduTableSink:(Total: 11.878us, non-child: 11.878us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 960.501ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.64 GB (79073124352) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 4m32s - CumulativeAllocationBytes: 73.64 GB (79073116160) - CumulativeAllocations: 37.70K (37705) - PeakReservation: 73.64 GB (79073116160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.64 GB (79073116160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m24s, non-child: 17s284ms, % non-child: 0.77%) - ConvertRowBatchTime: 7s627ms - PeakMemoryUsage: 19.53 MB (20482086) - RowsReturned: 288.79M (288785448) - RowsReturnedRate: 128.65 K/sec Buffer pool: - AllocTime: 16m4s - CumulativeAllocationBytes: 131.15 GB (140817285120) - CumulativeAllocations: 6.88M (6875844) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.83 GB, 13.33 GB, 19.79 GB, 23.93 GB, 26.93 GB, 29.50 GB, 31.81 GB, 33.97 GB, 35.76 GB, 37.51 GB, 38.93 GB, 40.19 GB, 41.50 GB, 42.80 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.67 GB, 50.73 GB, 51.73 GB, 52.94 GB, 54.00 GB, 55.14 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.57 GB, 69.38 GB, 70.21 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 960.263ms - TotalBytesReceived: 74.44 GB (79931619637) - TotalGetBatchTime: 37m14s - DataArrivalTimer: 37m7s SenderSide: - DeserializeRowBatchTime: 19m24s - NumBatchesArrived: 3.44M (3437922) - NumBatchesDeferred: 77.77K (77772) - NumBatchesEnqueued: 3.44M (3437922) - NumBatchesReceived: 3.44M (3437922) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 49.865ms, non-child: 49.865ms, % non-child: 100.00%) - CodegenTime: 1.015ms - CompileTime: 4.588ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 27.281ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 17.540ms Instance 844a0200d7876345:20bb38b90000009b (host=vc1534.foo.com:22000):(Total: 1s210ms, non-child: 234.561ms, % non-child: 19.38%) Fragment Instance Lifecycle Event Timeline: 1s210ms - Prepare Finished: 233.775ms (233.775ms) - Open Finished: 1s210ms (976.679ms) MemoryUsage(1m4s): 4.78 GB, 13.20 GB, 19.60 GB, 23.70 GB, 26.67 GB, 29.21 GB, 31.50 GB, 33.63 GB, 35.40 GB, 37.14 GB, 38.54 GB, 39.78 GB, 41.08 GB, 42.36 GB, 43.59 GB, 44.79 GB, 45.93 GB, 47.00 GB, 48.08 GB, 49.16 GB, 50.21 GB, 51.20 GB, 52.39 GB, 53.45 GB, 54.57 GB, 55.60 GB, 56.57 GB, 57.52 GB, 58.43 GB, 59.37 GB, 60.30 GB, 61.19 GB, 62.10 GB, 63.03 GB, 64.14 GB, 65.10 GB, 66.14 GB, 67.05 GB, 67.86 GB, 68.65 GB, 69.48 GB, 70.28 GB, 71.07 GB, 71.83 GB, 72.60 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.37 GB (78783791542) - PeakReservation: 73.34 GB (78743863296) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.78 GB (93176715702) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m8s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 976.672ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 49.992ms - TotalThreadsVoluntaryContextSwitches: 12 (12) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 976.675ms - ExecTreeOpenTime: 925.665ms - PrepareTime: 233.441ms - ExecTreePrepareTime: 222.571us KuduTableSink:(Total: 12.599us, non-child: 12.599us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 925.885ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.34 GB (78743871488) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m2s - CumulativeAllocationBytes: 73.34 GB (78743863296) - CumulativeAllocations: 37.55K (37548) - PeakReservation: 73.34 GB (78743863296) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.34 GB (78743863296) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m18s, non-child: 18s168ms, % non-child: 0.79%) - ConvertRowBatchTime: 7s902ms - PeakMemoryUsage: 19.53 MB (20481375) - RowsReturned: 287.58M (287584920) - RowsReturnedRate: 125.12 K/sec Buffer pool: - AllocTime: 15m57s - CumulativeAllocationBytes: 130.60 GB (140231884800) - CumulativeAllocations: 6.85M (6847260) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.87 GB, 13.37 GB, 19.81 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.97 GB, 35.76 GB, 37.51 GB, 38.93 GB, 40.18 GB, 41.50 GB, 42.79 GB, 44.03 GB, 45.24 GB, 46.40 GB, 47.48 GB, 48.57 GB, 49.67 GB, 50.72 GB, 51.73 GB, 52.93 GB, 54.00 GB, 55.14 GB, 56.17 GB, 57.15 GB, 58.11 GB, 59.04 GB, 59.99 GB, 60.92 GB, 61.82 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.56 GB, 69.37 GB, 70.21 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 925.600ms - TotalBytesReceived: 74.13 GB (79599251790) - TotalGetBatchTime: 38m7s - DataArrivalTimer: 38m SenderSide: - DeserializeRowBatchTime: 19m32s - NumBatchesArrived: 3.42M (3423630) - NumBatchesDeferred: 31.96K (31957) - NumBatchesEnqueued: 3.42M (3423630) - NumBatchesReceived: 3.42M (3423630) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 49.718ms, non-child: 49.718ms, % non-child: 100.00%) - CodegenTime: 995.992us - CompileTime: 5.187ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 26.962ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 17.028ms Instance 844a0200d7876345:20bb38b9000000eb (host=vc1535.foo.com:22000):(Total: 1s174ms, non-child: 197.629ms, % non-child: 16.83%) Fragment Instance Lifecycle Event Timeline: 1s175ms - Prepare Finished: 196.854ms (196.854ms) - Open Finished: 1s175ms (978.213ms) MemoryUsage(1m4s): 4.36 GB, 12.03 GB, 17.84 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.97 GB (71905132982) - PeakReservation: 66.93 GB (71865204736) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.27 GB (86186376141) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m16s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 978.189ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 55.991ms - TotalThreadsVoluntaryContextSwitches: 20 (20) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 978.192ms - ExecTreeOpenTime: 921.093ms - PrepareTime: 196.322ms - ExecTreePrepareTime: 243.658us KuduTableSink:(Total: 13.541us, non-child: 13.541us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 921.334ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.93 GB (71865212928) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m37s - CumulativeAllocationBytes: 66.93 GB (71865204736) - CumulativeAllocations: 34.27K (34268) - PeakReservation: 66.93 GB (71865204736) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.93 GB (71865204736) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m26s, non-child: 17s560ms, % non-child: 0.76%) - ConvertRowBatchTime: 7s636ms - PeakMemoryUsage: 19.53 MB (20483705) - RowsReturned: 262.47M (262469088) - RowsReturnedRate: 113.82 K/sec Buffer pool: - AllocTime: 17m29s - CumulativeAllocationBytes: 119.20 GB (127984926720) - CumulativeAllocations: 6.25M (6249264) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.45 GB, 12.17 GB, 18.02 GB, 21.78 GB, 24.50 GB, 26.84 GB, 28.94 GB, 30.90 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.96 GB, 52.84 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.92 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 921.044ms - TotalBytesReceived: 67.66 GB (72647568145) - TotalGetBatchTime: 38m15s - DataArrivalTimer: 38m8s SenderSide: - DeserializeRowBatchTime: 21m21s - NumBatchesArrived: 3.12M (3124632) - NumBatchesDeferred: 43.87K (43873) - NumBatchesEnqueued: 3.12M (3124632) - NumBatchesReceived: 3.12M (3124632) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 55.629ms, non-child: 55.629ms, % non-child: 100.00%) - CodegenTime: 1.090ms - CompileTime: 5.927ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.033ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 21.106ms Instance 844a0200d7876345:20bb38b9000000cb (host=vc1536.foo.com:22000):(Total: 1s243ms, non-child: 190.290ms, % non-child: 15.30%) Fragment Instance Lifecycle Event Timeline: 1s244ms - Prepare Finished: 189.448ms (189.448ms) - Open Finished: 1s244ms (1s054ms) MemoryUsage(1m4s): 4.34 GB, 12.00 GB, 17.82 GB, 21.55 GB, 24.25 GB, 26.56 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.04 GB, 36.17 GB, 37.35 GB, 38.52 GB, 39.64 GB, 40.72 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.70 GB, 45.65 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.32 GB, 59.19 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.85 GB (71779303862) - PeakReservation: 66.81 GB (71739375616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.27 GB (86191063773) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m3s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s054ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 47.993ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s054ms - ExecTreeOpenTime: 1s003ms - PrepareTime: 189.198ms - ExecTreePrepareTime: 175.558us KuduTableSink:(Total: 12.853us, non-child: 12.853us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 1s003ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.81 GB (71739383808) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m46s - CumulativeAllocationBytes: 66.81 GB (71739375616) - CumulativeAllocations: 34.21K (34208) - PeakReservation: 66.81 GB (71739375616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.81 GB (71739375616) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m13s, non-child: 17s687ms, % non-child: 0.75%) - ConvertRowBatchTime: 7s732ms - PeakMemoryUsage: 19.53 MB (20482255) - RowsReturned: 262.00M (262002688) - RowsReturnedRate: 111.32 K/sec Buffer pool: - AllocTime: 13m40s - CumulativeAllocationBytes: 118.98 GB (127757803520) - CumulativeAllocations: 6.24M (6238174) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.42 GB, 12.15 GB, 18.01 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.73 GB, 38.90 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.96 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.92 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 1s003ms - TotalBytesReceived: 67.54 GB (72518962858) - TotalGetBatchTime: 39m2s - DataArrivalTimer: 38m56s SenderSide: - DeserializeRowBatchTime: 16m54s - NumBatchesArrived: 3.12M (3119087) - NumBatchesDeferred: 9.72K (9724) - NumBatchesEnqueued: 3.12M (3119087) - NumBatchesReceived: 3.12M (3119087) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 50.072ms, non-child: 50.072ms, % non-child: 100.00%) - CodegenTime: 961.919us - CompileTime: 5.293ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 26.411ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 17.892ms Instance 844a0200d7876345:20bb38b9000000a5 (host=vc1537.foo.com:22000):(Total: 1s158ms, non-child: 192.729ms, % non-child: 16.64%) Fragment Instance Lifecycle Event Timeline: 1s158ms - Prepare Finished: 191.882ms (191.882ms) - Open Finished: 1s158ms (966.932ms) MemoryUsage(1m4s): 4.83 GB, 13.25 GB, 19.64 GB, 23.72 GB, 26.69 GB, 29.23 GB, 31.52 GB, 33.65 GB, 35.42 GB, 37.16 GB, 38.56 GB, 39.80 GB, 41.10 GB, 42.38 GB, 43.61 GB, 44.81 GB, 45.96 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.23 GB, 51.22 GB, 52.41 GB, 53.47 GB, 54.59 GB, 55.62 GB, 56.59 GB, 57.54 GB, 58.46 GB, 59.39 GB, 60.31 GB, 61.21 GB, 62.12 GB, 63.05 GB, 64.16 GB, 65.12 GB, 66.16 GB, 67.07 GB, 67.87 GB, 68.67 GB, 69.50 GB, 70.30 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.62 GB (79050129846) - PeakReservation: 73.58 GB (79010201600) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.20 GB (93630051103) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 36m48s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 966.917ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 62.990ms - TotalThreadsVoluntaryContextSwitches: 7 (7) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 966.921ms - ExecTreeOpenTime: 903.113ms - PrepareTime: 191.461ms - ExecTreePrepareTime: 202.036us KuduTableSink:(Total: 11.773us, non-child: 11.773us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 903.312ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.58 GB (79010209792) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 4m41s - CumulativeAllocationBytes: 73.58 GB (79010201600) - CumulativeAllocations: 37.67K (37675) - PeakReservation: 73.58 GB (79010201600) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.58 GB (79010201600) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 36m58s, non-child: 18s371ms, % non-child: 0.83%) - ConvertRowBatchTime: 7s912ms - PeakMemoryUsage: 19.53 MB (20481411) - RowsReturned: 288.55M (288552264) - RowsReturnedRate: 130.08 K/sec Buffer pool: - AllocTime: 18m51s - CumulativeAllocationBytes: 131.04 GB (140703580160) - CumulativeAllocations: 6.87M (6870292) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.85 GB, 13.36 GB, 19.81 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.19 GB, 41.51 GB, 42.80 GB, 44.05 GB, 45.26 GB, 46.42 GB, 47.50 GB, 48.59 GB, 49.68 GB, 50.74 GB, 51.74 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.19 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.57 GB, 69.38 GB, 70.22 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.37 GB - FirstBatchArrivalWaitTime: 903.039ms - TotalBytesReceived: 74.38 GB (79867089317) - TotalGetBatchTime: 36m47s - DataArrivalTimer: 36m40s SenderSide: - DeserializeRowBatchTime: 22m36s - NumBatchesArrived: 3.44M (3435146) - NumBatchesDeferred: 73.95K (73949) - NumBatchesEnqueued: 3.44M (3435146) - NumBatchesReceived: 3.44M (3435146) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 62.391ms, non-child: 62.391ms, % non-child: 100.00%) - CodegenTime: 1.062ms - CompileTime: 4.764ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.688ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.238ms Instance 844a0200d7876345:20bb38b9000000d2 (host=vc1538.foo.com:22000):(Total: 1s206ms, non-child: 241.319ms, % non-child: 20.01%) Fragment Instance Lifecycle Event Timeline: 1s206ms - Prepare Finished: 240.497ms (240.497ms) - Open Finished: 1s206ms (965.994ms) MemoryUsage(1m4s): 4.35 GB, 12.01 GB, 17.83 GB, 21.55 GB, 24.25 GB, 26.56 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.76 GB, 35.04 GB, 36.17 GB, 37.35 GB, 38.51 GB, 39.64 GB, 40.72 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.70 GB, 45.65 GB, 46.55 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.55 GB, 51.43 GB, 52.30 GB, 53.13 GB, 53.98 GB, 54.82 GB, 55.63 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.13 GB, 60.96 GB, 61.70 GB, 62.42 GB, 63.17 GB, 63.90 GB, 64.61 GB, 65.30 GB, 66.00 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.90 GB (71835926966) - PeakReservation: 66.87 GB (71795998720) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.14 GB (86048973071) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m24s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 965.963ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 54.992ms - TotalThreadsVoluntaryContextSwitches: 18 (18) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 965.967ms - ExecTreeOpenTime: 907.770ms - PrepareTime: 240.233ms - ExecTreePrepareTime: 194.336us KuduTableSink:(Total: 12.657us, non-child: 12.657us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 907.961ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.87 GB (71796006912) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m25s - CumulativeAllocationBytes: 66.87 GB (71795998720) - CumulativeAllocations: 34.23K (34235) - PeakReservation: 66.87 GB (71795998720) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.87 GB (71795998720) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m33s, non-child: 16s975ms, % non-child: 0.72%) - ConvertRowBatchTime: 7s362ms - PeakMemoryUsage: 19.53 MB (20481636) - RowsReturned: 262.21M (262210452) - RowsReturnedRate: 110.45 K/sec Buffer pool: - AllocTime: 10m25s - CumulativeAllocationBytes: 119.08 GB (127858810880) - CumulativeAllocations: 6.24M (6243106) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.43 GB, 12.16 GB, 18.01 GB, 21.77 GB, 24.49 GB, 26.83 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.10 GB, 35.39 GB, 36.53 GB, 37.73 GB, 38.90 GB, 40.04 GB, 41.13 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.11 GB, 47.03 GB, 48.12 GB, 49.09 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.76 GB, 61.59 GB, 62.33 GB, 63.07 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 907.680ms - TotalBytesReceived: 67.59 GB (72576217932) - TotalGetBatchTime: 39m23s - DataArrivalTimer: 39m17s SenderSide: - DeserializeRowBatchTime: 13m34s - NumBatchesArrived: 3.12M (3121553) - NumBatchesDeferred: 8.73K (8730) - NumBatchesEnqueued: 3.12M (3121553) - NumBatchesReceived: 3.12M (3121553) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 56.967ms, non-child: 56.967ms, % non-child: 100.00%) - CodegenTime: 957.235us - CompileTime: 5.082ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 27.097ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.235ms Instance 844a0200d7876345:20bb38b9000000fd (host=vc1539.foo.com:22000):(Total: 1s256ms, non-child: 207.024ms, % non-child: 16.48%) Fragment Instance Lifecycle Event Timeline: 1s256ms - Prepare Finished: 206.294ms (206.294ms) - Open Finished: 1s256ms (1s050ms) MemoryUsage(1m4s): 4.39 GB, 12.04 GB, 17.84 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.04 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.70 GB, 45.65 GB, 46.55 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.55 GB, 51.43 GB, 52.29 GB, 53.13 GB, 53.98 GB, 54.82 GB, 55.63 GB, 56.46 GB, 57.31 GB, 58.31 GB, 59.18 GB, 60.13 GB, 60.96 GB, 61.69 GB, 62.42 GB, 63.17 GB, 63.90 GB, 64.61 GB, 65.30 GB, 66.00 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.94 GB (71877870006) - PeakReservation: 66.90 GB (71837941760) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.42 GB (86354967689) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m5s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s050ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 62.991ms - TotalThreadsVoluntaryContextSwitches: 18 (18) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s050ms - ExecTreeOpenTime: 986.615ms - PrepareTime: 205.862ms - ExecTreePrepareTime: 150.477us KuduTableSink:(Total: 12.843us, non-child: 12.843us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 986.762ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.90 GB (71837949952) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m53s - CumulativeAllocationBytes: 66.90 GB (71837941760) - CumulativeAllocations: 34.26K (34255) - PeakReservation: 66.90 GB (71837941760) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.90 GB (71837941760) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m14s, non-child: 17s328ms, % non-child: 0.76%) - ConvertRowBatchTime: 7s569ms - PeakMemoryUsage: 19.53 MB (20482789) - RowsReturned: 262.36M (262362408) - RowsReturnedRate: 114.33 K/sec Buffer pool: - AllocTime: 18m5s - CumulativeAllocationBytes: 119.15 GB (127932948480) - CumulativeAllocations: 6.25M (6246726) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.40 GB, 12.13 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.50 GB, 34.10 GB, 35.39 GB, 36.53 GB, 37.72 GB, 38.90 GB, 40.03 GB, 41.13 GB, 42.18 GB, 43.16 GB, 44.15 GB, 45.15 GB, 46.11 GB, 47.02 GB, 48.11 GB, 49.08 GB, 50.12 GB, 51.06 GB, 51.95 GB, 52.82 GB, 53.67 GB, 54.53 GB, 55.38 GB, 56.20 GB, 57.04 GB, 57.89 GB, 58.91 GB, 59.79 GB, 60.75 GB, 61.58 GB, 62.33 GB, 63.06 GB, 63.82 GB, 64.55 GB, 65.27 GB, 65.97 GB, 66.68 GB - FirstBatchArrivalWaitTime: 986.536ms - TotalBytesReceived: 67.63 GB (72618071124) - TotalGetBatchTime: 38m4s - DataArrivalTimer: 37m57s SenderSide: - DeserializeRowBatchTime: 21m21s - NumBatchesArrived: 3.12M (3123364) - NumBatchesDeferred: 30.62K (30618) - NumBatchesEnqueued: 3.12M (3123363) - NumBatchesReceived: 3.12M (3123364) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 62.296ms, non-child: 62.296ms, % non-child: 100.00%) - CodegenTime: 1.050ms - CompileTime: 6.016ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.564ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.016ms Instance 844a0200d7876345:20bb38b9000000d8 (host=vc1540.foo.com:22000):(Total: 1s215ms, non-child: 222.983ms, % non-child: 18.35%) Fragment Instance Lifecycle Event Timeline: 1s215ms - Prepare Finished: 222.156ms (222.156ms) - Open Finished: 1s215ms (993.508ms) MemoryUsage(1m4s): 4.40 GB, 12.05 GB, 17.85 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.19 GB, 33.77 GB, 35.04 GB, 36.17 GB, 37.35 GB, 38.52 GB, 39.64 GB, 40.72 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.70 GB, 45.65 GB, 46.55 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.56 GB, 51.43 GB, 52.30 GB, 53.13 GB, 53.99 GB, 54.82 GB, 55.64 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.14 GB, 60.96 GB, 61.70 GB, 62.42 GB, 63.18 GB, 63.90 GB, 64.61 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.76 GB (71680737718) - PeakReservation: 66.72 GB (71640809472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.20 GB (86112904299) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 40m2s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 993.491ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 53.992ms - TotalThreadsVoluntaryContextSwitches: 26 (26) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 993.495ms - ExecTreeOpenTime: 938.361ms - PrepareTime: 221.746ms - ExecTreePrepareTime: 169.535us KuduTableSink:(Total: 12.004us, non-child: 12.004us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 938.528ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.72 GB (71640817664) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 1m47s - CumulativeAllocationBytes: 66.72 GB (71640809472) - CumulativeAllocations: 34.16K (34161) - PeakReservation: 66.72 GB (71640809472) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.72 GB (71640809472) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 40m11s, non-child: 16s446ms, % non-child: 0.68%) - ConvertRowBatchTime: 7s253ms - PeakMemoryUsage: 19.49 MB (20437985) - RowsReturned: 261.64M (261644628) - RowsReturnedRate: 108.48 K/sec Buffer pool: - AllocTime: 7m2s - CumulativeAllocationBytes: 118.82 GB (127582904320) - CumulativeAllocations: 6.23M (6229634) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.42 GB, 12.14 GB, 18.00 GB, 21.75 GB, 24.48 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.50 GB, 34.10 GB, 35.38 GB, 36.53 GB, 37.72 GB, 38.90 GB, 40.03 GB, 41.13 GB, 42.18 GB, 43.16 GB, 44.15 GB, 45.15 GB, 46.11 GB, 47.02 GB, 48.12 GB, 49.09 GB, 50.12 GB, 51.07 GB, 51.95 GB, 52.83 GB, 53.67 GB, 54.53 GB, 55.38 GB, 56.20 GB, 57.04 GB, 57.90 GB, 58.91 GB, 59.80 GB, 60.75 GB, 61.59 GB, 62.33 GB, 63.06 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 938.283ms - TotalBytesReceived: 67.45 GB (72419367697) - TotalGetBatchTime: 40m1s - DataArrivalTimer: 39m55s SenderSide: - DeserializeRowBatchTime: 10m8s - NumBatchesArrived: 3.11M (3114817) - NumBatchesDeferred: 1.45K (1445) - NumBatchesEnqueued: 3.11M (3114817) - NumBatchesReceived: 3.11M (3114817) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 53.773ms, non-child: 53.773ms, % non-child: 100.00%) - CodegenTime: 969.541us - CompileTime: 5.607ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 25.364ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.332ms Instance 844a0200d7876345:20bb38b9000000ab (host=vc1541.foo.com:22000):(Total: 1s204ms, non-child: 232.699ms, % non-child: 19.32%) Fragment Instance Lifecycle Event Timeline: 1s204ms - Prepare Finished: 231.849ms (231.849ms) - Open Finished: 1s204ms (973.034ms) MemoryUsage(1m4s): 4.80 GB, 13.23 GB, 19.62 GB, 23.71 GB, 26.68 GB, 29.23 GB, 31.51 GB, 33.65 GB, 35.42 GB, 37.15 GB, 38.55 GB, 39.80 GB, 41.10 GB, 42.38 GB, 43.61 GB, 44.81 GB, 45.96 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.23 GB, 51.22 GB, 52.41 GB, 53.47 GB, 54.59 GB, 55.62 GB, 56.59 GB, 57.54 GB, 58.45 GB, 59.39 GB, 60.32 GB, 61.21 GB, 62.12 GB, 63.05 GB, 64.16 GB, 65.12 GB, 66.16 GB, 67.07 GB, 67.88 GB, 68.67 GB, 69.50 GB, 70.30 GB, 71.08 GB, 71.84 GB, 72.62 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.40 GB (78813151670) - PeakReservation: 73.36 GB (78773223424) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.69 GB (93085170816) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m10s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 973.019ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 57.991ms - TotalThreadsVoluntaryContextSwitches: 19 (19) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 973.022ms - ExecTreeOpenTime: 913.847ms - PrepareTime: 231.434ms - ExecTreePrepareTime: 187.198us KuduTableSink:(Total: 12.202us, non-child: 12.202us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 914.031ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.36 GB (78773231616) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m5s - CumulativeAllocationBytes: 73.36 GB (78773223424) - CumulativeAllocations: 37.56K (37562) - PeakReservation: 73.36 GB (78773223424) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.36 GB (78773223424) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m20s, non-child: 18s664ms, % non-child: 0.81%) - ConvertRowBatchTime: 8s093ms - PeakMemoryUsage: 19.53 MB (20482278) - RowsReturned: 287.70M (287696304) - RowsReturnedRate: 125.06 K/sec Buffer pool: - AllocTime: 16m31s - CumulativeAllocationBytes: 130.65 GB (140286197760) - CumulativeAllocations: 6.85M (6849912) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.83 GB, 13.34 GB, 19.79 GB, 23.93 GB, 26.93 GB, 29.50 GB, 31.81 GB, 33.97 GB, 35.76 GB, 37.52 GB, 38.93 GB, 40.20 GB, 41.51 GB, 42.80 GB, 44.05 GB, 45.26 GB, 46.42 GB, 47.50 GB, 48.59 GB, 49.68 GB, 50.74 GB, 51.74 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.19 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.84 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.58 GB, 69.38 GB, 70.22 GB, 71.03 GB, 71.82 GB, 72.59 GB, 73.37 GB - FirstBatchArrivalWaitTime: 913.754ms - TotalBytesReceived: 74.16 GB (79629844841) - TotalGetBatchTime: 38m9s - DataArrivalTimer: 38m2s SenderSide: - DeserializeRowBatchTime: 20m34s - NumBatchesArrived: 3.42M (3424956) - NumBatchesDeferred: 33.88K (33877) - NumBatchesEnqueued: 3.42M (3424956) - NumBatchesReceived: 3.42M (3424956) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 57.776ms, non-child: 57.776ms, % non-child: 100.00%) - CodegenTime: 1.773ms - CompileTime: 5.603ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 30.823ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 20.827ms Instance 844a0200d7876345:20bb38b9000000da (host=vc1542.foo.com:22000):(Total: 1s276ms, non-child: 149.606ms, % non-child: 11.72%) Fragment Instance Lifecycle Event Timeline: 1s277ms - Prepare Finished: 148.539ms (148.539ms) - Open Finished: 1s277ms (1s128ms) MemoryUsage(1m4s): 4.36 GB, 12.02 GB, 17.83 GB, 21.55 GB, 24.26 GB, 26.56 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.04 GB, 36.17 GB, 37.35 GB, 38.51 GB, 39.63 GB, 40.72 GB, 41.76 GB, 42.73 GB, 43.71 GB, 44.70 GB, 45.65 GB, 46.55 GB, 47.63 GB, 48.59 GB, 49.62 GB, 50.55 GB, 51.43 GB, 52.29 GB, 53.13 GB, 53.98 GB, 54.82 GB, 55.63 GB, 56.46 GB, 57.31 GB, 58.31 GB, 59.19 GB, 60.13 GB, 60.96 GB, 61.69 GB, 62.42 GB, 63.17 GB, 63.90 GB, 64.61 GB, 65.30 GB, 66.00 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.77 GB (71697514934) - PeakReservation: 66.74 GB (71657586688) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.21 GB (86123608430) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 36m49s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s128ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 52.992ms - TotalThreadsVoluntaryContextSwitches: 17 (17) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s128ms - ExecTreeOpenTime: 1s071ms - PrepareTime: 148.187ms - ExecTreePrepareTime: 173.652us KuduTableSink:(Total: 49.401us, non-child: 49.401us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 1s071ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.74 GB (71657594880) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 4m46s - CumulativeAllocationBytes: 66.74 GB (71657586688) - CumulativeAllocations: 34.17K (34169) - PeakReservation: 66.74 GB (71657586688) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.74 GB (71657586688) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 36m59s, non-child: 17s734ms, % non-child: 0.80%) - ConvertRowBatchTime: 7s720ms - PeakMemoryUsage: 19.53 MB (20483562) - RowsReturned: 261.70M (261701632) - RowsReturnedRate: 117.93 K/sec Buffer pool: - AllocTime: 22m38s - CumulativeAllocationBytes: 118.85 GB (127612968960) - CumulativeAllocations: 6.23M (6231102) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.37 GB, 12.11 GB, 17.98 GB, 21.75 GB, 24.48 GB, 26.81 GB, 28.91 GB, 30.88 GB, 32.50 GB, 34.10 GB, 35.38 GB, 36.52 GB, 37.72 GB, 38.89 GB, 40.02 GB, 41.12 GB, 42.18 GB, 43.16 GB, 44.15 GB, 45.15 GB, 46.11 GB, 47.02 GB, 48.11 GB, 49.08 GB, 50.12 GB, 51.06 GB, 51.95 GB, 52.82 GB, 53.67 GB, 54.53 GB, 55.38 GB, 56.20 GB, 57.04 GB, 57.89 GB, 58.91 GB, 59.79 GB, 60.75 GB, 61.58 GB, 62.33 GB, 63.06 GB, 63.82 GB, 64.55 GB, 65.27 GB, 65.97 GB, 66.68 GB - FirstBatchArrivalWaitTime: 1s071ms - TotalBytesReceived: 67.46 GB (72436403624) - TotalGetBatchTime: 36m48s - DataArrivalTimer: 36m41s SenderSide: - DeserializeRowBatchTime: 26m35s - NumBatchesArrived: 3.12M (3115551) - NumBatchesDeferred: 67.77K (67766) - NumBatchesEnqueued: 3.12M (3115551) - NumBatchesReceived: 3.12M (3115551) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 55.186ms, non-child: 55.186ms, % non-child: 100.00%) - CodegenTime: 1.062ms - CompileTime: 5.605ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 26.037ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.011ms Instance 844a0200d7876345:20bb38b900000099 (host=vd1101.foo.com:22000):(Total: 1s216ms, non-child: 234.721ms, % non-child: 19.29%) Fragment Instance Lifecycle Event Timeline: 1s216ms - Prepare Finished: 233.815ms (233.815ms) - Open Finished: 1s216ms (983.052ms) MemoryUsage(1m4s): 4.79 GB, 13.21 GB, 19.61 GB, 23.70 GB, 26.68 GB, 29.22 GB, 31.50 GB, 33.64 GB, 35.41 GB, 37.14 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.95 GB, 47.01 GB, 48.09 GB, 49.17 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.58 GB, 55.61 GB, 56.58 GB, 57.53 GB, 58.44 GB, 59.38 GB, 60.31 GB, 61.20 GB, 62.11 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.66 GB, 69.49 GB, 70.29 GB, 71.07 GB, 71.83 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.39 GB (78804763062) - PeakReservation: 73.36 GB (78764834816) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.82 GB (93223963768) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m3s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 983.035ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 58.991ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 983.038ms - ExecTreeOpenTime: 919.418ms - PrepareTime: 233.481ms - ExecTreePrepareTime: 141.339us KuduTableSink:(Total: 12.028us, non-child: 12.028us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 919.557ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.36 GB (78764843008) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m8s - CumulativeAllocationBytes: 73.36 GB (78764834816) - CumulativeAllocations: 37.56K (37558) - PeakReservation: 73.36 GB (78764834816) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.36 GB (78764834816) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m13s, non-child: 17s924ms, % non-child: 0.78%) - ConvertRowBatchTime: 7s896ms - PeakMemoryUsage: 19.53 MB (20481172) - RowsReturned: 287.66M (287661108) - RowsReturnedRate: 125.43 K/sec Buffer pool: - AllocTime: 10m21s - CumulativeAllocationBytes: 130.64 GB (140269035520) - CumulativeAllocations: 6.85M (6849074) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.88 GB, 13.38 GB, 19.82 GB, 23.95 GB, 26.95 GB, 29.52 GB, 31.83 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.19 GB, 41.51 GB, 42.80 GB, 44.05 GB, 45.26 GB, 46.42 GB, 47.49 GB, 48.58 GB, 49.68 GB, 50.73 GB, 51.74 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.57 GB, 69.38 GB, 70.22 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.37 GB - FirstBatchArrivalWaitTime: 919.306ms - TotalBytesReceived: 74.15 GB (79620354083) - TotalGetBatchTime: 38m2s - DataArrivalTimer: 37m55s SenderSide: - DeserializeRowBatchTime: 13m46s - NumBatchesArrived: 3.42M (3424537) - NumBatchesDeferred: 17.13K (17129) - NumBatchesEnqueued: 3.42M (3424537) - NumBatchesReceived: 3.42M (3424537) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 62.296ms, non-child: 62.296ms, % non-child: 100.00%) - CodegenTime: 1.062ms - CompileTime: 5.406ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 29.805ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 26.480ms Instance 844a0200d7876345:20bb38b9000000d5 (host=vd1102.foo.com:22000):(Total: 1s195ms, non-child: 216.758ms, % non-child: 18.13%) Fragment Instance Lifecycle Event Timeline: 1s196ms - Prepare Finished: 215.844ms (215.844ms) - Open Finished: 1s196ms (980.158ms) MemoryUsage(1m4s): 4.38 GB, 12.03 GB, 17.83 GB, 21.55 GB, 24.25 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.19 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.13 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.13 GB, 60.96 GB, 61.70 GB, 62.42 GB, 63.17 GB, 63.90 GB, 64.61 GB, 65.30 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.78 GB (71705903542) - PeakReservation: 66.74 GB (71665975296) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.15 GB (86065631617) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m24s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 980.140ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 58.991ms - TotalThreadsVoluntaryContextSwitches: 12 (12) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 980.144ms - ExecTreeOpenTime: 919.482ms - PrepareTime: 215.558ms - ExecTreePrepareTime: 193.774us KuduTableSink:(Total: 14.079us, non-child: 14.079us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 919.673ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.74 GB (71665983488) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m23s - CumulativeAllocationBytes: 66.74 GB (71665975296) - CumulativeAllocations: 34.17K (34173) - PeakReservation: 66.74 GB (71665975296) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.74 GB (71665975296) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m34s, non-child: 17s516ms, % non-child: 0.74%) - ConvertRowBatchTime: 7s765ms - PeakMemoryUsage: 19.53 MB (20482301) - RowsReturned: 261.74M (261739968) - RowsReturnedRate: 110.23 K/sec Buffer pool: - AllocTime: 9m50s - CumulativeAllocationBytes: 118.86 GB (127629393920) - CumulativeAllocations: 6.23M (6231904) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.40 GB, 12.13 GB, 18.00 GB, 21.75 GB, 24.49 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.10 GB, 35.39 GB, 36.53 GB, 37.73 GB, 38.90 GB, 40.04 GB, 41.13 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.15 GB, 46.11 GB, 47.03 GB, 48.12 GB, 49.09 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.67 GB, 54.54 GB, 55.38 GB, 56.20 GB, 57.04 GB, 57.90 GB, 58.91 GB, 59.80 GB, 60.75 GB, 61.59 GB, 62.33 GB, 63.06 GB, 63.82 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 919.367ms - TotalBytesReceived: 67.47 GB (72445877791) - TotalGetBatchTime: 39m23s - DataArrivalTimer: 39m17s SenderSide: - DeserializeRowBatchTime: 13m10s - NumBatchesArrived: 3.12M (3115952) - NumBatchesDeferred: 5.04K (5040) - NumBatchesEnqueued: 3.12M (3115952) - NumBatchesReceived: 3.12M (3115952) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 59.319ms, non-child: 59.319ms, % non-child: 100.00%) - CodegenTime: 1.069ms - CompileTime: 4.796ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.757ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 25.209ms Instance 844a0200d7876345:20bb38b900000097 (host=vd1103.foo.com:22000):(Total: 1s178ms, non-child: 206.346ms, % non-child: 17.51%) Fragment Instance Lifecycle Event Timeline: 1s179ms - Prepare Finished: 205.630ms (205.630ms) - Open Finished: 1s179ms (973.386ms) MemoryUsage(1m4s): 4.79 GB, 13.21 GB, 19.61 GB, 23.70 GB, 26.68 GB, 29.22 GB, 31.50 GB, 33.63 GB, 35.40 GB, 37.14 GB, 38.54 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.95 GB, 47.01 GB, 48.09 GB, 49.18 GB, 50.22 GB, 51.22 GB, 52.41 GB, 53.46 GB, 54.59 GB, 55.62 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.12 GB, 63.05 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.67 GB, 69.50 GB, 70.29 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.66 GB (79087878582) - PeakReservation: 73.62 GB (79047950336) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.91 GB (93318090286) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m38s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 973.361ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 62.990ms - TotalThreadsVoluntaryContextSwitches: 6 (6) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 973.364ms - ExecTreeOpenTime: 910.365ms - PrepareTime: 205.209ms - ExecTreePrepareTime: 163.162us KuduTableSink:(Total: 17.430us, non-child: 17.430us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 910.526ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.62 GB (79047958528) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m4s - CumulativeAllocationBytes: 73.62 GB (79047950336) - CumulativeAllocations: 37.69K (37693) - PeakReservation: 73.62 GB (79047950336) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.62 GB (79047950336) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m48s, non-child: 17s555ms, % non-child: 0.75%) - ConvertRowBatchTime: 7s664ms - PeakMemoryUsage: 19.53 MB (20480780) - RowsReturned: 288.69M (288690176) - RowsReturnedRate: 123.96 K/sec Buffer pool: - AllocTime: 12m8s - CumulativeAllocationBytes: 131.11 GB (140773376000) - CumulativeAllocations: 6.87M (6873700) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.88 GB, 13.38 GB, 19.82 GB, 23.95 GB, 26.95 GB, 29.52 GB, 31.82 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.20 GB, 41.51 GB, 42.80 GB, 44.05 GB, 45.26 GB, 46.42 GB, 47.50 GB, 48.59 GB, 49.68 GB, 50.74 GB, 51.74 GB, 52.95 GB, 54.01 GB, 55.15 GB, 56.19 GB, 57.17 GB, 58.13 GB, 59.06 GB, 60.01 GB, 60.94 GB, 61.84 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.58 GB, 69.38 GB, 70.22 GB, 71.03 GB, 71.82 GB, 72.59 GB, 73.37 GB - FirstBatchArrivalWaitTime: 910.276ms - TotalBytesReceived: 74.42 GB (79906671549) - TotalGetBatchTime: 38m38s - DataArrivalTimer: 38m31s SenderSide: - DeserializeRowBatchTime: 15m37s - NumBatchesArrived: 3.44M (3436850) - NumBatchesDeferred: 18.86K (18863) - NumBatchesEnqueued: 3.44M (3436850) - NumBatchesReceived: 3.44M (3436850) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 61.744ms, non-child: 61.744ms, % non-child: 100.00%) - CodegenTime: 1.345ms - CompileTime: 5.126ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 31.960ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.966ms Instance 844a0200d7876345:20bb38b9000000f1 (host=vd1104.foo.com:22000):(Total: 1s227ms, non-child: 228.914ms, % non-child: 18.64%) Fragment Instance Lifecycle Event Timeline: 1s228ms - Prepare Finished: 228.153ms (228.153ms) - Open Finished: 1s228ms (1s000ms) MemoryUsage(1m4s): 4.40 GB, 12.05 GB, 17.85 GB, 21.57 GB, 24.27 GB, 26.58 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.53 GB, 39.65 GB, 40.73 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.57 GB, 51.44 GB, 52.31 GB, 53.14 GB, 54.00 GB, 54.84 GB, 55.65 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.15 GB, 60.98 GB, 61.71 GB, 62.44 GB, 63.19 GB, 63.92 GB, 64.63 GB, 65.32 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.74 GB (71657669046) - PeakReservation: 66.70 GB (71617740800) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.17 GB (86081888050) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m49s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s000ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 58.991ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s000ms - ExecTreeOpenTime: 937.996ms - PrepareTime: 227.705ms - ExecTreePrepareTime: 190.384us KuduTableSink:(Total: 12.425us, non-child: 12.425us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 938.184ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.70 GB (71617748992) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m53s - CumulativeAllocationBytes: 66.70 GB (71617740800) - CumulativeAllocations: 34.15K (34150) - PeakReservation: 66.70 GB (71617740800) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.70 GB (71617740800) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m58s, non-child: 16s675ms, % non-child: 0.73%) - ConvertRowBatchTime: 7s294ms - PeakMemoryUsage: 19.54 MB (20484183) - RowsReturned: 261.56M (261555084) - RowsReturnedRate: 114.78 K/sec Buffer pool: - AllocTime: 19m35s - CumulativeAllocationBytes: 118.78 GB (127539240960) - CumulativeAllocations: 6.23M (6227502) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.42 GB, 12.15 GB, 18.01 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.11 GB, 35.39 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 937.935ms - TotalBytesReceived: 67.42 GB (72394667569) - TotalGetBatchTime: 37m48s - DataArrivalTimer: 37m42s SenderSide: - DeserializeRowBatchTime: 22m53s - NumBatchesArrived: 3.11M (3113751) - NumBatchesDeferred: 35.74K (35737) - NumBatchesEnqueued: 3.11M (3113751) - NumBatchesReceived: 3.11M (3113751) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 60.691ms, non-child: 60.691ms, % non-child: 100.00%) - CodegenTime: 1.142ms - CompileTime: 5.152ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 31.613ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.178ms Instance 844a0200d7876345:20bb38b900000088 (host=vd1105.foo.com:22000):(Total: 1s237ms, non-child: 217.804ms, % non-child: 17.60%) Fragment Instance Lifecycle Event Timeline: 1s238ms - Prepare Finished: 217.159ms (217.159ms) - Open Finished: 1s238ms (1s021ms) MemoryUsage(1m4s): 4.81 GB, 13.23 GB, 19.62 GB, 23.71 GB, 26.68 GB, 29.22 GB, 31.51 GB, 33.64 GB, 35.41 GB, 37.14 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.95 GB, 47.01 GB, 48.09 GB, 49.17 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.58 GB, 55.61 GB, 56.57 GB, 57.52 GB, 58.44 GB, 59.38 GB, 60.30 GB, 61.19 GB, 62.11 GB, 63.04 GB, 64.14 GB, 65.10 GB, 66.14 GB, 67.05 GB, 67.86 GB, 68.66 GB, 69.48 GB, 70.28 GB, 71.07 GB, 71.82 GB, 72.60 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.66 GB (79087878582) - PeakReservation: 73.62 GB (79047950336) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.99 GB (93403324670) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m26s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s021ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 60.991ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s021ms - ExecTreeOpenTime: 957.573ms - PrepareTime: 216.621ms - ExecTreePrepareTime: 179.042us KuduTableSink:(Total: 13.281us, non-child: 13.281us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 957.749ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.62 GB (79047958528) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m3s - CumulativeAllocationBytes: 73.62 GB (79047950336) - CumulativeAllocations: 37.69K (37693) - PeakReservation: 73.62 GB (79047950336) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.62 GB (79047950336) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m36s, non-child: 18s115ms, % non-child: 0.78%) - ConvertRowBatchTime: 7s941ms - PeakMemoryUsage: 19.53 MB (20481255) - RowsReturned: 288.69M (288689856) - RowsReturnedRate: 124.60 K/sec Buffer pool: - AllocTime: 14m19s - CumulativeAllocationBytes: 131.10 GB (140770713600) - CumulativeAllocations: 6.87M (6873570) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.82 GB, 13.33 GB, 19.79 GB, 23.93 GB, 26.93 GB, 29.50 GB, 31.81 GB, 33.97 GB, 35.75 GB, 37.51 GB, 38.92 GB, 40.19 GB, 41.50 GB, 42.79 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.57 GB, 49.67 GB, 50.72 GB, 51.73 GB, 52.93 GB, 54.00 GB, 55.14 GB, 56.17 GB, 57.15 GB, 58.11 GB, 59.04 GB, 59.99 GB, 60.92 GB, 61.82 GB, 62.74 GB, 63.68 GB, 64.80 GB, 65.77 GB, 66.82 GB, 67.74 GB, 68.56 GB, 69.37 GB, 70.20 GB, 71.01 GB, 71.80 GB, 72.57 GB, 73.35 GB - FirstBatchArrivalWaitTime: 957.511ms - TotalBytesReceived: 74.42 GB (79905383747) - TotalGetBatchTime: 38m25s - DataArrivalTimer: 38m19s SenderSide: - DeserializeRowBatchTime: 17m46s - NumBatchesArrived: 3.44M (3436785) - NumBatchesDeferred: 27.91K (27905) - NumBatchesEnqueued: 3.44M (3436785) - NumBatchesReceived: 3.44M (3436785) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 62.276ms, non-child: 62.276ms, % non-child: 100.00%) - CodegenTime: 960.813us - CompileTime: 5.728ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 31.864ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.176ms Instance 844a0200d7876345:20bb38b90000008e (host=vd1107.foo.com:22000):(Total: 1s218ms, non-child: 234.602ms, % non-child: 19.25%) Fragment Instance Lifecycle Event Timeline: 1s219ms - Prepare Finished: 233.783ms (233.783ms) - Open Finished: 1s219ms (985.559ms) MemoryUsage(1m4s): 4.81 GB, 13.23 GB, 19.62 GB, 23.71 GB, 26.68 GB, 29.23 GB, 31.51 GB, 33.65 GB, 35.41 GB, 37.15 GB, 38.55 GB, 39.80 GB, 41.10 GB, 42.38 GB, 43.61 GB, 44.81 GB, 45.95 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.23 GB, 51.22 GB, 52.41 GB, 53.47 GB, 54.59 GB, 55.62 GB, 56.59 GB, 57.54 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.21 GB, 62.12 GB, 63.05 GB, 64.16 GB, 65.12 GB, 66.16 GB, 67.07 GB, 67.88 GB, 68.68 GB, 69.50 GB, 70.30 GB, 71.08 GB, 71.84 GB, 72.62 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.52 GB (78945272246) - PeakReservation: 73.49 GB (78905344000) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.86 GB (93268703787) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m29s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 985.528ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 52.992ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 985.532ms - ExecTreeOpenTime: 928.739ms - PrepareTime: 233.331ms - ExecTreePrepareTime: 156.815us KuduTableSink:(Total: 12.736us, non-child: 12.736us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 928.893ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.49 GB (78905352192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 4m7s - CumulativeAllocationBytes: 73.49 GB (78905344000) - CumulativeAllocations: 37.62K (37625) - PeakReservation: 73.49 GB (78905344000) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.49 GB (78905344000) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m39s, non-child: 18s102ms, % non-child: 0.80%) - ConvertRowBatchTime: 7s730ms - PeakMemoryUsage: 19.53 MB (20481898) - RowsReturned: 288.17M (288173056) - RowsReturnedRate: 127.52 K/sec Buffer pool: - AllocTime: 15m46s - CumulativeAllocationBytes: 130.87 GB (140520775680) - CumulativeAllocations: 6.86M (6861366) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.90 GB, 13.39 GB, 19.83 GB, 23.96 GB, 26.96 GB, 29.52 GB, 31.83 GB, 33.99 GB, 35.77 GB, 37.53 GB, 38.94 GB, 40.20 GB, 41.52 GB, 42.81 GB, 44.06 GB, 45.26 GB, 46.42 GB, 47.50 GB, 48.59 GB, 49.69 GB, 50.74 GB, 51.75 GB, 52.95 GB, 54.02 GB, 55.16 GB, 56.19 GB, 57.17 GB, 58.13 GB, 59.06 GB, 60.01 GB, 60.94 GB, 61.84 GB, 62.77 GB, 63.71 GB, 64.83 GB, 65.80 GB, 66.85 GB, 67.77 GB, 68.58 GB, 69.39 GB, 70.23 GB, 71.03 GB, 71.83 GB, 72.59 GB, 73.38 GB - FirstBatchArrivalWaitTime: 928.640ms - TotalBytesReceived: 74.29 GB (79763583348) - TotalGetBatchTime: 37m29s - DataArrivalTimer: 37m22s SenderSide: - DeserializeRowBatchTime: 19m24s - NumBatchesArrived: 3.43M (3430683) - NumBatchesDeferred: 136.49K (136493) - NumBatchesEnqueued: 3.43M (3430683) - NumBatchesReceived: 3.43M (3430683) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 55.414ms, non-child: 55.414ms, % non-child: 100.00%) - CodegenTime: 1.234ms - CompileTime: 5.395ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 30.342ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 19.061ms Instance 844a0200d7876345:20bb38b9000000b9 (host=vd1108.foo.com:22000):(Total: 1s212ms, non-child: 225.516ms, % non-child: 18.60%) Fragment Instance Lifecycle Event Timeline: 1s212ms - Prepare Finished: 224.856ms (224.856ms) - Open Finished: 1s212ms (988.043ms) MemoryUsage(1m4s): 4.39 GB, 12.05 GB, 17.85 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.19 GB, 33.77 GB, 35.04 GB, 36.17 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.72 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.70 GB, 45.65 GB, 46.55 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.55 GB, 51.43 GB, 52.30 GB, 53.13 GB, 53.99 GB, 54.82 GB, 55.63 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.13 GB, 60.96 GB, 61.70 GB, 62.42 GB, 63.18 GB, 63.90 GB, 64.61 GB, 65.30 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.98 GB (71917715894) - PeakReservation: 66.94 GB (71877787648) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.30 GB (86223754414) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m58s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 988.033ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 57.991ms - TotalThreadsVoluntaryContextSwitches: 8 (8) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 988.035ms - ExecTreeOpenTime: 927.989ms - PrepareTime: 224.469ms - ExecTreePrepareTime: 177.790us KuduTableSink:(Total: 13.010us, non-child: 13.010us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 928.164ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.94 GB (71877795840) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m53s - CumulativeAllocationBytes: 66.94 GB (71877787648) - CumulativeAllocations: 34.27K (34274) - PeakReservation: 66.94 GB (71877787648) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.94 GB (71877787648) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m7s, non-child: 17s248ms, % non-child: 0.75%) - ConvertRowBatchTime: 7s482ms - PeakMemoryUsage: 19.54 MB (20484258) - RowsReturned: 262.50M (262504956) - RowsReturnedRate: 114.74 K/sec Buffer pool: - AllocTime: 24m26s - CumulativeAllocationBytes: 119.21 GB (128002416640) - CumulativeAllocations: 6.25M (6250118) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.41 GB, 12.14 GB, 18.00 GB, 21.76 GB, 24.48 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.50 GB, 34.10 GB, 35.39 GB, 36.53 GB, 37.72 GB, 38.90 GB, 40.03 GB, 41.13 GB, 42.18 GB, 43.16 GB, 44.16 GB, 45.15 GB, 46.11 GB, 47.02 GB, 48.12 GB, 49.09 GB, 50.12 GB, 51.07 GB, 51.95 GB, 52.83 GB, 53.67 GB, 54.53 GB, 55.38 GB, 56.20 GB, 57.04 GB, 57.90 GB, 58.91 GB, 59.80 GB, 60.75 GB, 61.59 GB, 62.33 GB, 63.06 GB, 63.82 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 927.930ms - TotalBytesReceived: 67.67 GB (72657589162) - TotalGetBatchTime: 37m57s - DataArrivalTimer: 37m50s SenderSide: - DeserializeRowBatchTime: 27m56s - NumBatchesArrived: 3.13M (3125059) - NumBatchesDeferred: 39.33K (39328) - NumBatchesEnqueued: 3.13M (3125059) - NumBatchesReceived: 3.13M (3125059) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 58.880ms, non-child: 58.880ms, % non-child: 100.00%) - CodegenTime: 1.219ms - CompileTime: 5.293ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.301ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 20.766ms Instance 844a0200d7876345:20bb38b9000000be (host=vd1109.foo.com:22000):(Total: 1s204ms, non-child: 230.700ms, % non-child: 19.16%) Fragment Instance Lifecycle Event Timeline: 1s204ms - Prepare Finished: 230.028ms (230.028ms) - Open Finished: 1s204ms (974.595ms) MemoryUsage(1m4s): 4.38 GB, 12.04 GB, 17.84 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.19 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.65 GB, 40.73 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.31 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.85 GB (71779303862) - PeakReservation: 66.81 GB (71739375616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.12 GB (86027261828) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m49s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 974.576ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 50.992ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 974.580ms - ExecTreeOpenTime: 921.709ms - PrepareTime: 229.607ms - ExecTreePrepareTime: 168.593us KuduTableSink:(Total: 12.983us, non-child: 12.983us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 921.874ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.81 GB (71739383808) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 1m51s - CumulativeAllocationBytes: 66.81 GB (71739375616) - CumulativeAllocations: 34.21K (34208) - PeakReservation: 66.81 GB (71739375616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.81 GB (71739375616) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m59s, non-child: 17s001ms, % non-child: 0.71%) - ConvertRowBatchTime: 7s398ms - PeakMemoryUsage: 19.53 MB (20482463) - RowsReturned: 262.00M (262000536) - RowsReturnedRate: 109.21 K/sec Buffer pool: - AllocTime: 8m35s - CumulativeAllocationBytes: 118.98 GB (127756451840) - CumulativeAllocations: 6.24M (6238108) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.39 GB, 12.13 GB, 17.99 GB, 21.75 GB, 24.48 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.50 GB, 34.10 GB, 35.39 GB, 36.53 GB, 37.73 GB, 38.90 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.84 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.29 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 921.615ms - TotalBytesReceived: 67.54 GB (72518013768) - TotalGetBatchTime: 39m48s - DataArrivalTimer: 39m42s SenderSide: - DeserializeRowBatchTime: 11m45s - NumBatchesArrived: 3.12M (3119054) - NumBatchesDeferred: 10.23K (10232) - NumBatchesEnqueued: 3.12M (3119054) - NumBatchesReceived: 3.12M (3119054) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 51.668ms, non-child: 51.668ms, % non-child: 100.00%) - CodegenTime: 848.154us - CompileTime: 4.082ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 25.897ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 21.208ms Instance 844a0200d7876345:20bb38b900000089 (host=vd1110.foo.com:22000):(Total: 1s233ms, non-child: 214.195ms, % non-child: 17.37%) Fragment Instance Lifecycle Event Timeline: 1s234ms - Prepare Finished: 213.602ms (213.602ms) - Open Finished: 1s234ms (1s020ms) MemoryUsage(1m4s): 4.83 GB, 13.24 GB, 19.62 GB, 23.72 GB, 26.69 GB, 29.23 GB, 31.51 GB, 33.65 GB, 35.42 GB, 37.15 GB, 38.55 GB, 39.80 GB, 41.10 GB, 42.38 GB, 43.61 GB, 44.81 GB, 45.95 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.23 GB, 51.22 GB, 52.41 GB, 53.47 GB, 54.59 GB, 55.62 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.12 GB, 63.05 GB, 64.16 GB, 65.12 GB, 66.16 GB, 67.07 GB, 67.87 GB, 68.67 GB, 69.50 GB, 70.30 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.46 GB (78880260534) - PeakReservation: 73.43 GB (78840332288) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.76 GB (93156029794) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m10s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s020ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s020ms - ExecTreeOpenTime: 956.328ms - PrepareTime: 212.914ms - ExecTreePrepareTime: 148.119us KuduTableSink:(Total: 15.760us, non-child: 15.760us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 956.473ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.43 GB (78840340480) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m12s - CumulativeAllocationBytes: 73.43 GB (78840332288) - CumulativeAllocations: 37.59K (37594) - PeakReservation: 73.43 GB (78840332288) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.43 GB (78840332288) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m20s, non-child: 18s274ms, % non-child: 0.79%) - ConvertRowBatchTime: 7s893ms - PeakMemoryUsage: 19.53 MB (20481380) - RowsReturned: 287.93M (287932848) - RowsReturnedRate: 125.15 K/sec Buffer pool: - AllocTime: 21m26s - CumulativeAllocationBytes: 130.76 GB (140401541120) - CumulativeAllocations: 6.86M (6855544) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.85 GB, 13.36 GB, 19.80 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.98 GB, 35.76 GB, 37.52 GB, 38.93 GB, 40.19 GB, 41.51 GB, 42.80 GB, 44.05 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.68 GB, 50.73 GB, 51.74 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.57 GB, 69.38 GB, 70.22 GB, 71.02 GB, 71.82 GB, 72.58 GB, 73.37 GB - FirstBatchArrivalWaitTime: 956.211ms - TotalBytesReceived: 74.22 GB (79695923968) - TotalGetBatchTime: 38m9s - DataArrivalTimer: 38m2s SenderSide: - DeserializeRowBatchTime: 25m20s - NumBatchesArrived: 3.43M (3427772) - NumBatchesDeferred: 30.91K (30910) - NumBatchesEnqueued: 3.43M (3427772) - NumBatchesReceived: 3.43M (3427772) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 62.780ms, non-child: 62.780ms, % non-child: 100.00%) - CodegenTime: 1.478ms - CompileTime: 5.559ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.392ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.124ms Instance 844a0200d7876345:20bb38b9000000bb (host=vd1111.foo.com:22000):(Total: 1s184ms, non-child: 202.691ms, % non-child: 17.12%) Fragment Instance Lifecycle Event Timeline: 1s184ms - Prepare Finished: 201.875ms (201.875ms) - Open Finished: 1s184ms (982.535ms) MemoryUsage(1m4s): 4.39 GB, 12.05 GB, 17.85 GB, 21.57 GB, 24.27 GB, 26.58 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.19 GB, 37.37 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.72 GB, 45.67 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.57 GB, 51.44 GB, 52.31 GB, 53.14 GB, 54.00 GB, 54.83 GB, 55.65 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.15 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.19 GB, 63.91 GB, 64.62 GB, 65.32 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.71 GB (71634600374) - PeakReservation: 66.68 GB (71594672128) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.14 GB (86050043469) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m52s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 982.519ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 45.993ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 982.522ms - ExecTreeOpenTime: 935.672ms - PrepareTime: 201.622ms - ExecTreePrepareTime: 184.348us KuduTableSink:(Total: 12.532us, non-child: 12.532us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 935.854ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.68 GB (71594680320) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m56s - CumulativeAllocationBytes: 66.68 GB (71594672128) - CumulativeAllocations: 34.14K (34139) - PeakReservation: 66.68 GB (71594672128) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.68 GB (71594672128) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m1s, non-child: 16s354ms, % non-child: 0.70%) - ConvertRowBatchTime: 7s242ms - PeakMemoryUsage: 19.53 MB (20483529) - RowsReturned: 261.48M (261479400) - RowsReturnedRate: 111.68 K/sec Buffer pool: - AllocTime: 12m27s - CumulativeAllocationBytes: 118.75 GB (127502336000) - CumulativeAllocations: 6.23M (6225700) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.40 GB, 12.14 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.74 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.96 GB, 52.84 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.92 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 935.555ms - TotalBytesReceived: 67.40 GB (72373519901) - TotalGetBatchTime: 38m51s - DataArrivalTimer: 38m45s SenderSide: - DeserializeRowBatchTime: 15m33s - NumBatchesArrived: 3.11M (3112850) - NumBatchesDeferred: 18.73K (18726) - NumBatchesEnqueued: 3.11M (3112850) - NumBatchesReceived: 3.11M (3112850) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 45.648ms, non-child: 45.648ms, % non-child: 100.00%) - CodegenTime: 901.211us - CompileTime: 4.341ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 24.747ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 16.111ms Instance 844a0200d7876345:20bb38b900000085 (host=vd1112.foo.com:22000):(Total: 1s184ms, non-child: 218.613ms, % non-child: 18.46%) Fragment Instance Lifecycle Event Timeline: 1s184ms - Prepare Finished: 217.746ms (217.746ms) - Open Finished: 1s184ms (966.900ms) MemoryUsage(1m4s): 4.79 GB, 13.22 GB, 19.61 GB, 23.70 GB, 26.68 GB, 29.22 GB, 31.51 GB, 33.64 GB, 35.41 GB, 37.15 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.79 GB, 45.94 GB, 47.01 GB, 48.09 GB, 49.17 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.58 GB, 55.61 GB, 56.57 GB, 57.53 GB, 58.44 GB, 59.38 GB, 60.31 GB, 61.20 GB, 62.11 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.66 GB, 69.49 GB, 70.29 GB, 71.07 GB, 71.83 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.67 GB (79100461494) - PeakReservation: 73.63 GB (79060533248) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.16 GB (93590633429) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m10s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 966.892ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 58.991ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 966.894ms - ExecTreeOpenTime: 906.499ms - PrepareTime: 217.463ms - ExecTreePrepareTime: 148.155us KuduTableSink:(Total: 16.117us, non-child: 16.117us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 906.644ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.63 GB (79060541440) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m32s - CumulativeAllocationBytes: 73.63 GB (79060533248) - CumulativeAllocations: 37.70K (37699) - PeakReservation: 73.63 GB (79060533248) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.63 GB (79060533248) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m20s, non-child: 18s126ms, % non-child: 0.79%) - ConvertRowBatchTime: 7s864ms - PeakMemoryUsage: 19.53 MB (20481530) - RowsReturned: 288.74M (288744288) - RowsReturnedRate: 125.52 K/sec Buffer pool: - AllocTime: 13m53s - CumulativeAllocationBytes: 131.13 GB (140797214720) - CumulativeAllocations: 6.87M (6874864) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.88 GB, 13.38 GB, 19.82 GB, 23.95 GB, 26.95 GB, 29.52 GB, 31.83 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.19 GB, 41.50 GB, 42.80 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.68 GB, 50.73 GB, 51.74 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.76 GB, 63.70 GB, 64.81 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.57 GB, 69.38 GB, 70.21 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 906.420ms - TotalBytesReceived: 74.43 GB (79920108437) - TotalGetBatchTime: 38m9s - DataArrivalTimer: 38m2s SenderSide: - DeserializeRowBatchTime: 17m23s - NumBatchesArrived: 3.44M (3437432) - NumBatchesDeferred: 31.52K (31521) - NumBatchesEnqueued: 3.44M (3437432) - NumBatchesReceived: 3.44M (3437432) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 59.147ms, non-child: 59.147ms, % non-child: 100.00%) - CodegenTime: 1.257ms - CompileTime: 5.176ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 30.966ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.379ms Instance 844a0200d7876345:20bb38b900000082 (host=vd1113.foo.com:22000):(Total: 1s169ms, non-child: 212.812ms, % non-child: 18.20%) Fragment Instance Lifecycle Event Timeline: 1s170ms - Prepare Finished: 212.127ms (212.127ms) - Open Finished: 1s170ms (957.965ms) MemoryUsage(1m4s): 4.83 GB, 13.26 GB, 19.64 GB, 23.72 GB, 26.69 GB, 29.23 GB, 31.52 GB, 33.65 GB, 35.42 GB, 37.16 GB, 38.56 GB, 39.80 GB, 41.10 GB, 42.38 GB, 43.61 GB, 44.81 GB, 45.96 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.23 GB, 51.22 GB, 52.41 GB, 53.47 GB, 54.59 GB, 55.62 GB, 56.59 GB, 57.54 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.21 GB, 62.12 GB, 63.05 GB, 64.16 GB, 65.12 GB, 66.16 GB, 67.07 GB, 67.88 GB, 68.68 GB, 69.50 GB, 70.30 GB, 71.08 GB, 71.84 GB, 72.62 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.51 GB (78930592182) - PeakReservation: 73.47 GB (78890663936) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.83 GB (93238305708) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m12s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 957.934ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 61.991ms - TotalThreadsVoluntaryContextSwitches: 10 (10) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 957.937ms - ExecTreeOpenTime: 895.177ms - PrepareTime: 211.596ms - ExecTreePrepareTime: 159.109us KuduTableSink:(Total: 11.847us, non-child: 11.847us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 895.333ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.47 GB (78890672128) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m6s - CumulativeAllocationBytes: 73.47 GB (78890663936) - CumulativeAllocations: 37.62K (37618) - PeakReservation: 73.47 GB (78890663936) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.47 GB (78890663936) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m22s, non-child: 18s041ms, % non-child: 0.78%) - ConvertRowBatchTime: 7s870ms - PeakMemoryUsage: 19.53 MB (20481840) - RowsReturned: 288.12M (288123192) - RowsReturnedRate: 125.13 K/sec Buffer pool: - AllocTime: 11m40s - CumulativeAllocationBytes: 130.85 GB (140494356480) - CumulativeAllocations: 6.86M (6860076) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.85 GB, 13.36 GB, 19.81 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.20 GB, 41.51 GB, 42.80 GB, 44.05 GB, 45.26 GB, 46.42 GB, 47.50 GB, 48.59 GB, 49.68 GB, 50.73 GB, 51.74 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.19 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.58 GB, 69.38 GB, 70.22 GB, 71.03 GB, 71.82 GB, 72.59 GB, 73.37 GB - FirstBatchArrivalWaitTime: 895.118ms - TotalBytesReceived: 74.27 GB (79748356947) - TotalGetBatchTime: 38m11s - DataArrivalTimer: 38m4s SenderSide: - DeserializeRowBatchTime: 15m20s - NumBatchesArrived: 3.43M (3430038) - NumBatchesDeferred: 24.26K (24260) - NumBatchesEnqueued: 3.43M (3430038) - NumBatchesReceived: 3.43M (3430038) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 61.445ms, non-child: 61.445ms, % non-child: 100.00%) - CodegenTime: 988.249us - CompileTime: 5.186ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.699ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.005ms Instance 844a0200d7876345:20bb38b9000000f8 (host=vd1114.foo.com:22000):(Total: 1s211ms, non-child: 213.455ms, % non-child: 17.61%) Fragment Instance Lifecycle Event Timeline: 1s212ms - Prepare Finished: 212.691ms (212.691ms) - Open Finished: 1s212ms (999.470ms) MemoryUsage(1m4s): 4.37 GB, 12.03 GB, 17.84 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.77 GB, 35.05 GB, 36.19 GB, 37.37 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.31 GB, 53.14 GB, 54.00 GB, 54.83 GB, 55.65 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.93 GB (71867384246) - PeakReservation: 66.89 GB (71827456000) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.21 GB (86124156132) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 41m5s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 999.443ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 54.992ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 999.445ms - ExecTreeOpenTime: 944.509ms - PrepareTime: 212.290ms - ExecTreePrepareTime: 171.589us KuduTableSink:(Total: 8.038us, non-child: 8.038us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 944.679ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.89 GB (71827464192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 43s421ms - CumulativeAllocationBytes: 66.89 GB (71827456000) - CumulativeAllocations: 34.25K (34250) - PeakReservation: 66.89 GB (71827456000) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.89 GB (71827456000) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 41m15s, non-child: 17s081ms, % non-child: 0.69%) - ConvertRowBatchTime: 7s500ms - PeakMemoryUsage: 18.78 MB (19694948) - RowsReturned: 262.33M (262325112) - RowsReturnedRate: 105.98 K/sec Buffer pool: - AllocTime: 1m59s - CumulativeAllocationBytes: 119.13 GB (127914721280) - CumulativeAllocations: 6.25M (6245836) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.39 GB, 12.13 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.82 GB, 28.92 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.39 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.96 GB, 52.84 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.92 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 944.426ms - TotalBytesReceived: 67.62 GB (72607891569) - TotalGetBatchTime: 41m4s - DataArrivalTimer: 40m58s SenderSide: - DeserializeRowBatchTime: 4m59s - NumBatchesArrived: 3.12M (3122918) - NumBatchesDeferred: 210 (210) - NumBatchesEnqueued: 3.12M (3122918) - NumBatchesReceived: 3.12M (3122918) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 53.655ms, non-child: 53.655ms, % non-child: 100.00%) - CodegenTime: 972.295us - CompileTime: 5.174ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.073ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 19.902ms Instance 844a0200d7876345:20bb38b9000000f5 (host=vd1115.foo.com:22000):(Total: 1s166ms, non-child: 193.469ms, % non-child: 16.58%) Fragment Instance Lifecycle Event Timeline: 1s167ms - Prepare Finished: 192.882ms (192.882ms) - Open Finished: 1s167ms (974.280ms) MemoryUsage(1m4s): 4.35 GB, 12.01 GB, 17.83 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.06 GB, 36.18 GB, 37.36 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.31 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.95 GB (71888355766) - PeakReservation: 66.91 GB (71848427520) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.28 GB (86201986478) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m4s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 974.253ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 63.990ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 974.256ms - ExecTreeOpenTime: 908.714ms - PrepareTime: 192.280ms - ExecTreePrepareTime: 160.724us KuduTableSink:(Total: 16.762us, non-child: 16.762us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 908.872ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.91 GB (71848435712) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m47s - CumulativeAllocationBytes: 66.91 GB (71848427520) - CumulativeAllocations: 34.26K (34260) - PeakReservation: 66.91 GB (71848427520) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.91 GB (71848427520) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m14s, non-child: 17s191ms, % non-child: 0.73%) - ConvertRowBatchTime: 7s607ms - PeakMemoryUsage: 19.53 MB (20482962) - RowsReturned: 262.40M (262397604) - RowsReturnedRate: 111.46 K/sec Buffer pool: - AllocTime: 17m - CumulativeAllocationBytes: 119.16 GB (127950069760) - CumulativeAllocations: 6.25M (6247562) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.44 GB, 12.17 GB, 18.03 GB, 21.78 GB, 24.51 GB, 26.84 GB, 28.94 GB, 30.90 GB, 32.53 GB, 34.12 GB, 35.41 GB, 36.55 GB, 37.74 GB, 38.92 GB, 40.05 GB, 41.15 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.17 GB, 46.13 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.69 GB, 54.55 GB, 55.40 GB, 56.22 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.77 GB, 61.60 GB, 62.35 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 908.643ms - TotalBytesReceived: 67.64 GB (72628105248) - TotalGetBatchTime: 39m3s - DataArrivalTimer: 38m57s SenderSide: - DeserializeRowBatchTime: 20m11s - NumBatchesArrived: 3.12M (3123781) - NumBatchesDeferred: 16.64K (16642) - NumBatchesEnqueued: 3.12M (3123781) - NumBatchesReceived: 3.12M (3123781) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 64.231ms, non-child: 64.231ms, % non-child: 100.00%) - CodegenTime: 1.195ms - CompileTime: 5.568ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 31.320ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 26.722ms Instance 844a0200d7876345:20bb38b90000008d (host=vd1116.foo.com:22000):(Total: 1s215ms, non-child: 225.826ms, % non-child: 18.57%) Fragment Instance Lifecycle Event Timeline: 1s216ms - Prepare Finished: 224.981ms (224.981ms) - Open Finished: 1s216ms (991.236ms) MemoryUsage(1m4s): 4.79 GB, 13.21 GB, 19.60 GB, 23.69 GB, 26.67 GB, 29.21 GB, 31.49 GB, 33.63 GB, 35.40 GB, 37.13 GB, 38.53 GB, 39.78 GB, 41.08 GB, 42.36 GB, 43.59 GB, 44.78 GB, 45.93 GB, 47.00 GB, 48.08 GB, 49.16 GB, 50.21 GB, 51.20 GB, 52.39 GB, 53.45 GB, 54.57 GB, 55.60 GB, 56.57 GB, 57.52 GB, 58.43 GB, 59.37 GB, 60.30 GB, 61.19 GB, 62.10 GB, 63.03 GB, 64.14 GB, 65.10 GB, 66.14 GB, 67.05 GB, 67.86 GB, 68.65 GB, 69.48 GB, 70.28 GB, 71.06 GB, 71.82 GB, 72.59 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.69 GB (79123530166) - PeakReservation: 73.65 GB (79083601920) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.90 GB (93311087289) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 36m21s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 991.209ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 62.990ms - TotalThreadsVoluntaryContextSwitches: 10 (10) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 991.224ms - ExecTreeOpenTime: 927.736ms - PrepareTime: 224.582ms - ExecTreePrepareTime: 157.907us KuduTableSink:(Total: 11.437us, non-child: 11.437us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 927.891ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.65 GB (79083610112) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 5m9s - CumulativeAllocationBytes: 73.65 GB (79083601920) - CumulativeAllocations: 37.71K (37710) - PeakReservation: 73.65 GB (79083601920) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.65 GB (79083601920) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 36m31s, non-child: 17s722ms, % non-child: 0.81%) - ConvertRowBatchTime: 7s703ms - PeakMemoryUsage: 19.53 MB (20482110) - RowsReturned: 288.83M (288832572) - RowsReturnedRate: 131.78 K/sec Buffer pool: - AllocTime: 30m40s - CumulativeAllocationBytes: 131.17 GB (140840263680) - CumulativeAllocations: 6.88M (6876966) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.88 GB, 13.38 GB, 19.82 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.97 GB, 35.76 GB, 37.51 GB, 38.92 GB, 40.18 GB, 41.49 GB, 42.79 GB, 44.03 GB, 45.24 GB, 46.40 GB, 47.48 GB, 48.57 GB, 49.67 GB, 50.72 GB, 51.73 GB, 52.93 GB, 54.00 GB, 55.14 GB, 56.17 GB, 57.15 GB, 58.11 GB, 59.04 GB, 59.99 GB, 60.92 GB, 61.82 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.56 GB, 69.37 GB, 70.21 GB, 71.01 GB, 71.80 GB, 72.57 GB, 73.35 GB - FirstBatchArrivalWaitTime: 927.645ms - TotalBytesReceived: 74.45 GB (79944455694) - TotalGetBatchTime: 36m21s - DataArrivalTimer: 36m14s SenderSide: - DeserializeRowBatchTime: 35m16s - NumBatchesArrived: 3.44M (3438483) - NumBatchesDeferred: 79.19K (79194) - NumBatchesEnqueued: 3.44M (3438483) - NumBatchesReceived: 3.44M (3438483) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 62.159ms, non-child: 62.159ms, % non-child: 100.00%) - CodegenTime: 1.032ms - CompileTime: 5.763ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 34.630ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 21.112ms Instance 844a0200d7876345:20bb38b900000084 (host=vd1117.foo.com:22000):(Total: 1s238ms, non-child: 207.878ms, % non-child: 16.78%) Fragment Instance Lifecycle Event Timeline: 1s239ms - Prepare Finished: 207.050ms (207.050ms) - Open Finished: 1s239ms (1s032ms) MemoryUsage(1m4s): 4.78 GB, 13.21 GB, 19.61 GB, 23.70 GB, 26.68 GB, 29.22 GB, 31.51 GB, 33.64 GB, 35.41 GB, 37.15 GB, 38.55 GB, 39.80 GB, 41.10 GB, 42.38 GB, 43.61 GB, 44.81 GB, 45.95 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.23 GB, 51.22 GB, 52.41 GB, 53.47 GB, 54.59 GB, 55.62 GB, 56.59 GB, 57.54 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.21 GB, 62.12 GB, 63.05 GB, 64.16 GB, 65.12 GB, 66.16 GB, 67.07 GB, 67.88 GB, 68.67 GB, 69.50 GB, 70.30 GB, 71.08 GB, 71.84 GB, 72.62 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.53 GB (78947369398) - PeakReservation: 73.49 GB (78907441152) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.87 GB (93277996711) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m17s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 1s032ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 51.992ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s032ms - ExecTreeOpenTime: 979.066ms - PrepareTime: 206.609ms - ExecTreePrepareTime: 152.685us KuduTableSink:(Total: 12.385us, non-child: 12.385us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 979.215ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.49 GB (78907449344) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m2s - CumulativeAllocationBytes: 73.49 GB (78907441152) - CumulativeAllocations: 37.63K (37626) - PeakReservation: 73.49 GB (78907441152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.49 GB (78907441152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m27s, non-child: 17s931ms, % non-child: 0.78%) - ConvertRowBatchTime: 7s818ms - PeakMemoryUsage: 19.53 MB (20481322) - RowsReturned: 288.18M (288183336) - RowsReturnedRate: 124.86 K/sec Buffer pool: - AllocTime: 10m53s - CumulativeAllocationBytes: 130.87 GB (140523683840) - CumulativeAllocations: 6.86M (6861508) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.87 GB, 13.37 GB, 19.82 GB, 23.95 GB, 26.95 GB, 29.52 GB, 31.83 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.20 GB, 41.51 GB, 42.81 GB, 44.05 GB, 45.26 GB, 46.42 GB, 47.50 GB, 48.59 GB, 49.69 GB, 50.74 GB, 51.74 GB, 52.95 GB, 54.02 GB, 55.16 GB, 56.19 GB, 57.17 GB, 58.13 GB, 59.06 GB, 60.01 GB, 60.94 GB, 61.84 GB, 62.77 GB, 63.71 GB, 64.82 GB, 65.80 GB, 66.85 GB, 67.77 GB, 68.58 GB, 69.39 GB, 70.23 GB, 71.03 GB, 71.82 GB, 72.59 GB, 73.38 GB - FirstBatchArrivalWaitTime: 978.998ms - TotalBytesReceived: 74.29 GB (79764976050) - TotalGetBatchTime: 38m17s - DataArrivalTimer: 38m10s SenderSide: - DeserializeRowBatchTime: 14m17s - NumBatchesArrived: 3.43M (3430754) - NumBatchesDeferred: 20.43K (20427) - NumBatchesEnqueued: 3.43M (3430754) - NumBatchesReceived: 3.43M (3430754) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 51.836ms, non-child: 51.836ms, % non-child: 100.00%) - CodegenTime: 1.027ms - CompileTime: 4.776ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 25.790ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 20.714ms Instance 844a0200d7876345:20bb38b900000083 (host=vd1118.foo.com:22000):(Total: 1s188ms, non-child: 208.134ms, % non-child: 17.51%) Fragment Instance Lifecycle Event Timeline: 1s189ms - Prepare Finished: 207.642ms (207.642ms) - Open Finished: 1s189ms (981.568ms) MemoryUsage(1m4s): 4.79 GB, 13.21 GB, 19.61 GB, 23.70 GB, 26.67 GB, 29.21 GB, 31.50 GB, 33.63 GB, 35.40 GB, 37.14 GB, 38.54 GB, 39.78 GB, 41.08 GB, 42.36 GB, 43.60 GB, 44.79 GB, 45.94 GB, 47.01 GB, 48.09 GB, 49.17 GB, 50.21 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.58 GB, 55.61 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.38 GB, 60.31 GB, 61.20 GB, 62.11 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.66 GB, 69.49 GB, 70.29 GB, 71.08 GB, 71.83 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.55 GB (78976729526) - PeakReservation: 73.52 GB (78936801280) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.95 GB (93357927677) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m15s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 981.551ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 981.553ms - ExecTreeOpenTime: 919.414ms - PrepareTime: 207.055ms - ExecTreePrepareTime: 169.788us KuduTableSink:(Total: 15.008us, non-child: 15.008us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 919.581ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.52 GB (78936809472) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m32s - CumulativeAllocationBytes: 73.52 GB (78936801280) - CumulativeAllocations: 37.64K (37640) - PeakReservation: 73.52 GB (78936801280) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.52 GB (78936801280) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m25s, non-child: 17s675ms, % non-child: 0.77%) - ConvertRowBatchTime: 7s651ms - PeakMemoryUsage: 19.53 MB (20480817) - RowsReturned: 288.30M (288297996) - RowsReturnedRate: 125.06 K/sec Buffer pool: - AllocTime: 12m6s - CumulativeAllocationBytes: 130.92 GB (140579594240) - CumulativeAllocations: 6.86M (6864238) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.88 GB, 13.38 GB, 19.82 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.97 GB, 35.76 GB, 37.52 GB, 38.93 GB, 40.19 GB, 41.50 GB, 42.79 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.67 GB, 50.73 GB, 51.73 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.76 GB, 63.70 GB, 64.81 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.57 GB, 69.38 GB, 70.22 GB, 71.02 GB, 71.82 GB, 72.58 GB, 73.37 GB - FirstBatchArrivalWaitTime: 919.343ms - TotalBytesReceived: 74.32 GB (79796394503) - TotalGetBatchTime: 38m14s - DataArrivalTimer: 38m7s SenderSide: - DeserializeRowBatchTime: 15m25s - NumBatchesArrived: 3.43M (3432119) - NumBatchesDeferred: 18.32K (18320) - NumBatchesEnqueued: 3.43M (3432119) - NumBatchesReceived: 3.43M (3432119) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 60.940ms, non-child: 60.940ms, % non-child: 100.00%) - CodegenTime: 1.246ms - CompileTime: 5.040ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 30.892ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.331ms Instance 844a0200d7876345:20bb38b9000000f6 (host=vd1119.foo.com:22000):(Total: 1s248ms, non-child: 223.381ms, % non-child: 17.89%) Fragment Instance Lifecycle Event Timeline: 1s249ms - Prepare Finished: 222.795ms (222.795ms) - Open Finished: 1s249ms (1s026ms) MemoryUsage(1m4s): 4.38 GB, 12.04 GB, 17.85 GB, 21.57 GB, 24.27 GB, 26.58 GB, 28.66 GB, 30.60 GB, 32.21 GB, 33.79 GB, 35.06 GB, 36.19 GB, 37.38 GB, 38.54 GB, 39.66 GB, 40.75 GB, 41.79 GB, 42.76 GB, 43.74 GB, 44.72 GB, 45.67 GB, 46.58 GB, 47.66 GB, 48.62 GB, 49.64 GB, 50.58 GB, 51.45 GB, 52.32 GB, 53.15 GB, 54.01 GB, 54.84 GB, 55.66 GB, 56.49 GB, 57.33 GB, 58.34 GB, 59.21 GB, 60.16 GB, 60.98 GB, 61.72 GB, 62.44 GB, 63.19 GB, 63.92 GB, 64.63 GB, 65.32 GB, 66.03 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.94 GB (71871578550) - PeakReservation: 66.90 GB (71831650304) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.15 GB (86059854542) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m7s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s026ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 46.993ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s026ms - ExecTreeOpenTime: 977.555ms - PrepareTime: 222.185ms - ExecTreePrepareTime: 171.480us KuduTableSink:(Total: 11.457us, non-child: 11.457us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 977.724ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.90 GB (71831658496) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m54s - CumulativeAllocationBytes: 66.90 GB (71831650304) - CumulativeAllocations: 34.25K (34252) - PeakReservation: 66.90 GB (71831650304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.90 GB (71831650304) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m17s, non-child: 17s630ms, % non-child: 0.75%) - ConvertRowBatchTime: 7s892ms - PeakMemoryUsage: 19.53 MB (20482626) - RowsReturned: 262.34M (262343508) - RowsReturnedRate: 111.28 K/sec Buffer pool: - AllocTime: 19m9s - CumulativeAllocationBytes: 119.14 GB (127923691520) - CumulativeAllocations: 6.25M (6246274) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.40 GB, 12.13 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.55 GB, 37.74 GB, 38.92 GB, 40.05 GB, 41.15 GB, 42.20 GB, 43.18 GB, 44.18 GB, 45.17 GB, 46.13 GB, 47.04 GB, 48.14 GB, 49.11 GB, 50.14 GB, 51.09 GB, 51.98 GB, 52.85 GB, 53.69 GB, 54.56 GB, 55.40 GB, 56.22 GB, 57.06 GB, 57.92 GB, 58.93 GB, 59.82 GB, 60.77 GB, 61.61 GB, 62.35 GB, 63.08 GB, 63.84 GB, 64.58 GB, 65.30 GB, 65.99 GB, 66.71 GB - FirstBatchArrivalWaitTime: 977.476ms - TotalBytesReceived: 67.63 GB (72612914137) - TotalGetBatchTime: 39m6s - DataArrivalTimer: 39m SenderSide: - DeserializeRowBatchTime: 22m21s - NumBatchesArrived: 3.12M (3123137) - NumBatchesDeferred: 17.17K (17167) - NumBatchesEnqueued: 3.12M (3123137) - NumBatchesReceived: 3.12M (3123137) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 47.675ms, non-child: 47.675ms, % non-child: 100.00%) - CodegenTime: 1.112ms - CompileTime: 4.590ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 26.240ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 16.385ms Instance 844a0200d7876345:20bb38b9000000c0 (host=vd1120.foo.com:22000):(Total: 1s258ms, non-child: 189.204ms, % non-child: 15.04%) Fragment Instance Lifecycle Event Timeline: 1s258ms - Prepare Finished: 188.355ms (188.355ms) - Open Finished: 1s258ms (1s070ms) MemoryUsage(1m4s): 4.38 GB, 12.04 GB, 17.84 GB, 21.56 GB, 24.27 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.32 GB, 59.19 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.90 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.88 GB (71808663990) - PeakReservation: 66.84 GB (71768735744) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.25 GB (86166547034) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m23s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s069ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 64.989ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s069ms - ExecTreeOpenTime: 1s004ms - PrepareTime: 187.941ms - ExecTreePrepareTime: 165.267us KuduTableSink:(Total: 12.719us, non-child: 12.719us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 1s004ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.84 GB (71768743936) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m22s - CumulativeAllocationBytes: 66.84 GB (71768735744) - CumulativeAllocations: 34.22K (34222) - PeakReservation: 66.84 GB (71768735744) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.84 GB (71768735744) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m33s, non-child: 17s129ms, % non-child: 0.74%) - ConvertRowBatchTime: 7s552ms - PeakMemoryUsage: 19.53 MB (20482810) - RowsReturned: 262.11M (262109568) - RowsReturnedRate: 113.29 K/sec Buffer pool: - AllocTime: 17m40s - CumulativeAllocationBytes: 119.03 GB (127809617920) - CumulativeAllocations: 6.24M (6240704) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.39 GB, 12.13 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.11 GB, 35.39 GB, 36.53 GB, 37.72 GB, 38.90 GB, 40.03 GB, 41.13 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.15 GB, 46.11 GB, 47.02 GB, 48.12 GB, 49.09 GB, 50.12 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.75 GB, 61.59 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 1s004ms - TotalBytesReceived: 67.57 GB (72548032339) - TotalGetBatchTime: 38m23s - DataArrivalTimer: 38m16s SenderSide: - DeserializeRowBatchTime: 21m10s - NumBatchesArrived: 3.12M (3120352) - NumBatchesDeferred: 29.53K (29526) - NumBatchesEnqueued: 3.12M (3120352) - NumBatchesReceived: 3.12M (3120352) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 64.281ms, non-child: 64.281ms, % non-child: 100.00%) - CodegenTime: 1.078ms - CompileTime: 5.404ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.938ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 25.267ms Instance 844a0200d7876345:20bb38b9000000e3 (host=vd1121.foo.com:22000):(Total: 1s230ms, non-child: 177.946ms, % non-child: 14.46%) Fragment Instance Lifecycle Event Timeline: 1s230ms - Prepare Finished: 177.253ms (177.253ms) - Open Finished: 1s230ms (1s053ms) MemoryUsage(1m4s): 4.40 GB, 12.05 GB, 17.85 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.53 GB, 39.65 GB, 40.73 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.32 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.95 GB (71890452918) - PeakReservation: 66.92 GB (71850524672) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.47 GB (86402598138) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m32s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 1s053ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 52.992ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s053ms - ExecTreeOpenTime: 999.458ms - PrepareTime: 176.822ms - ExecTreePrepareTime: 203.459us KuduTableSink:(Total: 13.615us, non-child: 13.615us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 999.658ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.92 GB (71850532864) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 4m17s - CumulativeAllocationBytes: 66.92 GB (71850524672) - CumulativeAllocations: 34.26K (34261) - PeakReservation: 66.92 GB (71850524672) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.92 GB (71850524672) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m42s, non-child: 17s739ms, % non-child: 0.78%) - ConvertRowBatchTime: 7s648ms - PeakMemoryUsage: 19.53 MB (20483733) - RowsReturned: 262.41M (262409028) - RowsReturnedRate: 116.00 K/sec Buffer pool: - AllocTime: 24m7s - CumulativeAllocationBytes: 119.17 GB (127955640320) - CumulativeAllocations: 6.25M (6247834) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.41 GB, 12.14 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.10 GB, 35.39 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.29 GB, 65.98 GB, 66.70 GB - FirstBatchArrivalWaitTime: 999.379ms - TotalBytesReceived: 67.64 GB (72631053845) - TotalGetBatchTime: 37m31s - DataArrivalTimer: 37m24s SenderSide: - DeserializeRowBatchTime: 27m42s - NumBatchesArrived: 3.12M (3123917) - NumBatchesDeferred: 50.67K (50671) - NumBatchesEnqueued: 3.12M (3123917) - NumBatchesReceived: 3.12M (3123917) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 52.768ms, non-child: 52.768ms, % non-child: 100.00%) - CodegenTime: 1.134ms - CompileTime: 4.515ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.670ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 19.024ms Instance 844a0200d7876345:20bb38b9000000ef (host=vd1122.foo.com:22000):(Total: 1s223ms, non-child: 239.349ms, % non-child: 19.56%) Fragment Instance Lifecycle Event Timeline: 1s224ms - Prepare Finished: 238.827ms (238.827ms) - Open Finished: 1s224ms (985.471ms) MemoryUsage(1m4s): 4.40 GB, 12.05 GB, 17.85 GB, 21.57 GB, 24.27 GB, 26.58 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.19 GB, 37.37 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.72 GB, 45.67 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.57 GB, 51.45 GB, 52.31 GB, 53.14 GB, 54.00 GB, 54.83 GB, 55.64 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.76 GB (71680737718) - PeakReservation: 66.72 GB (71640809472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.15 GB (86064318730) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m21s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 985.462ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 61.990ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 985.465ms - ExecTreeOpenTime: 922.011ms - PrepareTime: 238.097ms - ExecTreePrepareTime: 149.535us KuduTableSink:(Total: 16.303us, non-child: 16.303us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 922.158ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.72 GB (71640817664) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m29s - CumulativeAllocationBytes: 66.72 GB (71640809472) - CumulativeAllocations: 34.16K (34161) - PeakReservation: 66.72 GB (71640809472) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.72 GB (71640809472) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m30s, non-child: 16s036ms, % non-child: 0.69%) - ConvertRowBatchTime: 6s810ms - PeakMemoryUsage: 19.53 MB (20483289) - RowsReturned: 261.64M (261640192) - RowsReturnedRate: 113.25 K/sec Buffer pool: - AllocTime: 14m3s - CumulativeAllocationBytes: 118.82 GB (127580938240) - CumulativeAllocations: 6.23M (6229538) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.41 GB, 12.15 GB, 18.01 GB, 21.77 GB, 24.49 GB, 26.83 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.11 GB, 35.39 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.92 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 921.970ms - TotalBytesReceived: 67.45 GB (72418634292) - TotalGetBatchTime: 38m20s - DataArrivalTimer: 38m14s SenderSide: - DeserializeRowBatchTime: 18m17s - NumBatchesArrived: 3.11M (3114769) - NumBatchesDeferred: 25.14K (25138) - NumBatchesEnqueued: 3.11M (3114769) - NumBatchesReceived: 3.11M (3114769) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 62.097ms, non-child: 62.097ms, % non-child: 100.00%) - CodegenTime: 1.449ms - CompileTime: 6.145ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.544ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.810ms Instance 844a0200d7876345:20bb38b9000000ae (host=vd1123.foo.com:22000):(Total: 1s258ms, non-child: 174.331ms, % non-child: 13.86%) Fragment Instance Lifecycle Event Timeline: 1s258ms - Prepare Finished: 173.589ms (173.589ms) - Open Finished: 1s258ms (1s085ms) MemoryUsage(1m4s): 4.80 GB, 13.22 GB, 19.62 GB, 23.71 GB, 26.69 GB, 29.23 GB, 31.52 GB, 33.65 GB, 35.42 GB, 37.15 GB, 38.55 GB, 39.80 GB, 41.10 GB, 42.37 GB, 43.61 GB, 44.80 GB, 45.95 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.22 GB, 51.22 GB, 52.41 GB, 53.46 GB, 54.59 GB, 55.62 GB, 56.59 GB, 57.54 GB, 58.45 GB, 59.39 GB, 60.32 GB, 61.21 GB, 62.12 GB, 63.05 GB, 64.16 GB, 65.12 GB, 66.16 GB, 67.07 GB, 67.88 GB, 68.67 GB, 69.50 GB, 70.30 GB, 71.08 GB, 71.84 GB, 72.62 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.47 GB (78885397510) - PeakReservation: 73.43 GB (78844526592) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.69 GB (93081831532) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 36m17s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s085ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 7 (7) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s085ms - ExecTreeOpenTime: 1s021ms - PrepareTime: 172.944ms - ExecTreePrepareTime: 162.140us KuduTableSink:(Total: 12.332us, non-child: 12.332us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 1s021ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.43 GB (78844534784) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 4m58s - CumulativeAllocationBytes: 73.43 GB (78844526592) - CumulativeAllocations: 37.60K (37596) - PeakReservation: 73.43 GB (78844526592) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.43 GB (78844526592) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 36m27s, non-child: 18s127ms, % non-child: 0.83%) - ConvertRowBatchTime: 7s750ms - PeakMemoryUsage: 19.53 MB (20482295) - RowsReturned: 287.95M (287951872) - RowsReturnedRate: 131.61 K/sec Buffer pool: - AllocTime: 24m39s - CumulativeAllocationBytes: 130.78 GB (140429312000) - CumulativeAllocations: 6.86M (6856900) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.82 GB, 13.33 GB, 19.80 GB, 23.93 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.98 GB, 35.76 GB, 37.52 GB, 38.93 GB, 40.19 GB, 41.50 GB, 42.80 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.68 GB, 50.73 GB, 51.73 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.19 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.84 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.58 GB, 69.38 GB, 70.22 GB, 71.03 GB, 71.82 GB, 72.59 GB, 73.37 GB - FirstBatchArrivalWaitTime: 1s021ms - TotalBytesReceived: 74.24 GB (79711632574) - TotalGetBatchTime: 36m16s - DataArrivalTimer: 36m10s SenderSide: - DeserializeRowBatchTime: 29m1s - NumBatchesArrived: 3.43M (3428529) - NumBatchesDeferred: 71.42K (71415) - NumBatchesEnqueued: 3.43M (3428448) - NumBatchesReceived: 3.43M (3428450) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 62.141ms, non-child: 62.141ms, % non-child: 100.00%) - CodegenTime: 1.169ms - CompileTime: 5.929ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 34.652ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 21.036ms Instance 844a0200d7876345:20bb38b9000000b1 (host=vd1124.foo.com:22000):(Total: 1s247ms, non-child: 167.417ms, % non-child: 13.42%) Fragment Instance Lifecycle Event Timeline: 1s247ms - Prepare Finished: 166.329ms (166.329ms) - Open Finished: 1s247ms (1s081ms) MemoryUsage(1m4s): 4.80 GB, 13.23 GB, 19.62 GB, 23.71 GB, 26.68 GB, 29.22 GB, 31.51 GB, 33.64 GB, 35.42 GB, 37.15 GB, 38.55 GB, 39.80 GB, 41.10 GB, 42.38 GB, 43.61 GB, 44.81 GB, 45.95 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.22 GB, 51.22 GB, 52.41 GB, 53.46 GB, 54.59 GB, 55.62 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.12 GB, 63.05 GB, 64.16 GB, 65.12 GB, 66.16 GB, 67.07 GB, 67.88 GB, 68.67 GB, 69.50 GB, 70.30 GB, 71.08 GB, 71.84 GB, 72.62 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.53 GB (78951563702) - PeakReservation: 73.49 GB (78911635456) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.89 GB (93302208317) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m22s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s081ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 65.990ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s081ms - ExecTreeOpenTime: 1s013ms - PrepareTime: 165.905ms - ExecTreePrepareTime: 147.353us KuduTableSink:(Total: 11.828us, non-child: 11.828us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 1s013ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.49 GB (78911643648) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m59s - CumulativeAllocationBytes: 73.49 GB (78911635456) - CumulativeAllocations: 37.63K (37628) - PeakReservation: 73.49 GB (78911635456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.49 GB (78911635456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m32s, non-child: 17s994ms, % non-child: 0.80%) - ConvertRowBatchTime: 7s813ms - PeakMemoryUsage: 19.53 MB (20481826) - RowsReturned: 288.20M (288196608) - RowsReturnedRate: 127.95 K/sec Buffer pool: - AllocTime: 16m42s - CumulativeAllocationBytes: 130.88 GB (140530688000) - CumulativeAllocations: 6.86M (6861850) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.82 GB, 13.33 GB, 19.79 GB, 23.93 GB, 26.93 GB, 29.50 GB, 31.81 GB, 33.97 GB, 35.76 GB, 37.52 GB, 38.93 GB, 40.19 GB, 41.51 GB, 42.80 GB, 44.05 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.68 GB, 50.73 GB, 51.73 GB, 52.94 GB, 54.01 GB, 55.14 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.58 GB, 69.38 GB, 70.22 GB, 71.03 GB, 71.82 GB, 72.59 GB, 73.37 GB - FirstBatchArrivalWaitTime: 1s013ms - TotalBytesReceived: 74.29 GB (79768953207) - TotalGetBatchTime: 37m21s - DataArrivalTimer: 37m14s SenderSide: - DeserializeRowBatchTime: 20m26s - NumBatchesArrived: 3.43M (3430925) - NumBatchesDeferred: 51.95K (51951) - NumBatchesEnqueued: 3.43M (3430925) - NumBatchesReceived: 3.43M (3430925) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 66.496ms, non-child: 66.496ms, % non-child: 100.00%) - CodegenTime: 1.395ms - CompileTime: 5.802ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 34.157ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 25.899ms Instance 844a0200d7876345:20bb38b9000000b4 (host=vd1125.foo.com:22000):(Total: 1s187ms, non-child: 217.230ms, % non-child: 18.30%) Fragment Instance Lifecycle Event Timeline: 1s187ms - Prepare Finished: 216.315ms (216.315ms) - Open Finished: 1s187ms (971.175ms) MemoryUsage(1m4s): 4.42 GB, 12.06 GB, 17.86 GB, 21.57 GB, 24.27 GB, 26.58 GB, 28.66 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.53 GB, 39.65 GB, 40.73 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.57 GB, 51.44 GB, 52.31 GB, 53.14 GB, 54.00 GB, 54.84 GB, 55.65 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.15 GB, 60.98 GB, 61.71 GB, 62.44 GB, 63.19 GB, 63.92 GB, 64.63 GB, 65.32 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.94 GB (71871578550) - PeakReservation: 66.90 GB (71831650304) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.36 GB (86281440363) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m44s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 971.155ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 9 (9) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 971.158ms - ExecTreeOpenTime: 908.706ms - PrepareTime: 215.913ms - ExecTreePrepareTime: 162.231us KuduTableSink:(Total: 16.081us, non-child: 16.081us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 908.865ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.90 GB (71831658496) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m20s - CumulativeAllocationBytes: 66.90 GB (71831650304) - CumulativeAllocations: 34.25K (34252) - PeakReservation: 66.90 GB (71831650304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.90 GB (71831650304) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m54s, non-child: 17s694ms, % non-child: 0.76%) - ConvertRowBatchTime: 7s745ms - PeakMemoryUsage: 19.54 MB (20484166) - RowsReturned: 262.34M (262335276) - RowsReturnedRate: 112.38 K/sec Buffer pool: - AllocTime: 12m31s - CumulativeAllocationBytes: 119.13 GB (127919677440) - CumulativeAllocations: 6.25M (6246078) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.43 GB, 12.16 GB, 18.01 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.39 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.96 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 908.632ms - TotalBytesReceived: 67.62 GB (72610602447) - TotalGetBatchTime: 38m43s - DataArrivalTimer: 38m37s SenderSide: - DeserializeRowBatchTime: 15m53s - NumBatchesArrived: 3.12M (3123039) - NumBatchesDeferred: 19.19K (19193) - NumBatchesEnqueued: 3.12M (3123039) - NumBatchesReceived: 3.12M (3123039) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 61.022ms, non-child: 61.022ms, % non-child: 100.00%) - CodegenTime: 1.123ms - CompileTime: 4.658ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 31.853ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.847ms Instance 844a0200d7876345:20bb38b9000000fc (host=vd1126.foo.com:22000):(Total: 1s186ms, non-child: 211.258ms, % non-child: 17.80%) Fragment Instance Lifecycle Event Timeline: 1s187ms - Prepare Finished: 210.286ms (210.286ms) - Open Finished: 1s187ms (976.975ms) MemoryUsage(1m4s): 4.37 GB, 12.03 GB, 17.84 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.04 GB, 36.17 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.70 GB, 45.65 GB, 46.55 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.55 GB, 51.43 GB, 52.29 GB, 53.13 GB, 53.98 GB, 54.82 GB, 55.63 GB, 56.46 GB, 57.31 GB, 58.31 GB, 59.19 GB, 60.13 GB, 60.96 GB, 61.69 GB, 62.42 GB, 63.17 GB, 63.90 GB, 64.61 GB, 65.30 GB, 66.00 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.87 GB (71804469686) - PeakReservation: 66.84 GB (71764541440) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.15 GB (86059110447) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m42s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 976.956ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 64.989ms - TotalThreadsVoluntaryContextSwitches: 11 (11) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 976.958ms - ExecTreeOpenTime: 910.433ms - PrepareTime: 209.941ms - ExecTreePrepareTime: 155.032us KuduTableSink:(Total: 19.458us, non-child: 19.458us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 910.585ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.84 GB (71764549632) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m3s - CumulativeAllocationBytes: 66.84 GB (71764541440) - CumulativeAllocations: 34.22K (34220) - PeakReservation: 66.84 GB (71764541440) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.84 GB (71764541440) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m52s, non-child: 17s164ms, % non-child: 0.74%) - ConvertRowBatchTime: 7s591ms - PeakMemoryUsage: 19.53 MB (20482459) - RowsReturned: 262.10M (262097136) - RowsReturnedRate: 112.36 K/sec Buffer pool: - AllocTime: 17m53s - CumulativeAllocationBytes: 119.03 GB (127803555840) - CumulativeAllocations: 6.24M (6240408) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.45 GB, 12.17 GB, 18.03 GB, 21.78 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.39 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.12 GB, 49.09 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.67 GB, 54.54 GB, 55.38 GB, 56.20 GB, 57.04 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.75 GB, 61.59 GB, 62.33 GB, 63.07 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 910.336ms - TotalBytesReceived: 67.56 GB (72544557151) - TotalGetBatchTime: 38m42s - DataArrivalTimer: 38m35s SenderSide: - DeserializeRowBatchTime: 21m8s - NumBatchesArrived: 3.12M (3120204) - NumBatchesDeferred: 18.93K (18935) - NumBatchesEnqueued: 3.12M (3120204) - NumBatchesReceived: 3.12M (3120204) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 65.080ms, non-child: 65.080ms, % non-child: 100.00%) - CodegenTime: 1.429ms - CompileTime: 5.389ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 33.561ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 25.430ms Instance 844a0200d7876345:20bb38b9000000b8 (host=vd1127.foo.com:22000):(Total: 1s221ms, non-child: 220.073ms, % non-child: 18.02%) Fragment Instance Lifecycle Event Timeline: 1s221ms - Prepare Finished: 219.493ms (219.493ms) - Open Finished: 1s221ms (1s002ms) MemoryUsage(1m4s): 4.40 GB, 12.06 GB, 17.85 GB, 21.57 GB, 24.27 GB, 26.58 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.19 GB, 37.37 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.87 GB (71804469686) - PeakReservation: 66.84 GB (71764541440) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.85 GB (84668142894) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m1s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s002ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 60.991ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s002ms - ExecTreeOpenTime: 940.021ms - PrepareTime: 218.895ms - ExecTreePrepareTime: 159.811us KuduTableSink:(Total: 12.248us, non-child: 12.248us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 940.178ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.84 GB (71764549632) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m40s - CumulativeAllocationBytes: 66.84 GB (71764541440) - CumulativeAllocations: 34.22K (34220) - PeakReservation: 66.84 GB (71764541440) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.84 GB (71764541440) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m10s, non-child: 17s149ms, % non-child: 0.73%) - ConvertRowBatchTime: 7s543ms - PeakMemoryUsage: 19.53 MB (20482938) - RowsReturned: 262.09M (262094868) - RowsReturnedRate: 111.50 K/sec Buffer pool: - AllocTime: 12m51s - CumulativeAllocationBytes: 119.03 GB (127802449920) - CumulativeAllocations: 6.24M (6240354) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.41 GB, 12.15 GB, 18.01 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.39 GB, 36.54 GB, 37.74 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.29 GB, 65.98 GB, 66.70 GB - FirstBatchArrivalWaitTime: 939.922ms - TotalBytesReceived: 67.56 GB (72544047324) - TotalGetBatchTime: 39m - DataArrivalTimer: 38m53s SenderSide: - DeserializeRowBatchTime: 16m7s - NumBatchesArrived: 3.12M (3120177) - NumBatchesDeferred: 14.51K (14514) - NumBatchesEnqueued: 3.12M (3120177) - NumBatchesReceived: 3.12M (3120177) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 61.043ms, non-child: 61.043ms, % non-child: 100.00%) - CodegenTime: 1.242ms - CompileTime: 5.425ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.828ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.155ms Instance 844a0200d7876345:20bb38b9000000a9 (host=vd1129.foo.com:22000):(Total: 1s236ms, non-child: 227.916ms, % non-child: 18.43%) Fragment Instance Lifecycle Event Timeline: 1s236ms - Prepare Finished: 227.025ms (227.025ms) - Open Finished: 1s236ms (1s009ms) MemoryUsage(1m4s): 4.78 GB, 13.21 GB, 19.60 GB, 23.70 GB, 26.67 GB, 29.21 GB, 31.50 GB, 33.63 GB, 35.40 GB, 37.14 GB, 38.54 GB, 39.79 GB, 41.09 GB, 42.36 GB, 43.60 GB, 44.79 GB, 45.94 GB, 47.01 GB, 48.09 GB, 49.17 GB, 50.21 GB, 51.21 GB, 52.40 GB, 53.45 GB, 54.58 GB, 55.61 GB, 56.57 GB, 57.52 GB, 58.44 GB, 59.38 GB, 60.30 GB, 61.19 GB, 62.11 GB, 63.03 GB, 64.14 GB, 65.10 GB, 66.14 GB, 67.05 GB, 67.86 GB, 68.66 GB, 69.49 GB, 70.28 GB, 71.07 GB, 71.83 GB, 72.60 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.42 GB (78838317494) - PeakReservation: 73.39 GB (78798389248) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.60 GB (91916598634) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m30s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s009ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 7 (7) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s009ms - ExecTreeOpenTime: 946.493ms - PrepareTime: 226.651ms - ExecTreePrepareTime: 176.570us KuduTableSink:(Total: 12.973us, non-child: 12.973us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 946.667ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.39 GB (78798397440) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m36s - CumulativeAllocationBytes: 73.39 GB (78798389248) - CumulativeAllocations: 37.57K (37574) - PeakReservation: 73.39 GB (78798389248) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.39 GB (78798389248) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m40s, non-child: 18s367ms, % non-child: 0.81%) - ConvertRowBatchTime: 7s920ms - PeakMemoryUsage: 19.53 MB (20481617) - RowsReturned: 287.79M (287792652) - RowsReturnedRate: 127.30 K/sec Buffer pool: - AllocTime: 19m44s - CumulativeAllocationBytes: 130.70 GB (140333178880) - CumulativeAllocations: 6.85M (6852206) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.88 GB, 13.38 GB, 19.82 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.97 GB, 35.76 GB, 37.51 GB, 38.93 GB, 40.19 GB, 41.50 GB, 42.80 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.67 GB, 50.73 GB, 51.73 GB, 52.94 GB, 54.01 GB, 55.14 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.04 GB, 59.99 GB, 60.93 GB, 61.83 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.57 GB, 69.37 GB, 70.21 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 946.417ms - TotalBytesReceived: 74.19 GB (79656709214) - TotalGetBatchTime: 37m29s - DataArrivalTimer: 37m22s SenderSide: - DeserializeRowBatchTime: 23m53s - NumBatchesArrived: 3.43M (3426103) - NumBatchesDeferred: 55.12K (55122) - NumBatchesEnqueued: 3.43M (3426103) - NumBatchesReceived: 3.43M (3426103) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 61.872ms, non-child: 61.872ms, % non-child: 100.00%) - CodegenTime: 1.316ms - CompileTime: 5.795ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 33.444ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 21.918ms Instance 844a0200d7876345:20bb38b9000000ff (host=vd1130.foo.com:22000):(Total: 1s233ms, non-child: 208.526ms, % non-child: 16.90%) Fragment Instance Lifecycle Event Timeline: 1s234ms - Prepare Finished: 207.537ms (207.537ms) - Open Finished: 1s234ms (1s026ms) MemoryUsage(1m4s): 4.40 GB, 12.05 GB, 17.85 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.65 GB, 40.73 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.31 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.79 GB (71718486454) - PeakReservation: 66.76 GB (71678558208) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.93 GB (84746478389) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m48s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s026ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 61.991ms - TotalThreadsVoluntaryContextSwitches: 8 (8) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s026ms - ExecTreeOpenTime: 962.966ms - PrepareTime: 207.090ms - ExecTreePrepareTime: 166.948us KuduTableSink:(Total: 12.142us, non-child: 12.142us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 963.130ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.76 GB (71678566400) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m48s - CumulativeAllocationBytes: 66.76 GB (71678558208) - CumulativeAllocations: 34.18K (34179) - PeakReservation: 66.76 GB (71678558208) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.76 GB (71678558208) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m57s, non-child: 16s494ms, % non-child: 0.71%) - ConvertRowBatchTime: 7s168ms - PeakMemoryUsage: 19.53 MB (20483599) - RowsReturned: 261.78M (261776928) - RowsReturnedRate: 111.98 K/sec Buffer pool: - AllocTime: 12m26s - CumulativeAllocationBytes: 118.88 GB (127647416320) - CumulativeAllocations: 6.23M (6232784) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.41 GB, 12.14 GB, 18.00 GB, 21.75 GB, 24.48 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.10 GB, 35.39 GB, 36.53 GB, 37.73 GB, 38.90 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.84 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.92 GB, 59.80 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.29 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 962.903ms - TotalBytesReceived: 67.48 GB (72455863092) - TotalGetBatchTime: 38m47s - DataArrivalTimer: 38m41s SenderSide: - DeserializeRowBatchTime: 15m37s - NumBatchesArrived: 3.12M (3116392) - NumBatchesDeferred: 7.96K (7959) - NumBatchesEnqueued: 3.12M (3116392) - NumBatchesReceived: 3.12M (3116392) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 62.279ms, non-child: 62.279ms, % non-child: 100.00%) - CodegenTime: 1.136ms - CompileTime: 5.146ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 31.336ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.712ms Instance 844a0200d7876345:20bb38b9000000fb (host=vd1131.foo.com:22000):(Total: 1s188ms, non-child: 214.321ms, % non-child: 18.03%) Fragment Instance Lifecycle Event Timeline: 1s188ms - Prepare Finished: 213.926ms (213.926ms) - Open Finished: 1s188ms (974.904ms) MemoryUsage(1m4s): 4.39 GB, 12.04 GB, 17.85 GB, 21.57 GB, 24.27 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.70 GB, 45.65 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.13 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.90 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.89 GB (71825441206) - PeakReservation: 66.86 GB (71785512960) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.03 GB (84853395510) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m34s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 974.893ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 55.991ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 974.896ms - ExecTreeOpenTime: 917.240ms - PrepareTime: 213.424ms - ExecTreePrepareTime: 200.753us KuduTableSink:(Total: 15.389us, non-child: 15.389us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 917.437ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.86 GB (71785521152) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m8s - CumulativeAllocationBytes: 66.86 GB (71785512960) - CumulativeAllocations: 34.23K (34230) - PeakReservation: 66.86 GB (71785512960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.86 GB (71785512960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m44s, non-child: 17s281ms, % non-child: 0.72%) - ConvertRowBatchTime: 7s530ms - PeakMemoryUsage: 19.53 MB (20480849) - RowsReturned: 262.18M (262175744) - RowsReturnedRate: 109.97 K/sec Buffer pool: - AllocTime: 8m36s - CumulativeAllocationBytes: 119.06 GB (127841894400) - CumulativeAllocations: 6.24M (6242280) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.41 GB, 12.14 GB, 18.01 GB, 21.76 GB, 24.49 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.10 GB, 35.39 GB, 36.53 GB, 37.72 GB, 38.90 GB, 40.03 GB, 41.13 GB, 42.18 GB, 43.17 GB, 44.16 GB, 45.15 GB, 46.11 GB, 47.02 GB, 48.12 GB, 49.09 GB, 50.12 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.67 GB, 54.54 GB, 55.38 GB, 56.20 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.75 GB, 61.59 GB, 62.33 GB, 63.07 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 917.177ms - TotalBytesReceived: 67.58 GB (72566437914) - TotalGetBatchTime: 39m33s - DataArrivalTimer: 39m27s SenderSide: - DeserializeRowBatchTime: 11m48s - NumBatchesArrived: 3.12M (3121140) - NumBatchesDeferred: 4.72K (4723) - NumBatchesEnqueued: 3.12M (3121140) - NumBatchesReceived: 3.12M (3121140) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 56.607ms, non-child: 56.607ms, % non-child: 100.00%) - CodegenTime: 773.452us - CompileTime: 4.759ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 27.652ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.726ms Instance 844a0200d7876345:20bb38b90000008b (host=vd1132.foo.com:22000):(Total: 1s200ms, non-child: 217.902ms, % non-child: 18.15%) Fragment Instance Lifecycle Event Timeline: 1s201ms - Prepare Finished: 217.057ms (217.057ms) - Open Finished: 1s201ms (983.996ms) MemoryUsage(1m4s): 4.83 GB, 13.25 GB, 19.63 GB, 23.72 GB, 26.69 GB, 29.23 GB, 31.52 GB, 33.65 GB, 35.42 GB, 37.16 GB, 38.56 GB, 39.80 GB, 41.10 GB, 42.38 GB, 43.61 GB, 44.81 GB, 45.96 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.23 GB, 51.22 GB, 52.41 GB, 53.47 GB, 54.59 GB, 55.62 GB, 56.59 GB, 57.54 GB, 58.45 GB, 59.39 GB, 60.32 GB, 61.21 GB, 62.12 GB, 63.05 GB, 64.16 GB, 65.12 GB, 66.16 GB, 67.07 GB, 67.87 GB, 68.67 GB, 69.50 GB, 70.30 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.47 GB (78884454838) - PeakReservation: 73.43 GB (78844526592) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.44 GB (91738056016) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 35m47s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 983.988ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 64.989ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 983.990ms - ExecTreeOpenTime: 918.150ms - PrepareTime: 216.760ms - ExecTreePrepareTime: 201.732us KuduTableSink:(Total: 13.438us, non-child: 13.438us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 918.348ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.43 GB (78844534784) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 5m25s - CumulativeAllocationBytes: 73.43 GB (78844526592) - CumulativeAllocations: 37.60K (37596) - PeakReservation: 73.43 GB (78844526592) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.43 GB (78844526592) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 35m57s, non-child: 18s367ms, % non-child: 0.85%) - ConvertRowBatchTime: 7s859ms - PeakMemoryUsage: 19.53 MB (20481770) - RowsReturned: 287.95M (287954100) - RowsReturnedRate: 133.47 K/sec Buffer pool: - AllocTime: 35m50s - CumulativeAllocationBytes: 130.77 GB (140411904000) - CumulativeAllocations: 6.86M (6856050) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.85 GB, 13.36 GB, 19.81 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.19 GB, 41.51 GB, 42.80 GB, 44.05 GB, 45.26 GB, 46.42 GB, 47.50 GB, 48.59 GB, 49.68 GB, 50.74 GB, 51.74 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.19 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.84 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.58 GB, 69.38 GB, 70.22 GB, 71.02 GB, 71.82 GB, 72.58 GB, 73.37 GB - FirstBatchArrivalWaitTime: 918.089ms - TotalBytesReceived: 74.23 GB (79701622842) - TotalGetBatchTime: 35m46s - DataArrivalTimer: 35m39s SenderSide: - DeserializeRowBatchTime: 40m38s - NumBatchesArrived: 3.43M (3428025) - NumBatchesDeferred: 102.16K (102157) - NumBatchesEnqueued: 3.43M (3428025) - NumBatchesReceived: 3.43M (3428025) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 64.554ms, non-child: 64.554ms, % non-child: 100.00%) - CodegenTime: 1.123ms - CompileTime: 4.721ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 35.467ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.720ms Instance 844a0200d7876345:20bb38b9000000c5 (host=vd1133.foo.com:22000):(Total: 1s223ms, non-child: 233.572ms, % non-child: 19.09%) Fragment Instance Lifecycle Event Timeline: 1s224ms - Prepare Finished: 233.049ms (233.049ms) - Open Finished: 1s224ms (991.230ms) MemoryUsage(1m4s): 4.34 GB, 12.00 GB, 17.81 GB, 21.53 GB, 24.24 GB, 26.55 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.76 GB, 35.04 GB, 36.17 GB, 37.35 GB, 38.51 GB, 39.63 GB, 40.72 GB, 41.76 GB, 42.73 GB, 43.71 GB, 44.70 GB, 45.64 GB, 46.55 GB, 47.63 GB, 48.59 GB, 49.61 GB, 50.55 GB, 51.43 GB, 52.29 GB, 53.13 GB, 53.98 GB, 54.82 GB, 55.63 GB, 56.46 GB, 57.30 GB, 58.31 GB, 59.18 GB, 60.13 GB, 60.96 GB, 61.69 GB, 62.42 GB, 63.17 GB, 63.90 GB, 64.61 GB, 65.30 GB, 66.00 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.87 GB (71798178230) - PeakReservation: 66.83 GB (71758249984) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.96 GB (84778131975) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m39s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 991.210ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 991.213ms - ExecTreeOpenTime: 930.479ms - PrepareTime: 232.289ms - ExecTreePrepareTime: 200.643us KuduTableSink:(Total: 12.269us, non-child: 12.269us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 930.677ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.83 GB (71758258176) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 4m5s - CumulativeAllocationBytes: 66.83 GB (71758249984) - CumulativeAllocations: 34.22K (34217) - PeakReservation: 66.83 GB (71758249984) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.83 GB (71758249984) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m48s, non-child: 17s215ms, % non-child: 0.76%) - ConvertRowBatchTime: 7s526ms - PeakMemoryUsage: 19.53 MB (20483657) - RowsReturned: 262.08M (262076052) - RowsReturnedRate: 115.51 K/sec Buffer pool: - AllocTime: 17m38s - CumulativeAllocationBytes: 119.02 GB (127793274880) - CumulativeAllocations: 6.24M (6239906) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.43 GB, 12.16 GB, 18.01 GB, 21.77 GB, 24.49 GB, 26.83 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.10 GB, 35.39 GB, 36.53 GB, 37.72 GB, 38.90 GB, 40.03 GB, 41.13 GB, 42.18 GB, 43.17 GB, 44.16 GB, 45.15 GB, 46.11 GB, 47.02 GB, 48.12 GB, 49.09 GB, 50.12 GB, 51.07 GB, 51.95 GB, 52.83 GB, 53.67 GB, 54.53 GB, 55.38 GB, 56.20 GB, 57.04 GB, 57.90 GB, 58.91 GB, 59.80 GB, 60.75 GB, 61.59 GB, 62.33 GB, 63.06 GB, 63.82 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 930.403ms - TotalBytesReceived: 67.56 GB (72538671190) - TotalGetBatchTime: 37m38s - DataArrivalTimer: 37m31s SenderSide: - DeserializeRowBatchTime: 21m51s - NumBatchesArrived: 3.12M (3119953) - NumBatchesDeferred: 44.02K (44017) - NumBatchesEnqueued: 3.12M (3119953) - NumBatchesReceived: 3.12M (3119953) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 59.306ms, non-child: 59.306ms, % non-child: 100.00%) - CodegenTime: 1.402ms - CompileTime: 5.828ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 33.306ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 19.548ms Instance 844a0200d7876345:20bb38b9000000f7 (host=vd1134.foo.com:22000):(Total: 1s186ms, non-child: 212.490ms, % non-child: 17.91%) Fragment Instance Lifecycle Event Timeline: 1s187ms - Prepare Finished: 211.766ms (211.766ms) - Open Finished: 1s187ms (975.255ms) MemoryUsage(1m4s): 4.35 GB, 12.02 GB, 17.83 GB, 21.55 GB, 24.26 GB, 26.57 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.05 GB, 36.17 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.73 GB (71651377590) - PeakReservation: 66.69 GB (71611449344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.79 GB (84602777893) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m31s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 975.233ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 54.991ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 975.236ms - ExecTreeOpenTime: 916.103ms - PrepareTime: 211.271ms - ExecTreePrepareTime: 186.093us KuduTableSink:(Total: 24.927us, non-child: 24.927us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 916.286ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.69 GB (71611457536) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m4s - CumulativeAllocationBytes: 66.69 GB (71611449344) - CumulativeAllocations: 34.15K (34147) - PeakReservation: 66.69 GB (71611449344) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.69 GB (71611449344) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m41s, non-child: 17s501ms, % non-child: 0.73%) - ConvertRowBatchTime: 7s526ms - PeakMemoryUsage: 19.53 MB (20482873) - RowsReturned: 261.54M (261537696) - RowsReturnedRate: 109.83 K/sec Buffer pool: - AllocTime: 8m32s - CumulativeAllocationBytes: 118.77 GB (127530762240) - CumulativeAllocations: 6.23M (6227088) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.43 GB, 12.16 GB, 18.02 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 916.033ms - TotalBytesReceived: 67.42 GB (72389899220) - TotalGetBatchTime: 39m30s - DataArrivalTimer: 39m24s SenderSide: - DeserializeRowBatchTime: 11m35s - NumBatchesArrived: 3.11M (3113545) - NumBatchesDeferred: 7.64K (7639) - NumBatchesEnqueued: 3.11M (3113544) - NumBatchesReceived: 3.11M (3113545) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 57.763ms, non-child: 57.763ms, % non-child: 100.00%) - CodegenTime: 1.044ms - CompileTime: 4.543ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.540ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.119ms Instance 844a0200d7876345:20bb38b9000000ee (host=vd1135.foo.com:22000):(Total: 1s233ms, non-child: 193.401ms, % non-child: 15.68%) Fragment Instance Lifecycle Event Timeline: 1s233ms - Prepare Finished: 192.613ms (192.613ms) - Open Finished: 1s233ms (1s041ms) MemoryUsage(1m4s): 4.39 GB, 12.05 GB, 17.85 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.53 GB, 39.65 GB, 40.73 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.57 GB, 51.44 GB, 52.31 GB, 53.14 GB, 54.00 GB, 54.84 GB, 55.65 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.15 GB, 60.98 GB, 61.71 GB, 62.44 GB, 63.19 GB, 63.91 GB, 64.63 GB, 65.32 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.86 GB (71793983926) - PeakReservation: 66.83 GB (71754055680) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.02 GB (84851128686) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m17s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s041ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 62.991ms - TotalThreadsVoluntaryContextSwitches: 7 (7) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s041ms - ExecTreeOpenTime: 977.019ms - PrepareTime: 192.188ms - ExecTreePrepareTime: 151.279us KuduTableSink:(Total: 16.020us, non-child: 16.020us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 977.167ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.83 GB (71754063872) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m30s - CumulativeAllocationBytes: 66.83 GB (71754055680) - CumulativeAllocations: 34.22K (34215) - PeakReservation: 66.83 GB (71754055680) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.83 GB (71754055680) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m26s, non-child: 17s461ms, % non-child: 0.74%) - ConvertRowBatchTime: 7s594ms - PeakMemoryUsage: 19.53 MB (20481833) - RowsReturned: 262.05M (262054632) - RowsReturnedRate: 110.71 K/sec Buffer pool: - AllocTime: 11m5s - CumulativeAllocationBytes: 119.01 GB (127782830080) - CumulativeAllocations: 6.24M (6239396) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.40 GB, 12.14 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.11 GB, 35.39 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.96 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 976.945ms - TotalBytesReceived: 67.55 GB (72533079545) - TotalGetBatchTime: 39m16s - DataArrivalTimer: 39m9s SenderSide: - DeserializeRowBatchTime: 14m10s - NumBatchesArrived: 3.12M (3119698) - NumBatchesDeferred: 8.90K (8897) - NumBatchesEnqueued: 3.12M (3119698) - NumBatchesReceived: 3.12M (3119698) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 62.698ms, non-child: 62.698ms, % non-child: 100.00%) - CodegenTime: 1.416ms - CompileTime: 5.213ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 31.258ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 25.637ms Instance 844a0200d7876345:20bb38b9000000a2 (host=vd1136.foo.com:22000):(Total: 1s226ms, non-child: 220.749ms, % non-child: 18.00%) Fragment Instance Lifecycle Event Timeline: 1s226ms - Prepare Finished: 219.948ms (219.948ms) - Open Finished: 1s226ms (1s006ms) MemoryUsage(1m4s): 4.81 GB, 13.23 GB, 19.62 GB, 23.71 GB, 26.68 GB, 29.22 GB, 31.51 GB, 33.64 GB, 35.41 GB, 37.15 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.61 GB, 44.80 GB, 45.95 GB, 47.02 GB, 48.09 GB, 49.18 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.58 GB, 55.61 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.11 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.86 GB, 68.66 GB, 69.49 GB, 70.29 GB, 71.07 GB, 71.83 GB, 72.60 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.67 GB (79098364342) - PeakReservation: 73.63 GB (79058436096) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.60 GB (91915310423) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m31s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 1s006ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 56.991ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s006ms - ExecTreeOpenTime: 949.889ms - PrepareTime: 219.472ms - ExecTreePrepareTime: 216.178us KuduTableSink:(Total: 12.920us, non-child: 12.920us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 950.103ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.63 GB (79058444288) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m9s - CumulativeAllocationBytes: 73.63 GB (79058436096) - CumulativeAllocations: 37.70K (37698) - PeakReservation: 73.63 GB (79058436096) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.63 GB (79058436096) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m41s, non-child: 18s438ms, % non-child: 0.79%) - ConvertRowBatchTime: 7s993ms - PeakMemoryUsage: 19.53 MB (20481276) - RowsReturned: 288.74M (288740844) - RowsReturnedRate: 124.37 K/sec Buffer pool: - AllocTime: 17m40s - CumulativeAllocationBytes: 131.13 GB (140795535360) - CumulativeAllocations: 6.87M (6874782) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.83 GB, 13.34 GB, 19.80 GB, 23.93 GB, 26.93 GB, 29.50 GB, 31.81 GB, 33.97 GB, 35.76 GB, 37.51 GB, 38.93 GB, 40.19 GB, 41.50 GB, 42.79 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.67 GB, 50.73 GB, 51.73 GB, 52.93 GB, 54.00 GB, 55.14 GB, 56.18 GB, 57.15 GB, 58.11 GB, 59.04 GB, 59.99 GB, 60.92 GB, 61.83 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.56 GB, 69.37 GB, 70.21 GB, 71.01 GB, 71.81 GB, 72.57 GB, 73.35 GB - FirstBatchArrivalWaitTime: 949.799ms - TotalBytesReceived: 74.43 GB (79919305891) - TotalGetBatchTime: 38m30s - DataArrivalTimer: 38m23s SenderSide: - DeserializeRowBatchTime: 21m22s - NumBatchesArrived: 3.44M (3437391) - NumBatchesDeferred: 33.67K (33671) - NumBatchesEnqueued: 3.44M (3437391) - NumBatchesReceived: 3.44M (3437391) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 55.571ms, non-child: 55.571ms, % non-child: 100.00%) - CodegenTime: 1.154ms - CompileTime: 5.619ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.320ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 21.024ms Instance 844a0200d7876345:20bb38b900000081 (host=vd1138.foo.com:22000):(Total: 1s203ms, non-child: 225.986ms, % non-child: 18.78%) Fragment Instance Lifecycle Event Timeline: 1s204ms - Prepare Finished: 225.406ms (225.406ms) - Open Finished: 1s204ms (978.662ms) MemoryUsage(1m4s): 4.83 GB, 13.25 GB, 19.63 GB, 23.72 GB, 26.69 GB, 29.23 GB, 31.51 GB, 33.65 GB, 35.42 GB, 37.15 GB, 38.55 GB, 39.80 GB, 41.10 GB, 42.37 GB, 43.61 GB, 44.80 GB, 45.95 GB, 47.02 GB, 48.10 GB, 49.18 GB, 50.22 GB, 51.21 GB, 52.41 GB, 53.46 GB, 54.59 GB, 55.61 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.12 GB, 63.05 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.67 GB, 69.50 GB, 70.29 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.53 GB (78949466550) - PeakReservation: 73.49 GB (78909538304) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.63 GB (91943233420) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m24s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 978.643ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 60.991ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 978.646ms - ExecTreeOpenTime: 916.804ms - PrepareTime: 224.886ms - ExecTreePrepareTime: 168.669us KuduTableSink:(Total: 12.168us, non-child: 12.168us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 916.970ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.49 GB (78909546496) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m2s - CumulativeAllocationBytes: 73.49 GB (78909538304) - CumulativeAllocations: 37.63K (37627) - PeakReservation: 73.49 GB (78909538304) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.49 GB (78909538304) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m34s, non-child: 17s843ms, % non-child: 0.77%) - ConvertRowBatchTime: 7s724ms - PeakMemoryUsage: 19.53 MB (20480441) - RowsReturned: 288.19M (288186368) - RowsReturnedRate: 124.50 K/sec Buffer pool: - AllocTime: 11m8s - CumulativeAllocationBytes: 130.87 GB (140525854720) - CumulativeAllocations: 6.86M (6861614) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.85 GB, 13.35 GB, 19.80 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.97 GB, 35.76 GB, 37.51 GB, 38.93 GB, 40.19 GB, 41.50 GB, 42.80 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.67 GB, 50.73 GB, 51.73 GB, 52.94 GB, 54.00 GB, 55.14 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.04 GB, 59.99 GB, 60.93 GB, 61.83 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.57 GB, 69.38 GB, 70.21 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 916.744ms - TotalBytesReceived: 74.29 GB (79766260951) - TotalGetBatchTime: 38m23s - DataArrivalTimer: 38m17s SenderSide: - DeserializeRowBatchTime: 14m32s - NumBatchesArrived: 3.43M (3430807) - NumBatchesDeferred: 10.75K (10752) - NumBatchesEnqueued: 3.43M (3430807) - NumBatchesReceived: 3.43M (3430807) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 60.614ms, non-child: 60.614ms, % non-child: 100.00%) - CodegenTime: 1.108ms - CompileTime: 5.680ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 34.703ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 19.575ms Instance 844a0200d7876345:20bb38b90000009c (host=vd1139.foo.com:22000):(Total: 1s185ms, non-child: 221.952ms, % non-child: 18.73%) Fragment Instance Lifecycle Event Timeline: 1s185ms - Prepare Finished: 221.121ms (221.121ms) - Open Finished: 1s185ms (964.553ms) MemoryUsage(1m4s): 4.78 GB, 13.21 GB, 19.60 GB, 23.70 GB, 26.67 GB, 29.22 GB, 31.50 GB, 33.64 GB, 35.41 GB, 37.15 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.95 GB, 47.01 GB, 48.09 GB, 49.18 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.58 GB, 55.61 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.11 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.66 GB, 69.49 GB, 70.29 GB, 71.07 GB, 71.83 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.47 GB (78888649142) - PeakReservation: 73.43 GB (78848720896) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.32 GB (91606648290) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 36m45s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 964.529ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 63.990ms - TotalThreadsVoluntaryContextSwitches: 7 (7) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 964.532ms - ExecTreeOpenTime: 897.960ms - PrepareTime: 220.727ms - ExecTreePrepareTime: 164.686us KuduTableSink:(Total: 12.154us, non-child: 12.154us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 898.122ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.43 GB (78848729088) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 4m25s - CumulativeAllocationBytes: 73.43 GB (78848720896) - CumulativeAllocations: 37.60K (37598) - PeakReservation: 73.43 GB (78848720896) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.43 GB (78848720896) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 36m56s, non-child: 18s023ms, % non-child: 0.81%) - ConvertRowBatchTime: 7s832ms - PeakMemoryUsage: 19.53 MB (20482285) - RowsReturned: 287.97M (287970228) - RowsReturnedRate: 129.95 K/sec Buffer pool: - AllocTime: 20m30s - CumulativeAllocationBytes: 130.78 GB (140419768320) - CumulativeAllocations: 6.86M (6856434) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.87 GB, 13.37 GB, 19.82 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.20 GB, 41.51 GB, 42.80 GB, 44.05 GB, 45.26 GB, 46.42 GB, 47.50 GB, 48.59 GB, 49.68 GB, 50.74 GB, 51.74 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.19 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.57 GB, 69.38 GB, 70.22 GB, 71.02 GB, 71.82 GB, 72.58 GB, 73.37 GB - FirstBatchArrivalWaitTime: 897.877ms - TotalBytesReceived: 74.23 GB (79705921091) - TotalGetBatchTime: 36m45s - DataArrivalTimer: 36m38s SenderSide: - DeserializeRowBatchTime: 24m29s - NumBatchesArrived: 3.43M (3428217) - NumBatchesDeferred: 53.88K (53885) - NumBatchesEnqueued: 3.43M (3428217) - NumBatchesReceived: 3.43M (3428217) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 65.227ms, non-child: 65.227ms, % non-child: 100.00%) - CodegenTime: 1.226ms - CompileTime: 5.237ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.493ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 26.805ms Instance 844a0200d7876345:20bb38b9000000f4 (host=vd1140.foo.com:22000):(Total: 1s194ms, non-child: 205.508ms, % non-child: 17.20%) Fragment Instance Lifecycle Event Timeline: 1s195ms - Prepare Finished: 205.086ms (205.086ms) - Open Finished: 1s195ms (990.602ms) MemoryUsage(1m4s): 4.38 GB, 12.04 GB, 17.85 GB, 21.56 GB, 24.27 GB, 26.58 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.65 GB, 40.73 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.31 GB, 53.14 GB, 54.00 GB, 54.83 GB, 55.65 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.72 GB (71645086134) - PeakReservation: 66.69 GB (71605157888) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.79 GB (84603566013) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m39s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 990.587ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 54.991ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 990.590ms - ExecTreeOpenTime: 932.857ms - PrepareTime: 204.304ms - ExecTreePrepareTime: 185.966us KuduTableSink:(Total: 12.141us, non-child: 12.141us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 933.039ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.69 GB (71605166080) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m46s - CumulativeAllocationBytes: 66.69 GB (71605157888) - CumulativeAllocations: 34.14K (34144) - PeakReservation: 66.69 GB (71605157888) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.69 GB (71605157888) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m49s, non-child: 17s490ms, % non-child: 0.77%) - ConvertRowBatchTime: 7s622ms - PeakMemoryUsage: 19.53 MB (20483513) - RowsReturned: 261.51M (261511168) - RowsReturnedRate: 115.25 K/sec Buffer pool: - AllocTime: 15m38s - CumulativeAllocationBytes: 118.78 GB (127534858240) - CumulativeAllocations: 6.23M (6227288) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.39 GB, 12.13 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.92 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.39 GB, 36.53 GB, 37.73 GB, 38.90 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.96 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.92 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 932.763ms - TotalBytesReceived: 67.42 GB (72391941044) - TotalGetBatchTime: 37m38s - DataArrivalTimer: 37m32s SenderSide: - DeserializeRowBatchTime: 18m56s - NumBatchesArrived: 3.11M (3113644) - NumBatchesDeferred: 38.01K (38007) - NumBatchesEnqueued: 3.11M (3113625) - NumBatchesReceived: 3.11M (3113644) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 56.410ms, non-child: 56.410ms, % non-child: 100.00%) - CodegenTime: 1.215ms - CompileTime: 5.076ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 31.914ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 18.882ms Instance 844a0200d7876345:20bb38b9000000a6 (host=vd1141.foo.com:22000):(Total: 1s175ms, non-child: 208.781ms, % non-child: 17.76%) Fragment Instance Lifecycle Event Timeline: 1s175ms - Prepare Finished: 207.844ms (207.844ms) - Open Finished: 1s175ms (967.764ms) MemoryUsage(1m4s): 4.82 GB, 13.24 GB, 19.63 GB, 23.72 GB, 26.69 GB, 29.23 GB, 31.51 GB, 33.65 GB, 35.42 GB, 37.16 GB, 38.56 GB, 39.80 GB, 41.10 GB, 42.38 GB, 43.61 GB, 44.81 GB, 45.96 GB, 47.03 GB, 48.11 GB, 49.19 GB, 50.23 GB, 51.22 GB, 52.42 GB, 53.47 GB, 54.60 GB, 55.63 GB, 56.59 GB, 57.54 GB, 58.46 GB, 59.40 GB, 60.32 GB, 61.22 GB, 62.13 GB, 63.06 GB, 64.17 GB, 65.13 GB, 66.17 GB, 67.08 GB, 67.89 GB, 68.68 GB, 69.51 GB, 70.31 GB, 71.09 GB, 71.85 GB, 72.63 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.45 GB (78861386166) - PeakReservation: 73.41 GB (78821457920) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.40 GB (91697381993) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m29s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 967.747ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 43.993ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 967.750ms - ExecTreeOpenTime: 921.653ms - PrepareTime: 207.480ms - ExecTreePrepareTime: 141.566us KuduTableSink:(Total: 12.004us, non-child: 12.004us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 921.791ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.41 GB (78821466112) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m6s - CumulativeAllocationBytes: 73.41 GB (78821457920) - CumulativeAllocations: 37.59K (37585) - PeakReservation: 73.41 GB (78821457920) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.41 GB (78821457920) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m38s, non-child: 17s460ms, % non-child: 0.75%) - ConvertRowBatchTime: 7s605ms - PeakMemoryUsage: 19.53 MB (20480814) - RowsReturned: 287.88M (287876736) - RowsReturnedRate: 124.15 K/sec Buffer pool: - AllocTime: 14m36s - CumulativeAllocationBytes: 130.73 GB (140374179840) - CumulativeAllocations: 6.85M (6854208) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.84 GB, 13.34 GB, 19.80 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.19 GB, 41.51 GB, 42.80 GB, 44.05 GB, 45.26 GB, 46.42 GB, 47.50 GB, 48.59 GB, 49.68 GB, 50.74 GB, 51.74 GB, 52.95 GB, 54.02 GB, 55.15 GB, 56.19 GB, 57.17 GB, 58.13 GB, 59.06 GB, 60.01 GB, 60.94 GB, 61.84 GB, 62.77 GB, 63.71 GB, 64.83 GB, 65.80 GB, 66.85 GB, 67.77 GB, 68.59 GB, 69.39 GB, 70.23 GB, 71.04 GB, 71.83 GB, 72.60 GB, 73.38 GB - FirstBatchArrivalWaitTime: 921.579ms - TotalBytesReceived: 74.21 GB (79679802061) - TotalGetBatchTime: 38m28s - DataArrivalTimer: 38m21s SenderSide: - DeserializeRowBatchTime: 17m56s - NumBatchesArrived: 3.43M (3427104) - NumBatchesDeferred: 23.74K (23744) - NumBatchesEnqueued: 3.43M (3427104) - NumBatchesReceived: 3.43M (3427104) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 44.694ms, non-child: 44.694ms, % non-child: 100.00%) - CodegenTime: 871.184us - CompileTime: 3.546ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 22.233ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 18.428ms Instance 844a0200d7876345:20bb38b9000000c6 (host=vd1142.foo.com:22000):(Total: 1s183ms, non-child: 205.864ms, % non-child: 17.40%) Fragment Instance Lifecycle Event Timeline: 1s183ms - Prepare Finished: 204.862ms (204.862ms) - Open Finished: 1s183ms (978.686ms) MemoryUsage(1m4s): 4.34 GB, 12.01 GB, 17.83 GB, 21.55 GB, 24.26 GB, 26.57 GB, 28.64 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.65 GB, 40.73 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.32 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.86 GB (71789789622) - PeakReservation: 66.82 GB (71749861376) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.84 GB (84649959343) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m23s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 978.661ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 52.992ms - TotalThreadsVoluntaryContextSwitches: 18 (18) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 978.664ms - ExecTreeOpenTime: 925.100ms - PrepareTime: 204.464ms - ExecTreePrepareTime: 158.070us KuduTableSink:(Total: 16.879us, non-child: 16.879us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 925.255ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.82 GB (71749869568) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m17s - CumulativeAllocationBytes: 66.82 GB (71749861376) - CumulativeAllocations: 34.21K (34213) - PeakReservation: 66.82 GB (71749861376) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.82 GB (71749861376) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m32s, non-child: 17s461ms, % non-child: 0.75%) - ConvertRowBatchTime: 7s598ms - PeakMemoryUsage: 19.53 MB (20483337) - RowsReturned: 262.05M (262048164) - RowsReturnedRate: 113.30 K/sec Buffer pool: - AllocTime: 18m26s - CumulativeAllocationBytes: 119.00 GB (127779676160) - CumulativeAllocations: 6.24M (6239242) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.43 GB, 12.16 GB, 18.02 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.74 GB, 38.91 GB, 40.05 GB, 41.15 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.17 GB, 46.13 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.69 GB, 54.55 GB, 55.40 GB, 56.22 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 925.011ms - TotalBytesReceived: 67.55 GB (72531083101) - TotalGetBatchTime: 38m22s - DataArrivalTimer: 38m15s SenderSide: - DeserializeRowBatchTime: 21m54s - NumBatchesArrived: 3.12M (3119621) - NumBatchesDeferred: 31.19K (31190) - NumBatchesEnqueued: 3.12M (3119621) - NumBatchesReceived: 3.12M (3119621) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 52.053ms, non-child: 52.053ms, % non-child: 100.00%) - CodegenTime: 1.028ms - CompileTime: 4.085ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 25.806ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 21.576ms Instance 844a0200d7876345:20bb38b9000000a4 (host=vd1326.foo.com:22000):(Total: 1s197ms, non-child: 226.975ms, % non-child: 18.95%) Fragment Instance Lifecycle Event Timeline: 1s198ms - Prepare Finished: 226.237ms (226.237ms) - Open Finished: 1s198ms (972.069ms) MemoryUsage(1m4s): 4.78 GB, 13.20 GB, 19.59 GB, 23.69 GB, 26.67 GB, 29.22 GB, 31.50 GB, 33.63 GB, 35.40 GB, 37.14 GB, 38.54 GB, 39.79 GB, 41.09 GB, 42.36 GB, 43.60 GB, 44.79 GB, 45.94 GB, 47.01 GB, 48.09 GB, 49.17 GB, 50.21 GB, 51.21 GB, 52.40 GB, 53.45 GB, 54.58 GB, 55.61 GB, 56.57 GB, 57.52 GB, 58.44 GB, 59.38 GB, 60.30 GB, 61.19 GB, 62.11 GB, 63.04 GB, 64.14 GB, 65.10 GB, 66.14 GB, 67.06 GB, 67.86 GB, 68.66 GB, 69.49 GB, 70.29 GB, 71.07 GB, 71.83 GB, 72.60 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.43 GB (78840414646) - PeakReservation: 73.39 GB (78800486400) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.54 GB (91844463693) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m27s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 972.055ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 57.991ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 972.058ms - ExecTreeOpenTime: 913.091ms - PrepareTime: 225.846ms - ExecTreePrepareTime: 149.327us KuduTableSink:(Total: 17.547us, non-child: 17.547us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 913.237ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.39 GB (78800494592) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m48s - CumulativeAllocationBytes: 73.39 GB (78800486400) - CumulativeAllocations: 37.58K (37575) - PeakReservation: 73.39 GB (78800486400) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.39 GB (78800486400) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m37s, non-child: 18s200ms, % non-child: 0.81%) - ConvertRowBatchTime: 8s043ms - PeakMemoryUsage: 19.53 MB (20481430) - RowsReturned: 287.79M (287792064) - RowsReturnedRate: 127.46 K/sec Buffer pool: - AllocTime: 20m26s - CumulativeAllocationBytes: 130.70 GB (140332892160) - CumulativeAllocations: 6.85M (6852192) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.88 GB, 13.38 GB, 19.82 GB, 23.95 GB, 26.95 GB, 29.51 GB, 31.82 GB, 33.98 GB, 35.76 GB, 37.52 GB, 38.93 GB, 40.19 GB, 41.50 GB, 42.80 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.67 GB, 50.73 GB, 51.73 GB, 52.94 GB, 54.01 GB, 55.14 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.04 GB, 59.99 GB, 60.93 GB, 61.83 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.57 GB, 69.38 GB, 70.21 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 912.990ms - TotalBytesReceived: 74.19 GB (79656914641) - TotalGetBatchTime: 37m26s - DataArrivalTimer: 37m20s SenderSide: - DeserializeRowBatchTime: 24m5s - NumBatchesArrived: 3.43M (3426096) - NumBatchesDeferred: 43.51K (43507) - NumBatchesEnqueued: 3.43M (3426096) - NumBatchesReceived: 3.43M (3426096) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 57.736ms, non-child: 57.736ms, % non-child: 100.00%) - CodegenTime: 971.777us - CompileTime: 5.036ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 29.799ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.389ms Instance 844a0200d7876345:20bb38b9000000ad (host=vd1327.foo.com:22000):(Total: 1s226ms, non-child: 224.651ms, % non-child: 18.32%) Fragment Instance Lifecycle Event Timeline: 1s226ms - Prepare Finished: 224.295ms (224.295ms) - Open Finished: 1s226ms (1s002ms) MemoryUsage(1m4s): 4.80 GB, 13.22 GB, 19.61 GB, 23.70 GB, 26.68 GB, 29.22 GB, 31.51 GB, 33.64 GB, 35.41 GB, 37.15 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.95 GB, 47.01 GB, 48.09 GB, 49.18 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.59 GB, 55.61 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.11 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.66 GB, 69.49 GB, 70.29 GB, 71.07 GB, 71.83 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.53 GB (78951563702) - PeakReservation: 73.49 GB (78911635456) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.59 GB (91906712567) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m24s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s002ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 60.990ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s002ms - ExecTreeOpenTime: 939.238ms - PrepareTime: 223.584ms - ExecTreePrepareTime: 170.033us KuduTableSink:(Total: 11.954us, non-child: 11.954us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 939.404ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.49 GB (78911643648) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 1m45s - CumulativeAllocationBytes: 73.49 GB (78911635456) - CumulativeAllocations: 37.63K (37628) - PeakReservation: 73.49 GB (78911635456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.49 GB (78911635456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m34s, non-child: 17s991ms, % non-child: 0.76%) - ConvertRowBatchTime: 7s869ms - PeakMemoryUsage: 19.53 MB (20481700) - RowsReturned: 288.19M (288194004) - RowsReturnedRate: 121.39 K/sec Buffer pool: - AllocTime: 9m50s - CumulativeAllocationBytes: 130.88 GB (140528967680) - CumulativeAllocations: 6.86M (6861766) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.89 GB, 13.38 GB, 19.82 GB, 23.95 GB, 26.95 GB, 29.52 GB, 31.83 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.20 GB, 41.51 GB, 42.80 GB, 44.05 GB, 45.26 GB, 46.42 GB, 47.50 GB, 48.59 GB, 49.68 GB, 50.73 GB, 51.74 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.19 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.57 GB, 69.38 GB, 70.22 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.37 GB - FirstBatchArrivalWaitTime: 939.174ms - TotalBytesReceived: 74.29 GB (79768255314) - TotalGetBatchTime: 39m23s - DataArrivalTimer: 39m16s SenderSide: - DeserializeRowBatchTime: 13m20s - NumBatchesArrived: 3.43M (3430884) - NumBatchesDeferred: 9.61K (9613) - NumBatchesEnqueued: 3.43M (3430883) - NumBatchesReceived: 3.43M (3430884) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 62.170ms, non-child: 62.170ms, % non-child: 100.00%) - CodegenTime: 972.958us - CompileTime: 5.698ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.064ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.876ms Instance 844a0200d7876345:20bb38b9000000d3 (host=vd1328.foo.com:22000):(Total: 1s219ms, non-child: 237.361ms, % non-child: 19.46%) Fragment Instance Lifecycle Event Timeline: 1s220ms - Prepare Finished: 236.537ms (236.537ms) - Open Finished: 1s220ms (983.717ms) MemoryUsage(1m4s): 4.36 GB, 12.02 GB, 17.83 GB, 21.55 GB, 24.26 GB, 26.57 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.32 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.90 GB, 64.61 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.79 GB (71718486454) - PeakReservation: 66.76 GB (71678558208) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.80 GB (84607398680) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m31s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 983.704ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 983.706ms - ExecTreeOpenTime: 920.142ms - PrepareTime: 236.136ms - ExecTreePrepareTime: 166.283us KuduTableSink:(Total: 11.589us, non-child: 11.589us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 920.305ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.76 GB (71678566400) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m7s - CumulativeAllocationBytes: 66.76 GB (71678558208) - CumulativeAllocations: 34.18K (34179) - PeakReservation: 66.76 GB (71678558208) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.76 GB (71678558208) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m41s, non-child: 17s216ms, % non-child: 0.74%) - ConvertRowBatchTime: 7s519ms - PeakMemoryUsage: 19.53 MB (20482654) - RowsReturned: 261.78M (261776340) - RowsReturnedRate: 112.77 K/sec Buffer pool: - AllocTime: 16m36s - CumulativeAllocationBytes: 118.88 GB (127647129600) - CumulativeAllocations: 6.23M (6232770) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.44 GB, 12.17 GB, 18.02 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.74 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.28 GB, 65.98 GB, 66.70 GB - FirstBatchArrivalWaitTime: 920.068ms - TotalBytesReceived: 67.48 GB (72456073853) - TotalGetBatchTime: 38m30s - DataArrivalTimer: 38m24s SenderSide: - DeserializeRowBatchTime: 19m57s - NumBatchesArrived: 3.12M (3116385) - NumBatchesDeferred: 23.57K (23570) - NumBatchesEnqueued: 3.12M (3116385) - NumBatchesReceived: 3.12M (3116385) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 62.220ms, non-child: 62.220ms, % non-child: 100.00%) - CodegenTime: 1.172ms - CompileTime: 5.031ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.358ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.333ms Instance 844a0200d7876345:20bb38b9000000df (host=vd1329.foo.com:22000):(Total: 1s207ms, non-child: 215.249ms, % non-child: 17.83%) Fragment Instance Lifecycle Event Timeline: 1s207ms - Prepare Finished: 214.329ms (214.329ms) - Open Finished: 1s207ms (993.248ms) MemoryUsage(1m4s): 4.36 GB, 12.03 GB, 17.83 GB, 21.55 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.31 GB, 53.14 GB, 54.00 GB, 54.83 GB, 55.64 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.98 GB (71917715894) - PeakReservation: 66.94 GB (71877787648) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.06 GB (84889822740) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m32s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 993.226ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 50.992ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 993.236ms - ExecTreeOpenTime: 939.369ms - PrepareTime: 213.885ms - ExecTreePrepareTime: 156.708us KuduTableSink:(Total: 13.512us, non-child: 13.512us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 939.522ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.94 GB (71877795840) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m22s - CumulativeAllocationBytes: 66.94 GB (71877787648) - CumulativeAllocations: 34.27K (34274) - PeakReservation: 66.94 GB (71877787648) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.94 GB (71877787648) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m42s, non-child: 17s651ms, % non-child: 0.74%) - ConvertRowBatchTime: 7s796ms - PeakMemoryUsage: 19.53 MB (20481445) - RowsReturned: 262.51M (262506972) - RowsReturnedRate: 110.16 K/sec Buffer pool: - AllocTime: 7m19s - CumulativeAllocationBytes: 119.21 GB (128003399680) - CumulativeAllocations: 6.25M (6250166) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.45 GB, 12.17 GB, 18.02 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.17 GB, 46.13 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.69 GB, 54.55 GB, 55.40 GB, 56.22 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.77 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 939.273ms - TotalBytesReceived: 67.67 GB (72658076046) - TotalGetBatchTime: 39m32s - DataArrivalTimer: 39m25s SenderSide: - DeserializeRowBatchTime: 10m21s - NumBatchesArrived: 3.13M (3125083) - NumBatchesDeferred: 5.70K (5697) - NumBatchesEnqueued: 3.13M (3125083) - NumBatchesReceived: 3.13M (3125083) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 52.419ms, non-child: 52.419ms, % non-child: 100.00%) - CodegenTime: 1.259ms - CompileTime: 4.789ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 30.029ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 17.026ms Instance 844a0200d7876345:20bb38b9000000af (host=vd1330.foo.com:22000):(Total: 1s159ms, non-child: 197.912ms, % non-child: 17.07%) Fragment Instance Lifecycle Event Timeline: 1s160ms - Prepare Finished: 197.183ms (197.183ms) - Open Finished: 1s160ms (962.976ms) MemoryUsage(1m4s): 4.80 GB, 13.22 GB, 19.62 GB, 23.71 GB, 26.69 GB, 29.23 GB, 31.51 GB, 33.65 GB, 35.42 GB, 37.15 GB, 38.55 GB, 39.80 GB, 41.10 GB, 42.38 GB, 43.61 GB, 44.81 GB, 45.96 GB, 47.02 GB, 48.10 GB, 49.19 GB, 50.23 GB, 51.22 GB, 52.42 GB, 53.47 GB, 54.60 GB, 55.63 GB, 56.59 GB, 57.54 GB, 58.46 GB, 59.40 GB, 60.32 GB, 61.21 GB, 62.13 GB, 63.06 GB, 64.17 GB, 65.12 GB, 66.16 GB, 67.08 GB, 67.88 GB, 68.68 GB, 69.51 GB, 70.31 GB, 71.09 GB, 71.85 GB, 72.62 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.64 GB (79073198518) - PeakReservation: 73.61 GB (79033270272) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.65 GB (91966393958) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m37s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 962.960ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 60.990ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 962.964ms - ExecTreeOpenTime: 901.044ms - PrepareTime: 196.664ms - ExecTreePrepareTime: 161.015us KuduTableSink:(Total: 12.061us, non-child: 12.061us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 901.202ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.61 GB (79033278464) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m56s - CumulativeAllocationBytes: 73.61 GB (79033270272) - CumulativeAllocations: 37.69K (37686) - PeakReservation: 73.61 GB (79033270272) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.61 GB (79033270272) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m47s, non-child: 18s489ms, % non-child: 0.82%) - ConvertRowBatchTime: 7s971ms - PeakMemoryUsage: 19.53 MB (20482260) - RowsReturned: 288.64M (288644916) - RowsReturnedRate: 127.28 K/sec Buffer pool: - AllocTime: 19m47s - CumulativeAllocationBytes: 131.08 GB (140748759040) - CumulativeAllocations: 6.87M (6872498) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.90 GB, 13.40 GB, 19.84 GB, 23.96 GB, 26.96 GB, 29.53 GB, 31.83 GB, 33.99 GB, 35.78 GB, 37.53 GB, 38.94 GB, 40.20 GB, 41.52 GB, 42.81 GB, 44.06 GB, 45.27 GB, 46.43 GB, 47.50 GB, 48.60 GB, 49.69 GB, 50.75 GB, 51.75 GB, 52.96 GB, 54.02 GB, 55.16 GB, 56.20 GB, 57.18 GB, 58.14 GB, 59.06 GB, 60.02 GB, 60.95 GB, 61.85 GB, 62.77 GB, 63.71 GB, 64.83 GB, 65.80 GB, 66.85 GB, 67.77 GB, 68.59 GB, 69.40 GB, 70.23 GB, 71.04 GB, 71.83 GB, 72.60 GB, 73.38 GB - FirstBatchArrivalWaitTime: 900.957ms - TotalBytesReceived: 74.41 GB (79892561010) - TotalGetBatchTime: 37m36s - DataArrivalTimer: 37m29s SenderSide: - DeserializeRowBatchTime: 23m36s - NumBatchesArrived: 3.44M (3436249) - NumBatchesDeferred: 48.84K (48838) - NumBatchesEnqueued: 3.44M (3436249) - NumBatchesReceived: 3.44M (3436249) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 60.560ms, non-child: 60.560ms, % non-child: 100.00%) - CodegenTime: 1.233ms - CompileTime: 4.740ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 31.774ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.278ms Instance 844a0200d7876345:20bb38b90000009f (host=vd1331.foo.com:22000):(Total: 1s166ms, non-child: 199.497ms, % non-child: 17.10%) Fragment Instance Lifecycle Event Timeline: 1s167ms - Prepare Finished: 198.685ms (198.685ms) - Open Finished: 1s167ms (968.718ms) MemoryUsage(1m4s): 4.81 GB, 13.23 GB, 19.62 GB, 23.71 GB, 26.68 GB, 29.23 GB, 31.51 GB, 33.64 GB, 35.41 GB, 37.15 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.95 GB, 47.01 GB, 48.09 GB, 49.18 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.58 GB, 55.61 GB, 56.58 GB, 57.53 GB, 58.44 GB, 59.38 GB, 60.30 GB, 61.20 GB, 62.11 GB, 63.04 GB, 64.15 GB, 65.11 GB, 66.15 GB, 67.06 GB, 67.87 GB, 68.66 GB, 69.49 GB, 70.29 GB, 71.07 GB, 71.83 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.39 GB (78800568758) - PeakReservation: 73.35 GB (78760640512) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.55 GB (91861914334) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m57s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 968.690ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 54.991ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 968.694ms - ExecTreeOpenTime: 909.815ms - PrepareTime: 198.188ms - ExecTreePrepareTime: 193.463us KuduTableSink:(Total: 34.737us, non-child: 34.737us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 910.006ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.35 GB (78760648704) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m23s - CumulativeAllocationBytes: 73.35 GB (78760640512) - CumulativeAllocations: 37.56K (37556) - PeakReservation: 73.35 GB (78760640512) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.35 GB (78760640512) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m7s, non-child: 17s680ms, % non-child: 0.77%) - ConvertRowBatchTime: 7s734ms - PeakMemoryUsage: 19.53 MB (20481650) - RowsReturned: 287.65M (287651028) - RowsReturnedRate: 125.75 K/sec Buffer pool: - AllocTime: 17m11s - CumulativeAllocationBytes: 130.63 GB (140264120320) - CumulativeAllocations: 6.85M (6848834) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.90 GB, 13.39 GB, 19.83 GB, 23.96 GB, 26.96 GB, 29.52 GB, 31.83 GB, 33.98 GB, 35.77 GB, 37.52 GB, 38.94 GB, 40.20 GB, 41.51 GB, 42.80 GB, 44.05 GB, 45.26 GB, 46.42 GB, 47.50 GB, 48.59 GB, 49.68 GB, 50.73 GB, 51.74 GB, 52.94 GB, 54.01 GB, 55.15 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.76 GB, 63.70 GB, 64.81 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.57 GB, 69.38 GB, 70.21 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 909.737ms - TotalBytesReceived: 74.15 GB (79617559810) - TotalGetBatchTime: 37m56s - DataArrivalTimer: 37m50s SenderSide: - DeserializeRowBatchTime: 20m58s - NumBatchesArrived: 3.42M (3424417) - NumBatchesDeferred: 38.37K (38369) - NumBatchesEnqueued: 3.42M (3424417) - NumBatchesReceived: 3.42M (3424417) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 57.446ms, non-child: 57.446ms, % non-child: 100.00%) - CodegenTime: 1.105ms - CompileTime: 4.959ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.838ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.176ms Instance 844a0200d7876345:20bb38b9000000fa (host=vd1332.foo.com:22000):(Total: 1s327ms, non-child: 96.447ms, % non-child: 7.27%) Fragment Instance Lifecycle Event Timeline: 1s327ms - Prepare Finished: 95.286ms (95.286ms) - Open Finished: 1s327ms (1s232ms) MemoryUsage(1m4s): 4.36 GB, 12.02 GB, 17.84 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.31 GB, 53.14 GB, 54.00 GB, 54.84 GB, 55.65 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.15 GB, 60.98 GB, 61.71 GB, 62.44 GB, 63.19 GB, 63.91 GB, 64.63 GB, 65.32 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.80 GB (71731069366) - PeakReservation: 66.77 GB (71691141120) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.86 GB (84670196191) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m12s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 1s232ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 53.991ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s232ms - ExecTreeOpenTime: 1s174ms - PrepareTime: 94.870ms - ExecTreePrepareTime: 175.355us KuduTableSink:(Total: 13.314us, non-child: 13.314us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 1s175ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.77 GB (71691149312) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m33s - CumulativeAllocationBytes: 66.77 GB (71691141120) - CumulativeAllocations: 34.19K (34185) - PeakReservation: 66.77 GB (71691141120) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.77 GB (71691141120) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m22s, non-child: 17s870ms, % non-child: 0.76%) - ConvertRowBatchTime: 7s760ms - PeakMemoryUsage: 19.53 MB (20483070) - RowsReturned: 261.82M (261824512) - RowsReturnedRate: 110.82 K/sec Buffer pool: - AllocTime: 11m54s - CumulativeAllocationBytes: 118.92 GB (127685427200) - CumulativeAllocations: 6.23M (6234640) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.37 GB, 12.11 GB, 17.99 GB, 21.75 GB, 24.49 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.11 GB, 35.39 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.96 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 1s174ms - TotalBytesReceived: 67.50 GB (72477736613) - TotalGetBatchTime: 39m11s - DataArrivalTimer: 39m5s SenderSide: - DeserializeRowBatchTime: 16m16s - NumBatchesArrived: 3.12M (3117320) - NumBatchesDeferred: 9.65K (9654) - NumBatchesEnqueued: 3.12M (3117290) - NumBatchesReceived: 3.12M (3117320) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 55.504ms, non-child: 55.504ms, % non-child: 100.00%) - CodegenTime: 1.098ms - CompileTime: 4.518ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.216ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.256ms Instance 844a0200d7876345:20bb38b900000086 (host=vd1333.foo.com:22000):(Total: 1s186ms, non-child: 201.493ms, % non-child: 16.98%) Fragment Instance Lifecycle Event Timeline: 1s186ms - Prepare Finished: 200.700ms (200.700ms) - Open Finished: 1s186ms (986.107ms) MemoryUsage(1m4s): 4.83 GB, 13.25 GB, 19.63 GB, 23.72 GB, 26.69 GB, 29.23 GB, 31.51 GB, 33.64 GB, 35.41 GB, 37.15 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.36 GB, 43.60 GB, 44.79 GB, 45.94 GB, 47.01 GB, 48.09 GB, 49.17 GB, 50.21 GB, 51.21 GB, 52.40 GB, 53.45 GB, 54.58 GB, 55.61 GB, 56.57 GB, 57.52 GB, 58.44 GB, 59.38 GB, 60.30 GB, 61.19 GB, 62.11 GB, 63.04 GB, 64.15 GB, 65.10 GB, 66.14 GB, 67.06 GB, 67.86 GB, 68.66 GB, 69.49 GB, 70.29 GB, 71.07 GB, 71.83 GB, 72.60 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.54 GB (78957855158) - PeakReservation: 73.50 GB (78917926912) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.32 GB (91612983423) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 36m6s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 986.085ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 54.992ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 986.088ms - ExecTreeOpenTime: 927.852ms - PrepareTime: 200.286ms - ExecTreePrepareTime: 177.762us KuduTableSink:(Total: 13.568us, non-child: 13.568us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 928.027ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.50 GB (78917935104) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 5m5s - CumulativeAllocationBytes: 73.50 GB (78917926912) - CumulativeAllocations: 37.63K (37631) - PeakReservation: 73.50 GB (78917926912) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.50 GB (78917926912) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 36m16s, non-child: 18s105ms, % non-child: 0.83%) - ConvertRowBatchTime: 7s859ms - PeakMemoryUsage: 19.53 MB (20481910) - RowsReturned: 288.22M (288217356) - RowsReturnedRate: 132.43 K/sec Buffer pool: - AllocTime: 26m20s - CumulativeAllocationBytes: 130.89 GB (140540272640) - CumulativeAllocations: 6.86M (6862318) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.85 GB, 13.36 GB, 19.80 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.81 GB, 33.97 GB, 35.76 GB, 37.51 GB, 38.93 GB, 40.18 GB, 41.49 GB, 42.79 GB, 44.03 GB, 45.24 GB, 46.40 GB, 47.48 GB, 48.57 GB, 49.66 GB, 50.72 GB, 51.72 GB, 52.93 GB, 54.00 GB, 55.14 GB, 56.17 GB, 57.15 GB, 58.11 GB, 59.04 GB, 59.99 GB, 60.92 GB, 61.82 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.77 GB, 66.83 GB, 67.75 GB, 68.56 GB, 69.37 GB, 70.21 GB, 71.01 GB, 71.80 GB, 72.57 GB, 73.36 GB - FirstBatchArrivalWaitTime: 927.781ms - TotalBytesReceived: 74.30 GB (79774176628) - TotalGetBatchTime: 36m5s - DataArrivalTimer: 35m58s SenderSide: - DeserializeRowBatchTime: 31m23s - NumBatchesArrived: 3.43M (3431159) - NumBatchesDeferred: 95.33K (95329) - NumBatchesEnqueued: 3.43M (3431159) - NumBatchesReceived: 3.43M (3431159) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 56.896ms, non-child: 56.896ms, % non-child: 100.00%) - CodegenTime: 964.700us - CompileTime: 4.580ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.129ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.624ms Instance 844a0200d7876345:20bb38b9000000a7 (host=vd1334.foo.com:22000):(Total: 1s207ms, non-child: 227.273ms, % non-child: 18.82%) Fragment Instance Lifecycle Event Timeline: 1s207ms - Prepare Finished: 226.446ms (226.446ms) - Open Finished: 1s207ms (981.452ms) MemoryUsage(1m4s): 4.79 GB, 13.22 GB, 19.61 GB, 23.70 GB, 26.68 GB, 29.22 GB, 31.50 GB, 33.63 GB, 35.40 GB, 37.14 GB, 38.54 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.94 GB, 47.01 GB, 48.09 GB, 49.17 GB, 50.21 GB, 51.21 GB, 52.40 GB, 53.45 GB, 54.58 GB, 55.60 GB, 56.57 GB, 57.52 GB, 58.44 GB, 59.38 GB, 60.30 GB, 61.19 GB, 62.10 GB, 63.03 GB, 64.14 GB, 65.10 GB, 66.14 GB, 67.05 GB, 67.86 GB, 68.66 GB, 69.49 GB, 70.29 GB, 71.07 GB, 71.83 GB, 72.60 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.49 GB (78905426358) - PeakReservation: 73.45 GB (78865498112) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.51 GB (91811173466) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m48s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 981.435ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 58.991ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 981.438ms - ExecTreeOpenTime: 922.141ms - PrepareTime: 226.075ms - ExecTreePrepareTime: 176.526us KuduTableSink:(Total: 13.170us, non-child: 13.170us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 922.315ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.45 GB (78865506304) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m27s - CumulativeAllocationBytes: 73.45 GB (78865498112) - CumulativeAllocations: 37.61K (37606) - PeakReservation: 73.45 GB (78865498112) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.45 GB (78865498112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m58s, non-child: 18s528ms, % non-child: 0.81%) - ConvertRowBatchTime: 8s072ms - PeakMemoryUsage: 19.53 MB (20481369) - RowsReturned: 288.03M (288031716) - RowsReturnedRate: 126.39 K/sec Buffer pool: - AllocTime: 20m13s - CumulativeAllocationBytes: 130.80 GB (140449792000) - CumulativeAllocations: 6.86M (6857900) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.88 GB, 13.38 GB, 19.82 GB, 23.95 GB, 26.95 GB, 29.51 GB, 31.82 GB, 33.98 GB, 35.76 GB, 37.52 GB, 38.93 GB, 40.19 GB, 41.51 GB, 42.80 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.67 GB, 50.73 GB, 51.73 GB, 52.94 GB, 54.00 GB, 55.14 GB, 56.18 GB, 57.15 GB, 58.11 GB, 59.04 GB, 59.99 GB, 60.92 GB, 61.83 GB, 62.75 GB, 63.69 GB, 64.81 GB, 65.78 GB, 66.83 GB, 67.75 GB, 68.57 GB, 69.37 GB, 70.21 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 922.083ms - TotalBytesReceived: 74.25 GB (79723033817) - TotalGetBatchTime: 37m47s - DataArrivalTimer: 37m40s SenderSide: - DeserializeRowBatchTime: 25m17s - NumBatchesArrived: 3.43M (3428950) - NumBatchesDeferred: 39.89K (39890) - NumBatchesEnqueued: 3.43M (3428950) - NumBatchesReceived: 3.43M (3428950) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 57.973ms, non-child: 57.973ms, % non-child: 100.00%) - CodegenTime: 1.189ms - CompileTime: 4.877ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.975ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.501ms Instance 844a0200d7876345:20bb38b900000093 (host=vd1335.foo.com:22000):(Total: 1s212ms, non-child: 221.270ms, % non-child: 18.25%) Fragment Instance Lifecycle Event Timeline: 1s213ms - Prepare Finished: 220.712ms (220.712ms) - Open Finished: 1s213ms (992.623ms) MemoryUsage(1m4s): 4.84 GB, 13.26 GB, 19.64 GB, 23.72 GB, 26.69 GB, 29.23 GB, 31.51 GB, 33.65 GB, 35.42 GB, 37.15 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.95 GB, 47.02 GB, 48.09 GB, 49.18 GB, 50.22 GB, 51.21 GB, 52.41 GB, 53.46 GB, 54.59 GB, 55.62 GB, 56.58 GB, 57.53 GB, 58.45 GB, 59.39 GB, 60.31 GB, 61.20 GB, 62.12 GB, 63.05 GB, 64.16 GB, 65.12 GB, 66.15 GB, 67.07 GB, 67.87 GB, 68.67 GB, 69.50 GB, 70.30 GB, 71.08 GB, 71.84 GB, 72.61 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.63 GB (79062712758) - PeakReservation: 73.60 GB (79022784512) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.71 GB (92030227794) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m54s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 992.608ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 53.991ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 992.611ms - ExecTreeOpenTime: 934.242ms - PrepareTime: 219.965ms - ExecTreePrepareTime: 157.904us KuduTableSink:(Total: 12.128us, non-child: 12.128us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 934.397ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.60 GB (79022792704) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m34s - CumulativeAllocationBytes: 73.60 GB (79022784512) - CumulativeAllocations: 37.68K (37681) - PeakReservation: 73.60 GB (79022784512) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.60 GB (79022784512) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m4s, non-child: 18s601ms, % non-child: 0.79%) - ConvertRowBatchTime: 8s078ms - PeakMemoryUsage: 19.53 MB (20480235) - RowsReturned: 288.61M (288607032) - RowsReturnedRate: 123.08 K/sec Buffer pool: - AllocTime: 12m37s - CumulativeAllocationBytes: 131.07 GB (140730286080) - CumulativeAllocations: 6.87M (6871596) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.87 GB, 13.37 GB, 19.81 GB, 23.94 GB, 26.94 GB, 29.51 GB, 31.82 GB, 33.97 GB, 35.76 GB, 37.51 GB, 38.93 GB, 40.18 GB, 41.50 GB, 42.79 GB, 44.04 GB, 45.25 GB, 46.41 GB, 47.49 GB, 48.58 GB, 49.67 GB, 50.73 GB, 51.73 GB, 52.94 GB, 54.01 GB, 55.14 GB, 56.18 GB, 57.16 GB, 58.12 GB, 59.05 GB, 60.00 GB, 60.93 GB, 61.83 GB, 62.76 GB, 63.70 GB, 64.82 GB, 65.79 GB, 66.84 GB, 67.76 GB, 68.57 GB, 69.38 GB, 70.22 GB, 71.02 GB, 71.81 GB, 72.58 GB, 73.36 GB - FirstBatchArrivalWaitTime: 934.157ms - TotalBytesReceived: 74.40 GB (79881837369) - TotalGetBatchTime: 38m53s - DataArrivalTimer: 38m46s SenderSide: - DeserializeRowBatchTime: 16m17s - NumBatchesArrived: 3.44M (3435798) - NumBatchesDeferred: 12.00K (12000) - NumBatchesEnqueued: 3.44M (3435798) - NumBatchesReceived: 3.44M (3435798) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 56.957ms, non-child: 56.957ms, % non-child: 100.00%) - CodegenTime: 1.346ms - CompileTime: 5.489ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 31.979ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 18.940ms Instance 844a0200d7876345:20bb38b9000000de (host=vd1336.foo.com:22000):(Total: 1s171ms, non-child: 207.545ms, % non-child: 17.72%) Fragment Instance Lifecycle Event Timeline: 1s171ms - Prepare Finished: 206.458ms (206.458ms) - Open Finished: 1s171ms (965.129ms) MemoryUsage(1m4s): 4.35 GB, 12.01 GB, 17.83 GB, 21.55 GB, 24.26 GB, 26.57 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.31 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.87 GB (71804469686) - PeakReservation: 66.84 GB (71764541440) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.06 GB (84891071677) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m26s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 965.110ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 54.992ms - TotalThreadsVoluntaryContextSwitches: 8 (8) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 965.113ms - ExecTreeOpenTime: 908.727ms - PrepareTime: 206.180ms - ExecTreePrepareTime: 232.193us KuduTableSink:(Total: 13.949us, non-child: 13.949us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 908.956ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.84 GB (71764549632) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m21s - CumulativeAllocationBytes: 66.84 GB (71764541440) - CumulativeAllocations: 34.22K (34220) - PeakReservation: 66.84 GB (71764541440) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.84 GB (71764541440) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m35s, non-child: 17s385ms, % non-child: 0.75%) - ConvertRowBatchTime: 7s516ms - PeakMemoryUsage: 19.53 MB (20483823) - RowsReturned: 262.10M (262099236) - RowsReturnedRate: 113.17 K/sec Buffer pool: - AllocTime: 15m9s - CumulativeAllocationBytes: 119.03 GB (127804579840) - CumulativeAllocations: 6.24M (6240458) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.43 GB, 12.16 GB, 18.02 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.74 GB, 38.91 GB, 40.05 GB, 41.15 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.17 GB, 46.13 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.69 GB, 54.55 GB, 55.40 GB, 56.22 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.77 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 908.611ms - TotalBytesReceived: 67.56 GB (72545013312) - TotalGetBatchTime: 38m25s - DataArrivalTimer: 38m18s SenderSide: - DeserializeRowBatchTime: 18m51s - NumBatchesArrived: 3.12M (3120229) - NumBatchesDeferred: 32.07K (32067) - NumBatchesEnqueued: 3.12M (3120229) - NumBatchesReceived: 3.12M (3120229) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 54.839ms, non-child: 54.839ms, % non-child: 100.00%) - CodegenTime: 1.295ms - CompileTime: 5.681ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 29.203ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 19.478ms Instance 844a0200d7876345:20bb38b9000000bf (host=vd1337.foo.com:22000):(Total: 1s170ms, non-child: 210.341ms, % non-child: 17.97%) Fragment Instance Lifecycle Event Timeline: 1s171ms - Prepare Finished: 209.605ms (209.605ms) - Open Finished: 1s171ms (961.600ms) MemoryUsage(1m4s): 4.39 GB, 12.04 GB, 17.85 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.70 GB, 45.65 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.56 GB, 51.43 GB, 52.30 GB, 53.13 GB, 53.99 GB, 54.82 GB, 55.64 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.42 GB, 63.18 GB, 63.90 GB, 64.61 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.97 GB (71911424438) - PeakReservation: 66.94 GB (71871496192) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.97 GB (84797087257) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m41s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 961.576ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 61.990ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 961.578ms - ExecTreeOpenTime: 897.306ms - PrepareTime: 209.183ms - ExecTreePrepareTime: 182.003us KuduTableSink:(Total: 11.730us, non-child: 11.730us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 897.485ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.94 GB (71871504384) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m12s - CumulativeAllocationBytes: 66.94 GB (71871496192) - CumulativeAllocations: 34.27K (34271) - PeakReservation: 66.94 GB (71871496192) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.94 GB (71871496192) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m51s, non-child: 17s640ms, % non-child: 0.76%) - ConvertRowBatchTime: 7s705ms - PeakMemoryUsage: 19.53 MB (20483089) - RowsReturned: 262.48M (262484796) - RowsReturnedRate: 112.58 K/sec Buffer pool: - AllocTime: 16m37s - CumulativeAllocationBytes: 119.20 GB (127992627200) - CumulativeAllocations: 6.25M (6249640) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.40 GB, 12.13 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.10 GB, 35.39 GB, 36.53 GB, 37.72 GB, 38.90 GB, 40.03 GB, 41.13 GB, 42.18 GB, 43.17 GB, 44.16 GB, 45.15 GB, 46.11 GB, 47.02 GB, 48.12 GB, 49.09 GB, 50.12 GB, 51.07 GB, 51.95 GB, 52.83 GB, 53.67 GB, 54.53 GB, 55.38 GB, 56.20 GB, 57.04 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.75 GB, 61.59 GB, 62.33 GB, 63.07 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 897.252ms - TotalBytesReceived: 67.66 GB (72651915974) - TotalGetBatchTime: 38m40s - DataArrivalTimer: 38m34s SenderSide: - DeserializeRowBatchTime: 20m1s - NumBatchesArrived: 3.12M (3124820) - NumBatchesDeferred: 21.68K (21679) - NumBatchesEnqueued: 3.12M (3124820) - NumBatchesReceived: 3.12M (3124820) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 62.981ms, non-child: 62.981ms, % non-child: 100.00%) - CodegenTime: 1.234ms - CompileTime: 5.515ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.595ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.190ms Instance 844a0200d7876345:20bb38b9000000dd (host=vd1338.foo.com:22000):(Total: 1s191ms, non-child: 218.322ms, % non-child: 18.32%) Fragment Instance Lifecycle Event Timeline: 1s191ms - Prepare Finished: 217.525ms (217.525ms) - Open Finished: 1s191ms (974.229ms) MemoryUsage(1m4s): 4.37 GB, 12.04 GB, 17.85 GB, 21.57 GB, 24.27 GB, 26.58 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.06 GB, 36.19 GB, 37.37 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.72 GB, 45.67 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.64 GB, 50.57 GB, 51.45 GB, 52.31 GB, 53.15 GB, 54.00 GB, 54.84 GB, 55.65 GB, 56.48 GB, 57.33 GB, 58.33 GB, 59.21 GB, 60.15 GB, 60.98 GB, 61.71 GB, 62.44 GB, 63.19 GB, 63.92 GB, 64.63 GB, 65.32 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.87 GB (71800275382) - PeakReservation: 66.83 GB (71760347136) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.77 GB (84578342065) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m45s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 974.215ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 61.990ms - TotalThreadsVoluntaryContextSwitches: 8 (8) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 974.218ms - ExecTreeOpenTime: 908.846ms - PrepareTime: 217.111ms - ExecTreePrepareTime: 168.524us KuduTableSink:(Total: 17.032us, non-child: 17.032us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 909.012ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.83 GB (71760355328) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m19s - CumulativeAllocationBytes: 66.83 GB (71760347136) - CumulativeAllocations: 34.22K (34218) - PeakReservation: 66.83 GB (71760347136) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.83 GB (71760347136) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m54s, non-child: 16s869ms, % non-child: 0.72%) - ConvertRowBatchTime: 7s273ms - PeakMemoryUsage: 19.53 MB (20483081) - RowsReturned: 262.08M (262078404) - RowsReturnedRate: 112.26 K/sec Buffer pool: - AllocTime: 14m23s - CumulativeAllocationBytes: 119.02 GB (127794421760) - CumulativeAllocations: 6.24M (6239962) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.39 GB, 12.13 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.74 GB, 38.91 GB, 40.05 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.17 GB, 46.13 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.40 GB, 56.22 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.77 GB, 61.60 GB, 62.35 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 908.772ms - TotalBytesReceived: 67.56 GB (72539783013) - TotalGetBatchTime: 38m44s - DataArrivalTimer: 38m38s SenderSide: - DeserializeRowBatchTime: 17m30s - NumBatchesArrived: 3.12M (3119981) - NumBatchesDeferred: 20.38K (20378) - NumBatchesEnqueued: 3.12M (3119981) - NumBatchesReceived: 3.12M (3119981) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 64.040ms, non-child: 64.040ms, % non-child: 100.00%) - CodegenTime: 1.492ms - CompileTime: 6.012ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 33.264ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.122ms Instance 844a0200d7876345:20bb38b9000000db (host=vd1339.foo.com:22000):(Total: 1s195ms, non-child: 215.573ms, % non-child: 18.04%) Fragment Instance Lifecycle Event Timeline: 1s195ms - Prepare Finished: 214.449ms (214.449ms) - Open Finished: 1s195ms (980.935ms) MemoryUsage(1m4s): 4.39 GB, 12.04 GB, 17.85 GB, 21.56 GB, 24.27 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.71 GB, 45.65 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.56 GB, 51.43 GB, 52.30 GB, 53.13 GB, 53.98 GB, 54.82 GB, 55.63 GB, 56.46 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.13 GB, 60.96 GB, 61.70 GB, 62.42 GB, 63.18 GB, 63.90 GB, 64.61 GB, 65.30 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.97 GB (71909327286) - PeakReservation: 66.93 GB (71869399040) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.15 GB (84991535143) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m4s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 980.918ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 58.991ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 980.926ms - ExecTreeOpenTime: 920.723ms - PrepareTime: 214.175ms - ExecTreePrepareTime: 176.413us KuduTableSink:(Total: 19.314us, non-child: 19.314us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 920.897ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.93 GB (71869407232) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m53s - CumulativeAllocationBytes: 66.93 GB (71869399040) - CumulativeAllocations: 34.27K (34270) - PeakReservation: 66.93 GB (71869399040) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.93 GB (71869399040) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m14s, non-child: 17s321ms, % non-child: 0.74%) - ConvertRowBatchTime: 7s542ms - PeakMemoryUsage: 19.53 MB (20482754) - RowsReturned: 262.48M (262479168) - RowsReturnedRate: 111.47 K/sec Buffer pool: - AllocTime: 13m54s - CumulativeAllocationBytes: 119.20 GB (127989841920) - CumulativeAllocations: 6.25M (6249504) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.40 GB, 12.13 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.10 GB, 35.39 GB, 36.53 GB, 37.73 GB, 38.90 GB, 40.03 GB, 41.13 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.15 GB, 46.11 GB, 47.02 GB, 48.12 GB, 49.09 GB, 50.12 GB, 51.07 GB, 51.95 GB, 52.83 GB, 53.67 GB, 54.53 GB, 55.38 GB, 56.20 GB, 57.04 GB, 57.89 GB, 58.91 GB, 59.79 GB, 60.75 GB, 61.59 GB, 62.33 GB, 63.06 GB, 63.82 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 920.633ms - TotalBytesReceived: 67.66 GB (72650162145) - TotalGetBatchTime: 39m4s - DataArrivalTimer: 38m57s SenderSide: - DeserializeRowBatchTime: 17m4s - NumBatchesArrived: 3.12M (3124752) - NumBatchesDeferred: 14.61K (14610) - NumBatchesEnqueued: 3.12M (3124752) - NumBatchesReceived: 3.12M (3124752) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 58.677ms, non-child: 58.677ms, % non-child: 100.00%) - CodegenTime: 1.985ms - CompileTime: 4.452ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 29.121ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.578ms Instance 844a0200d7876345:20bb38b9000000d7 (host=vd1340.foo.com:22000):(Total: 1s177ms, non-child: 194.236ms, % non-child: 16.50%) Fragment Instance Lifecycle Event Timeline: 1s177ms - Prepare Finished: 193.226ms (193.226ms) - Open Finished: 1s177ms (984.275ms) MemoryUsage(1m4s): 4.36 GB, 12.02 GB, 17.83 GB, 21.55 GB, 24.25 GB, 26.56 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.04 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.71 GB, 45.65 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.56 GB, 51.43 GB, 52.30 GB, 53.13 GB, 53.99 GB, 54.82 GB, 55.64 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.42 GB, 63.18 GB, 63.90 GB, 64.61 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.87 GB (71800275382) - PeakReservation: 66.83 GB (71760347136) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.12 GB (84954587409) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m32s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 984.252ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 62.991ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 984.255ms - ExecTreeOpenTime: 917.344ms - PrepareTime: 192.844ms - ExecTreePrepareTime: 150.599us KuduTableSink:(Total: 17.791us, non-child: 17.791us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 917.492ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.83 GB (71760355328) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 4m12s - CumulativeAllocationBytes: 66.83 GB (71760347136) - CumulativeAllocations: 34.22K (34218) - PeakReservation: 66.83 GB (71760347136) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.83 GB (71760347136) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m41s, non-child: 17s663ms, % non-child: 0.78%) - ConvertRowBatchTime: 7s571ms - PeakMemoryUsage: 19.53 MB (20483748) - RowsReturned: 262.08M (262078908) - RowsReturnedRate: 115.87 K/sec Buffer pool: - AllocTime: 31m38s - CumulativeAllocationBytes: 119.02 GB (127794667520) - CumulativeAllocations: 6.24M (6239974) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.44 GB, 12.17 GB, 18.02 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.39 GB, 36.54 GB, 37.74 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.92 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 917.269ms - TotalBytesReceived: 67.56 GB (72539748131) - TotalGetBatchTime: 37m31s - DataArrivalTimer: 37m24s SenderSide: - DeserializeRowBatchTime: 35m11s - NumBatchesArrived: 3.12M (3119987) - NumBatchesDeferred: 52.68K (52677) - NumBatchesEnqueued: 3.12M (3119987) - NumBatchesReceived: 3.12M (3119987) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 65.414ms, non-child: 65.414ms, % non-child: 100.00%) - CodegenTime: 1.307ms - CompileTime: 5.760ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 34.592ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.476ms Instance 844a0200d7876345:20bb38b9000000d6 (host=vd1341.foo.com:22000):(Total: 1s225ms, non-child: 192.352ms, % non-child: 15.70%) Fragment Instance Lifecycle Event Timeline: 1s225ms - Prepare Finished: 191.582ms (191.582ms) - Open Finished: 1s225ms (1s033ms) MemoryUsage(1m4s): 4.38 GB, 12.04 GB, 17.85 GB, 21.57 GB, 24.27 GB, 26.58 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.37 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.31 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.19 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.88 GB (71806566838) - PeakReservation: 66.84 GB (71766638592) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.96 GB (84779742786) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m47s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s033ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 60.991ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s033ms - ExecTreeOpenTime: 972.292ms - PrepareTime: 191.172ms - ExecTreePrepareTime: 157.325us KuduTableSink:(Total: 15.222us, non-child: 15.222us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 972.446ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.84 GB (71766646784) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m13s - CumulativeAllocationBytes: 66.84 GB (71766638592) - CumulativeAllocations: 34.22K (34221) - PeakReservation: 66.84 GB (71766638592) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.84 GB (71766638592) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m57s, non-child: 17s454ms, % non-child: 0.75%) - ConvertRowBatchTime: 7s632ms - PeakMemoryUsage: 19.53 MB (20483867) - RowsReturned: 262.10M (262102016) - RowsReturnedRate: 112.11 K/sec Buffer pool: - AllocTime: 15m23s - CumulativeAllocationBytes: 119.04 GB (127813836800) - CumulativeAllocations: 6.24M (6240910) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.39 GB, 12.13 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.92 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.39 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.96 GB, 52.84 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.92 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 972.180ms - TotalBytesReceived: 67.57 GB (72550776388) - TotalGetBatchTime: 38m47s - DataArrivalTimer: 38m40s SenderSide: - DeserializeRowBatchTime: 18m34s - NumBatchesArrived: 3.12M (3120456) - NumBatchesDeferred: 17.31K (17314) - NumBatchesEnqueued: 3.12M (3120447) - NumBatchesReceived: 3.12M (3120456) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 60.231ms, non-child: 60.231ms, % non-child: 100.00%) - CodegenTime: 1.040ms - CompileTime: 5.740ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 31.850ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.086ms Instance 844a0200d7876345:20bb38b9000000d0 (host=vd1342.foo.com:22000):(Total: 1s242ms, non-child: 215.750ms, % non-child: 17.37%) Fragment Instance Lifecycle Event Timeline: 1s242ms - Prepare Finished: 214.615ms (214.615ms) - Open Finished: 1s242ms (1s027ms) MemoryUsage(1m4s): 4.34 GB, 12.00 GB, 17.82 GB, 21.55 GB, 24.26 GB, 26.57 GB, 28.64 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.32 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.77 GB (71689126326) - PeakReservation: 66.73 GB (71649198080) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.73 GB (84535843092) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m19s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 1s027ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 56.992ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s027ms - ExecTreeOpenTime: 969.796ms - PrepareTime: 214.228ms - ExecTreePrepareTime: 215.290us KuduTableSink:(Total: 15.465us, non-child: 15.465us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 970.008ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.73 GB (71649206272) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m18s - CumulativeAllocationBytes: 66.73 GB (71649198080) - CumulativeAllocations: 34.16K (34165) - PeakReservation: 66.73 GB (71649198080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.73 GB (71649198080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m29s, non-child: 17s538ms, % non-child: 0.76%) - ConvertRowBatchTime: 7s678ms - PeakMemoryUsage: 19.54 MB (20483934) - RowsReturned: 261.67M (261673860) - RowsReturnedRate: 113.32 K/sec Buffer pool: - AllocTime: 16m1s - CumulativeAllocationBytes: 118.83 GB (127597199360) - CumulativeAllocations: 6.23M (6230332) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.42 GB, 12.16 GB, 18.02 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.22 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 969.695ms - TotalBytesReceived: 67.45 GB (72427716787) - TotalGetBatchTime: 38m18s - DataArrivalTimer: 38m12s SenderSide: - DeserializeRowBatchTime: 19m18s - NumBatchesArrived: 3.12M (3115166) - NumBatchesDeferred: 23.73K (23734) - NumBatchesEnqueued: 3.12M (3115165) - NumBatchesReceived: 3.12M (3115166) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 56.393ms, non-child: 56.393ms, % non-child: 100.00%) - CodegenTime: 1.112ms - CompileTime: 4.893ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.550ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.345ms Instance 844a0200d7876345:20bb38b9000000ea (host=ve1125.foo.com:22000):(Total: 1s183ms, non-child: 203.336ms, % non-child: 17.18%) Fragment Instance Lifecycle Event Timeline: 1s183ms - Prepare Finished: 202.643ms (202.643ms) - Open Finished: 1s183ms (981.215ms) MemoryUsage(1m4s): 4.40 GB, 12.05 GB, 17.85 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.94 GB (71875772854) - PeakReservation: 66.90 GB (71835844608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.84 GB (84653613869) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m13s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 981.174ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 57.992ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 981.176ms - ExecTreeOpenTime: 921.572ms - PrepareTime: 202.222ms - ExecTreePrepareTime: 134.804us KuduTableSink:(Total: 11.560us, non-child: 11.560us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 921.704ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.90 GB (71835852800) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m51s - CumulativeAllocationBytes: 66.90 GB (71835844608) - CumulativeAllocations: 34.25K (34254) - PeakReservation: 66.90 GB (71835844608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.90 GB (71835844608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m23s, non-child: 17s442ms, % non-child: 0.74%) - ConvertRowBatchTime: 7s586ms - PeakMemoryUsage: 19.53 MB (20482704) - RowsReturned: 262.36M (262356696) - RowsReturnedRate: 110.99 K/sec Buffer pool: - AllocTime: 9m12s - CumulativeAllocationBytes: 119.14 GB (127930122240) - CumulativeAllocations: 6.25M (6246588) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.41 GB, 12.14 GB, 18.00 GB, 21.76 GB, 24.48 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.10 GB, 35.39 GB, 36.53 GB, 37.73 GB, 38.90 GB, 40.03 GB, 41.13 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.12 GB, 49.10 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 921.512ms - TotalBytesReceived: 67.63 GB (72616549702) - TotalGetBatchTime: 39m13s - DataArrivalTimer: 39m6s SenderSide: - DeserializeRowBatchTime: 12m33s - NumBatchesArrived: 3.12M (3123294) - NumBatchesDeferred: 8.13K (8135) - NumBatchesEnqueued: 3.12M (3123294) - NumBatchesReceived: 3.12M (3123294) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 58.432ms, non-child: 58.432ms, % non-child: 100.00%) - CodegenTime: 1.027ms - CompileTime: 5.007ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.440ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 20.311ms Instance 844a0200d7876345:20bb38b9000000e6 (host=ve1126.foo.com:22000):(Total: 1s219ms, non-child: 224.713ms, % non-child: 18.43%) Fragment Instance Lifecycle Event Timeline: 1s219ms - Prepare Finished: 223.890ms (223.890ms) - Open Finished: 1s219ms (995.670ms) MemoryUsage(1m4s): 4.35 GB, 12.01 GB, 17.83 GB, 21.55 GB, 24.25 GB, 26.56 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.05 GB, 36.17 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.70 GB, 45.65 GB, 46.55 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.55 GB, 51.43 GB, 52.30 GB, 53.13 GB, 53.99 GB, 54.82 GB, 55.63 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.13 GB, 60.96 GB, 61.70 GB, 62.42 GB, 63.17 GB, 63.90 GB, 64.61 GB, 65.30 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.71 GB (71628308918) - PeakReservation: 66.67 GB (71588380672) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.69 GB (84490233243) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m40s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 995.655ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 995.658ms - ExecTreeOpenTime: 934.512ms - PrepareTime: 223.462ms - ExecTreePrepareTime: 171.335us KuduTableSink:(Total: 13.651us, non-child: 13.651us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 934.681ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.67 GB (71588388864) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m48s - CumulativeAllocationBytes: 66.67 GB (71588380672) - CumulativeAllocations: 34.14K (34136) - PeakReservation: 66.67 GB (71588380672) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.67 GB (71588380672) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m50s, non-child: 17s174ms, % non-child: 0.74%) - ConvertRowBatchTime: 7s557ms - PeakMemoryUsage: 19.53 MB (20482370) - RowsReturned: 261.46M (261458652) - RowsReturnedRate: 112.21 K/sec Buffer pool: - AllocTime: 9m48s - CumulativeAllocationBytes: 118.74 GB (127492218880) - CumulativeAllocations: 6.23M (6225206) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.43 GB, 12.16 GB, 18.01 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.12 GB, 49.09 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.76 GB, 61.59 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 934.444ms - TotalBytesReceived: 67.40 GB (72367869843) - TotalGetBatchTime: 38m39s - DataArrivalTimer: 38m33s SenderSide: - DeserializeRowBatchTime: 12m48s - NumBatchesArrived: 3.11M (3112603) - NumBatchesDeferred: 7.89K (7892) - NumBatchesEnqueued: 3.11M (3112603) - NumBatchesReceived: 3.11M (3112603) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 59.776ms, non-child: 59.776ms, % non-child: 100.00%) - CodegenTime: 1.132ms - CompileTime: 5.957ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 31.607ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 21.316ms Instance 844a0200d7876345:20bb38b9000000e7 (host=ve1127.foo.com:22000):(Total: 1s171ms, non-child: 200.242ms, % non-child: 17.10%) Fragment Instance Lifecycle Event Timeline: 1s171ms - Prepare Finished: 199.500ms (199.500ms) - Open Finished: 1s171ms (971.918ms) MemoryUsage(1m4s): 4.35 GB, 12.01 GB, 17.83 GB, 21.55 GB, 24.26 GB, 26.57 GB, 28.64 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.13 GB, 53.99 GB, 54.82 GB, 55.63 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.13 GB, 60.96 GB, 61.70 GB, 62.42 GB, 63.17 GB, 63.90 GB, 64.61 GB, 65.30 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.93 GB (71863189942) - PeakReservation: 66.89 GB (71823261696) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.13 GB (84965543022) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 40m8s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 971.901ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 58.991ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 971.906ms - ExecTreeOpenTime: 910.815ms - PrepareTime: 199.051ms - ExecTreePrepareTime: 189.070us KuduTableSink:(Total: 15.703us, non-child: 15.703us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 911.000ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.89 GB (71823269888) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 1m48s - CumulativeAllocationBytes: 66.89 GB (71823261696) - CumulativeAllocations: 34.25K (34248) - PeakReservation: 66.89 GB (71823261696) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.89 GB (71823261696) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 40m18s, non-child: 17s248ms, % non-child: 0.71%) - ConvertRowBatchTime: 7s528ms - PeakMemoryUsage: 19.36 MB (20301930) - RowsReturned: 262.30M (262304952) - RowsReturnedRate: 108.45 K/sec Buffer pool: - AllocTime: 4m48s - CumulativeAllocationBytes: 119.12 GB (127904890880) - CumulativeAllocations: 6.25M (6245356) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.43 GB, 12.16 GB, 18.02 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.96 GB, 52.84 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.76 GB, 61.59 GB, 62.33 GB, 63.07 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 910.735ms - TotalBytesReceived: 67.62 GB (72602175423) - TotalGetBatchTime: 40m8s - DataArrivalTimer: 40m1s SenderSide: - DeserializeRowBatchTime: 7m48s - NumBatchesArrived: 3.12M (3122678) - NumBatchesDeferred: 1.11K (1108) - NumBatchesEnqueued: 3.12M (3122678) - NumBatchesReceived: 3.12M (3122678) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 59.760ms, non-child: 59.760ms, % non-child: 100.00%) - CodegenTime: 1.084ms - CompileTime: 4.810ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 29.530ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.879ms Instance 844a0200d7876345:20bb38b9000000c3 (host=ve1128.foo.com:22000):(Total: 1s183ms, non-child: 202.081ms, % non-child: 17.08%) Fragment Instance Lifecycle Event Timeline: 1s183ms - Prepare Finished: 201.188ms (201.188ms) - Open Finished: 1s183ms (982.219ms) MemoryUsage(1m4s): 4.40 GB, 12.05 GB, 17.85 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.04 GB, 36.17 GB, 37.35 GB, 38.51 GB, 39.64 GB, 40.72 GB, 41.76 GB, 42.73 GB, 43.72 GB, 44.70 GB, 45.65 GB, 46.55 GB, 47.63 GB, 48.59 GB, 49.62 GB, 50.55 GB, 51.43 GB, 52.29 GB, 53.13 GB, 53.98 GB, 54.82 GB, 55.63 GB, 56.46 GB, 57.31 GB, 58.31 GB, 59.19 GB, 60.13 GB, 60.96 GB, 61.69 GB, 62.42 GB, 63.17 GB, 63.89 GB, 64.61 GB, 65.30 GB, 66.00 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.89 GB (71825441206) - PeakReservation: 66.86 GB (71785512960) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.93 GB (84745446486) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m19s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 982.203ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 57.991ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 982.206ms - ExecTreeOpenTime: 922.007ms - PrepareTime: 200.904ms - ExecTreePrepareTime: 234.494us KuduTableSink:(Total: 19.899us, non-child: 19.899us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 922.238ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.86 GB (71785521152) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m27s - CumulativeAllocationBytes: 66.86 GB (71785512960) - CumulativeAllocations: 34.23K (34230) - PeakReservation: 66.86 GB (71785512960) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.86 GB (71785512960) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m29s, non-child: 18s270ms, % non-child: 0.77%) - ConvertRowBatchTime: 7s973ms - PeakMemoryUsage: 19.53 MB (20483206) - RowsReturned: 262.17M (262174500) - RowsReturnedRate: 110.63 K/sec Buffer pool: - AllocTime: 17m10s - CumulativeAllocationBytes: 119.06 GB (127841280000) - CumulativeAllocations: 6.24M (6242250) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.41 GB, 12.14 GB, 18.00 GB, 21.76 GB, 24.48 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.50 GB, 34.10 GB, 35.38 GB, 36.53 GB, 37.72 GB, 38.89 GB, 40.03 GB, 41.13 GB, 42.18 GB, 43.16 GB, 44.15 GB, 45.15 GB, 46.11 GB, 47.02 GB, 48.11 GB, 49.08 GB, 50.12 GB, 51.06 GB, 51.95 GB, 52.82 GB, 53.67 GB, 54.53 GB, 55.38 GB, 56.20 GB, 57.04 GB, 57.89 GB, 58.91 GB, 59.79 GB, 60.75 GB, 61.58 GB, 62.32 GB, 63.06 GB, 63.82 GB, 64.55 GB, 65.27 GB, 65.97 GB, 66.68 GB - FirstBatchArrivalWaitTime: 921.937ms - TotalBytesReceived: 67.58 GB (72566048635) - TotalGetBatchTime: 39m18s - DataArrivalTimer: 39m12s SenderSide: - DeserializeRowBatchTime: 21m15s - NumBatchesArrived: 3.12M (3121125) - NumBatchesDeferred: 11.66K (11665) - NumBatchesEnqueued: 3.12M (3121125) - NumBatchesReceived: 3.12M (3121125) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 58.830ms, non-child: 58.830ms, % non-child: 100.00%) - CodegenTime: 1.129ms - CompileTime: 4.824ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.609ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.819ms Instance 844a0200d7876345:20bb38b9000000bc (host=ve1129.foo.com:22000):(Total: 1s225ms, non-child: 208.178ms, % non-child: 16.99%) Fragment Instance Lifecycle Event Timeline: 1s225ms - Prepare Finished: 207.231ms (207.231ms) - Open Finished: 1s225ms (1s018ms) MemoryUsage(1m4s): 4.38 GB, 12.04 GB, 17.84 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.65 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.13 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.75 GB (71676543414) - PeakReservation: 66.72 GB (71636615168) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.87 GB (84683972840) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m35s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1s018ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 63.990ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s018ms - ExecTreeOpenTime: 952.536ms - PrepareTime: 206.810ms - ExecTreePrepareTime: 145.290us KuduTableSink:(Total: 15.505us, non-child: 15.505us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 952.678ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.72 GB (71636623360) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m58s - CumulativeAllocationBytes: 66.72 GB (71636615168) - CumulativeAllocations: 34.16K (34159) - PeakReservation: 66.72 GB (71636615168) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.72 GB (71636615168) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m44s, non-child: 16s988ms, % non-child: 0.73%) - ConvertRowBatchTime: 7s457ms - PeakMemoryUsage: 19.53 MB (20482699) - RowsReturned: 261.63M (261627904) - RowsReturnedRate: 112.53 K/sec Buffer pool: - AllocTime: 10m42s - CumulativeAllocationBytes: 118.81 GB (127574835200) - CumulativeAllocations: 6.23M (6229240) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.39 GB, 12.13 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.10 GB, 35.39 GB, 36.54 GB, 37.73 GB, 38.90 GB, 40.04 GB, 41.13 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.11 GB, 47.03 GB, 48.12 GB, 49.09 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.67 GB, 54.54 GB, 55.38 GB, 56.20 GB, 57.04 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.75 GB, 61.59 GB, 62.33 GB, 63.07 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 952.457ms - TotalBytesReceived: 67.44 GB (72415017864) - TotalGetBatchTime: 38m34s - DataArrivalTimer: 38m28s SenderSide: - DeserializeRowBatchTime: 13m54s - NumBatchesArrived: 3.11M (3114620) - NumBatchesDeferred: 14.14K (14136) - NumBatchesEnqueued: 3.11M (3114620) - NumBatchesReceived: 3.11M (3114620) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 64.233ms, non-child: 64.233ms, % non-child: 100.00%) - CodegenTime: 1.614ms - CompileTime: 6.358ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 33.597ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.603ms Instance 844a0200d7876345:20bb38b9000000ed (host=ve1130.foo.com:22000):(Total: 1s176ms, non-child: 216.292ms, % non-child: 18.39%) Fragment Instance Lifecycle Event Timeline: 1s176ms - Prepare Finished: 215.500ms (215.500ms) - Open Finished: 1s176ms (961.015ms) MemoryUsage(1m4s): 4.34 GB, 12.00 GB, 17.83 GB, 21.55 GB, 24.26 GB, 26.57 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 67.00 GB (71940784566) - PeakReservation: 66.96 GB (71900856320) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.91 GB (84730293834) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m13s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 960.991ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 61.991ms - TotalThreadsVoluntaryContextSwitches: 9 (9) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 960.995ms - ExecTreeOpenTime: 898.118ms - PrepareTime: 214.966ms - ExecTreePrepareTime: 177.341us KuduTableSink:(Total: 12.522us, non-child: 12.522us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 898.293ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.96 GB (71900864512) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 4m44s - CumulativeAllocationBytes: 66.96 GB (71900856320) - CumulativeAllocations: 34.28K (34285) - PeakReservation: 66.96 GB (71900856320) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.96 GB (71900856320) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m23s, non-child: 17s899ms, % non-child: 0.80%) - ConvertRowBatchTime: 7s798ms - PeakMemoryUsage: 19.54 MB (20484826) - RowsReturned: 262.59M (262590132) - RowsReturnedRate: 117.04 K/sec Buffer pool: - AllocTime: 29m22s - CumulativeAllocationBytes: 119.25 GB (128043950080) - CumulativeAllocations: 6.25M (6252146) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.43 GB, 12.16 GB, 18.02 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.74 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.92 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 898.042ms - TotalBytesReceived: 67.69 GB (72680987356) - TotalGetBatchTime: 37m12s - DataArrivalTimer: 37m6s SenderSide: - DeserializeRowBatchTime: 33m58s - NumBatchesArrived: 3.13M (3126073) - NumBatchesDeferred: 60.25K (60254) - NumBatchesEnqueued: 3.13M (3126073) - NumBatchesReceived: 3.13M (3126073) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 61.450ms, non-child: 61.450ms, % non-child: 100.00%) - CodegenTime: 1.219ms - CompileTime: 5.387ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 29.318ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 26.177ms Instance 844a0200d7876345:20bb38b9000000f3 (host=ve1131.foo.com:22000):(Total: 1s218ms, non-child: 246.000ms, % non-child: 20.19%) Fragment Instance Lifecycle Event Timeline: 1s218ms - Prepare Finished: 245.338ms (245.338ms) - Open Finished: 1s218ms (973.488ms) MemoryUsage(1m4s): 4.38 GB, 12.03 GB, 17.84 GB, 21.55 GB, 24.25 GB, 26.57 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.04 GB, 36.17 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.70 GB, 45.65 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.56 GB, 51.43 GB, 52.30 GB, 53.13 GB, 53.99 GB, 54.82 GB, 55.63 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.13 GB, 60.96 GB, 61.70 GB, 62.42 GB, 63.17 GB, 63.90 GB, 64.61 GB, 65.30 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.86 GB (71789789622) - PeakReservation: 66.82 GB (71749861376) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.97 GB (84792526777) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m51s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 973.471ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 49.992ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 973.475ms - ExecTreeOpenTime: 923.428ms - PrepareTime: 244.886ms - ExecTreePrepareTime: 173.836us KuduTableSink:(Total: 14.079us, non-child: 14.079us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 923.598ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.82 GB (71749869568) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m8s - CumulativeAllocationBytes: 66.82 GB (71749861376) - CumulativeAllocations: 34.21K (34213) - PeakReservation: 66.82 GB (71749861376) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.82 GB (71749861376) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 40m1s, non-child: 17s380ms, % non-child: 0.72%) - ConvertRowBatchTime: 7s694ms - PeakMemoryUsage: 19.48 MB (20422649) - RowsReturned: 262.04M (262042032) - RowsReturnedRate: 109.14 K/sec Buffer pool: - AllocTime: 7m48s - CumulativeAllocationBytes: 119.00 GB (127776686080) - CumulativeAllocations: 6.24M (6239096) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.40 GB, 12.13 GB, 17.99 GB, 21.75 GB, 24.48 GB, 26.82 GB, 28.91 GB, 30.88 GB, 32.50 GB, 34.09 GB, 35.38 GB, 36.53 GB, 37.72 GB, 38.90 GB, 40.03 GB, 41.13 GB, 42.18 GB, 43.16 GB, 44.16 GB, 45.15 GB, 46.11 GB, 47.02 GB, 48.12 GB, 49.09 GB, 50.12 GB, 51.07 GB, 51.95 GB, 52.83 GB, 53.67 GB, 54.53 GB, 55.38 GB, 56.20 GB, 57.04 GB, 57.90 GB, 58.91 GB, 59.79 GB, 60.75 GB, 61.59 GB, 62.33 GB, 63.06 GB, 63.82 GB, 64.56 GB, 65.28 GB, 65.97 GB, 66.69 GB - FirstBatchArrivalWaitTime: 923.339ms - TotalBytesReceived: 67.55 GB (72529062071) - TotalGetBatchTime: 39m50s - DataArrivalTimer: 39m44s SenderSide: - DeserializeRowBatchTime: 11m33s - NumBatchesArrived: 3.12M (3119548) - NumBatchesDeferred: 3.65K (3651) - NumBatchesEnqueued: 3.12M (3119548) - NumBatchesReceived: 3.12M (3119548) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 48.814ms, non-child: 48.814ms, % non-child: 100.00%) - CodegenTime: 1.084ms - CompileTime: 5.359ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 26.981ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 15.981ms Instance 844a0200d7876345:20bb38b9000000f2 (host=ve1132.foo.com:22000):(Total: 1s198ms, non-child: 207.931ms, % non-child: 17.35%) Fragment Instance Lifecycle Event Timeline: 1s199ms - Prepare Finished: 207.314ms (207.314ms) - Open Finished: 1s199ms (991.831ms) MemoryUsage(1m4s): 4.35 GB, 12.01 GB, 17.82 GB, 21.54 GB, 24.25 GB, 26.56 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.04 GB, 36.17 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.70 GB, 45.65 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.56 GB, 51.43 GB, 52.30 GB, 53.13 GB, 53.99 GB, 54.82 GB, 55.64 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.13 GB, 60.96 GB, 61.70 GB, 62.42 GB, 63.17 GB, 63.90 GB, 64.61 GB, 65.30 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.89 GB (71821246902) - PeakReservation: 66.85 GB (71781318656) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.93 GB (84755032991) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m51s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 991.817ms - TotalThreadsSysTime: 5.000ms - TotalThreadsUserTime: 57.991ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 991.820ms - ExecTreeOpenTime: 928.149ms - PrepareTime: 206.781ms - ExecTreePrepareTime: 168.418us KuduTableSink:(Total: 15.122us, non-child: 15.122us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 928.315ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.85 GB (71781326848) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m2s - CumulativeAllocationBytes: 66.85 GB (71781318656) - CumulativeAllocations: 34.23K (34228) - PeakReservation: 66.85 GB (71781318656) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.85 GB (71781318656) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 40m1s, non-child: 17s153ms, % non-child: 0.71%) - ConvertRowBatchTime: 7s389ms - PeakMemoryUsage: 19.53 MB (20481868) - RowsReturned: 262.16M (262159360) - RowsReturnedRate: 109.17 K/sec Buffer pool: - AllocTime: 7m14s - CumulativeAllocationBytes: 119.05 GB (127833948160) - CumulativeAllocations: 6.24M (6241892) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.44 GB, 12.17 GB, 18.02 GB, 21.78 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.39 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.76 GB, 61.59 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 928.075ms - TotalBytesReceived: 67.58 GB (72561653945) - TotalGetBatchTime: 39m51s - DataArrivalTimer: 39m44s SenderSide: - DeserializeRowBatchTime: 10m50s - NumBatchesArrived: 3.12M (3120946) - NumBatchesDeferred: 3.69K (3694) - NumBatchesEnqueued: 3.12M (3120946) - NumBatchesReceived: 3.12M (3120946) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 62.406ms, non-child: 62.406ms, % non-child: 100.00%) - CodegenTime: 1.102ms - CompileTime: 5.761ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 32.674ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.420ms Instance 844a0200d7876345:20bb38b9000000d9 (host=ve1134.foo.com:22000):(Total: 1s226ms, non-child: 201.759ms, % non-child: 16.45%) Fragment Instance Lifecycle Event Timeline: 1s227ms - Prepare Finished: 201.144ms (201.144ms) - Open Finished: 1s227ms (1s026ms) MemoryUsage(1m4s): 4.35 GB, 12.01 GB, 17.83 GB, 21.55 GB, 24.26 GB, 26.57 GB, 28.64 GB, 30.58 GB, 32.19 GB, 33.77 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.65 GB, 40.73 GB, 41.77 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.90 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.93 GB (71863189942) - PeakReservation: 66.89 GB (71823261696) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.81 GB (84625281986) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m15s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 1s026ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 65.990ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s026ms - ExecTreeOpenTime: 956.347ms - PrepareTime: 200.630ms - ExecTreePrepareTime: 162.502us KuduTableSink:(Total: 12.505us, non-child: 12.505us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 956.507ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.89 GB (71823269888) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m35s - CumulativeAllocationBytes: 66.89 GB (71823261696) - CumulativeAllocations: 34.25K (34248) - PeakReservation: 66.89 GB (71823261696) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.89 GB (71823261696) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m25s, non-child: 17s660ms, % non-child: 0.75%) - ConvertRowBatchTime: 7s595ms - PeakMemoryUsage: 19.53 MB (20483388) - RowsReturned: 262.30M (262301844) - RowsReturnedRate: 110.89 K/sec Buffer pool: - AllocTime: 12m55s - CumulativeAllocationBytes: 119.12 GB (127903375360) - CumulativeAllocations: 6.25M (6245282) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.43 GB, 12.16 GB, 18.02 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.74 GB, 38.91 GB, 40.05 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.13 GB, 49.10 GB, 50.13 GB, 51.08 GB, 51.96 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.92 GB, 59.81 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 956.257ms - TotalBytesReceived: 67.62 GB (72601401250) - TotalGetBatchTime: 39m14s - DataArrivalTimer: 39m8s SenderSide: - DeserializeRowBatchTime: 16m15s - NumBatchesArrived: 3.12M (3122641) - NumBatchesDeferred: 11.46K (11459) - NumBatchesEnqueued: 3.12M (3122641) - NumBatchesReceived: 3.12M (3122641) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 68.494ms, non-child: 68.494ms, % non-child: 100.00%) - CodegenTime: 1.161ms - CompileTime: 5.621ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 34.729ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 27.622ms Instance 844a0200d7876345:20bb38b9000000b3 (host=ve1135.foo.com:22000):(Total: 1s200ms, non-child: 216.960ms, % non-child: 18.07%) Fragment Instance Lifecycle Event Timeline: 1s201ms - Prepare Finished: 216.307ms (216.307ms) - Open Finished: 1s201ms (985.126ms) MemoryUsage(1m4s): 4.40 GB, 12.06 GB, 17.86 GB, 21.57 GB, 24.27 GB, 26.58 GB, 28.66 GB, 30.60 GB, 32.21 GB, 33.78 GB, 35.06 GB, 36.19 GB, 37.37 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.72 GB, 45.67 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.64 GB, 50.57 GB, 51.45 GB, 52.31 GB, 53.14 GB, 54.00 GB, 54.83 GB, 55.65 GB, 56.48 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.84 GB (71764623798) - PeakReservation: 66.80 GB (71724695552) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.80 GB (84614449174) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m54s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 985.109ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 53.992ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 985.113ms - ExecTreeOpenTime: 929.144ms - PrepareTime: 215.693ms - ExecTreePrepareTime: 160.055us KuduTableSink:(Total: 11.236us, non-child: 11.236us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 929.301ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.80 GB (71724703744) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m47s - CumulativeAllocationBytes: 66.80 GB (71724695552) - CumulativeAllocations: 34.20K (34201) - PeakReservation: 66.80 GB (71724695552) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.80 GB (71724695552) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m4s, non-child: 17s522ms, % non-child: 0.75%) - ConvertRowBatchTime: 7s683ms - PeakMemoryUsage: 19.53 MB (20482227) - RowsReturned: 261.95M (261948624) - RowsReturnedRate: 111.72 K/sec Buffer pool: - AllocTime: 12m7s - CumulativeAllocationBytes: 118.96 GB (127731138560) - CumulativeAllocations: 6.24M (6236872) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.42 GB, 12.15 GB, 18.01 GB, 21.77 GB, 24.50 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.55 GB, 37.74 GB, 38.91 GB, 40.05 GB, 41.15 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.17 GB, 46.12 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.68 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.91 GB, 58.92 GB, 59.80 GB, 60.76 GB, 61.60 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.57 GB, 65.29 GB, 65.98 GB, 66.70 GB - FirstBatchArrivalWaitTime: 929.029ms - TotalBytesReceived: 67.52 GB (72503559229) - TotalGetBatchTime: 38m54s - DataArrivalTimer: 38m47s SenderSide: - DeserializeRowBatchTime: 15m18s - NumBatchesArrived: 3.12M (3118436) - NumBatchesDeferred: 14.77K (14770) - NumBatchesEnqueued: 3.12M (3118436) - NumBatchesReceived: 3.12M (3118436) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 54.618ms, non-child: 54.618ms, % non-child: 100.00%) - CodegenTime: 1.161ms - CompileTime: 5.098ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 31.386ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 17.569ms Instance 844a0200d7876345:20bb38b900000090 (host=ve1136.foo.com:22000):(Total: 1s156ms, non-child: 199.873ms, % non-child: 17.28%) Fragment Instance Lifecycle Event Timeline: 1s157ms - Prepare Finished: 199.451ms (199.451ms) - Open Finished: 1s157ms (957.597ms) MemoryUsage(1m4s): 4.83 GB, 13.24 GB, 19.63 GB, 23.72 GB, 26.69 GB, 29.23 GB, 31.51 GB, 33.64 GB, 35.41 GB, 37.14 GB, 38.55 GB, 39.79 GB, 41.09 GB, 42.37 GB, 43.60 GB, 44.80 GB, 45.94 GB, 47.01 GB, 48.09 GB, 49.17 GB, 50.22 GB, 51.21 GB, 52.40 GB, 53.46 GB, 54.58 GB, 55.61 GB, 56.57 GB, 57.52 GB, 58.44 GB, 59.38 GB, 60.30 GB, 61.19 GB, 62.11 GB, 63.04 GB, 64.14 GB, 65.10 GB, 66.14 GB, 67.05 GB, 67.86 GB, 68.66 GB, 69.49 GB, 70.28 GB, 71.07 GB, 71.83 GB, 72.60 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.62 GB (79045935542) - PeakReservation: 73.58 GB (79006007296) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.77 GB (92089758125) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m9s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 957.581ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 55.991ms - TotalThreadsVoluntaryContextSwitches: 15 (15) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 957.584ms - ExecTreeOpenTime: 898.285ms - PrepareTime: 198.814ms - ExecTreePrepareTime: 176.373us KuduTableSink:(Total: 12.789us, non-child: 12.789us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 898.458ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 73.58 GB (79006015488) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m12s - CumulativeAllocationBytes: 73.58 GB (79006007296) - CumulativeAllocations: 37.67K (37673) - PeakReservation: 73.58 GB (79006007296) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 73.58 GB (79006007296) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m19s, non-child: 17s741ms, % non-child: 0.77%) - ConvertRowBatchTime: 7s751ms - PeakMemoryUsage: 19.53 MB (20480961) - RowsReturned: 288.55M (288545796) - RowsReturnedRate: 125.46 K/sec Buffer pool: - AllocTime: 11m34s - CumulativeAllocationBytes: 131.04 GB (140700426240) - CumulativeAllocations: 6.87M (6870138) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.85 GB, 13.36 GB, 19.80 GB, 23.93 GB, 26.94 GB, 29.50 GB, 31.81 GB, 33.97 GB, 35.76 GB, 37.51 GB, 38.93 GB, 40.18 GB, 41.50 GB, 42.79 GB, 44.04 GB, 45.24 GB, 46.40 GB, 47.48 GB, 48.57 GB, 49.67 GB, 50.72 GB, 51.73 GB, 52.93 GB, 54.00 GB, 55.14 GB, 56.17 GB, 57.15 GB, 58.11 GB, 59.04 GB, 59.99 GB, 60.92 GB, 61.82 GB, 62.75 GB, 63.69 GB, 64.80 GB, 65.77 GB, 66.82 GB, 67.74 GB, 68.56 GB, 69.37 GB, 70.20 GB, 71.01 GB, 71.80 GB, 72.57 GB, 73.35 GB - FirstBatchArrivalWaitTime: 898.223ms - TotalBytesReceived: 74.38 GB (79865391175) - TotalGetBatchTime: 38m9s - DataArrivalTimer: 38m2s SenderSide: - DeserializeRowBatchTime: 15m1s - NumBatchesArrived: 3.44M (3435069) - NumBatchesDeferred: 24.15K (24148) - NumBatchesEnqueued: 3.44M (3435069) - NumBatchesReceived: 3.44M (3435069) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 58.111ms, non-child: 58.111ms, % non-child: 100.00%) - CodegenTime: 1.001ms - CompileTime: 4.800ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.271ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.519ms Instance 844a0200d7876345:20bb38b9000000ba (host=ve1137.foo.com:22000):(Total: 1s187ms, non-child: 217.902ms, % non-child: 18.35%) Fragment Instance Lifecycle Event Timeline: 1s188ms - Prepare Finished: 216.907ms (216.907ms) - Open Finished: 1s188ms (971.094ms) MemoryUsage(1m4s): 4.38 GB, 12.04 GB, 17.85 GB, 21.57 GB, 24.27 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.37 GB, 38.53 GB, 39.65 GB, 40.73 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.65 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.31 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.33 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.71 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.95 GB (71890452918) - PeakReservation: 66.92 GB (71850524672) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.12 GB (84950768956) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m48s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 971.072ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 53.991ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 971.075ms - ExecTreeOpenTime: 916.239ms - PrepareTime: 216.574ms - ExecTreePrepareTime: 177.385us KuduTableSink:(Total: 13.304us, non-child: 13.304us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 916.413ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.92 GB (71850532864) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m5s - CumulativeAllocationBytes: 66.92 GB (71850524672) - CumulativeAllocations: 34.26K (34261) - PeakReservation: 66.92 GB (71850524672) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.92 GB (71850524672) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m57s, non-child: 17s579ms, % non-child: 0.75%) - ConvertRowBatchTime: 7s738ms - PeakMemoryUsage: 19.53 MB (20483148) - RowsReturned: 262.41M (262408944) - RowsReturnedRate: 112.24 K/sec Buffer pool: - AllocTime: 17m50s - CumulativeAllocationBytes: 119.17 GB (127955599360) - CumulativeAllocations: 6.25M (6247832) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.46 GB, 12.18 GB, 18.03 GB, 21.78 GB, 24.51 GB, 26.84 GB, 28.94 GB, 30.90 GB, 32.52 GB, 34.12 GB, 35.40 GB, 36.55 GB, 37.74 GB, 38.92 GB, 40.05 GB, 41.15 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.17 GB, 46.13 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.69 GB, 54.55 GB, 55.39 GB, 56.21 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.77 GB, 61.60 GB, 62.34 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 916.144ms - TotalBytesReceived: 67.64 GB (72630808717) - TotalGetBatchTime: 38m47s - DataArrivalTimer: 38m40s SenderSide: - DeserializeRowBatchTime: 21m11s - NumBatchesArrived: 3.12M (3123916) - NumBatchesDeferred: 23.98K (23981) - NumBatchesEnqueued: 3.12M (3123916) - NumBatchesReceived: 3.12M (3123916) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 53.400ms, non-child: 53.400ms, % non-child: 100.00%) - CodegenTime: 1.188ms - CompileTime: 4.605ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 27.259ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 20.941ms Instance 844a0200d7876345:20bb38b9000000c4 (host=ve1138.foo.com:22000):(Total: 1s172ms, non-child: 203.374ms, % non-child: 17.34%) Fragment Instance Lifecycle Event Timeline: 1s172ms - Prepare Finished: 202.479ms (202.479ms) - Open Finished: 1s172ms (970.423ms) MemoryUsage(1m4s): 4.39 GB, 12.04 GB, 17.84 GB, 21.56 GB, 24.26 GB, 26.58 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.32 GB, 59.19 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.42 GB, 63.18 GB, 63.90 GB, 64.61 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.96 GB (71896744374) - PeakReservation: 66.92 GB (71856816128) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.81 GB (84625232154) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 39m11s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 970.405ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 970.408ms - ExecTreeOpenTime: 908.341ms - PrepareTime: 202.113ms - ExecTreePrepareTime: 173.016us KuduTableSink:(Total: 12.179us, non-child: 12.179us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 908.511ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.92 GB (71856824320) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 2m45s - CumulativeAllocationBytes: 66.92 GB (71856816128) - CumulativeAllocations: 34.26K (34264) - PeakReservation: 66.92 GB (71856816128) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.92 GB (71856816128) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 39m21s, non-child: 17s089ms, % non-child: 0.72%) - ConvertRowBatchTime: 7s620ms - PeakMemoryUsage: 19.53 MB (20482286) - RowsReturned: 262.43M (262431036) - RowsReturnedRate: 111.13 K/sec Buffer pool: - AllocTime: 10m2s - CumulativeAllocationBytes: 119.18 GB (127966371840) - CumulativeAllocations: 6.25M (6248358) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.41 GB, 12.14 GB, 18.01 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.39 GB, 36.54 GB, 37.73 GB, 38.90 GB, 40.04 GB, 41.13 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.11 GB, 47.03 GB, 48.12 GB, 49.09 GB, 50.12 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.75 GB, 61.59 GB, 62.33 GB, 63.06 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 908.280ms - TotalBytesReceived: 67.65 GB (72637270569) - TotalGetBatchTime: 39m11s - DataArrivalTimer: 39m4s SenderSide: - DeserializeRowBatchTime: 13m47s - NumBatchesArrived: 3.12M (3124179) - NumBatchesDeferred: 13.77K (13767) - NumBatchesEnqueued: 3.12M (3124179) - NumBatchesReceived: 3.12M (3124179) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 60.681ms, non-child: 60.681ms, % non-child: 100.00%) - CodegenTime: 1.107ms - CompileTime: 5.794ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 34.487ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 19.789ms Instance 844a0200d7876345:20bb38b9000000d4 (host=ve1139.foo.com:22000):(Total: 1s232ms, non-child: 213.539ms, % non-child: 17.32%) Fragment Instance Lifecycle Event Timeline: 1s232ms - Prepare Finished: 212.688ms (212.688ms) - Open Finished: 1s232ms (1s020ms) MemoryUsage(1m4s): 4.41 GB, 12.06 GB, 17.85 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.17 GB, 37.36 GB, 38.52 GB, 39.64 GB, 40.73 GB, 41.77 GB, 42.74 GB, 43.72 GB, 44.70 GB, 45.65 GB, 46.56 GB, 47.64 GB, 48.60 GB, 49.62 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.13 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.31 GB, 58.32 GB, 59.19 GB, 60.13 GB, 60.96 GB, 61.70 GB, 62.42 GB, 63.17 GB, 63.90 GB, 64.61 GB, 65.30 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.82 GB (71747846582) - PeakReservation: 66.78 GB (71707918336) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.88 GB (84693368209) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m34s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 1s020ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 63.990ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 1s020ms - ExecTreeOpenTime: 953.073ms - PrepareTime: 212.313ms - ExecTreePrepareTime: 153.340us KuduTableSink:(Total: 12.055us, non-child: 12.055us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 953.223ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.78 GB (71707926528) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m9s - CumulativeAllocationBytes: 66.78 GB (71707918336) - CumulativeAllocations: 34.19K (34193) - PeakReservation: 66.78 GB (71707918336) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.78 GB (71707918336) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m43s, non-child: 16s585ms, % non-child: 0.71%) - ConvertRowBatchTime: 7s512ms - PeakMemoryUsage: 19.53 MB (20483314) - RowsReturned: 261.89M (261885540) - RowsReturnedRate: 112.71 K/sec Buffer pool: - AllocTime: 15m46s - CumulativeAllocationBytes: 118.93 GB (127700377600) - CumulativeAllocations: 6.24M (6235370) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.42 GB, 12.15 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.82 GB, 28.92 GB, 30.88 GB, 32.51 GB, 34.10 GB, 35.39 GB, 36.53 GB, 37.72 GB, 38.90 GB, 40.03 GB, 41.13 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.15 GB, 46.11 GB, 47.02 GB, 48.12 GB, 49.09 GB, 50.12 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.67 GB, 54.54 GB, 55.38 GB, 56.20 GB, 57.04 GB, 57.90 GB, 58.91 GB, 59.80 GB, 60.75 GB, 61.59 GB, 62.33 GB, 63.06 GB, 63.82 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 952.993ms - TotalBytesReceived: 67.51 GB (72485885946) - TotalGetBatchTime: 38m33s - DataArrivalTimer: 38m27s SenderSide: - DeserializeRowBatchTime: 19m - NumBatchesArrived: 3.12M (3117685) - NumBatchesDeferred: 26.09K (26093) - NumBatchesEnqueued: 3.12M (3117685) - NumBatchesReceived: 3.12M (3117685) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 65.810ms, non-child: 65.810ms, % non-child: 100.00%) - CodegenTime: 1.071ms - CompileTime: 6.604ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 34.045ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.566ms Instance 844a0200d7876345:20bb38b9000000ce (host=ve1140.foo.com:22000):(Total: 1s181ms, non-child: 213.301ms, % non-child: 18.06%) Fragment Instance Lifecycle Event Timeline: 1s181ms - Prepare Finished: 212.605ms (212.605ms) - Open Finished: 1s181ms (968.971ms) MemoryUsage(1m4s): 4.41 GB, 12.06 GB, 17.85 GB, 21.57 GB, 24.27 GB, 26.58 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.36 GB, 38.52 GB, 39.65 GB, 40.73 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.64 GB, 48.61 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.32 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.81 GB (71733166518) - PeakReservation: 66.77 GB (71693238272) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.89 GB (84707476082) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 40m20s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 968.942ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 55.991ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 968.945ms - ExecTreeOpenTime: 910.409ms - PrepareTime: 212.069ms - ExecTreePrepareTime: 162.404us KuduTableSink:(Total: 21.933us, non-child: 21.933us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 910.568ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.77 GB (71693246464) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 1m28s - CumulativeAllocationBytes: 66.77 GB (71693238272) - CumulativeAllocations: 34.19K (34186) - PeakReservation: 66.77 GB (71693238272) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.77 GB (71693238272) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 40m29s, non-child: 17s726ms, % non-child: 0.73%) - ConvertRowBatchTime: 7s590ms - PeakMemoryUsage: 19.53 MB (20482914) - RowsReturned: 261.83M (261833460) - RowsReturnedRate: 107.75 K/sec Buffer pool: - AllocTime: 5m1s - CumulativeAllocationBytes: 118.91 GB (127674982400) - CumulativeAllocations: 6.23M (6234130) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.42 GB, 12.15 GB, 18.01 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.39 GB, 36.54 GB, 37.73 GB, 38.90 GB, 40.04 GB, 41.14 GB, 42.19 GB, 43.17 GB, 44.16 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.12 GB, 49.09 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.75 GB, 61.59 GB, 62.33 GB, 63.07 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 910.324ms - TotalBytesReceived: 67.49 GB (72471553266) - TotalGetBatchTime: 40m19s - DataArrivalTimer: 40m12s SenderSide: - DeserializeRowBatchTime: 8m12s - NumBatchesArrived: 3.12M (3117066) - NumBatchesDeferred: 1.90K (1896) - NumBatchesEnqueued: 3.12M (3117065) - NumBatchesReceived: 3.12M (3117066) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 57.202ms, non-child: 57.202ms, % non-child: 100.00%) - CodegenTime: 1.029ms - CompileTime: 4.536ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 27.448ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 24.664ms Instance 844a0200d7876345:20bb38b9000000cc (host=ve1141.foo.com:22000):(Total: 1s201ms, non-child: 218.938ms, % non-child: 18.22%) Fragment Instance Lifecycle Event Timeline: 1s202ms - Prepare Finished: 218.360ms (218.360ms) - Open Finished: 1s202ms (984.151ms) MemoryUsage(1m4s): 4.38 GB, 12.05 GB, 17.85 GB, 21.56 GB, 24.27 GB, 26.58 GB, 28.65 GB, 30.60 GB, 32.21 GB, 33.78 GB, 35.06 GB, 36.19 GB, 37.37 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.72 GB, 45.67 GB, 46.57 GB, 47.65 GB, 48.61 GB, 49.64 GB, 50.57 GB, 51.45 GB, 52.31 GB, 53.15 GB, 54.00 GB, 54.84 GB, 55.65 GB, 56.48 GB, 57.33 GB, 58.33 GB, 59.21 GB, 60.15 GB, 60.98 GB, 61.71 GB, 62.44 GB, 63.19 GB, 63.92 GB, 64.63 GB, 65.32 GB, 66.02 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.95 GB (71890452918) - PeakReservation: 66.92 GB (71850524672) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.05 GB (84878096169) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 38m10s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 10 (10) - TotalThreadsTotalWallClockTime: 984.127ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 65.990ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 984.131ms - ExecTreeOpenTime: 916.438ms - PrepareTime: 217.747ms - ExecTreePrepareTime: 145.462us KuduTableSink:(Total: 13.344us, non-child: 13.344us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 916.581ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.92 GB (71850532864) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 3m43s - CumulativeAllocationBytes: 66.92 GB (71850524672) - CumulativeAllocations: 34.26K (34261) - PeakReservation: 66.92 GB (71850524672) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.92 GB (71850524672) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 38m20s, non-child: 17s500ms, % non-child: 0.76%) - ConvertRowBatchTime: 7s689ms - PeakMemoryUsage: 19.53 MB (20483930) - RowsReturned: 262.41M (262408692) - RowsReturnedRate: 114.06 K/sec Buffer pool: - AllocTime: 23m36s - CumulativeAllocationBytes: 119.17 GB (127955476480) - CumulativeAllocations: 6.25M (6247826) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.40 GB, 12.14 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.52 GB, 34.11 GB, 35.40 GB, 36.54 GB, 37.74 GB, 38.91 GB, 40.05 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.04 GB, 48.13 GB, 49.10 GB, 50.14 GB, 51.08 GB, 51.97 GB, 52.84 GB, 53.69 GB, 54.55 GB, 55.40 GB, 56.22 GB, 57.06 GB, 57.91 GB, 58.93 GB, 59.81 GB, 60.77 GB, 61.60 GB, 62.35 GB, 63.08 GB, 63.84 GB, 64.57 GB, 65.29 GB, 65.99 GB, 66.70 GB - FirstBatchArrivalWaitTime: 916.355ms - TotalBytesReceived: 67.64 GB (72630745518) - TotalGetBatchTime: 38m9s - DataArrivalTimer: 38m3s SenderSide: - DeserializeRowBatchTime: 26m59s - NumBatchesArrived: 3.12M (3123913) - NumBatchesDeferred: 40.74K (40736) - NumBatchesEnqueued: 3.12M (3123913) - NumBatchesReceived: 3.12M (3123913) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 66.395ms, non-child: 66.395ms, % non-child: 100.00%) - CodegenTime: 1.084ms - CompileTime: 5.963ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 35.955ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 23.929ms Instance 844a0200d7876345:20bb38b9000000c1 (host=ve1142.foo.com:22000):(Total: 1s186ms, non-child: 212.815ms, % non-child: 17.94%) Fragment Instance Lifecycle Event Timeline: 1s186ms - Prepare Finished: 212.009ms (212.009ms) - Open Finished: 1s186ms (974.370ms) MemoryUsage(1m4s): 4.39 GB, 12.04 GB, 17.84 GB, 21.56 GB, 24.26 GB, 26.57 GB, 28.65 GB, 30.59 GB, 32.20 GB, 33.78 GB, 35.05 GB, 36.18 GB, 37.37 GB, 38.53 GB, 39.65 GB, 40.74 GB, 41.78 GB, 42.75 GB, 43.73 GB, 44.71 GB, 45.66 GB, 46.56 GB, 47.65 GB, 48.60 GB, 49.63 GB, 50.56 GB, 51.44 GB, 52.30 GB, 53.14 GB, 53.99 GB, 54.83 GB, 55.64 GB, 56.47 GB, 57.32 GB, 58.32 GB, 59.20 GB, 60.14 GB, 60.97 GB, 61.70 GB, 62.43 GB, 63.18 GB, 63.91 GB, 64.62 GB, 65.31 GB, 66.01 GB ThreadUsage(1m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 66.78 GB (71699612086) - PeakReservation: 66.74 GB (71659683840) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.76 GB (84565131038) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 37m38s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 974.351ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 50.992ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 974.355ms - ExecTreeOpenTime: 921.784ms - PrepareTime: 211.667ms - ExecTreePrepareTime: 157.005us KuduTableSink:(Total: 22.402us, non-child: 22.402us, % non-child: 100.00%) - KuduApplyTimer: 0.000ns - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 0 - TotalNumRows: 0 (0) SORT_NODE (id=2):(Total: 921.938ms, non-child: 0.000ns, % non-child: 0.00%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: 0 (0) (Number of samples: 0) - InMemorySortTime: 0.000ns - PeakMemoryUsage: 66.74 GB (71659692032) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - RunsCreated: 1 (1) - SortDataSize: 0 Buffer pool: - AllocTime: 4m - CumulativeAllocationBytes: 66.74 GB (71659683840) - CumulativeAllocations: 34.17K (34170) - PeakReservation: 66.74 GB (71659683840) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 66.74 GB (71659683840) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 37m48s, non-child: 17s486ms, % non-child: 0.77%) - ConvertRowBatchTime: 7s617ms - PeakMemoryUsage: 19.53 MB (20483478) - RowsReturned: 261.71M (261711872) - RowsReturnedRate: 115.35 K/sec Buffer pool: - AllocTime: 29m17s - CumulativeAllocationBytes: 118.85 GB (127615836160) - CumulativeAllocations: 6.23M (6231242) - PeakReservation: 18.06 MB (18939904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 18.06 MB (18939904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns RecvrSide: BytesReceived(1m4s): 4.41 GB, 12.14 GB, 18.00 GB, 21.76 GB, 24.49 GB, 26.83 GB, 28.93 GB, 30.89 GB, 32.51 GB, 34.11 GB, 35.39 GB, 36.54 GB, 37.73 GB, 38.91 GB, 40.04 GB, 41.14 GB, 42.20 GB, 43.18 GB, 44.17 GB, 45.16 GB, 46.12 GB, 47.03 GB, 48.12 GB, 49.09 GB, 50.13 GB, 51.07 GB, 51.96 GB, 52.83 GB, 53.68 GB, 54.54 GB, 55.39 GB, 56.21 GB, 57.05 GB, 57.90 GB, 58.92 GB, 59.80 GB, 60.76 GB, 61.59 GB, 62.34 GB, 63.07 GB, 63.83 GB, 64.56 GB, 65.28 GB, 65.98 GB, 66.69 GB - FirstBatchArrivalWaitTime: 921.706ms - TotalBytesReceived: 67.46 GB (72437797666) - TotalGetBatchTime: 37m38s - DataArrivalTimer: 37m31s SenderSide: - DeserializeRowBatchTime: 32m42s - NumBatchesArrived: 3.12M (3115621) - NumBatchesDeferred: 46.32K (46320) - NumBatchesEnqueued: 3.12M (3115621) - NumBatchesReceived: 3.12M (3115621) - NumEarlySenders: 0 (0) - NumEosReceived: 0 (0) CodeGen:(Total: 51.311ms, non-child: 51.311ms, % non-child: 100.00%) - CodegenTime: 1.009ms - CompileTime: 4.394ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 26.736ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 19.691ms Averaged Fragment F00: Fragment F00: Instance 844a0200d7876345:20bb38b900000063 (host=va1026.foo.com:22000):(Total: 304.784ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:29/7.05 GB 0:19/4.70 GB 5:30/7.32 GB 3:24/5.75 GB 4:30/7.31 GB 1:39/9.55 GB 2:32/7.85 GB 6:21/5.16 GB Fragment Instance Lifecycle Event Timeline: 1s813ms - Prepare Finished: 279.259ms (279.259ms) - Open Finished: 305.395ms (26.135ms) - First Batch Produced: 1s811ms (1s506ms) - First Batch Sent: 1s813ms (2.012ms) MemoryUsage(1m4s): 8.11 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.91 GB, 13.88 GB, 13.86 GB, 13.84 GB, 13.81 GB, 13.77 GB, 13.75 GB, 13.71 GB, 13.67 GB, 13.65 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.98 GB (15012267519) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.58 GB (86522238824) - RowsProduced: 255.81M (255805440) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m8s - TotalStorageWaitTime: 25m49s - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 26.132ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 24.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s385ms - OpenTime: 26.133ms - ExecTreeOpenTime: 267.327us - PrepareTime: 278.586ms - ExecTreePrepareTime: 1.806ms KrpcDataStreamSender (dst_id=1):(Total: 4m49s, non-child: 4m49s, % non-child: 100.00%) - BytesSent: 33.60 GB (36079745679) - EosSent: 0 (0) - OverallThroughput: 118.98 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 255.80M (255804416) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m48s - UncompressedRowBatchSize: 65.94 GB (70801752856) HDFS_SCAN_NODE (id=0):(Total: 3s173ms, non-child: 3s173ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:29/7.05 GB 0:19/4.70 GB 5:30/7.32 GB 3:24/5.75 GB 4:30/7.31 GB 1:39/9.55 GB 2:32/7.85 GB 6:21/5.16 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.12 GB, 12.76 GB, 13.11 GB, 13.43 GB, 13.55 GB, 13.73 GB, 14.03 GB, 14.34 GB, 14.81 GB, 15.42 GB, 15.90 GB, 16.26 GB, 16.53 GB, 16.68 GB, 16.75 GB, 16.77 GB, 16.81 GB, 16.86 GB, 16.90 GB, 16.94 GB, 16.97 GB, 17.05 GB, 17.16 GB, 17.26 GB, 17.38 GB, 17.45 GB, 17.50 GB, 17.54 GB, 17.56 GB, 17.59 GB, 17.63 GB, 17.70 GB, 17.78 GB, 17.89 GB, 17.99 GB, 18.05 GB, 18.18 GB, 18.37 GB, 18.58 GB, 18.82 GB, 19.05 GB, 19.21 GB, 19.32 GB, 19.41 GB, 19.47 GB - FooterProcessingTime: (Avg: 3s934ms ; Min: 97.171ms ; Max: 15s245ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.53 GB (20974448383) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 57s551ms - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.98 GB (15009331516) - PerReadThreadRawHdfsThroughput: 48.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 256.02M (256018432) - RowsReturned: 255.81M (255805440) - RowsReturnedRate: 80.61 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s739ms - TotalRawHdfsReadTime(*): 6m49s - TotalReadThroughput: 6.80 MB/sec CodeGen:(Total: 25.609ms, non-child: 25.609ms, % non-child: 100.00%) - CodegenTime: 411.360us - CompileTime: 4.592ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.592ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 13.905ms Instance 844a0200d7876345:20bb38b900000015 (host=va1027.foo.com:22000):(Total: 191.805ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:23/5.66 GB 1:23/5.58 GB 0:32/7.76 GB 3:30/7.27 GB 5:29/7.06 GB 2:27/6.68 GB 7:30/7.43 GB 4:29/7.03 GB Fragment Instance Lifecycle Event Timeline: 1s852ms - Prepare Finished: 162.377ms (162.377ms) - Open Finished: 192.392ms (30.014ms) - First Batch Produced: 1s850ms (1s657ms) - First Batch Sent: 1s852ms (1.901ms) MemoryUsage(1m4s): 7.65 GB, 13.93 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.92 GB, 13.92 GB, 13.91 GB, 13.90 GB, 13.89 GB, 13.89 GB, 13.88 GB, 13.88 GB, 13.87 GB, 13.84 GB, 13.84 GB, 13.82 GB, 13.80 GB, 13.79 GB, 13.77 GB, 13.75 GB, 13.72 GB, 13.68 GB, 13.64 GB, 13.61 GB, 13.56 GB, 13.52 GB, 13.48 GB, 13.44 GB, 13.38 GB, 13.34 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.94 GB (14967496499) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.99 GB (93401566164) - RowsProduced: 271.70M (271699968) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m41s - TotalStorageWaitTime: 29m15s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 29.999ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 28.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s360ms - OpenTime: 30.001ms - ExecTreeOpenTime: 282.367us - PrepareTime: 161.733ms - ExecTreePrepareTime: 1.614ms KrpcDataStreamSender (dst_id=1):(Total: 4m38s, non-child: 4m38s, % non-child: 100.00%) - BytesSent: 35.65 GB (38277481057) - EosSent: 0 (0) - OverallThroughput: 130.89 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 271.70M (271698944) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m38s - UncompressedRowBatchSize: 70.04 GB (75201026002) HDFS_SCAN_NODE (id=0):(Total: 3s191ms, non-child: 3s191ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:23/5.66 GB 1:23/5.58 GB 0:32/7.76 GB 3:30/7.27 GB 5:29/7.06 GB 2:27/6.68 GB 7:30/7.43 GB 4:29/7.03 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.73 GB, 12.77 GB, 13.23 GB, 13.54 GB, 13.71 GB, 13.97 GB, 14.34 GB, 14.85 GB, 15.40 GB, 15.99 GB, 16.37 GB, 16.55 GB, 16.70 GB, 16.77 GB, 16.80 GB, 16.84 GB, 16.89 GB, 16.96 GB, 17.05 GB, 17.12 GB, 17.22 GB, 17.29 GB, 17.40 GB, 17.49 GB, 17.52 GB, 17.55 GB, 17.60 GB, 17.66 GB, 17.73 GB, 17.81 GB, 17.87 GB, 17.98 GB, 18.12 GB, 18.27 GB, 18.53 GB, 18.75 GB, 18.97 GB, 19.18 GB, 19.32 GB, 19.42 GB, 19.49 GB, 19.53 GB, 19.58 GB, 19.65 GB, 19.71 GB - FooterProcessingTime: (Avg: 5s050ms ; Min: 83.956ms ; Max: 13s851ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.77 GB (21231939220) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.94 GB (14964405125) - PerReadThreadRawHdfsThroughput: 53.04 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 271.91M (271912960) - RowsReturned: 271.70M (271699968) - RowsReturnedRate: 85.13 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s551ms - TotalRawHdfsReadTime(*): 6m21s - TotalReadThroughput: 6.88 MB/sec CodeGen:(Total: 29.414ms, non-child: 29.414ms, % non-child: 100.00%) - CodegenTime: 424.112us - CompileTime: 3.918ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.757ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 18.115ms Instance 844a0200d7876345:20bb38b900000009 (host=va1028.foo.com:22000):(Total: 265.860ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:17/4.12 GB 4:29/7.10 GB 0:28/6.59 GB 3:30/7.24 GB 1:21/5.13 GB 6:32/7.77 GB 7:35/8.59 GB 2:33/8.09 GB Fragment Instance Lifecycle Event Timeline: 1s893ms - Prepare Finished: 230.463ms (230.463ms) - Open Finished: 266.282ms (35.819ms) - First Batch Produced: 1s891ms (1s625ms) - First Batch Sent: 1s893ms (2.020ms) MemoryUsage(1m4s): 7.81 GB, 13.90 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.91 GB, 13.90 GB, 13.90 GB, 13.89 GB, 13.88 GB, 13.88 GB, 13.87 GB, 13.84 GB, 13.83 GB, 13.79 GB, 13.75 GB, 13.73 GB, 13.71 GB, 13.68 GB, 13.65 GB, 13.60 GB, 13.55 GB, 13.50 GB, 13.46 GB, 13.43 GB, 13.40 GB, 13.37 GB, 13.34 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.96 GB (14994637149) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.79 GB (93185734651) - RowsProduced: 278.52M (278518784) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m53s - TotalStorageWaitTime: 26m42s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 35.814ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 33.995ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s632ms - OpenTime: 35.816ms - ExecTreeOpenTime: 186.701us - PrepareTime: 229.968ms - ExecTreePrepareTime: 2.124ms KrpcDataStreamSender (dst_id=1):(Total: 4m34s, non-child: 4m34s, % non-child: 100.00%) - BytesSent: 36.55 GB (39245994122) - EosSent: 0 (0) - OverallThroughput: 136.22 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 278.52M (278517760) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m34s - UncompressedRowBatchSize: 71.79 GB (77088524312) HDFS_SCAN_NODE (id=0):(Total: 3s460ms, non-child: 3s460ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:17/4.12 GB 4:29/7.10 GB 0:28/6.59 GB 3:30/7.24 GB 1:21/5.13 GB 6:32/7.77 GB 7:35/8.59 GB 2:33/8.09 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.85 GB, 12.85 GB, 13.37 GB, 13.74 GB, 14.13 GB, 14.64 GB, 15.24 GB, 15.78 GB, 16.21 GB, 16.52 GB, 16.67 GB, 16.79 GB, 16.86 GB, 16.92 GB, 16.98 GB, 17.04 GB, 17.11 GB, 17.18 GB, 17.27 GB, 17.34 GB, 17.39 GB, 17.48 GB, 17.54 GB, 17.61 GB, 17.70 GB, 17.78 GB, 17.87 GB, 17.96 GB, 18.05 GB, 18.19 GB, 18.35 GB, 18.52 GB, 18.68 GB, 18.87 GB, 19.04 GB, 19.15 GB, 19.32 GB, 19.45 GB, 19.57 GB, 19.64 GB, 19.69 GB, 19.74 GB, 19.79 GB, 19.82 GB, 19.87 GB - FooterProcessingTime: (Avg: 4s444ms ; Min: 107.801ms ; Max: 10s191ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.92 GB (21393904456) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m26s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.96 GB (14991545749) - PerReadThreadRawHdfsThroughput: 45.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 278.73M (278730752) - RowsReturned: 278.52M (278518784) - RowsReturnedRate: 80.48 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 11s891ms - TotalRawHdfsReadTime(*): 7m27s - TotalReadThroughput: 6.98 MB/sec CodeGen:(Total: 35.245ms, non-child: 35.245ms, % non-child: 100.00%) - CodegenTime: 492.118us - CompileTime: 4.332ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.301ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 21.964ms Instance 844a0200d7876345:20bb38b90000002b (host=va1029.foo.com:22000):(Total: 245.877ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:32/7.69 GB 7:27/6.25 GB 4:28/6.81 GB 2:25/6.07 GB 1:29/6.90 GB 3:29/7.09 GB 0:28/6.90 GB 6:29/7.04 GB Fragment Instance Lifecycle Event Timeline: 1s784ms - Prepare Finished: 208.688ms (208.688ms) - Open Finished: 246.545ms (37.856ms) - First Batch Produced: 1s783ms (1s536ms) - First Batch Sent: 1s784ms (1.948ms) MemoryUsage(1m4s): 8.31 GB, 13.73 GB, 13.72 GB, 13.72 GB, 13.79 GB, 13.81 GB, 13.80 GB, 13.79 GB, 13.78 GB, 13.77 GB, 13.77 GB, 13.85 GB, 13.90 GB, 13.90 GB, 13.90 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.87 GB, 13.86 GB, 13.85 GB, 13.84 GB, 13.83 GB, 13.82 GB, 13.79 GB, 13.77 GB, 13.74 GB, 13.71 GB, 13.68 GB, 13.73 GB, 13.73 GB, 13.70 GB, 13.67 GB, 13.63 GB, 13.60 GB, 13.54 GB, 13.49 GB, 13.45 GB, 13.40 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.90 GB (14924557447) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.03 GB (93450972280) - RowsProduced: 273.16M (273160146) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m13s - TotalStorageWaitTime: 23m40s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 37.852ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 35.994ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s226ms - OpenTime: 37.854ms - ExecTreeOpenTime: 264.989us - PrepareTime: 207.950ms - ExecTreePrepareTime: 2.287ms KrpcDataStreamSender (dst_id=1):(Total: 4m40s, non-child: 4m40s, % non-child: 100.00%) - BytesSent: 35.87 GB (38510977187) - EosSent: 0 (0) - OverallThroughput: 131.04 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 273.16M (273159122) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m39s - UncompressedRowBatchSize: 70.41 GB (75605380606) HDFS_SCAN_NODE (id=0):(Total: 3s028ms, non-child: 3s028ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:32/7.69 GB 7:27/6.25 GB 4:28/6.81 GB 2:25/6.07 GB 1:29/6.90 GB 3:29/7.09 GB 0:28/6.90 GB 6:29/7.04 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.28 GB, 12.56 GB, 13.02 GB, 13.27 GB, 13.67 GB, 14.06 GB, 14.55 GB, 15.18 GB, 15.84 GB, 16.22 GB, 16.44 GB, 16.62 GB, 16.72 GB, 16.78 GB, 16.81 GB, 16.84 GB, 16.88 GB, 16.94 GB, 17.04 GB, 17.11 GB, 17.23 GB, 17.34 GB, 17.40 GB, 17.40 GB, 17.44 GB, 17.52 GB, 17.60 GB, 17.72 GB, 17.80 GB, 17.86 GB, 17.94 GB, 18.06 GB, 18.22 GB, 18.45 GB, 18.70 GB, 19.09 GB, 19.35 GB, 19.48 GB, 19.54 GB, 19.58 GB, 19.62 GB, 19.71 GB, 19.79 GB, 19.84 GB, 19.91 GB - FooterProcessingTime: (Avg: 3s540ms ; Min: 91.059ms ; Max: 12s208ms ; Number of samples: 91) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.99 GB (21466320403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m20s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 91 (91) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.90 GB (14921457917) - PerReadThreadRawHdfsThroughput: 45.63 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 273.37M (273373138) - RowsReturned: 273.16M (273160146) - RowsReturnedRate: 90.21 M/sec - ScanRangesComplete: 3 (3) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 2s385ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s642ms - TotalRawHdfsReadTime(*): 7m28s - TotalReadThroughput: 6.97 MB/sec CodeGen:(Total: 37.225ms, non-child: 37.225ms, % non-child: 100.00%) - CodegenTime: 575.934us - CompileTime: 4.479ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 9.116ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 23.079ms Instance 844a0200d7876345:20bb38b900000022 (host=va1030.foo.com:22000):(Total: 241.266ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:22/5.41 GB 6:33/8.13 GB 2:33/8.01 GB 5:31/7.38 GB 0:21/5.16 GB 3:31/7.59 GB 1:24/5.87 GB 4:27/6.57 GB Fragment Instance Lifecycle Event Timeline: 1s767ms - Prepare Finished: 215.342ms (215.342ms) - Open Finished: 242.049ms (26.706ms) - First Batch Produced: 1s765ms (1s523ms) - First Batch Sent: 1s767ms (2.061ms) MemoryUsage(1m4s): 7.76 GB, 13.87 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.87 GB, 13.86 GB, 13.86 GB, 13.86 GB, 13.86 GB, 13.87 GB, 13.86 GB, 13.85 GB, 13.90 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.92 GB, 13.90 GB, 13.88 GB, 13.87 GB, 13.86 GB, 13.84 GB, 13.82 GB, 13.78 GB, 13.75 GB, 13.72 GB, 13.68 GB, 13.63 GB, 13.58 GB, 13.55 GB, 13.49 GB, 13.45 GB, 13.43 GB, 13.40 GB, 13.36 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.97 GB (15003118278) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.03 GB (93448590037) - RowsProduced: 281.02M (281018954) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m7s - TotalStorageWaitTime: 26m28s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 26.719ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 24.996ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s844ms - OpenTime: 26.719ms - ExecTreeOpenTime: 144.950us - PrepareTime: 214.467ms - ExecTreePrepareTime: 1.827ms KrpcDataStreamSender (dst_id=1):(Total: 4m39s, non-child: 4m39s, % non-child: 100.00%) - BytesSent: 36.90 GB (39619161456) - EosSent: 0 (0) - OverallThroughput: 135.27 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 281.02M (281017930) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m38s - UncompressedRowBatchSize: 72.44 GB (77780470390) HDFS_SCAN_NODE (id=0):(Total: 3s654ms, non-child: 3s654ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:22/5.41 GB 6:33/8.13 GB 2:33/8.01 GB 5:31/7.38 GB 0:21/5.16 GB 3:31/7.59 GB 1:24/5.87 GB 4:27/6.57 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.80 GB, 12.83 GB, 13.32 GB, 13.69 GB, 14.10 GB, 14.61 GB, 15.24 GB, 15.83 GB, 16.27 GB, 16.53 GB, 16.68 GB, 16.74 GB, 16.79 GB, 16.84 GB, 16.96 GB, 17.11 GB, 17.19 GB, 17.27 GB, 17.32 GB, 17.37 GB, 17.44 GB, 17.56 GB, 17.67 GB, 17.72 GB, 17.77 GB, 17.84 GB, 17.95 GB, 18.05 GB, 18.17 GB, 18.29 GB, 18.45 GB, 18.62 GB, 18.79 GB, 18.94 GB, 19.13 GB, 19.29 GB, 19.46 GB, 19.60 GB, 19.68 GB, 19.72 GB, 19.77 GB, 19.82 GB, 19.86 GB, 19.91 GB, 19.95 GB - FooterProcessingTime: (Avg: 4s143ms ; Min: 109.528ms ; Max: 10s620ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 20.02 GB (21491546209) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m25s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.97 GB (15000018777) - PerReadThreadRawHdfsThroughput: 43.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 281.23M (281231946) - RowsReturned: 281.02M (281018954) - RowsReturnedRate: 76.90 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 783.836ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s889ms - TotalRawHdfsReadTime(*): 7m48s - TotalReadThroughput: 6.97 MB/sec CodeGen:(Total: 26.297ms, non-child: 26.297ms, % non-child: 100.00%) - CodegenTime: 381.450us - CompileTime: 4.030ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.383ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 15.278ms Instance 844a0200d7876345:20bb38b900000017 (host=va1031.foo.com:22000):(Total: 119.043ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:32/7.89 GB 0:31/7.45 GB 2:28/6.84 GB 4:29/7.09 GB 3:30/7.31 GB 7:27/6.59 GB 5:26/6.40 GB 6:21/5.12 GB Fragment Instance Lifecycle Event Timeline: 1s380ms - Prepare Finished: 88.142ms (88.142ms) - Open Finished: 119.587ms (31.444ms) - First Batch Produced: 1s378ms (1s258ms) - First Batch Sent: 1s380ms (2.277ms) MemoryUsage(1m4s): 7.53 GB, 13.90 GB, 13.94 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.93 GB, 13.93 GB, 13.91 GB, 13.89 GB, 13.87 GB, 13.86 GB, 13.85 GB, 13.83 GB, 13.79 GB, 13.75 GB, 13.71 GB, 13.67 GB, 13.64 GB, 13.62 GB, 13.58 GB, 13.55 GB, 13.50 GB, 13.45 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.97 GB (14995137294) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.83 GB (93233039149) - RowsProduced: 264.29M (264294400) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m4s - TotalStorageWaitTime: 28m51s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 31.439ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 30.995ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 2s914ms - OpenTime: 31.441ms - ExecTreeOpenTime: 182.800us - PrepareTime: 87.537ms - ExecTreePrepareTime: 1.747ms KrpcDataStreamSender (dst_id=1):(Total: 4m36s, non-child: 4m36s, % non-child: 100.00%) - BytesSent: 34.68 GB (37236840815) - EosSent: 0 (0) - OverallThroughput: 128.65 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 264.29M (264293376) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m35s - UncompressedRowBatchSize: 68.13 GB (73151759540) HDFS_SCAN_NODE (id=0):(Total: 2s735ms, non-child: 2s735ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:32/7.89 GB 0:31/7.45 GB 2:28/6.84 GB 4:29/7.09 GB 3:30/7.31 GB 7:27/6.59 GB 5:26/6.40 GB 6:21/5.12 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.59 GB, 12.71 GB, 13.13 GB, 13.48 GB, 13.63 GB, 13.86 GB, 14.15 GB, 14.58 GB, 15.06 GB, 15.67 GB, 16.05 GB, 16.39 GB, 16.59 GB, 16.69 GB, 16.76 GB, 16.79 GB, 16.86 GB, 16.91 GB, 16.94 GB, 16.99 GB, 17.08 GB, 17.17 GB, 17.30 GB, 17.39 GB, 17.46 GB, 17.54 GB, 17.57 GB, 17.60 GB, 17.63 GB, 17.68 GB, 17.78 GB, 17.87 GB, 17.95 GB, 18.03 GB, 18.19 GB, 18.40 GB, 18.62 GB, 18.85 GB, 19.06 GB, 19.18 GB, 19.29 GB, 19.41 GB, 19.50 GB, 19.56 GB, 19.60 GB - FooterProcessingTime: (Avg: 4s781ms ; Min: 102.485ms ; Max: 16s786ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.65 GB (21104112970) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m2s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.96 GB (14992211876) - PerReadThreadRawHdfsThroughput: 45.28 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 264.51M (264507392) - RowsReturned: 264.29M (264294400) - RowsReturnedRate: 96.61 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s532ms - TotalRawHdfsReadTime(*): 7m24s - TotalReadThroughput: 6.90 MB/sec CodeGen:(Total: 30.964ms, non-child: 30.964ms, % non-child: 100.00%) - CodegenTime: 402.226us - CompileTime: 4.549ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.955ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 18.952ms Instance 844a0200d7876345:20bb38b900000050 (host=va1032.foo.com:22000):(Total: 241.213ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:29/7.06 GB 7:25/5.99 GB 3:30/7.39 GB 5:28/6.89 GB 4:31/7.40 GB 2:28/6.82 GB 1:23/5.62 GB 6:31/7.55 GB Fragment Instance Lifecycle Event Timeline: 1s898ms - Prepare Finished: 206.257ms (206.257ms) - Open Finished: 241.693ms (35.435ms) - First Batch Produced: 1s896ms (1s654ms) - First Batch Sent: 1s898ms (1.750ms) MemoryUsage(1m4s): 8.23 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.92 GB, 13.91 GB, 13.89 GB, 13.88 GB, 13.85 GB, 13.82 GB, 13.78 GB, 13.75 GB, 13.71 GB, 13.68 GB, 13.64 GB, 13.60 GB, 13.56 GB, 13.51 GB, 13.46 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.99 GB (15018731358) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.15 GB (86059087323) - RowsProduced: 267.53M (267525120) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m12s - TotalStorageWaitTime: 23m37s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 35.426ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 32.995ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s514ms - OpenTime: 35.427ms - ExecTreeOpenTime: 208.153us - PrepareTime: 205.720ms - ExecTreePrepareTime: 1.902ms KrpcDataStreamSender (dst_id=1):(Total: 4m35s, non-child: 4m35s, % non-child: 100.00%) - BytesSent: 35.13 GB (37719400442) - EosSent: 0 (0) - OverallThroughput: 130.77 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 267.52M (267524096) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m34s - UncompressedRowBatchSize: 68.96 GB (74045664625) HDFS_SCAN_NODE (id=0):(Total: 3s327ms, non-child: 3s327ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:29/7.06 GB 7:25/5.99 GB 3:30/7.39 GB 5:28/6.89 GB 4:31/7.40 GB 2:28/6.82 GB 1:23/5.62 GB 6:31/7.55 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.19 GB, 12.76 GB, 13.15 GB, 13.43 GB, 13.60 GB, 13.90 GB, 14.35 GB, 14.94 GB, 15.56 GB, 16.11 GB, 16.46 GB, 16.63 GB, 16.73 GB, 16.79 GB, 16.83 GB, 16.87 GB, 16.93 GB, 16.97 GB, 17.04 GB, 17.14 GB, 17.25 GB, 17.34 GB, 17.43 GB, 17.49 GB, 17.52 GB, 17.53 GB, 17.58 GB, 17.66 GB, 17.74 GB, 17.82 GB, 17.92 GB, 18.02 GB, 18.14 GB, 18.29 GB, 18.54 GB, 18.81 GB, 19.08 GB, 19.24 GB, 19.38 GB, 19.48 GB, 19.54 GB, 19.60 GB, 19.65 GB, 19.70 GB, 19.76 GB - FooterProcessingTime: (Avg: 3s758ms ; Min: 75.754ms ; Max: 7s983ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.82 GB (21281422194) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.98 GB (15015640149) - PerReadThreadRawHdfsThroughput: 42.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 267.74M (267738112) - RowsReturned: 267.53M (267525120) - RowsReturnedRate: 80.39 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s728ms - TotalRawHdfsReadTime(*): 8m - TotalReadThroughput: 6.97 MB/sec CodeGen:(Total: 34.915ms, non-child: 34.915ms, % non-child: 100.00%) - CodegenTime: 460.659us - CompileTime: 4.066ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.703ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 21.651ms Instance 844a0200d7876345:20bb38b900000014 (host=va1033.foo.com:22000):(Total: 257.959ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:22/5.36 GB 6:33/8.09 GB 7:16/3.89 GB 2:26/6.36 GB 3:33/8.12 GB 0:34/8.12 GB 4:34/8.29 GB 1:26/6.35 GB Fragment Instance Lifecycle Event Timeline: 1s745ms - Prepare Finished: 222.993ms (222.993ms) - Open Finished: 258.452ms (35.459ms) - First Batch Produced: 1s743ms (1s484ms) - First Batch Sent: 1s745ms (1.882ms) MemoryUsage(1m4s): 8.60 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.98 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.91 GB, 13.91 GB, 13.90 GB, 13.88 GB, 13.86 GB, 13.82 GB, 13.78 GB, 13.75 GB, 13.72 GB, 13.68 GB, 13.63 GB, 13.57 GB, 13.54 GB, 13.49 GB, 13.43 GB, 13.40 GB, 13.36 GB, 13.34 GB, 13.32 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.99 GB (15017872290) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.99 GB (93400948917) - RowsProduced: 282.63M (282629120) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m28s - TotalStorageWaitTime: 23m18s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 35.457ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 33.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s280ms - OpenTime: 35.458ms - ExecTreeOpenTime: 213.876us - PrepareTime: 222.420ms - ExecTreePrepareTime: 2.109ms KrpcDataStreamSender (dst_id=1):(Total: 4m31s, non-child: 4m31s, % non-child: 100.00%) - BytesSent: 37.10 GB (39839241541) - EosSent: 0 (0) - OverallThroughput: 139.85 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 282.63M (282628096) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m31s - UncompressedRowBatchSize: 72.85 GB (78225946767) HDFS_SCAN_NODE (id=0):(Total: 3s096ms, non-child: 3s096ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:22/5.36 GB 6:33/8.09 GB 7:16/3.89 GB 2:26/6.36 GB 3:33/8.12 GB 0:34/8.12 GB 4:34/8.29 GB 1:26/6.35 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.57 GB, 12.87 GB, 13.36 GB, 13.68 GB, 14.08 GB, 14.66 GB, 15.36 GB, 16.14 GB, 16.51 GB, 16.73 GB, 16.80 GB, 16.84 GB, 16.87 GB, 16.92 GB, 16.98 GB, 17.07 GB, 17.14 GB, 17.24 GB, 17.32 GB, 17.41 GB, 17.47 GB, 17.51 GB, 17.58 GB, 17.65 GB, 17.75 GB, 17.84 GB, 17.93 GB, 18.01 GB, 18.14 GB, 18.35 GB, 18.53 GB, 18.70 GB, 18.90 GB, 19.12 GB, 19.36 GB, 19.50 GB, 19.56 GB, 19.64 GB, 19.68 GB, 19.74 GB, 19.81 GB, 19.86 GB, 19.91 GB, 19.95 GB, 19.97 GB - FooterProcessingTime: (Avg: 4s459ms ; Min: 98.027ms ; Max: 8s410ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 20.01 GB (21481710084) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m26s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.98 GB (15014845605) - PerReadThreadRawHdfsThroughput: 48.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 282.84M (282842112) - RowsReturned: 282.63M (282629120) - RowsReturnedRate: 91.27 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s311ms - TotalRawHdfsReadTime(*): 7m3s - TotalReadThroughput: 6.97 MB/sec CodeGen:(Total: 34.953ms, non-child: 34.953ms, % non-child: 100.00%) - CodegenTime: 421.313us - CompileTime: 4.124ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.689ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.561ms Instance 844a0200d7876345:20bb38b900000046 (host=va1034.foo.com:22000):(Total: 250.910ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:26/6.28 GB 6:30/7.34 GB 2:28/6.83 GB 7:26/6.29 GB 1:26/6.30 GB 0:29/7.15 GB 4:29/7.13 GB 5:29/7.10 GB Fragment Instance Lifecycle Event Timeline: 1s633ms - Prepare Finished: 211.956ms (211.956ms) - Open Finished: 251.386ms (39.430ms) - First Batch Produced: 1s631ms (1s379ms) - First Batch Sent: 1s633ms (1.725ms) MemoryUsage(1m4s): 7.86 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.92 GB, 13.92 GB, 13.90 GB, 13.89 GB, 13.88 GB, 13.87 GB, 13.83 GB, 13.81 GB, 13.78 GB, 13.75 GB, 13.69 GB, 13.65 GB, 13.58 GB, 13.55 GB, 13.50 GB, 13.44 GB, 13.39 GB, 13.33 GB, 13.27 GB, 13.24 GB, 13.19 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.94 GB (14970246011) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.10 GB (86004517331) - RowsProduced: 276.94M (276942848) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m40s - TotalStorageWaitTime: 26m51s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 39.412ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 38.994ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s193ms - OpenTime: 39.413ms - ExecTreeOpenTime: 294.214us - PrepareTime: 211.430ms - ExecTreePrepareTime: 2.252ms KrpcDataStreamSender (dst_id=1):(Total: 4m32s, non-child: 4m32s, % non-child: 100.00%) - BytesSent: 36.36 GB (39039086757) - EosSent: 0 (0) - OverallThroughput: 136.56 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 276.94M (276941824) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m32s - UncompressedRowBatchSize: 71.39 GB (76652208975) HDFS_SCAN_NODE (id=0):(Total: 3s012ms, non-child: 3s012ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:26/6.28 GB 6:30/7.34 GB 2:28/6.83 GB 7:26/6.29 GB 1:26/6.30 GB 0:29/7.15 GB 4:29/7.13 GB 5:29/7.10 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.90 GB, 12.76 GB, 13.22 GB, 13.55 GB, 13.81 GB, 14.14 GB, 14.69 GB, 15.43 GB, 16.09 GB, 16.48 GB, 16.69 GB, 16.76 GB, 16.78 GB, 16.83 GB, 16.86 GB, 16.91 GB, 16.98 GB, 17.06 GB, 17.17 GB, 17.28 GB, 17.38 GB, 17.46 GB, 17.52 GB, 17.59 GB, 17.64 GB, 17.69 GB, 17.77 GB, 17.82 GB, 17.90 GB, 18.00 GB, 18.13 GB, 18.30 GB, 18.51 GB, 18.72 GB, 18.99 GB, 19.18 GB, 19.34 GB, 19.41 GB, 19.47 GB, 19.53 GB, 19.60 GB, 19.65 GB, 19.69 GB, 19.73 GB, 19.78 GB - FooterProcessingTime: (Avg: 4s705ms ; Min: 146.314ms ; Max: 10s773ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.80 GB (21262478107) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.94 GB (14967121912) - PerReadThreadRawHdfsThroughput: 46.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 277.16M (277155840) - RowsReturned: 276.94M (276942848) - RowsReturnedRate: 91.93 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 12s440ms - TotalRawHdfsReadTime(*): 7m16s - TotalReadThroughput: 6.91 MB/sec CodeGen:(Total: 38.816ms, non-child: 38.816ms, % non-child: 100.00%) - CodegenTime: 391.084us - CompileTime: 5.562ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.547ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 24.195ms Instance 844a0200d7876345:20bb38b90000004e (host=va1035.foo.com:22000):(Total: 264.431ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:24/5.94 GB 2:29/6.88 GB 4:30/7.25 GB 0:25/6.11 GB 1:40/9.86 GB 3:24/5.75 GB 5:27/6.56 GB 7:26/6.37 GB Fragment Instance Lifecycle Event Timeline: 2s225ms - Prepare Finished: 231.689ms (231.689ms) - Open Finished: 265.141ms (33.451ms) - First Batch Produced: 2s223ms (1s957ms) - First Batch Sent: 2s225ms (2.000ms) MemoryUsage(1m4s): 8.33 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.94 GB, 13.92 GB, 13.92 GB, 13.91 GB, 13.90 GB, 13.87 GB, 13.84 GB, 13.80 GB, 13.75 GB, 13.73 GB, 13.70 GB, 13.66 GB, 13.61 GB, 13.55 GB, 13.49 GB, 13.44 GB, 13.38 GB, 13.34 GB, 13.31 GB, 13.29 GB, 13.29 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.98 GB (15006484025) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.05 GB (85957839599) - RowsProduced: 281.83M (281827328) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m13s - TotalStorageWaitTime: 23m29s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 33.444ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 30.996ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s175ms - OpenTime: 33.445ms - ExecTreeOpenTime: 133.729us - PrepareTime: 230.877ms - ExecTreePrepareTime: 2.243ms KrpcDataStreamSender (dst_id=1):(Total: 4m32s, non-child: 4m32s, % non-child: 100.00%) - BytesSent: 36.97 GB (39699492245) - EosSent: 0 (0) - OverallThroughput: 138.94 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 281.83M (281826304) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m31s - UncompressedRowBatchSize: 72.65 GB (78004817968) HDFS_SCAN_NODE (id=0):(Total: 3s989ms, non-child: 3s989ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:24/5.94 GB 2:29/6.88 GB 4:30/7.25 GB 0:25/6.11 GB 1:40/9.86 GB 3:24/5.75 GB 5:27/6.56 GB 7:26/6.37 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.31 GB, 12.84 GB, 13.37 GB, 13.77 GB, 14.13 GB, 14.58 GB, 15.29 GB, 16.07 GB, 16.49 GB, 16.72 GB, 16.78 GB, 16.84 GB, 16.86 GB, 16.89 GB, 16.93 GB, 17.00 GB, 17.09 GB, 17.19 GB, 17.30 GB, 17.41 GB, 17.51 GB, 17.54 GB, 17.60 GB, 17.68 GB, 17.80 GB, 17.86 GB, 17.92 GB, 18.02 GB, 18.13 GB, 18.29 GB, 18.47 GB, 18.69 GB, 18.92 GB, 19.15 GB, 19.36 GB, 19.48 GB, 19.55 GB, 19.60 GB, 19.67 GB, 19.72 GB, 19.79 GB, 19.86 GB, 19.90 GB, 19.92 GB, 19.94 GB - FooterProcessingTime: (Avg: 4s324ms ; Min: 99.906ms ; Max: 9s991ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.98 GB (21449294510) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m7s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.97 GB (15003335309) - PerReadThreadRawHdfsThroughput: 43.89 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 282.04M (282040320) - RowsReturned: 281.83M (281827328) - RowsReturnedRate: 70.65 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s161ms - TotalRawHdfsReadTime(*): 7m46s - TotalReadThroughput: 7.01 MB/sec CodeGen:(Total: 33.017ms, non-child: 33.017ms, % non-child: 100.00%) - CodegenTime: 398.894us - CompileTime: 3.959ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.406ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.087ms Instance 844a0200d7876345:20bb38b900000064 (host=va1036.foo.com:22000):(Total: 252.091ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:21/5.13 GB 2:29/7.06 GB 1:28/6.83 GB 7:28/6.59 GB 0:24/5.90 GB 6:21/5.16 GB 3:31/7.50 GB 5:41/9.95 GB Fragment Instance Lifecycle Event Timeline: 1s621ms - Prepare Finished: 223.479ms (223.479ms) - Open Finished: 252.502ms (29.023ms) - First Batch Produced: 1s618ms (1s365ms) - First Batch Sent: 1s621ms (2.887ms) MemoryUsage(1m4s): 7.83 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.92 GB, 13.92 GB, 13.90 GB, 13.89 GB, 13.88 GB, 13.87 GB, 13.86 GB, 13.85 GB, 13.85 GB, 13.83 GB, 13.81 GB, 13.77 GB, 13.70 GB, 13.67 GB, 13.63 GB, 13.60 GB, 13.56 GB, 13.52 GB, 13.47 GB, 13.43 GB, 13.38 GB, 13.34 GB, 13.30 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.97 GB (15002094186) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.23 GB (86142231507) - RowsProduced: 280.26M (280263680) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m35s - TotalStorageWaitTime: 27m3s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 29.021ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 25.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s333ms - OpenTime: 29.022ms - ExecTreeOpenTime: 139.007us - PrepareTime: 222.996ms - ExecTreePrepareTime: 1.868ms KrpcDataStreamSender (dst_id=1):(Total: 4m38s, non-child: 4m38s, % non-child: 100.00%) - BytesSent: 36.80 GB (39514922520) - EosSent: 0 (0) - OverallThroughput: 135.36 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 280.26M (280262656) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m37s - UncompressedRowBatchSize: 72.24 GB (77570974829) HDFS_SCAN_NODE (id=0):(Total: 3s144ms, non-child: 3s144ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:21/5.13 GB 2:29/7.06 GB 1:28/6.83 GB 7:28/6.59 GB 0:24/5.90 GB 6:21/5.16 GB 3:31/7.50 GB 5:41/9.95 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.88 GB, 12.90 GB, 13.47 GB, 13.79 GB, 14.10 GB, 14.48 GB, 14.97 GB, 15.56 GB, 16.17 GB, 16.53 GB, 16.73 GB, 16.81 GB, 16.85 GB, 16.90 GB, 16.96 GB, 17.02 GB, 17.09 GB, 17.19 GB, 17.26 GB, 17.37 GB, 17.51 GB, 17.60 GB, 17.62 GB, 17.67 GB, 17.75 GB, 17.86 GB, 17.96 GB, 18.03 GB, 18.14 GB, 18.22 GB, 18.32 GB, 18.49 GB, 18.66 GB, 18.81 GB, 19.04 GB, 19.27 GB, 19.49 GB, 19.57 GB, 19.60 GB, 19.63 GB, 19.70 GB, 19.75 GB, 19.81 GB, 19.86 GB, 19.91 GB - FooterProcessingTime: (Avg: 5s270ms ; Min: 141.018ms ; Max: 14s360ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.95 GB (21425197069) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 59s115ms - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.97 GB (14998970081) - PerReadThreadRawHdfsThroughput: 44.97 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 280.48M (280476672) - RowsReturned: 280.26M (280263680) - RowsReturnedRate: 89.14 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s327ms - TotalRawHdfsReadTime(*): 7m34s - TotalReadThroughput: 6.95 MB/sec CodeGen:(Total: 28.566ms, non-child: 28.566ms, % non-child: 100.00%) - CodegenTime: 488.035us - CompileTime: 4.285ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.204ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 16.464ms Instance 844a0200d7876345:20bb38b90000001c (host=va1037.foo.com:22000):(Total: 241.190ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:25/6.07 GB 2:27/6.54 GB 5:30/7.39 GB 4:27/6.30 GB 0:30/7.30 GB 1:31/7.60 GB 3:29/7.14 GB 7:27/6.50 GB Fragment Instance Lifecycle Event Timeline: 1s647ms - Prepare Finished: 209.331ms (209.331ms) - Open Finished: 241.757ms (32.426ms) - First Batch Produced: 1s645ms (1s403ms) - First Batch Sent: 1s647ms (2.136ms) MemoryUsage(1m4s): 9.15 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.91 GB, 13.90 GB, 13.89 GB, 13.88 GB, 13.88 GB, 13.85 GB, 13.81 GB, 13.76 GB, 13.72 GB, 13.68 GB, 13.65 GB, 13.62 GB, 13.57 GB, 13.51 GB, 13.45 GB, 13.38 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.95 GB (14981929758) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.75 GB (93145257263) - RowsProduced: 263.64M (263636992) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m1s - TotalStorageWaitTime: 19m51s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 32.419ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 29.995ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s136ms - OpenTime: 32.420ms - ExecTreeOpenTime: 315.708us - PrepareTime: 208.694ms - ExecTreePrepareTime: 1.863ms KrpcDataStreamSender (dst_id=1):(Total: 4m37s, non-child: 4m37s, % non-child: 100.00%) - BytesSent: 34.64 GB (37193946281) - EosSent: 0 (0) - OverallThroughput: 127.76 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 263.64M (263635968) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m37s - UncompressedRowBatchSize: 67.96 GB (72969064497) HDFS_SCAN_NODE (id=0):(Total: 2s955ms, non-child: 2s955ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:25/6.07 GB 2:27/6.54 GB 5:30/7.39 GB 4:27/6.30 GB 0:30/7.30 GB 1:31/7.60 GB 3:29/7.14 GB 7:27/6.50 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 8.07 GB, 12.69 GB, 13.09 GB, 13.34 GB, 13.42 GB, 13.66 GB, 13.99 GB, 14.54 GB, 15.23 GB, 15.95 GB, 16.32 GB, 16.54 GB, 16.65 GB, 16.67 GB, 16.69 GB, 16.73 GB, 16.78 GB, 16.81 GB, 16.85 GB, 16.93 GB, 17.02 GB, 17.15 GB, 17.29 GB, 17.36 GB, 17.38 GB, 17.39 GB, 17.41 GB, 17.43 GB, 17.48 GB, 17.55 GB, 17.64 GB, 17.75 GB, 17.83 GB, 17.96 GB, 18.20 GB, 18.48 GB, 18.84 GB, 19.09 GB, 19.26 GB, 19.33 GB, 19.37 GB, 19.41 GB, 19.48 GB, 19.54 GB, 19.60 GB - FooterProcessingTime: (Avg: 3s448ms ; Min: 120.636ms ; Max: 7s608ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.66 GB (21105128022) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m11s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.95 GB (14978811864) - PerReadThreadRawHdfsThroughput: 54.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 263.85M (263849984) - RowsReturned: 263.64M (263636992) - RowsReturnedRate: 89.19 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s732ms - TotalRawHdfsReadTime(*): 6m9s - TotalReadThroughput: 6.90 MB/sec CodeGen:(Total: 31.749ms, non-child: 31.749ms, % non-child: 100.00%) - CodegenTime: 433.716us - CompileTime: 4.356ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.030ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 19.748ms Instance 844a0200d7876345:20bb38b900000031 (host=va1039.foo.com:22000):(Total: 210.113ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:28/6.82 GB 0:31/7.67 GB 7:28/6.84 GB 3:30/7.36 GB 5:32/7.53 GB 2:21/5.13 GB 1:22/5.36 GB 4:31/7.64 GB Fragment Instance Lifecycle Event Timeline: 1s666ms - Prepare Finished: 176.909ms (176.909ms) - Open Finished: 210.604ms (33.695ms) - First Batch Produced: 1s663ms (1s453ms) - First Batch Sent: 1s666ms (2.123ms) MemoryUsage(1m4s): 7.70 GB, 13.92 GB, 13.94 GB, 13.92 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.91 GB, 13.91 GB, 13.90 GB, 13.89 GB, 13.88 GB, 13.87 GB, 13.86 GB, 13.86 GB, 13.83 GB, 13.83 GB, 13.81 GB, 13.80 GB, 13.77 GB, 13.74 GB, 13.71 GB, 13.70 GB, 13.67 GB, 13.63 GB, 13.59 GB, 13.55 GB, 13.50 GB, 13.57 GB, 13.53 GB, 13.50 GB, 13.45 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.94 GB (14965251962) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.93 GB (93336800768) - RowsProduced: 273.48M (273475762) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m59s - TotalStorageWaitTime: 27m39s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 33.692ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 28.996ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s583ms - OpenTime: 33.694ms - ExecTreeOpenTime: 160.407us - PrepareTime: 176.346ms - ExecTreePrepareTime: 2.049ms KrpcDataStreamSender (dst_id=1):(Total: 4m34s, non-child: 4m34s, % non-child: 100.00%) - BytesSent: 35.89 GB (38537038234) - EosSent: 0 (0) - OverallThroughput: 133.81 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 273.47M (273474738) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m34s - UncompressedRowBatchSize: 70.49 GB (75692534625) HDFS_SCAN_NODE (id=0):(Total: 3s399ms, non-child: 3s399ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:28/6.82 GB 0:31/7.67 GB 7:28/6.84 GB 3:30/7.36 GB 5:32/7.53 GB 2:21/5.13 GB 1:22/5.36 GB 4:31/7.64 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.76 GB, 12.85 GB, 13.29 GB, 13.62 GB, 13.93 GB, 14.21 GB, 14.58 GB, 15.20 GB, 15.77 GB, 16.26 GB, 16.53 GB, 16.64 GB, 16.76 GB, 16.83 GB, 16.87 GB, 16.91 GB, 16.96 GB, 17.01 GB, 17.08 GB, 17.19 GB, 17.29 GB, 17.37 GB, 17.44 GB, 17.53 GB, 17.62 GB, 17.71 GB, 17.79 GB, 17.84 GB, 17.88 GB, 17.96 GB, 18.06 GB, 18.15 GB, 18.30 GB, 18.50 GB, 18.73 GB, 18.93 GB, 19.11 GB, 19.23 GB, 19.33 GB, 19.45 GB, 19.55 GB, 19.72 GB, 19.81 GB, 19.86 GB, 19.92 GB - FooterProcessingTime: (Avg: 4s868ms ; Min: 53.167ms ; Max: 11s562ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.97 GB (21447926518) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m24s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.93 GB (14962087920) - PerReadThreadRawHdfsThroughput: 43.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 273.69M (273688754) - RowsReturned: 273.48M (273475762) - RowsReturnedRate: 80.44 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 2s228ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s216ms - TotalRawHdfsReadTime(*): 7m44s - TotalReadThroughput: 6.99 MB/sec CodeGen:(Total: 33.265ms, non-child: 33.265ms, % non-child: 100.00%) - CodegenTime: 470.435us - CompileTime: 4.286ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.776ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 20.671ms Instance 844a0200d7876345:20bb38b900000078 (host=va1041.foo.com:22000):(Total: 240.704ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:21/5.13 GB 0:23/5.62 GB 1:29/6.97 GB 2:34/8.23 GB 7:35/8.58 GB 3:27/6.53 GB 5:21/5.13 GB 6:35/8.58 GB Fragment Instance Lifecycle Event Timeline: 1s798ms - Prepare Finished: 211.389ms (211.389ms) - Open Finished: 241.192ms (29.803ms) - First Batch Produced: 1s796ms (1s555ms) - First Batch Sent: 1s798ms (2.096ms) MemoryUsage(1m4s): 7.81 GB, 13.96 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.95 GB, 13.94 GB, 13.92 GB, 13.91 GB, 13.89 GB, 13.87 GB, 13.85 GB, 13.82 GB, 13.80 GB, 13.77 GB, 13.71 GB, 13.68 GB, 13.65 GB, 13.62 GB, 13.59 GB, 13.56 GB, 13.51 GB, 13.47 GB, 13.42 GB, 13.38 GB, 13.35 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.00 GB (15028755530) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.33 GB (86253080013) - RowsProduced: 282.13M (282126336) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m31s - TotalStorageWaitTime: 27m46s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 29.800ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 29.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s414ms - OpenTime: 29.801ms - ExecTreeOpenTime: 166.405us - PrepareTime: 210.794ms - ExecTreePrepareTime: 2.052ms KrpcDataStreamSender (dst_id=1):(Total: 4m38s, non-child: 4m38s, % non-child: 100.00%) - BytesSent: 37.05 GB (39780168830) - EosSent: 0 (0) - OverallThroughput: 136.15 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 282.13M (282125312) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m38s - UncompressedRowBatchSize: 72.72 GB (78086690208) HDFS_SCAN_NODE (id=0):(Total: 3s208ms, non-child: 3s208ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:21/5.13 GB 0:23/5.62 GB 1:29/6.97 GB 2:34/8.23 GB 7:35/8.58 GB 3:27/6.53 GB 5:21/5.13 GB 6:35/8.58 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.85 GB, 12.91 GB, 13.36 GB, 13.87 GB, 14.37 GB, 14.85 GB, 15.30 GB, 15.82 GB, 16.30 GB, 16.59 GB, 16.77 GB, 16.89 GB, 16.95 GB, 16.99 GB, 17.04 GB, 17.09 GB, 17.14 GB, 17.19 GB, 17.24 GB, 17.32 GB, 17.45 GB, 17.55 GB, 17.65 GB, 17.72 GB, 17.83 GB, 17.93 GB, 18.02 GB, 18.15 GB, 18.27 GB, 18.40 GB, 18.52 GB, 18.64 GB, 18.77 GB, 18.91 GB, 19.11 GB, 19.33 GB, 19.52 GB, 19.62 GB, 19.66 GB, 19.71 GB, 19.77 GB, 19.84 GB, 19.91 GB, 19.97 GB, 20.01 GB - FooterProcessingTime: (Avg: 3s770ms ; Min: 146.358ms ; Max: 7s187ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 20.07 GB (21550229352) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m17s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.99 GB (15025516923) - PerReadThreadRawHdfsThroughput: 46.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 282.34M (282339328) - RowsReturned: 282.13M (282126336) - RowsReturnedRate: 87.93 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s514ms - TotalRawHdfsReadTime(*): 7m23s - TotalReadThroughput: 6.99 MB/sec CodeGen:(Total: 29.356ms, non-child: 29.356ms, % non-child: 100.00%) - CodegenTime: 397.697us - CompileTime: 4.188ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.363ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 17.310ms Instance 844a0200d7876345:20bb38b900000036 (host=va1042.foo.com:22000):(Total: 243.889ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:30/7.35 GB 4:19/4.62 GB 3:25/6.11 GB 5:29/7.07 GB 0:34/8.30 GB 1:29/7.11 GB 7:28/6.77 GB 6:30/7.26 GB Fragment Instance Lifecycle Event Timeline: 1s521ms - Prepare Finished: 205.621ms (205.621ms) - Open Finished: 244.785ms (39.164ms) - First Batch Produced: 1s520ms (1s275ms) - First Batch Sent: 1s521ms (1.503ms) MemoryUsage(1m4s): 8.55 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.95 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.92 GB, 13.91 GB, 13.91 GB, 13.90 GB, 13.88 GB, 13.86 GB, 13.84 GB, 13.80 GB, 13.75 GB, 13.71 GB, 13.67 GB, 13.66 GB, 13.62 GB, 13.57 GB, 13.52 GB, 13.46 GB, 13.41 GB, 13.37 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.96 GB (14989007065) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.17 GB (86085333958) - RowsProduced: 267.95M (267947008) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m49s - TotalStorageWaitTime: 22m39s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 39.161ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 36.994ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s622ms - OpenTime: 39.162ms - ExecTreeOpenTime: 241.517us - PrepareTime: 204.651ms - ExecTreePrepareTime: 1.835ms KrpcDataStreamSender (dst_id=1):(Total: 4m38s, non-child: 4m38s, % non-child: 100.00%) - BytesSent: 35.17 GB (37760902960) - EosSent: 0 (0) - OverallThroughput: 129.36 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 267.95M (267945984) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m37s - UncompressedRowBatchSize: 69.07 GB (74161463207) HDFS_SCAN_NODE (id=0):(Total: 3s421ms, non-child: 3s421ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:30/7.35 GB 4:19/4.62 GB 3:25/6.11 GB 5:29/7.07 GB 0:34/8.30 GB 1:29/7.11 GB 7:28/6.77 GB 6:30/7.26 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.52 GB, 12.75 GB, 13.12 GB, 13.38 GB, 13.55 GB, 13.87 GB, 14.33 GB, 14.97 GB, 15.65 GB, 16.21 GB, 16.49 GB, 16.68 GB, 16.73 GB, 16.77 GB, 16.81 GB, 16.85 GB, 16.89 GB, 16.96 GB, 17.02 GB, 17.11 GB, 17.18 GB, 17.28 GB, 17.39 GB, 17.44 GB, 17.47 GB, 17.50 GB, 17.54 GB, 17.60 GB, 17.69 GB, 17.78 GB, 17.86 GB, 17.96 GB, 18.11 GB, 18.29 GB, 18.50 GB, 18.70 GB, 18.99 GB, 19.24 GB, 19.35 GB, 19.41 GB, 19.46 GB, 19.50 GB, 19.57 GB, 19.63 GB, 19.68 GB - FooterProcessingTime: (Avg: 3s601ms ; Min: 115.332ms ; Max: 9s661ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.76 GB (21218574725) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m26s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.96 GB (14985909587) - PerReadThreadRawHdfsThroughput: 47.54 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 268.16M (268160000) - RowsReturned: 267.95M (267947008) - RowsReturnedRate: 78.31 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s667ms - TotalRawHdfsReadTime(*): 7m5s - TotalReadThroughput: 6.91 MB/sec CodeGen:(Total: 38.642ms, non-child: 38.642ms, % non-child: 100.00%) - CodegenTime: 485.778us - CompileTime: 5.214ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.358ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 24.536ms Instance 844a0200d7876345:20bb38b90000002f (host=va1043.foo.com:22000):(Total: 202.396ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:17/4.17 GB 3:21/5.16 GB 5:31/7.57 GB 2:27/6.61 GB 0:23/5.54 GB 6:35/8.50 GB 1:31/7.44 GB 4:39/9.37 GB Fragment Instance Lifecycle Event Timeline: 1s369ms - Prepare Finished: 171.870ms (171.870ms) - Open Finished: 202.795ms (30.925ms) - First Batch Produced: 1s367ms (1s165ms) - First Batch Sent: 1s369ms (2.129ms) MemoryUsage(1m4s): 8.45 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.92 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.89 GB, 13.89 GB, 13.87 GB, 13.85 GB, 13.84 GB, 13.82 GB, 13.79 GB, 13.76 GB, 13.72 GB, 13.69 GB, 13.66 GB, 13.60 GB, 13.54 GB, 13.47 GB, 13.42 GB, 13.38 GB, 13.34 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.96 GB (14993490801) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.77 GB (93168589523) - RowsProduced: 272.95M (272945152) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m6s - TotalStorageWaitTime: 23m36s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 30.921ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 27.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 2s710ms - OpenTime: 30.922ms - ExecTreeOpenTime: 316.608us - PrepareTime: 171.413ms - ExecTreePrepareTime: 1.947ms KrpcDataStreamSender (dst_id=1):(Total: 4m31s, non-child: 4m31s, % non-child: 100.00%) - BytesSent: 35.84 GB (38479755632) - EosSent: 0 (0) - OverallThroughput: 135.39 MB/sec - PeakMemoryUsage: 3.58 MB (3752608) - RowsReturned: 272.94M (272944128) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m30s - UncompressedRowBatchSize: 70.36 GB (75545688003) HDFS_SCAN_NODE (id=0):(Total: 2s540ms, non-child: 2s540ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:17/4.17 GB 3:21/5.16 GB 5:31/7.57 GB 2:27/6.61 GB 0:23/5.54 GB 6:35/8.50 GB 1:31/7.44 GB 4:39/9.37 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.42 GB, 12.75 GB, 13.15 GB, 13.42 GB, 13.65 GB, 14.00 GB, 14.48 GB, 15.17 GB, 15.79 GB, 16.28 GB, 16.55 GB, 16.65 GB, 16.73 GB, 16.76 GB, 16.80 GB, 16.85 GB, 16.91 GB, 16.97 GB, 17.06 GB, 17.16 GB, 17.26 GB, 17.34 GB, 17.41 GB, 17.46 GB, 17.48 GB, 17.54 GB, 17.61 GB, 17.67 GB, 17.78 GB, 17.87 GB, 17.98 GB, 18.13 GB, 18.30 GB, 18.55 GB, 18.86 GB, 19.08 GB, 19.26 GB, 19.39 GB, 19.47 GB, 19.55 GB, 19.61 GB, 19.66 GB, 19.72 GB, 19.78 GB, 19.82 GB - FooterProcessingTime: (Avg: 3s992ms ; Min: 65.611ms ; Max: 9s214ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.85 GB (21309169422) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m14s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.96 GB (14990354340) - PerReadThreadRawHdfsThroughput: 47.09 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 273.16M (273158144) - RowsReturned: 272.95M (272945152) - RowsReturnedRate: 107.44 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s774ms - TotalRawHdfsReadTime(*): 7m11s - TotalReadThroughput: 6.96 MB/sec CodeGen:(Total: 30.301ms, non-child: 30.301ms, % non-child: 100.00%) - CodegenTime: 406.950us - CompileTime: 4.320ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.008ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 18.362ms Instance 844a0200d7876345:20bb38b900000006 (host=va1044.foo.com:22000):(Total: 244.866ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:25/6.12 GB 6:24/5.87 GB 5:24/5.91 GB 2:23/5.57 GB 3:38/9.29 GB 0:33/8.12 GB 1:33/7.91 GB 4:23/5.66 GB Fragment Instance Lifecycle Event Timeline: 1s898ms - Prepare Finished: 214.048ms (214.048ms) - Open Finished: 245.352ms (31.304ms) - First Batch Produced: 1s896ms (1s650ms) - First Batch Sent: 1s898ms (1.968ms) MemoryUsage(1m4s): 7.15 GB, 13.79 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.94 GB, 13.91 GB, 13.91 GB, 13.90 GB, 13.90 GB, 13.89 GB, 13.88 GB, 13.87 GB, 13.86 GB, 13.84 GB, 13.83 GB, 13.80 GB, 13.78 GB, 13.76 GB, 13.74 GB, 13.73 GB, 13.70 GB, 13.66 GB, 13.63 GB, 13.59 GB, 13.54 GB, 13.50 GB, 13.45 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.96 GB (14985536199) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.90 GB (93310308531) - RowsProduced: 267.55M (267549696) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m38s - TotalStorageWaitTime: 31m11s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 31.293ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 30.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s366ms - OpenTime: 31.294ms - ExecTreeOpenTime: 151.210us - PrepareTime: 213.493ms - ExecTreePrepareTime: 2.350ms KrpcDataStreamSender (dst_id=1):(Total: 4m35s, non-child: 4m35s, % non-child: 100.00%) - BytesSent: 35.09 GB (37679442746) - EosSent: 0 (0) - OverallThroughput: 130.29 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 267.55M (267548672) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m35s - UncompressedRowBatchSize: 68.97 GB (74051951405) HDFS_SCAN_NODE (id=0):(Total: 3s178ms, non-child: 3s178ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:25/6.12 GB 6:24/5.87 GB 5:24/5.91 GB 2:23/5.57 GB 3:38/9.29 GB 0:33/8.12 GB 1:33/7.91 GB 4:23/5.66 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.27 GB, 12.70 GB, 13.26 GB, 13.65 GB, 13.92 GB, 14.18 GB, 14.44 GB, 14.89 GB, 15.38 GB, 15.79 GB, 16.18 GB, 16.47 GB, 16.62 GB, 16.76 GB, 16.86 GB, 16.90 GB, 16.95 GB, 16.98 GB, 17.04 GB, 17.14 GB, 17.25 GB, 17.33 GB, 17.39 GB, 17.46 GB, 17.57 GB, 17.68 GB, 17.74 GB, 17.79 GB, 17.86 GB, 17.92 GB, 18.00 GB, 18.08 GB, 18.13 GB, 18.23 GB, 18.42 GB, 18.63 GB, 18.87 GB, 18.99 GB, 19.06 GB, 19.15 GB, 19.28 GB, 19.43 GB, 19.55 GB, 19.63 GB, 19.67 GB - FooterProcessingTime: (Avg: 5s616ms ; Min: 136.957ms ; Max: 12s576ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.73 GB (21180889870) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m53s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.95 GB (14982395755) - PerReadThreadRawHdfsThroughput: 40.72 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 267.76M (267762688) - RowsReturned: 267.55M (267549696) - RowsReturnedRate: 84.16 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 11s281ms - TotalRawHdfsReadTime(*): 8m16s - TotalReadThroughput: 6.91 MB/sec CodeGen:(Total: 30.793ms, non-child: 30.793ms, % non-child: 100.00%) - CodegenTime: 478.359us - CompileTime: 4.334ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.780ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 18.047ms Instance 844a0200d7876345:20bb38b900000061 (host=va1045.foo.com:22000):(Total: 224.099ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:24/5.83 GB 1:38/9.21 GB 5:27/6.52 GB 4:31/7.49 GB 7:29/7.06 GB 2:32/7.67 GB 3:24/5.72 GB 6:21/5.12 GB Fragment Instance Lifecycle Event Timeline: 1s656ms - Prepare Finished: 189.608ms (189.608ms) - Open Finished: 224.537ms (34.929ms) - First Batch Produced: 1s654ms (1s430ms) - First Batch Sent: 1s656ms (1.928ms) MemoryUsage(1m4s): 7.14 GB, 13.77 GB, 13.86 GB, 13.87 GB, 13.87 GB, 13.87 GB, 13.86 GB, 13.85 GB, 13.84 GB, 13.84 GB, 13.84 GB, 13.84 GB, 13.84 GB, 13.84 GB, 13.84 GB, 13.83 GB, 13.82 GB, 13.82 GB, 13.80 GB, 13.79 GB, 13.77 GB, 13.77 GB, 13.74 GB, 13.73 GB, 13.73 GB, 13.72 GB, 13.70 GB, 13.67 GB, 13.63 GB, 13.62 GB, 13.57 GB, 13.55 GB, 13.63 GB, 13.61 GB, 13.57 GB, 13.55 GB, 13.48 GB, 13.44 GB, 13.40 GB, 13.37 GB, 13.33 GB, 13.30 GB, 13.26 GB, 13.21 GB, 13.18 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.87 GB (14894819136) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.14 GB (86047221601) - RowsProduced: 283.76M (283762528) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m36s - TotalStorageWaitTime: 30m50s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 34.925ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 31.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s039ms - OpenTime: 34.927ms - ExecTreeOpenTime: 198.579us - PrepareTime: 189.096ms - ExecTreePrepareTime: 2.103ms KrpcDataStreamSender (dst_id=1):(Total: 4m35s, non-child: 4m35s, % non-child: 100.00%) - BytesSent: 37.22 GB (39966838594) - EosSent: 0 (0) - OverallThroughput: 138.13 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 283.76M (283761504) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m35s - UncompressedRowBatchSize: 73.15 GB (78539293002) HDFS_SCAN_NODE (id=0):(Total: 2s856ms, non-child: 2s856ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:24/5.83 GB 1:38/9.21 GB 5:27/6.52 GB 4:31/7.49 GB 7:29/7.06 GB 2:32/7.67 GB 3:24/5.72 GB 6:21/5.12 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.27 GB, 12.77 GB, 13.42 GB, 13.86 GB, 14.24 GB, 14.72 GB, 15.27 GB, 15.79 GB, 16.19 GB, 16.49 GB, 16.63 GB, 16.74 GB, 16.81 GB, 16.86 GB, 16.90 GB, 16.97 GB, 17.08 GB, 17.15 GB, 17.22 GB, 17.31 GB, 17.37 GB, 17.48 GB, 17.58 GB, 17.64 GB, 17.71 GB, 17.80 GB, 17.88 GB, 17.95 GB, 18.05 GB, 18.15 GB, 18.30 GB, 18.48 GB, 18.74 GB, 18.89 GB, 19.07 GB, 19.19 GB, 19.37 GB, 19.52 GB, 19.58 GB, 19.63 GB, 19.68 GB, 19.70 GB, 19.76 GB, 19.82 GB, 19.85 GB - FooterProcessingTime: (Avg: 5s463ms ; Min: 103.979ms ; Max: 15s258ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 87.99 - BytesRead: 19.90 GB (21368410775) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m9s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.87 GB (14891695029) - PerReadThreadRawHdfsThroughput: 44.51 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 283.98M (283975520) - RowsReturned: 283.76M (283762528) - RowsReturnedRate: 99.35 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 1s153ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s620ms - TotalRawHdfsReadTime(*): 7m37s - TotalReadThroughput: 6.93 MB/sec CodeGen:(Total: 34.387ms, non-child: 34.387ms, % non-child: 100.00%) - CodegenTime: 459.440us - CompileTime: 4.308ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.552ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.044ms Instance 844a0200d7876345:20bb38b90000001f (host=va1046.foo.com:22000):(Total: 229.085ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:25/6.11 GB 0:36/8.68 GB 5:35/8.59 GB 7:27/6.45 GB 3:29/6.99 GB 2:20/4.84 GB 4:29/7.07 GB 6:24/5.88 GB Fragment Instance Lifecycle Event Timeline: 1s645ms - Prepare Finished: 193.329ms (193.329ms) - Open Finished: 229.796ms (36.466ms) - First Batch Produced: 1s644ms (1s414ms) - First Batch Sent: 1s645ms (1.347ms) MemoryUsage(1m4s): 8.50 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.91 GB, 13.90 GB, 13.86 GB, 13.85 GB, 13.82 GB, 13.79 GB, 13.76 GB, 13.70 GB, 13.67 GB, 13.63 GB, 13.59 GB, 13.55 GB, 13.50 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.97 GB (15002554256) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.92 GB (93330814699) - RowsProduced: 266.60M (266603520) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m51s - TotalStorageWaitTime: 23m20s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 36.463ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 35.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s542ms - OpenTime: 36.464ms - ExecTreeOpenTime: 205.880us - PrepareTime: 192.539ms - ExecTreePrepareTime: 1.721ms KrpcDataStreamSender (dst_id=1):(Total: 4m41s, non-child: 4m41s, % non-child: 100.00%) - BytesSent: 34.98 GB (37561748673) - EosSent: 0 (0) - OverallThroughput: 127.23 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 266.60M (266602496) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m40s - UncompressedRowBatchSize: 68.72 GB (73790708983) HDFS_SCAN_NODE (id=0):(Total: 3s361ms, non-child: 3s361ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:25/6.11 GB 0:36/8.68 GB 5:35/8.59 GB 7:27/6.45 GB 3:29/6.99 GB 2:20/4.84 GB 4:29/7.07 GB 6:24/5.88 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.48 GB, 12.81 GB, 13.21 GB, 13.50 GB, 13.72 GB, 14.06 GB, 14.48 GB, 15.06 GB, 15.53 GB, 16.04 GB, 16.40 GB, 16.54 GB, 16.70 GB, 16.80 GB, 16.81 GB, 16.85 GB, 16.90 GB, 16.96 GB, 17.03 GB, 17.11 GB, 17.20 GB, 17.28 GB, 17.34 GB, 17.43 GB, 17.51 GB, 17.54 GB, 17.63 GB, 17.70 GB, 17.74 GB, 17.81 GB, 17.93 GB, 18.04 GB, 18.16 GB, 18.32 GB, 18.55 GB, 18.74 GB, 18.91 GB, 19.08 GB, 19.22 GB, 19.39 GB, 19.52 GB, 19.58 GB, 19.63 GB, 19.66 GB, 19.72 GB - FooterProcessingTime: (Avg: 3s874ms ; Min: 87.830ms ; Max: 8s947ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.79 GB (21245356150) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m14s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.97 GB (14999438332) - PerReadThreadRawHdfsThroughput: 49.93 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 266.82M (266816512) - RowsReturned: 266.60M (266603520) - RowsReturnedRate: 79.31 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s176ms - TotalRawHdfsReadTime(*): 6m45s - TotalReadThroughput: 6.94 MB/sec CodeGen:(Total: 35.911ms, non-child: 35.911ms, % non-child: 100.00%) - CodegenTime: 487.212us - CompileTime: 4.554ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.230ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.617ms Instance 844a0200d7876345:20bb38b900000027 (host=vc1501.foo.com:22000):(Total: 267.641ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:29/7.14 GB 1:24/5.90 GB 2:26/6.36 GB 4:30/7.35 GB 6:25/6.19 GB 5:27/6.58 GB 0:36/8.80 GB 3:27/6.53 GB Fragment Instance Lifecycle Event Timeline: 1s819ms - Prepare Finished: 241.784ms (241.784ms) - Open Finished: 268.236ms (26.452ms) - First Batch Produced: 1s817ms (1s548ms) - First Batch Sent: 1s819ms (2.661ms) MemoryUsage(1m4s): 8.94 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 13.99 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.96 GB, 13.94 GB, 13.92 GB, 13.91 GB, 13.89 GB, 13.85 GB, 13.81 GB, 13.76 GB, 13.71 GB, 13.67 GB, 13.61 GB, 13.55 GB, 13.51 GB, 13.47 GB, 13.45 GB, 13.44 GB, 13.43 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.01 GB (15040770748) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.01 GB (93425167295) - RowsProduced: 283.89M (283893760) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m28s - TotalStorageWaitTime: 21m44s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 26.437ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 22.997ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s556ms - OpenTime: 26.449ms - ExecTreeOpenTime: 139.777us - PrepareTime: 241.111ms - ExecTreePrepareTime: 1.807ms KrpcDataStreamSender (dst_id=1):(Total: 4m33s, non-child: 4m33s, % non-child: 100.00%) - BytesSent: 37.26 GB (40004481904) - EosSent: 0 (0) - OverallThroughput: 139.70 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 283.89M (283892736) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m32s - UncompressedRowBatchSize: 73.18 GB (78576078140) HDFS_SCAN_NODE (id=0):(Total: 3s373ms, non-child: 3s373ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:29/7.14 GB 1:24/5.90 GB 2:26/6.36 GB 4:30/7.35 GB 6:25/6.19 GB 5:27/6.58 GB 0:36/8.80 GB 3:27/6.53 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.90 GB, 12.88 GB, 13.47 GB, 13.76 GB, 14.13 GB, 14.77 GB, 15.63 GB, 16.29 GB, 16.62 GB, 16.79 GB, 16.82 GB, 16.83 GB, 16.89 GB, 16.94 GB, 17.01 GB, 17.08 GB, 17.19 GB, 17.31 GB, 17.44 GB, 17.51 GB, 17.57 GB, 17.63 GB, 17.67 GB, 17.70 GB, 17.77 GB, 17.89 GB, 17.99 GB, 18.10 GB, 18.25 GB, 18.40 GB, 18.60 GB, 18.84 GB, 19.08 GB, 19.31 GB, 19.51 GB, 19.59 GB, 19.68 GB, 19.75 GB, 19.81 GB, 19.87 GB, 19.91 GB, 19.94 GB, 20.00 GB, 20.02 GB, 20.05 GB - FooterProcessingTime: (Avg: 3s848ms ; Min: 107.304ms ; Max: 9s103ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 20.10 GB (21580004910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m11s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 14.00 GB (15037646642) - PerReadThreadRawHdfsThroughput: 51.97 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 284.11M (284105728) - RowsReturned: 283.89M (283893760) - RowsReturnedRate: 84.15 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s016ms - TotalRawHdfsReadTime(*): 6m35s - TotalReadThroughput: 7.02 MB/sec CodeGen:(Total: 26.021ms, non-child: 26.021ms, % non-child: 100.00%) - CodegenTime: 362.671us - CompileTime: 3.920ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.631ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 14.967ms Instance 844a0200d7876345:20bb38b900000013 (host=vc1502.foo.com:22000):(Total: 253.628ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:27/6.59 GB 3:26/6.36 GB 6:23/5.62 GB 7:33/8.13 GB 4:27/6.64 GB 1:25/6.14 GB 5:28/6.89 GB 0:35/8.56 GB Fragment Instance Lifecycle Event Timeline: 1s805ms - Prepare Finished: 226.633ms (226.633ms) - Open Finished: 254.051ms (27.417ms) - First Batch Produced: 1s803ms (1s549ms) - First Batch Sent: 1s805ms (1.977ms) MemoryUsage(1m4s): 8.41 GB, 13.98 GB, 13.98 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 13.99 GB, 13.98 GB, 13.97 GB, 13.96 GB, 13.95 GB, 13.93 GB, 13.90 GB, 13.88 GB, 13.86 GB, 13.82 GB, 13.81 GB, 13.78 GB, 13.74 GB, 13.70 GB, 13.67 GB, 13.62 GB, 13.58 GB, 13.54 GB, 13.50 GB, 13.48 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.00 GB (15037322287) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.11 GB (93536713254) - RowsProduced: 276.89M (276888576) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m14s - TotalStorageWaitTime: 23m56s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 27.414ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 22.997ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s216ms - OpenTime: 27.415ms - ExecTreeOpenTime: 141.441us - PrepareTime: 226.126ms - ExecTreePrepareTime: 1.875ms KrpcDataStreamSender (dst_id=1):(Total: 4m37s, non-child: 4m37s, % non-child: 100.00%) - BytesSent: 36.34 GB (39020566961) - EosSent: 0 (0) - OverallThroughput: 134.10 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 276.89M (276887552) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m36s - UncompressedRowBatchSize: 71.37 GB (76636933367) HDFS_SCAN_NODE (id=0):(Total: 3s023ms, non-child: 3s023ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:27/6.59 GB 3:26/6.36 GB 6:23/5.62 GB 7:33/8.13 GB 4:27/6.64 GB 1:25/6.14 GB 5:28/6.89 GB 0:35/8.56 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.40 GB, 12.87 GB, 13.40 GB, 13.76 GB, 14.09 GB, 14.53 GB, 15.12 GB, 15.81 GB, 16.31 GB, 16.62 GB, 16.76 GB, 16.83 GB, 16.88 GB, 16.91 GB, 16.95 GB, 17.00 GB, 17.06 GB, 17.15 GB, 17.26 GB, 17.38 GB, 17.46 GB, 17.53 GB, 17.59 GB, 17.64 GB, 17.72 GB, 17.81 GB, 17.89 GB, 17.95 GB, 18.02 GB, 18.15 GB, 18.28 GB, 18.43 GB, 18.63 GB, 18.83 GB, 19.09 GB, 19.30 GB, 19.46 GB, 19.59 GB, 19.66 GB, 19.71 GB, 19.78 GB, 19.83 GB, 19.89 GB, 19.94 GB, 19.99 GB - FooterProcessingTime: (Avg: 4s735ms ; Min: 151.504ms ; Max: 11s678ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 20.02 GB (21501167893) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m23s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 14.00 GB (15034126468) - PerReadThreadRawHdfsThroughput: 46.82 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 277.10M (277101568) - RowsReturned: 276.89M (276888576) - RowsReturnedRate: 91.57 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s779ms - TotalRawHdfsReadTime(*): 7m17s - TotalReadThroughput: 6.98 MB/sec CodeGen:(Total: 27.009ms, non-child: 27.009ms, % non-child: 100.00%) - CodegenTime: 394.414us - CompileTime: 4.112ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.738ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 15.566ms Instance 844a0200d7876345:20bb38b900000049 (host=vc1503.foo.com:22000):(Total: 251.787ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:26/6.12 GB 0:26/6.40 GB 7:26/6.39 GB 2:26/6.40 GB 4:27/6.65 GB 5:27/6.57 GB 3:37/8.93 GB 1:29/7.10 GB Fragment Instance Lifecycle Event Timeline: 1s759ms - Prepare Finished: 225.703ms (225.703ms) - Open Finished: 252.522ms (26.819ms) - First Batch Produced: 1s757ms (1s505ms) - First Batch Sent: 1s759ms (1.931ms) MemoryUsage(1m4s): 7.84 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.99 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.94 GB, 13.93 GB, 13.91 GB, 13.90 GB, 13.90 GB, 13.89 GB, 13.88 GB, 13.86 GB, 13.84 GB, 13.82 GB, 13.80 GB, 13.78 GB, 13.72 GB, 13.67 GB, 13.62 GB, 13.57 GB, 13.53 GB, 13.50 GB, 13.46 GB, 13.44 GB, 13.42 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.99 GB (15021296889) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.08 GB (85983851962) - RowsProduced: 282.62M (282619636) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m51s - TotalStorageWaitTime: 27m36s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 26.815ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 23.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s554ms - OpenTime: 26.816ms - ExecTreeOpenTime: 154.534us - PrepareTime: 224.889ms - ExecTreePrepareTime: 1.768ms KrpcDataStreamSender (dst_id=1):(Total: 4m31s, non-child: 4m31s, % non-child: 100.00%) - BytesSent: 37.07 GB (39804107903) - EosSent: 0 (0) - OverallThroughput: 139.79 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 282.62M (282618612) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m31s - UncompressedRowBatchSize: 72.85 GB (78222795755) HDFS_SCAN_NODE (id=0):(Total: 3s367ms, non-child: 3s367ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:26/6.12 GB 0:26/6.40 GB 7:26/6.39 GB 2:26/6.40 GB 4:27/6.65 GB 5:27/6.57 GB 3:37/8.93 GB 1:29/7.10 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.91 GB, 12.91 GB, 13.52 GB, 13.87 GB, 14.15 GB, 14.67 GB, 15.38 GB, 16.08 GB, 16.52 GB, 16.75 GB, 16.85 GB, 16.89 GB, 16.92 GB, 16.96 GB, 17.08 GB, 17.17 GB, 17.26 GB, 17.35 GB, 17.45 GB, 17.56 GB, 17.63 GB, 17.69 GB, 17.74 GB, 17.80 GB, 17.89 GB, 17.94 GB, 17.98 GB, 18.06 GB, 18.20 GB, 18.38 GB, 18.57 GB, 18.75 GB, 18.95 GB, 19.14 GB, 19.34 GB, 19.49 GB, 19.63 GB, 19.72 GB, 19.78 GB, 19.82 GB, 19.88 GB, 19.94 GB, 19.97 GB, 20.01 GB, 20.03 GB - FooterProcessingTime: (Avg: 5s049ms ; Min: 151.881ms ; Max: 15s086ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 20.04 GB (21521788701) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m24s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.99 GB (15018180907) - PerReadThreadRawHdfsThroughput: 44.67 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 282.83M (282831604) - RowsReturned: 282.62M (282619636) - RowsReturnedRate: 83.94 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 18.458ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s858ms - TotalRawHdfsReadTime(*): 7m39s - TotalReadThroughput: 7.05 MB/sec CodeGen:(Total: 26.378ms, non-child: 26.378ms, % non-child: 100.00%) - CodegenTime: 400.606us - CompileTime: 4.187ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.329ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 14.317ms Instance 844a0200d7876345:20bb38b90000003c (host=vc1504.foo.com:22000):(Total: 290.816ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:28/6.90 GB 7:28/6.90 GB 3:33/8.05 GB 1:27/6.61 GB 6:27/6.64 GB 2:24/5.85 GB 4:28/6.86 GB 0:29/7.05 GB Fragment Instance Lifecycle Event Timeline: 1s488ms - Prepare Finished: 265.298ms (265.298ms) - Open Finished: 291.315ms (26.017ms) - First Batch Produced: 1s486ms (1s195ms) - First Batch Sent: 1s488ms (1.926ms) MemoryUsage(1m4s): 7.99 GB, 13.92 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.94 GB, 13.91 GB, 13.88 GB, 13.86 GB, 13.83 GB, 13.80 GB, 13.78 GB, 13.74 GB, 13.72 GB, 13.68 GB, 13.64 GB, 13.61 GB, 13.56 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.99 GB (15025363109) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.33 GB (86258225990) - RowsProduced: 263.72M (263717888) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m55s - TotalStorageWaitTime: 27m14s - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 26.014ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s036ms - OpenTime: 26.016ms - ExecTreeOpenTime: 249.787us - PrepareTime: 264.759ms - ExecTreePrepareTime: 1.512ms KrpcDataStreamSender (dst_id=1):(Total: 4m39s, non-child: 4m39s, % non-child: 100.00%) - BytesSent: 34.61 GB (37162063899) - EosSent: 0 (0) - OverallThroughput: 126.79 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 263.72M (263716864) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m38s - UncompressedRowBatchSize: 67.98 GB (72991953944) HDFS_SCAN_NODE (id=0):(Total: 2s845ms, non-child: 2s845ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:28/6.90 GB 7:28/6.90 GB 3:33/8.05 GB 1:27/6.61 GB 6:27/6.64 GB 2:24/5.85 GB 4:28/6.86 GB 0:29/7.05 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.01 GB, 12.73 GB, 13.17 GB, 13.41 GB, 13.57 GB, 13.88 GB, 14.29 GB, 14.80 GB, 15.33 GB, 15.81 GB, 16.16 GB, 16.44 GB, 16.61 GB, 16.72 GB, 16.80 GB, 16.84 GB, 16.89 GB, 16.95 GB, 17.04 GB, 17.09 GB, 17.17 GB, 17.25 GB, 17.31 GB, 17.38 GB, 17.43 GB, 17.51 GB, 17.56 GB, 17.59 GB, 17.63 GB, 17.72 GB, 17.80 GB, 17.88 GB, 17.97 GB, 18.14 GB, 18.33 GB, 18.57 GB, 18.80 GB, 18.96 GB, 19.09 GB, 19.22 GB, 19.34 GB, 19.48 GB, 19.58 GB, 19.64 GB, 19.70 GB - FooterProcessingTime: (Avg: 4s991ms ; Min: 92.483ms ; Max: 9s824ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.75 GB (21211050800) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m15s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.99 GB (15022198140) - PerReadThreadRawHdfsThroughput: 49.24 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 263.93M (263930880) - RowsReturned: 263.72M (263717888) - RowsReturnedRate: 92.68 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s009ms - TotalRawHdfsReadTime(*): 6m50s - TotalReadThroughput: 6.92 MB/sec CodeGen:(Total: 25.496ms, non-child: 25.496ms, % non-child: 100.00%) - CodegenTime: 396.555us - CompileTime: 3.890ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.618ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 14.575ms Instance 844a0200d7876345:20bb38b900000020 (host=vc1505.foo.com:22000):(Total: 271.529ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:27/6.57 GB 7:28/6.85 GB 1:31/7.63 GB 0:21/5.15 GB 3:32/7.77 GB 4:28/6.84 GB 6:31/7.56 GB 5:26/6.44 GB Fragment Instance Lifecycle Event Timeline: 1s803ms - Prepare Finished: 244.395ms (244.395ms) - Open Finished: 272.048ms (27.652ms) - First Batch Produced: 1s801ms (1s528ms) - First Batch Sent: 1s803ms (2.240ms) MemoryUsage(1m4s): 7.60 GB, 13.93 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.92 GB, 13.92 GB, 13.91 GB, 13.90 GB, 13.89 GB, 13.87 GB, 13.85 GB, 13.83 GB, 13.82 GB, 13.80 GB, 13.75 GB, 13.72 GB, 13.69 GB, 13.63 GB, 13.59 GB, 13.56 GB, 13.50 GB, 13.45 GB, 13.40 GB, 13.32 GB, 13.28 GB, 13.25 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.96 GB (14984959079) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.72 GB (93111924350) - RowsProduced: 281.07M (281067520) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m18s - TotalStorageWaitTime: 28m41s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 27.642ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 26.996ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s843ms - OpenTime: 27.643ms - ExecTreeOpenTime: 137.068us - PrepareTime: 243.809ms - ExecTreePrepareTime: 2.042ms KrpcDataStreamSender (dst_id=1):(Total: 4m32s, non-child: 4m32s, % non-child: 100.00%) - BytesSent: 36.87 GB (39590273941) - EosSent: 0 (0) - OverallThroughput: 138.35 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 281.07M (281066496) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m32s - UncompressedRowBatchSize: 72.45 GB (77793972372) HDFS_SCAN_NODE (id=0):(Total: 3s666ms, non-child: 3s666ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:27/6.57 GB 7:28/6.85 GB 1:31/7.63 GB 0:21/5.15 GB 3:32/7.77 GB 4:28/6.84 GB 6:31/7.56 GB 5:26/6.44 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.69 GB, 12.90 GB, 13.44 GB, 13.88 GB, 14.23 GB, 14.61 GB, 15.06 GB, 15.65 GB, 16.18 GB, 16.57 GB, 16.74 GB, 16.82 GB, 16.88 GB, 16.92 GB, 16.99 GB, 17.05 GB, 17.09 GB, 17.15 GB, 17.25 GB, 17.38 GB, 17.46 GB, 17.60 GB, 17.69 GB, 17.73 GB, 17.79 GB, 17.86 GB, 17.95 GB, 18.04 GB, 18.15 GB, 18.26 GB, 18.37 GB, 18.46 GB, 18.61 GB, 18.81 GB, 19.05 GB, 19.24 GB, 19.42 GB, 19.52 GB, 19.57 GB, 19.63 GB, 19.68 GB, 19.73 GB, 19.79 GB, 19.84 GB, 19.88 GB - FooterProcessingTime: (Avg: 4s857ms ; Min: 139.129ms ; Max: 12s030ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.92 GB (21392254503) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m9s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.95 GB (14981829129) - PerReadThreadRawHdfsThroughput: 45.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 281.28M (281280512) - RowsReturned: 281.07M (281067520) - RowsReturnedRate: 76.66 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s477ms - TotalRawHdfsReadTime(*): 7m26s - TotalReadThroughput: 6.98 MB/sec CodeGen:(Total: 27.178ms, non-child: 27.178ms, % non-child: 100.00%) - CodegenTime: 452.464us - CompileTime: 4.055ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.572ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 15.095ms Instance 844a0200d7876345:20bb38b900000019 (host=vc1507.foo.com:22000):(Total: 231.284ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:28/6.84 GB 5:30/7.01 GB 1:32/7.89 GB 4:20/4.71 GB 7:33/8.09 GB 0:25/6.01 GB 2:32/7.84 GB 6:25/6.11 GB Fragment Instance Lifecycle Event Timeline: 1s693ms - Prepare Finished: 202.830ms (202.830ms) - Open Finished: 231.707ms (28.876ms) - First Batch Produced: 1s691ms (1s460ms) - First Batch Sent: 1s693ms (1.341ms) MemoryUsage(1m4s): 8.37 GB, 13.81 GB, 13.81 GB, 13.80 GB, 13.81 GB, 13.81 GB, 13.86 GB, 13.92 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.91 GB, 13.90 GB, 13.89 GB, 13.89 GB, 13.88 GB, 13.85 GB, 13.83 GB, 13.81 GB, 13.80 GB, 13.78 GB, 13.74 GB, 13.69 GB, 13.64 GB, 13.60 GB, 13.57 GB, 13.54 GB, 13.50 GB, 13.45 GB, 13.42 GB, 13.37 GB, 13.31 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.93 GB (14960026988) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.72 GB (93119331135) - RowsProduced: 269.75M (269754710) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m6s - TotalStorageWaitTime: 24m5s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 28.872ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 24.996ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s350ms - OpenTime: 28.873ms - ExecTreeOpenTime: 247.111us - PrepareTime: 202.336ms - ExecTreePrepareTime: 1.722ms KrpcDataStreamSender (dst_id=1):(Total: 4m37s, non-child: 4m37s, % non-child: 100.00%) - BytesSent: 35.38 GB (37992368027) - EosSent: 0 (0) - OverallThroughput: 130.80 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 269.75M (269753686) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m36s - UncompressedRowBatchSize: 69.54 GB (74662849954) HDFS_SCAN_NODE (id=0):(Total: 3s136ms, non-child: 3s136ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:28/6.84 GB 5:30/7.01 GB 1:32/7.89 GB 4:20/4.71 GB 7:33/8.09 GB 0:25/6.01 GB 2:32/7.84 GB 6:25/6.11 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.39 GB, 12.73 GB, 13.13 GB, 13.41 GB, 13.65 GB, 13.99 GB, 14.49 GB, 15.12 GB, 15.72 GB, 16.20 GB, 16.49 GB, 16.63 GB, 16.73 GB, 16.77 GB, 16.82 GB, 16.87 GB, 16.90 GB, 16.96 GB, 17.03 GB, 17.10 GB, 17.21 GB, 17.31 GB, 17.36 GB, 17.46 GB, 17.53 GB, 17.58 GB, 17.60 GB, 17.66 GB, 17.74 GB, 17.82 GB, 17.89 GB, 17.99 GB, 18.13 GB, 18.32 GB, 18.52 GB, 18.77 GB, 19.01 GB, 19.16 GB, 19.28 GB, 19.37 GB, 19.43 GB, 19.50 GB, 19.56 GB, 19.62 GB, 19.65 GB - FooterProcessingTime: (Avg: 4s325ms ; Min: 106.431ms ; Max: 9s252ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.71 GB (21166070298) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m16s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.93 GB (14956927393) - PerReadThreadRawHdfsThroughput: 49.74 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 269.97M (269967702) - RowsReturned: 269.75M (269754710) - RowsReturnedRate: 86.00 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 502.059ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s171ms - TotalRawHdfsReadTime(*): 6m45s - TotalReadThroughput: 6.91 MB/sec CodeGen:(Total: 28.292ms, non-child: 28.292ms, % non-child: 100.00%) - CodegenTime: 476.394us - CompileTime: 4.606ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.666ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 15.463ms Instance 844a0200d7876345:20bb38b900000068 (host=vc1508.foo.com:22000):(Total: 262.316ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:24/5.88 GB 0:29/7.14 GB 2:28/6.85 GB 6:30/6.97 GB 4:26/6.00 GB 3:31/7.67 GB 7:29/6.99 GB 5:30/7.34 GB Fragment Instance Lifecycle Event Timeline: 1s656ms - Prepare Finished: 237.190ms (237.190ms) - Open Finished: 262.766ms (25.575ms) - First Batch Produced: 1s654ms (1s391ms) - First Batch Sent: 1s656ms (2.241ms) MemoryUsage(1m4s): 7.54 GB, 13.81 GB, 13.87 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.92 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.90 GB, 13.89 GB, 13.88 GB, 13.87 GB, 13.85 GB, 13.85 GB, 13.84 GB, 13.82 GB, 13.81 GB, 13.79 GB, 13.77 GB, 13.75 GB, 13.71 GB, 13.70 GB, 13.67 GB, 13.63 GB, 13.60 GB, 13.58 GB, 13.55 GB, 13.51 GB, 13.46 GB, 13.43 GB, 13.38 GB, 13.32 GB, 13.26 GB, 13.21 GB, 13.18 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.94 GB (14962801434) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.06 GB (85963218954) - RowsProduced: 282.04M (282040600) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m16s - TotalStorageWaitTime: 28m43s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 25.589ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 23.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s417ms - OpenTime: 25.590ms - ExecTreeOpenTime: 165.631us - PrepareTime: 236.647ms - ExecTreePrepareTime: 1.925ms KrpcDataStreamSender (dst_id=1):(Total: 4m31s, non-child: 4m31s, % non-child: 100.00%) - BytesSent: 37.03 GB (39758978984) - EosSent: 0 (0) - OverallThroughput: 139.41 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 282.04M (282039576) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m31s - UncompressedRowBatchSize: 72.70 GB (78062980140) HDFS_SCAN_NODE (id=0):(Total: 3s229ms, non-child: 3s229ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:24/5.88 GB 0:29/7.14 GB 2:28/6.85 GB 6:30/6.97 GB 4:26/6.00 GB 3:31/7.67 GB 7:29/6.99 GB 5:30/7.34 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.62 GB, 12.76 GB, 13.41 GB, 13.89 GB, 14.22 GB, 14.58 GB, 15.08 GB, 15.81 GB, 16.29 GB, 16.63 GB, 16.77 GB, 16.80 GB, 16.86 GB, 16.89 GB, 16.92 GB, 16.99 GB, 17.07 GB, 17.14 GB, 17.26 GB, 17.42 GB, 17.53 GB, 17.59 GB, 17.68 GB, 17.76 GB, 17.82 GB, 17.90 GB, 17.96 GB, 18.02 GB, 18.09 GB, 18.19 GB, 18.31 GB, 18.45 GB, 18.62 GB, 18.81 GB, 19.11 GB, 19.34 GB, 19.43 GB, 19.48 GB, 19.54 GB, 19.59 GB, 19.68 GB, 19.73 GB, 19.78 GB, 19.84 GB, 19.87 GB - FooterProcessingTime: (Avg: 4s401ms ; Min: 105.418ms ; Max: 11s427ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.90 GB (21365663958) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m27s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.93 GB (14959710629) - PerReadThreadRawHdfsThroughput: 45.82 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 282.25M (282253592) - RowsReturned: 282.04M (282040600) - RowsReturnedRate: 87.32 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 369.316ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 11s188ms - TotalRawHdfsReadTime(*): 7m24s - TotalReadThroughput: 6.95 MB/sec CodeGen:(Total: 25.125ms, non-child: 25.125ms, % non-child: 100.00%) - CodegenTime: 417.121us - CompileTime: 3.819ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.648ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 14.122ms Instance 844a0200d7876345:20bb38b90000005f (host=vc1509.foo.com:22000):(Total: 259.781ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:22/5.41 GB 2:26/6.37 GB 4:27/6.67 GB 0:29/7.10 GB 1:21/5.16 GB 5:37/9.00 GB 6:32/7.85 GB 3:30/7.19 GB Fragment Instance Lifecycle Event Timeline: 1s738ms - Prepare Finished: 233.325ms (233.325ms) - Open Finished: 260.548ms (27.223ms) - First Batch Produced: 1s736ms (1s476ms) - First Batch Sent: 1s738ms (2.136ms) MemoryUsage(1m4s): 8.27 GB, 13.93 GB, 13.93 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.90 GB, 13.90 GB, 13.89 GB, 13.88 GB, 13.86 GB, 13.83 GB, 13.79 GB, 13.76 GB, 13.73 GB, 13.70 GB, 13.65 GB, 13.62 GB, 13.58 GB, 13.52 GB, 13.49 GB, 13.43 GB, 13.37 GB, 13.34 GB, 13.31 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.96 GB (14984247262) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.04 GB (85943268614) - RowsProduced: 274.30M (274295808) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m58s - TotalStorageWaitTime: 24m52s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 27.219ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 22.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s906ms - OpenTime: 27.220ms - ExecTreeOpenTime: 296.477us - PrepareTime: 232.484ms - ExecTreePrepareTime: 1.722ms KrpcDataStreamSender (dst_id=1):(Total: 4m35s, non-child: 4m35s, % non-child: 100.00%) - BytesSent: 35.99 GB (38642772372) - EosSent: 0 (0) - OverallThroughput: 133.58 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 274.29M (274294784) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m35s - UncompressedRowBatchSize: 70.71 GB (75919346608) HDFS_SCAN_NODE (id=0):(Total: 3s710ms, non-child: 3s710ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:22/5.41 GB 2:26/6.37 GB 4:27/6.67 GB 0:29/7.10 GB 1:21/5.16 GB 5:37/9.00 GB 6:32/7.85 GB 3:30/7.19 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.27 GB, 12.79 GB, 13.23 GB, 13.48 GB, 13.81 GB, 14.23 GB, 14.83 GB, 15.56 GB, 16.13 GB, 16.46 GB, 16.63 GB, 16.74 GB, 16.77 GB, 16.83 GB, 16.87 GB, 16.93 GB, 16.98 GB, 17.05 GB, 17.16 GB, 17.25 GB, 17.29 GB, 17.36 GB, 17.40 GB, 17.46 GB, 17.53 GB, 17.59 GB, 17.68 GB, 17.76 GB, 17.85 GB, 17.98 GB, 18.09 GB, 18.24 GB, 18.41 GB, 18.67 GB, 18.94 GB, 19.05 GB, 19.25 GB, 19.40 GB, 19.45 GB, 19.52 GB, 19.57 GB, 19.63 GB, 19.69 GB, 19.74 GB, 19.78 GB - FooterProcessingTime: (Avg: 3s933ms ; Min: 147.521ms ; Max: 8s611ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.83 GB (21297233114) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m16s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.95 GB (14981053949) - PerReadThreadRawHdfsThroughput: 49.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 274.51M (274508800) - RowsReturned: 274.30M (274295808) - RowsReturnedRate: 73.93 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 11s136ms - TotalRawHdfsReadTime(*): 6m47s - TotalReadThroughput: 6.96 MB/sec CodeGen:(Total: 26.650ms, non-child: 26.650ms, % non-child: 100.00%) - CodegenTime: 368.685us - CompileTime: 4.760ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.995ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 14.435ms Instance 844a0200d7876345:20bb38b90000006b (host=vc1510.foo.com:22000):(Total: 247.960ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:27/6.38 GB 1:14/3.39 GB 6:29/7.14 GB 5:22/5.40 GB 2:28/6.72 GB 4:41/9.91 GB 7:31/7.33 GB 0:34/8.38 GB Fragment Instance Lifecycle Event Timeline: 1s764ms - Prepare Finished: 225.000ms (225.000ms) - Open Finished: 248.318ms (23.318ms) - First Batch Produced: 1s762ms (1s513ms) - First Batch Sent: 1s764ms (1.914ms) MemoryUsage(1m4s): 8.60 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.94 GB, 13.92 GB, 13.92 GB, 13.91 GB, 13.90 GB, 13.89 GB, 13.88 GB, 13.83 GB, 13.81 GB, 13.76 GB, 13.70 GB, 13.66 GB, 13.61 GB, 13.55 GB, 13.50 GB, 13.46 GB, 13.40 GB, 13.35 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.96 GB (14990616945) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.10 GB (86007565574) - RowsProduced: 267.79M (267794432) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m6s - TotalStorageWaitTime: 23m23s - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 23.315ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 21.997ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s153ms - OpenTime: 23.316ms - ExecTreeOpenTime: 220.124us - PrepareTime: 224.559ms - ExecTreePrepareTime: 1.618ms KrpcDataStreamSender (dst_id=1):(Total: 4m42s, non-child: 4m42s, % non-child: 100.00%) - BytesSent: 35.17 GB (37763690975) - EosSent: 0 (0) - OverallThroughput: 127.51 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 267.79M (267793408) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m41s - UncompressedRowBatchSize: 69.03 GB (74120503528) HDFS_SCAN_NODE (id=0):(Total: 2s961ms, non-child: 2s961ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:27/6.38 GB 1:14/3.39 GB 6:29/7.14 GB 5:22/5.40 GB 2:28/6.72 GB 4:41/9.91 GB 7:31/7.33 GB 0:34/8.38 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.58 GB, 12.76 GB, 13.14 GB, 13.41 GB, 13.60 GB, 13.92 GB, 14.38 GB, 15.05 GB, 15.59 GB, 16.12 GB, 16.43 GB, 16.59 GB, 16.69 GB, 16.76 GB, 16.79 GB, 16.84 GB, 16.88 GB, 16.94 GB, 17.02 GB, 17.11 GB, 17.21 GB, 17.25 GB, 17.33 GB, 17.42 GB, 17.48 GB, 17.51 GB, 17.54 GB, 17.59 GB, 17.65 GB, 17.75 GB, 17.86 GB, 17.99 GB, 18.15 GB, 18.32 GB, 18.58 GB, 18.81 GB, 18.97 GB, 19.12 GB, 19.25 GB, 19.36 GB, 19.48 GB, 19.55 GB, 19.59 GB, 19.63 GB, 19.68 GB - FooterProcessingTime: (Avg: 3s708ms ; Min: 151.967ms ; Max: 11s111ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.72 GB (21171826421) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m18s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.96 GB (14987574747) - PerReadThreadRawHdfsThroughput: 48.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 268.01M (268007424) - RowsReturned: 267.79M (267794432) - RowsReturnedRate: 90.44 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s482ms - TotalRawHdfsReadTime(*): 6m57s - TotalReadThroughput: 6.92 MB/sec CodeGen:(Total: 22.849ms, non-child: 22.849ms, % non-child: 100.00%) - CodegenTime: 353.513us - CompileTime: 3.723ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 5.475ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 13.182ms Instance 844a0200d7876345:20bb38b90000000b (host=vc1511.foo.com:22000):(Total: 247.921ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:23/5.45 GB 5:37/9.08 GB 7:20/4.92 GB 6:26/6.33 GB 4:33/7.89 GB 2:21/5.12 GB 3:33/8.02 GB 0:34/8.14 GB Fragment Instance Lifecycle Event Timeline: 1s710ms - Prepare Finished: 223.147ms (223.147ms) - Open Finished: 248.505ms (25.358ms) - First Batch Produced: 1s708ms (1s460ms) - First Batch Sent: 1s710ms (1.877ms) MemoryUsage(1m4s): 8.08 GB, 13.87 GB, 13.87 GB, 13.88 GB, 13.88 GB, 13.88 GB, 13.88 GB, 13.88 GB, 13.87 GB, 13.87 GB, 13.86 GB, 13.86 GB, 13.86 GB, 13.86 GB, 13.86 GB, 13.86 GB, 13.86 GB, 13.85 GB, 13.85 GB, 13.85 GB, 13.85 GB, 13.84 GB, 13.84 GB, 13.83 GB, 13.83 GB, 13.83 GB, 13.82 GB, 13.81 GB, 13.81 GB, 13.80 GB, 13.79 GB, 13.79 GB, 13.76 GB, 13.71 GB, 13.65 GB, 13.63 GB, 13.60 GB, 13.59 GB, 13.55 GB, 13.49 GB, 13.44 GB, 13.41 GB, 13.34 GB, 13.30 GB, 13.27 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.88 GB (14906597379) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.67 GB (93062653661) - RowsProduced: 266.07M (266070016) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m3s - TotalStorageWaitTime: 27m6s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 25.354ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 22.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s162ms - OpenTime: 25.356ms - ExecTreeOpenTime: 248.475us - PrepareTime: 222.490ms - ExecTreePrepareTime: 1.983ms KrpcDataStreamSender (dst_id=1):(Total: 4m36s, non-child: 4m36s, % non-child: 100.00%) - BytesSent: 34.92 GB (37492602699) - EosSent: 0 (0) - OverallThroughput: 129.46 MB/sec - PeakMemoryUsage: 3.59 MB (3760800) - RowsReturned: 266.07M (266068992) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m35s - UncompressedRowBatchSize: 68.58 GB (73642580870) HDFS_SCAN_NODE (id=0):(Total: 2s976ms, non-child: 2s976ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:23/5.45 GB 5:37/9.08 GB 7:20/4.92 GB 6:26/6.33 GB 4:33/7.89 GB 2:21/5.12 GB 3:33/8.02 GB 0:34/8.14 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.12 GB, 12.71 GB, 13.05 GB, 13.37 GB, 13.62 GB, 13.88 GB, 14.27 GB, 14.78 GB, 15.23 GB, 15.77 GB, 16.17 GB, 16.37 GB, 16.56 GB, 16.69 GB, 16.72 GB, 16.74 GB, 16.76 GB, 16.81 GB, 16.88 GB, 16.97 GB, 17.02 GB, 17.09 GB, 17.18 GB, 17.27 GB, 17.36 GB, 17.41 GB, 17.49 GB, 17.57 GB, 17.62 GB, 17.68 GB, 17.73 GB, 17.83 GB, 17.96 GB, 18.11 GB, 18.31 GB, 18.43 GB, 18.63 GB, 18.81 GB, 18.98 GB, 19.17 GB, 19.27 GB, 19.32 GB, 19.37 GB, 19.42 GB, 19.47 GB - FooterProcessingTime: (Avg: 5s534ms ; Min: 142.350ms ; Max: 11s172ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.56 GB (20998874441) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m9s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.88 GB (14903473267) - PerReadThreadRawHdfsThroughput: 52.55 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 266.28M (266281984) - RowsReturned: 266.07M (266070016) - RowsReturnedRate: 89.40 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s453ms - TotalRawHdfsReadTime(*): 6m21s - TotalReadThroughput: 6.86 MB/sec CodeGen:(Total: 24.867ms, non-child: 24.867ms, % non-child: 100.00%) - CodegenTime: 369.132us - CompileTime: 4.250ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.493ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 13.666ms Instance 844a0200d7876345:20bb38b90000007d (host=vc1513.foo.com:22000):(Total: 256.452ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:29/7.14 GB 0:26/6.44 GB 4:31/7.53 GB 1:23/5.57 GB 3:20/4.69 GB 6:30/7.29 GB 7:38/9.13 GB 5:29/7.09 GB Fragment Instance Lifecycle Event Timeline: 2s621ms - Prepare Finished: 232.917ms (232.917ms) - Open Finished: 256.902ms (23.985ms) - First Batch Produced: 2s619ms (2s362ms) - First Batch Sent: 2s621ms (2.058ms) MemoryUsage(1m4s): 7.31 GB, 13.82 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.93 GB, 13.92 GB, 13.91 GB, 13.91 GB, 13.89 GB, 13.86 GB, 13.85 GB, 13.82 GB, 13.78 GB, 13.74 GB, 13.73 GB, 13.69 GB, 13.68 GB, 13.64 GB, 13.60 GB, 13.58 GB, 13.53 GB, 13.47 GB, 13.42 GB, 13.36 GB, 13.33 GB, 13.31 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.98 GB (15007337995) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.24 GB (86157169392) - RowsProduced: 278.90M (278899132) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m42s - TotalStorageWaitTime: 29m21s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 23.980ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 23.996ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s454ms - OpenTime: 23.982ms - ExecTreeOpenTime: 138.549us - PrepareTime: 232.394ms - ExecTreePrepareTime: 2.010ms KrpcDataStreamSender (dst_id=1):(Total: 4m26s, non-child: 4m26s, % non-child: 100.00%) - BytesSent: 36.61 GB (39307139535) - EosSent: 0 (0) - OverallThroughput: 140.49 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 278.90M (278898108) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m26s - UncompressedRowBatchSize: 71.89 GB (77193364329) HDFS_SCAN_NODE (id=0):(Total: 4s261ms, non-child: 4s261ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:29/7.14 GB 0:26/6.44 GB 4:31/7.53 GB 1:23/5.57 GB 3:20/4.69 GB 6:30/7.29 GB 7:38/9.13 GB 5:29/7.09 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.39 GB, 12.70 GB, 13.29 GB, 13.63 GB, 13.96 GB, 14.33 GB, 14.86 GB, 15.55 GB, 16.14 GB, 16.51 GB, 16.69 GB, 16.78 GB, 16.85 GB, 16.90 GB, 16.93 GB, 16.98 GB, 17.04 GB, 17.13 GB, 17.25 GB, 17.34 GB, 17.43 GB, 17.53 GB, 17.57 GB, 17.62 GB, 17.67 GB, 17.76 GB, 17.85 GB, 17.92 GB, 18.00 GB, 18.10 GB, 18.22 GB, 18.39 GB, 18.61 GB, 18.81 GB, 19.07 GB, 19.25 GB, 19.42 GB, 19.52 GB, 19.56 GB, 19.62 GB, 19.69 GB, 19.74 GB, 19.81 GB, 19.86 GB, 19.90 GB - FooterProcessingTime: (Avg: 4s691ms ; Min: 89.125ms ; Max: 15s504ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.95 GB (21425840527) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m8s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.97 GB (15004241784) - PerReadThreadRawHdfsThroughput: 43.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 279.11M (279112124) - RowsReturned: 278.90M (278899132) - RowsReturnedRate: 65.45 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 198.160ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s540ms - TotalRawHdfsReadTime(*): 7m44s - TotalReadThroughput: 6.95 MB/sec CodeGen:(Total: 23.625ms, non-child: 23.625ms, % non-child: 100.00%) - CodegenTime: 339.124us - CompileTime: 4.064ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.219ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 12.743ms Instance 844a0200d7876345:20bb38b900000035 (host=vc1515.foo.com:22000):(Total: 243.347ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:21/5.11 GB 1:30/7.20 GB 7:25/6.15 GB 2:26/6.36 GB 3:27/6.34 GB 6:35/8.47 GB 5:35/8.59 GB 0:28/6.79 GB Fragment Instance Lifecycle Event Timeline: 1s521ms - Prepare Finished: 217.724ms (217.724ms) - Open Finished: 243.906ms (26.181ms) - First Batch Produced: 1s518ms (1s275ms) - First Batch Sent: 1s521ms (2.079ms) MemoryUsage(1m4s): 8.12 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.90 GB, 13.89 GB, 13.88 GB, 13.87 GB, 13.85 GB, 13.82 GB, 13.80 GB, 13.77 GB, 13.74 GB, 13.68 GB, 13.65 GB, 13.62 GB, 13.59 GB, 13.55 GB, 13.49 GB, 13.44 GB, 13.40 GB, 13.35 GB, 13.30 GB, 13.28 GB, 13.26 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.97 GB (14998270773) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.01 GB (85913750430) - RowsProduced: 281.43M (281428992) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m14s - TotalStorageWaitTime: 23m54s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 26.178ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 2s904ms - OpenTime: 26.180ms - ExecTreeOpenTime: 145.672us - PrepareTime: 217.078ms - ExecTreePrepareTime: 1.836ms KrpcDataStreamSender (dst_id=1):(Total: 4m32s, non-child: 4m32s, % non-child: 100.00%) - BytesSent: 36.95 GB (39679282841) - EosSent: 0 (0) - OverallThroughput: 139.08 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 281.43M (281427968) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m31s - UncompressedRowBatchSize: 72.54 GB (77893501785) HDFS_SCAN_NODE (id=0):(Total: 2s708ms, non-child: 2s708ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:21/5.11 GB 1:30/7.20 GB 7:25/6.15 GB 2:26/6.36 GB 3:27/6.34 GB 6:35/8.47 GB 5:35/8.59 GB 0:28/6.79 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.11 GB, 12.86 GB, 13.36 GB, 13.72 GB, 14.13 GB, 14.63 GB, 15.26 GB, 16.01 GB, 16.44 GB, 16.67 GB, 16.77 GB, 16.83 GB, 16.88 GB, 16.93 GB, 16.97 GB, 17.03 GB, 17.11 GB, 17.18 GB, 17.30 GB, 17.42 GB, 17.48 GB, 17.52 GB, 17.57 GB, 17.68 GB, 17.78 GB, 17.85 GB, 17.94 GB, 18.05 GB, 18.16 GB, 18.30 GB, 18.46 GB, 18.60 GB, 18.79 GB, 19.00 GB, 19.24 GB, 19.40 GB, 19.49 GB, 19.54 GB, 19.59 GB, 19.64 GB, 19.72 GB, 19.78 GB, 19.83 GB, 19.87 GB, 19.91 GB - FooterProcessingTime: (Avg: 3s756ms ; Min: 161.322ms ; Max: 8s537ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.94 GB (21408357801) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m4s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.97 GB (14995121396) - PerReadThreadRawHdfsThroughput: 42.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 281.64M (281641984) - RowsReturned: 281.43M (281428992) - RowsReturnedRate: 103.91 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s937ms - TotalRawHdfsReadTime(*): 7m56s - TotalReadThroughput: 7.00 MB/sec CodeGen:(Total: 25.707ms, non-child: 25.707ms, % non-child: 100.00%) - CodegenTime: 478.264us - CompileTime: 3.971ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.779ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 14.505ms Instance 844a0200d7876345:20bb38b900000048 (host=vc1516.foo.com:22000):(Total: 265.435ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:25/6.00 GB 5:26/6.31 GB 0:40/9.79 GB 4:30/7.35 GB 6:29/7.10 GB 7:28/6.86 GB 1:21/5.08 GB 3:27/6.68 GB Fragment Instance Lifecycle Event Timeline: 1s795ms - Prepare Finished: 239.004ms (239.004ms) - Open Finished: 266.030ms (27.026ms) - First Batch Produced: 1s793ms (1s527ms) - First Batch Sent: 1s795ms (2.182ms) MemoryUsage(1m4s): 8.71 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.91 GB, 13.87 GB, 13.84 GB, 13.80 GB, 13.78 GB, 13.74 GB, 13.70 GB, 13.66 GB, 13.59 GB, 13.53 GB, 13.47 GB, 13.41 GB, 13.37 GB, 13.33 GB, 13.31 GB, 13.29 GB, 13.27 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.97 GB (15001563772) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.21 GB (86127896230) - RowsProduced: 284.31M (284311552) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m34s - TotalStorageWaitTime: 22m31s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 27.001ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 24.997ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s270ms - OpenTime: 27.003ms - ExecTreeOpenTime: 153.062us - PrepareTime: 238.358ms - ExecTreePrepareTime: 1.940ms KrpcDataStreamSender (dst_id=1):(Total: 4m28s, non-child: 4m28s, % non-child: 100.00%) - BytesSent: 37.33 GB (40078333294) - EosSent: 0 (0) - OverallThroughput: 142.48 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 284.31M (284310528) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m27s - UncompressedRowBatchSize: 73.29 GB (78691376059) HDFS_SCAN_NODE (id=0):(Total: 3s092ms, non-child: 3s092ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:25/6.00 GB 5:26/6.31 GB 0:40/9.79 GB 4:30/7.35 GB 6:29/7.10 GB 7:28/6.86 GB 1:21/5.08 GB 3:27/6.68 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.68 GB, 12.86 GB, 13.35 GB, 13.69 GB, 14.11 GB, 14.65 GB, 15.40 GB, 16.13 GB, 16.52 GB, 16.70 GB, 16.79 GB, 16.85 GB, 16.89 GB, 16.94 GB, 17.00 GB, 17.07 GB, 17.20 GB, 17.30 GB, 17.39 GB, 17.43 GB, 17.46 GB, 17.51 GB, 17.60 GB, 17.68 GB, 17.81 GB, 17.90 GB, 17.97 GB, 18.06 GB, 18.18 GB, 18.34 GB, 18.56 GB, 18.78 GB, 18.98 GB, 19.20 GB, 19.34 GB, 19.44 GB, 19.54 GB, 19.59 GB, 19.67 GB, 19.74 GB, 19.78 GB, 19.85 GB, 19.90 GB, 19.92 GB, 19.95 GB - FooterProcessingTime: (Avg: 3s735ms ; Min: 144.209ms ; Max: 7s666ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.98 GB (21457969275) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m18s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.97 GB (14998439779) - PerReadThreadRawHdfsThroughput: 50.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 284.52M (284524544) - RowsReturned: 284.31M (284311552) - RowsReturnedRate: 91.93 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s841ms - TotalRawHdfsReadTime(*): 6m48s - TotalReadThroughput: 6.97 MB/sec CodeGen:(Total: 26.534ms, non-child: 26.534ms, % non-child: 100.00%) - CodegenTime: 392.243us - CompileTime: 3.907ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.659ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 15.484ms Instance 844a0200d7876345:20bb38b900000060 (host=vc1517.foo.com:22000):(Total: 260.251ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/6.86 GB 0:24/5.82 GB 5:29/7.14 GB 1:16/3.92 GB 3:25/6.03 GB 7:30/7.36 GB 4:39/9.39 GB 6:34/8.29 GB Fragment Instance Lifecycle Event Timeline: 1s539ms - Prepare Finished: 235.453ms (235.453ms) - Open Finished: 260.836ms (25.383ms) - First Batch Produced: 1s537ms (1s276ms) - First Batch Sent: 1s539ms (2.030ms) MemoryUsage(1m4s): 7.35 GB, 13.79 GB, 13.87 GB, 13.87 GB, 13.87 GB, 13.87 GB, 13.87 GB, 13.87 GB, 13.87 GB, 13.86 GB, 13.86 GB, 13.85 GB, 13.85 GB, 13.85 GB, 13.85 GB, 13.85 GB, 13.85 GB, 13.84 GB, 13.93 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.92 GB, 13.91 GB, 13.90 GB, 13.89 GB, 13.87 GB, 13.86 GB, 13.85 GB, 13.85 GB, 13.84 GB, 13.82 GB, 13.79 GB, 13.78 GB, 13.76 GB, 13.74 GB, 13.71 GB, 13.67 GB, 13.64 GB, 13.60 GB, 13.56 GB, 13.52 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.96 GB (14985505783) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.23 GB (86145849795) - RowsProduced: 264.30M (264297535) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m7s - TotalStorageWaitTime: 31m9s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 25.378ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 22.997ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 2s962ms - OpenTime: 25.379ms - ExecTreeOpenTime: 202.570us - PrepareTime: 234.795ms - ExecTreePrepareTime: 1.937ms KrpcDataStreamSender (dst_id=1):(Total: 4m37s, non-child: 4m37s, % non-child: 100.00%) - BytesSent: 34.67 GB (37230572494) - EosSent: 0 (0) - OverallThroughput: 128.15 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 264.30M (264296511) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m36s - UncompressedRowBatchSize: 68.13 GB (73151789360) HDFS_SCAN_NODE (id=0):(Total: 2s771ms, non-child: 2s771ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:28/6.86 GB 0:24/5.82 GB 5:29/7.14 GB 1:16/3.92 GB 3:25/6.03 GB 7:30/7.36 GB 4:39/9.39 GB 6:34/8.29 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.47 GB, 12.59 GB, 13.13 GB, 13.49 GB, 13.60 GB, 13.75 GB, 14.03 GB, 14.47 GB, 15.02 GB, 15.63 GB, 16.03 GB, 16.34 GB, 16.50 GB, 16.59 GB, 16.65 GB, 16.69 GB, 16.73 GB, 16.79 GB, 17.00 GB, 17.10 GB, 17.18 GB, 17.29 GB, 17.42 GB, 17.50 GB, 17.56 GB, 17.60 GB, 17.63 GB, 17.65 GB, 17.68 GB, 17.73 GB, 17.81 GB, 17.88 GB, 17.98 GB, 18.09 GB, 18.25 GB, 18.43 GB, 18.68 GB, 18.94 GB, 19.11 GB, 19.23 GB, 19.34 GB, 19.44 GB, 19.53 GB, 19.60 GB, 19.65 GB - FooterProcessingTime: (Avg: 6s454ms ; Min: 115.225ms ; Max: 14s155ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.69 GB (21139216210) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m1s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.95 GB (14982357249) - PerReadThreadRawHdfsThroughput: 43.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 264.51M (264510527) - RowsReturned: 264.30M (264297535) - RowsReturnedRate: 95.37 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 790.619ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s858ms - TotalRawHdfsReadTime(*): 7m46s - TotalReadThroughput: 6.92 MB/sec CodeGen:(Total: 24.976ms, non-child: 24.976ms, % non-child: 100.00%) - CodegenTime: 331.394us - CompileTime: 4.451ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.555ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 13.483ms Instance 844a0200d7876345:20bb38b900000041 (host=vc1518.foo.com:22000):(Total: 256.926ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:27/6.65 GB 2:31/7.57 GB 0:33/7.87 GB 1:28/6.81 GB 3:24/5.83 GB 4:30/7.12 GB 7:25/5.92 GB 6:28/6.81 GB Fragment Instance Lifecycle Event Timeline: 1s615ms - Prepare Finished: 231.478ms (231.478ms) - Open Finished: 257.430ms (25.952ms) - First Batch Produced: 1s613ms (1s356ms) - First Batch Sent: 1s615ms (1.945ms) MemoryUsage(1m4s): 7.48 GB, 13.90 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.91 GB, 13.91 GB, 13.89 GB, 13.88 GB, 13.87 GB, 13.86 GB, 13.84 GB, 13.80 GB, 13.78 GB, 13.76 GB, 13.72 GB, 13.70 GB, 13.67 GB, 13.65 GB, 13.63 GB, 13.58 GB, 13.54 GB, 13.51 GB, 13.46 GB, 13.42 GB, 13.37 GB, 13.33 GB, 13.30 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.95 GB (14976636513) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.07 GB (85970393302) - RowsProduced: 276.30M (276303872) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m3s - TotalStorageWaitTime: 27m10s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 25.976ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 24.996ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s289ms - OpenTime: 25.978ms - ExecTreeOpenTime: 156.984us - PrepareTime: 230.873ms - ExecTreePrepareTime: 2.054ms KrpcDataStreamSender (dst_id=1):(Total: 4m34s, non-child: 4m34s, % non-child: 100.00%) - BytesSent: 36.25 GB (38926107663) - EosSent: 0 (0) - OverallThroughput: 135.47 MB/sec - PeakMemoryUsage: 3.59 MB (3760800) - RowsReturned: 276.30M (276302848) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m33s - UncompressedRowBatchSize: 71.22 GB (76475252957) HDFS_SCAN_NODE (id=0):(Total: 3s106ms, non-child: 3s106ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:27/6.65 GB 2:31/7.57 GB 0:33/7.87 GB 1:28/6.81 GB 3:24/5.83 GB 4:30/7.12 GB 7:25/5.92 GB 6:28/6.81 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.55 GB, 12.85 GB, 13.38 GB, 13.82 GB, 14.13 GB, 14.51 GB, 15.00 GB, 15.57 GB, 16.09 GB, 16.48 GB, 16.67 GB, 16.80 GB, 16.85 GB, 16.87 GB, 16.91 GB, 16.98 GB, 17.03 GB, 17.08 GB, 17.16 GB, 17.26 GB, 17.33 GB, 17.44 GB, 17.57 GB, 17.65 GB, 17.71 GB, 17.78 GB, 17.84 GB, 17.90 GB, 17.98 GB, 18.08 GB, 18.19 GB, 18.30 GB, 18.42 GB, 18.60 GB, 18.83 GB, 19.01 GB, 19.19 GB, 19.38 GB, 19.47 GB, 19.54 GB, 19.60 GB, 19.66 GB, 19.71 GB, 19.77 GB, 19.82 GB - FooterProcessingTime: (Avg: 3s598ms ; Min: 96.825ms ; Max: 10s810ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.84 GB (21299748355) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m5s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.95 GB (14973520616) - PerReadThreadRawHdfsThroughput: 45.17 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 276.52M (276516864) - RowsReturned: 276.30M (276303872) - RowsReturnedRate: 88.96 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 11s486ms - TotalRawHdfsReadTime(*): 7m29s - TotalReadThroughput: 6.96 MB/sec CodeGen:(Total: 25.502ms, non-child: 25.502ms, % non-child: 100.00%) - CodegenTime: 460.708us - CompileTime: 4.056ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.341ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 14.533ms Instance 844a0200d7876345:20bb38b900000010 (host=vc1519.foo.com:22000):(Total: 260.582ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:23/5.66 GB 2:20/4.95 GB 7:29/6.98 GB 4:31/7.58 GB 0:22/5.41 GB 3:35/8.62 GB 5:36/8.78 GB 6:28/6.79 GB Fragment Instance Lifecycle Event Timeline: 1s513ms - Prepare Finished: 231.109ms (231.109ms) - Open Finished: 261.126ms (30.016ms) - First Batch Produced: 1s511ms (1s250ms) - First Batch Sent: 1s513ms (1.911ms) MemoryUsage(1m4s): 8.22 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.92 GB, 13.88 GB, 13.85 GB, 13.82 GB, 13.78 GB, 13.73 GB, 13.69 GB, 13.65 GB, 13.62 GB, 13.59 GB, 13.54 GB, 13.48 GB, 13.44 GB, 13.42 GB, 13.37 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.97 GB (15002267716) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.75 GB (93151148125) - RowsProduced: 276.74M (276740096) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m48s - TotalStorageWaitTime: 24m48s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 30.011ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 28.995ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s276ms - OpenTime: 30.013ms - ExecTreeOpenTime: 374.700us - PrepareTime: 230.489ms - ExecTreePrepareTime: 2.080ms KrpcDataStreamSender (dst_id=1):(Total: 4m33s, non-child: 4m33s, % non-child: 100.00%) - BytesSent: 36.31 GB (38990449166) - EosSent: 0 (0) - OverallThroughput: 135.81 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 276.74M (276739072) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m33s - UncompressedRowBatchSize: 71.34 GB (76595801721) HDFS_SCAN_NODE (id=0):(Total: 4s094ms, non-child: 4s094ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:23/5.66 GB 2:20/4.95 GB 7:29/6.98 GB 4:31/7.58 GB 0:22/5.41 GB 3:35/8.62 GB 5:36/8.78 GB 6:28/6.79 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.21 GB, 12.86 GB, 13.28 GB, 13.67 GB, 14.08 GB, 14.53 GB, 15.05 GB, 15.62 GB, 16.12 GB, 16.48 GB, 16.64 GB, 16.75 GB, 16.84 GB, 16.90 GB, 16.94 GB, 17.00 GB, 17.03 GB, 17.09 GB, 17.18 GB, 17.26 GB, 17.35 GB, 17.43 GB, 17.48 GB, 17.58 GB, 17.66 GB, 17.75 GB, 17.85 GB, 17.95 GB, 18.05 GB, 18.19 GB, 18.29 GB, 18.39 GB, 18.58 GB, 18.81 GB, 19.03 GB, 19.18 GB, 19.34 GB, 19.48 GB, 19.57 GB, 19.63 GB, 19.70 GB, 19.75 GB, 19.81 GB, 19.84 GB, 19.91 GB - FooterProcessingTime: (Avg: 3s207ms ; Min: 66.717ms ; Max: 7s779ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.95 GB (21418750577) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m43s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.97 GB (14999094470) - PerReadThreadRawHdfsThroughput: 47.15 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 276.95M (276953088) - RowsReturned: 276.74M (276740096) - RowsReturnedRate: 67.59 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s559ms - TotalRawHdfsReadTime(*): 7m13s - TotalReadThroughput: 7.01 MB/sec CodeGen:(Total: 29.307ms, non-child: 29.307ms, % non-child: 100.00%) - CodegenTime: 495.861us - CompileTime: 4.344ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.329ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 17.034ms Instance 844a0200d7876345:20bb38b90000006f (host=vc1520.foo.com:22000):(Total: 269.525ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:29/7.14 GB 4:24/5.77 GB 5:27/6.57 GB 1:29/7.15 GB 7:27/6.55 GB 2:37/8.93 GB 3:22/5.20 GB 0:31/7.59 GB Fragment Instance Lifecycle Event Timeline: 1s619ms - Prepare Finished: 242.861ms (242.861ms) - Open Finished: 269.981ms (27.120ms) - First Batch Produced: 1s618ms (1s348ms) - First Batch Sent: 1s619ms (1.429ms) MemoryUsage(1m4s): 7.49 GB, 13.89 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.92 GB, 13.90 GB, 13.90 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.88 GB, 13.88 GB, 13.87 GB, 13.87 GB, 13.87 GB, 13.87 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.95 GB, 13.94 GB, 13.91 GB, 13.88 GB, 13.85 GB, 13.80 GB, 13.78 GB, 13.76 GB, 13.71 GB, 13.69 GB, 13.65 GB, 13.60 GB, 13.56 GB, 13.53 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.97 GB (15003938289) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.28 GB (86199942837) - RowsProduced: 265.22M (265216026) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m2s - TotalStorageWaitTime: 27m58s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 27.122ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 25.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s207ms - OpenTime: 27.124ms - ExecTreeOpenTime: 289.235us - PrepareTime: 242.327ms - ExecTreePrepareTime: 2.055ms KrpcDataStreamSender (dst_id=1):(Total: 4m33s, non-child: 4m33s, % non-child: 100.00%) - BytesSent: 34.83 GB (37394649068) - EosSent: 0 (0) - OverallThroughput: 130.25 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 265.22M (265215002) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m33s - UncompressedRowBatchSize: 68.36 GB (73406129040) HDFS_SCAN_NODE (id=0):(Total: 3s013ms, non-child: 3s013ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:29/7.14 GB 4:24/5.77 GB 5:27/6.57 GB 1:29/7.15 GB 7:27/6.55 GB 2:37/8.93 GB 3:22/5.20 GB 0:31/7.59 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.53 GB, 12.70 GB, 13.09 GB, 13.38 GB, 13.56 GB, 13.87 GB, 14.21 GB, 14.64 GB, 15.07 GB, 15.63 GB, 16.06 GB, 16.34 GB, 16.52 GB, 16.65 GB, 16.71 GB, 16.77 GB, 16.81 GB, 16.86 GB, 16.89 GB, 16.97 GB, 17.05 GB, 17.11 GB, 17.22 GB, 17.28 GB, 17.40 GB, 17.45 GB, 17.62 GB, 17.66 GB, 17.76 GB, 17.87 GB, 17.94 GB, 18.04 GB, 18.10 GB, 18.18 GB, 18.38 GB, 18.55 GB, 18.79 GB, 19.01 GB, 19.17 GB, 19.34 GB, 19.48 GB, 19.56 GB, 19.60 GB, 19.65 GB, 19.70 GB - FooterProcessingTime: (Avg: 4s399ms ; Min: 120.172ms ; Max: 9s097ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.75 GB (21206443394) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m18s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.97 GB (15000920681) - PerReadThreadRawHdfsThroughput: 44.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 265.43M (265429018) - RowsReturned: 265.22M (265216026) - RowsReturnedRate: 88.01 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 1s002ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 12s536ms - TotalRawHdfsReadTime(*): 7m31s - TotalReadThroughput: 6.92 MB/sec CodeGen:(Total: 26.549ms, non-child: 26.549ms, % non-child: 100.00%) - CodegenTime: 405.920us - CompileTime: 4.449ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.528ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 14.962ms Instance 844a0200d7876345:20bb38b90000005b (host=vc1522.foo.com:22000):(Total: 245.530ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:18/4.39 GB 1:33/7.67 GB 2:24/5.94 GB 6:26/6.12 GB 3:37/9.09 GB 7:30/7.31 GB 5:37/8.95 GB 4:22/5.39 GB Fragment Instance Lifecycle Event Timeline: 2s163ms - Prepare Finished: 218.758ms (218.758ms) - Open Finished: 245.970ms (27.212ms) - First Batch Produced: 2s161ms (1s915ms) - First Batch Sent: 2s163ms (2.172ms) MemoryUsage(1m4s): 8.21 GB, 13.81 GB, 13.81 GB, 13.82 GB, 13.87 GB, 13.92 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.92 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.89 GB, 13.87 GB, 13.84 GB, 13.80 GB, 13.76 GB, 13.73 GB, 13.68 GB, 13.66 GB, 13.63 GB, 13.58 GB, 13.54 GB, 13.47 GB, 13.43 GB, 13.36 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.94 GB (14970386452) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.09 GB (85993145037) - RowsProduced: 265.23M (265225520) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m14s - TotalStorageWaitTime: 24m32s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 27.208ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 26.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s585ms - OpenTime: 27.209ms - ExecTreeOpenTime: 252.080us - PrepareTime: 218.250ms - ExecTreePrepareTime: 1.884ms KrpcDataStreamSender (dst_id=1):(Total: 4m37s, non-child: 4m37s, % non-child: 100.00%) - BytesSent: 34.81 GB (37375481502) - EosSent: 0 (0) - OverallThroughput: 128.32 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 265.22M (265224496) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m37s - UncompressedRowBatchSize: 68.37 GB (73408979836) HDFS_SCAN_NODE (id=0):(Total: 3s386ms, non-child: 3s386ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:18/4.39 GB 1:33/7.67 GB 2:24/5.94 GB 6:26/6.12 GB 3:37/9.09 GB 7:30/7.31 GB 5:37/8.95 GB 4:22/5.39 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.22 GB, 12.61 GB, 13.02 GB, 13.26 GB, 13.47 GB, 13.78 GB, 14.14 GB, 14.74 GB, 15.44 GB, 15.96 GB, 16.37 GB, 16.54 GB, 16.63 GB, 16.73 GB, 16.76 GB, 16.80 GB, 16.84 GB, 16.90 GB, 16.96 GB, 17.04 GB, 17.16 GB, 17.26 GB, 17.33 GB, 17.38 GB, 17.43 GB, 17.45 GB, 17.49 GB, 17.57 GB, 17.62 GB, 17.71 GB, 17.79 GB, 17.86 GB, 17.95 GB, 18.07 GB, 18.31 GB, 18.59 GB, 18.88 GB, 19.05 GB, 19.14 GB, 19.25 GB, 19.36 GB, 19.44 GB, 19.50 GB, 19.55 GB, 19.60 GB - FooterProcessingTime: (Avg: 3s980ms ; Min: 99.928ms ; Max: 8s647ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.68 GB (21127930022) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 57s279ms - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.94 GB (14967245962) - PerReadThreadRawHdfsThroughput: 49.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 265.44M (265438512) - RowsReturned: 265.23M (265225520) - RowsReturnedRate: 78.33 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 469.563ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s669ms - TotalRawHdfsReadTime(*): 6m44s - TotalReadThroughput: 6.90 MB/sec CodeGen:(Total: 26.731ms, non-child: 26.731ms, % non-child: 100.00%) - CodegenTime: 310.150us - CompileTime: 3.978ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.566ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 15.630ms Instance 844a0200d7876345:20bb38b900000047 (host=vc1523.foo.com:22000):(Total: 261.002ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:36/8.79 GB 7:23/5.62 GB 6:26/6.31 GB 4:21/5.16 GB 3:27/6.29 GB 0:23/5.66 GB 5:38/9.41 GB 2:30/7.34 GB Fragment Instance Lifecycle Event Timeline: 1s901ms - Prepare Finished: 234.689ms (234.689ms) - Open Finished: 261.459ms (26.770ms) - First Batch Produced: 1s899ms (1s638ms) - First Batch Sent: 1s901ms (1.600ms) MemoryUsage(1m4s): 7.89 GB, 13.83 GB, 13.83 GB, 13.83 GB, 13.90 GB, 13.92 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.90 GB, 13.90 GB, 13.90 GB, 13.90 GB, 13.90 GB, 13.89 GB, 13.88 GB, 13.88 GB, 13.87 GB, 13.87 GB, 13.86 GB, 13.84 GB, 13.82 GB, 13.79 GB, 13.76 GB, 13.83 GB, 13.81 GB, 13.78 GB, 13.75 GB, 13.73 GB, 13.73 GB, 13.71 GB, 13.68 GB, 13.65 GB, 13.60 GB, 13.55 GB, 13.51 GB, 13.47 GB, 13.44 GB, 13.42 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.94 GB (14971016890) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.32 GB (86242447731) - RowsProduced: 283.78M (283783908) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m21s - TotalStorageWaitTime: 26m39s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 26.766ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 24.996ms - TotalThreadsVoluntaryContextSwitches: 8 (8) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s576ms - OpenTime: 26.767ms - ExecTreeOpenTime: 130.217us - PrepareTime: 234.144ms - ExecTreePrepareTime: 2.412ms KrpcDataStreamSender (dst_id=1):(Total: 4m29s, non-child: 4m29s, % non-child: 100.00%) - BytesSent: 37.24 GB (39986806114) - EosSent: 0 (0) - OverallThroughput: 141.51 MB/sec - PeakMemoryUsage: 3.59 MB (3760800) - RowsReturned: 283.78M (283782884) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m28s - UncompressedRowBatchSize: 73.15 GB (78545619069) HDFS_SCAN_NODE (id=0):(Total: 3s396ms, non-child: 3s396ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:36/8.79 GB 7:23/5.62 GB 6:26/6.31 GB 4:21/5.16 GB 3:27/6.29 GB 0:23/5.66 GB 5:38/9.41 GB 2:30/7.34 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.92 GB, 12.75 GB, 13.21 GB, 13.76 GB, 14.39 GB, 14.74 GB, 15.23 GB, 15.90 GB, 16.37 GB, 16.65 GB, 16.78 GB, 16.84 GB, 16.90 GB, 16.94 GB, 16.95 GB, 16.97 GB, 17.04 GB, 17.15 GB, 17.25 GB, 17.35 GB, 17.42 GB, 17.53 GB, 17.66 GB, 17.79 GB, 17.92 GB, 18.03 GB, 18.12 GB, 18.19 GB, 18.25 GB, 18.31 GB, 18.57 GB, 18.75 GB, 19.02 GB, 19.24 GB, 19.44 GB, 19.55 GB, 19.65 GB, 19.72 GB, 19.80 GB, 19.87 GB, 19.95 GB, 20.01 GB, 20.08 GB, 20.12 GB, 20.14 GB - FooterProcessingTime: (Avg: 3s077ms ; Min: 95.504ms ; Max: 6s964ms ; Number of samples: 90) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 20.18 GB (21665474081) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m18s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 90 (90) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.94 GB (14967868210) - PerReadThreadRawHdfsThroughput: 44.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 284.00M (283996900) - RowsReturned: 283.78M (283783908) - RowsReturnedRate: 83.56 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 1s757ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s774ms - TotalRawHdfsReadTime(*): 7m40s - TotalReadThroughput: 7.05 MB/sec CodeGen:(Total: 26.356ms, non-child: 26.356ms, % non-child: 100.00%) - CodegenTime: 394.595us - CompileTime: 3.940ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.484ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 14.434ms Instance 844a0200d7876345:20bb38b90000001d (host=vc1524.foo.com:22000):(Total: 270.482ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:24/5.86 GB 7:16/3.76 GB 4:33/7.85 GB 1:30/7.21 GB 0:25/6.08 GB 5:36/8.51 GB 2:27/6.61 GB 3:37/8.98 GB Fragment Instance Lifecycle Event Timeline: 2s202ms - Prepare Finished: 244.202ms (244.202ms) - Open Finished: 270.975ms (26.773ms) - First Batch Produced: 2s200ms (1s929ms) - First Batch Sent: 2s202ms (2.010ms) MemoryUsage(1m4s): 7.10 GB, 13.80 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.91 GB, 13.91 GB, 13.88 GB, 13.88 GB, 13.87 GB, 13.87 GB, 13.87 GB, 13.87 GB, 13.87 GB, 13.86 GB, 13.86 GB, 13.86 GB, 13.86 GB, 13.85 GB, 13.83 GB, 13.83 GB, 13.82 GB, 13.81 GB, 13.80 GB, 13.80 GB, 13.79 GB, 13.77 GB, 13.75 GB, 13.74 GB, 13.71 GB, 13.66 GB, 13.64 GB, 13.61 GB, 13.59 GB, 13.56 GB, 13.52 GB, 13.49 GB, 13.46 GB, 13.44 GB, 13.42 GB, 13.40 GB, 13.37 GB, 13.32 GB, 13.28 GB, 13.23 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.92 GB (14951175486) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.84 GB (93242600333) - RowsProduced: 278.54M (278539467) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m18s - TotalStorageWaitTime: 29m33s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 26.780ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 24.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s591ms - OpenTime: 26.781ms - ExecTreeOpenTime: 140.955us - PrepareTime: 243.629ms - ExecTreePrepareTime: 1.999ms KrpcDataStreamSender (dst_id=1):(Total: 4m37s, non-child: 4m37s, % non-child: 100.00%) - BytesSent: 36.52 GB (39217672720) - EosSent: 0 (0) - OverallThroughput: 134.57 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 278.54M (278538443) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m37s - UncompressedRowBatchSize: 71.80 GB (77093482756) HDFS_SCAN_NODE (id=0):(Total: 3s411ms, non-child: 3s411ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:24/5.86 GB 7:16/3.76 GB 4:33/7.85 GB 1:30/7.21 GB 0:25/6.08 GB 5:36/8.51 GB 2:27/6.61 GB 3:37/8.98 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.18 GB, 12.73 GB, 13.33 GB, 13.78 GB, 14.21 GB, 14.62 GB, 14.99 GB, 15.50 GB, 16.01 GB, 16.39 GB, 16.60 GB, 16.71 GB, 16.74 GB, 16.80 GB, 16.87 GB, 16.93 GB, 16.98 GB, 17.01 GB, 17.09 GB, 17.18 GB, 17.27 GB, 17.38 GB, 17.49 GB, 17.57 GB, 17.64 GB, 17.71 GB, 17.77 GB, 17.89 GB, 18.00 GB, 18.09 GB, 18.19 GB, 18.28 GB, 18.38 GB, 18.53 GB, 18.75 GB, 18.96 GB, 19.20 GB, 19.34 GB, 19.40 GB, 19.46 GB, 19.51 GB, 19.57 GB, 19.64 GB, 19.68 GB, 19.75 GB - FooterProcessingTime: (Avg: 4s765ms ; Min: 115.129ms ; Max: 12s165ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.18 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.82 GB (21278912376) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m19s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.92 GB (14948018655) - PerReadThreadRawHdfsThroughput: 38.34 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 278.75M (278752459) - RowsReturned: 278.54M (278539467) - RowsReturnedRate: 81.66 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 183.321ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s223ms - TotalRawHdfsReadTime(*): 8m49s - TotalReadThroughput: 6.91 MB/sec CodeGen:(Total: 26.320ms, non-child: 26.320ms, % non-child: 100.00%) - CodegenTime: 427.261us - CompileTime: 4.130ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.502ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 15.152ms Instance 844a0200d7876345:20bb38b90000004c (host=vc1525.foo.com:22000):(Total: 246.825ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:22/5.40 GB 0:29/7.01 GB 5:21/5.16 GB 2:31/7.64 GB 7:28/6.45 GB 1:23/5.30 GB 3:36/8.82 GB 4:35/8.59 GB Fragment Instance Lifecycle Event Timeline: 1s757ms - Prepare Finished: 221.747ms (221.747ms) - Open Finished: 247.280ms (25.532ms) - First Batch Produced: 1s755ms (1s507ms) - First Batch Sent: 1s757ms (1.895ms) MemoryUsage(1m4s): 7.89 GB, 13.82 GB, 13.85 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.89 GB, 13.87 GB, 13.86 GB, 13.85 GB, 13.84 GB, 13.82 GB, 13.78 GB, 13.74 GB, 13.71 GB, 13.68 GB, 13.65 GB, 13.62 GB, 13.57 GB, 13.53 GB, 13.49 GB, 13.45 GB, 13.41 GB, 13.39 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.98 GB (15012545535) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.09 GB (85998241152) - RowsProduced: 279.40M (279396530) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m48s - TotalStorageWaitTime: 26m32s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 25.538ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 23.997ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s166ms - OpenTime: 25.540ms - ExecTreeOpenTime: 120.687us - PrepareTime: 221.209ms - ExecTreePrepareTime: 1.718ms KrpcDataStreamSender (dst_id=1):(Total: 4m32s, non-child: 4m32s, % non-child: 100.00%) - BytesSent: 36.64 GB (39343361383) - EosSent: 0 (0) - OverallThroughput: 137.69 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 279.40M (279395506) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m31s - UncompressedRowBatchSize: 72.02 GB (77331438419) HDFS_SCAN_NODE (id=0):(Total: 2s988ms, non-child: 2s988ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:22/5.40 GB 0:29/7.01 GB 5:21/5.16 GB 2:31/7.64 GB 7:28/6.45 GB 1:23/5.30 GB 3:36/8.82 GB 4:35/8.59 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.92 GB, 12.77 GB, 13.28 GB, 13.82 GB, 14.28 GB, 14.73 GB, 15.35 GB, 15.93 GB, 16.34 GB, 16.61 GB, 16.72 GB, 16.83 GB, 16.91 GB, 16.95 GB, 17.00 GB, 17.04 GB, 17.13 GB, 17.20 GB, 17.30 GB, 17.35 GB, 17.43 GB, 17.52 GB, 17.61 GB, 17.68 GB, 17.78 GB, 17.92 GB, 18.02 GB, 18.10 GB, 18.19 GB, 18.26 GB, 18.39 GB, 18.58 GB, 18.78 GB, 18.96 GB, 19.14 GB, 19.24 GB, 19.40 GB, 19.52 GB, 19.63 GB, 19.71 GB, 19.75 GB, 19.81 GB, 19.87 GB, 19.92 GB, 19.97 GB - FooterProcessingTime: (Avg: 4s144ms ; Min: 101.828ms ; Max: 8s076ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 20.00 GB (21479764400) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m26s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.98 GB (15009454381) - PerReadThreadRawHdfsThroughput: 43.76 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 279.61M (279609522) - RowsReturned: 279.40M (279396530) - RowsReturnedRate: 93.49 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 323.407ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s819ms - TotalRawHdfsReadTime(*): 7m48s - TotalReadThroughput: 7.03 MB/sec CodeGen:(Total: 25.129ms, non-child: 25.129ms, % non-child: 100.00%) - CodegenTime: 376.240us - CompileTime: 3.938ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.721ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 13.935ms Instance 844a0200d7876345:20bb38b90000007f (host=vc1526.foo.com:22000):(Total: 261.755ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:29/7.05 GB 5:19/4.62 GB 2:24/5.90 GB 4:33/8.04 GB 6:29/7.18 GB 1:33/8.00 GB 3:31/7.50 GB 7:26/6.36 GB Fragment Instance Lifecycle Event Timeline: 1s871ms - Prepare Finished: 235.733ms (235.733ms) - Open Finished: 262.185ms (26.451ms) - First Batch Produced: 1s869ms (1s607ms) - First Batch Sent: 1s871ms (1.803ms) MemoryUsage(1m4s): 8.00 GB, 13.94 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.92 GB, 13.92 GB, 13.91 GB, 13.90 GB, 13.89 GB, 13.89 GB, 13.88 GB, 13.87 GB, 13.85 GB, 13.84 GB, 13.84 GB, 13.82 GB, 13.79 GB, 13.76 GB, 13.74 GB, 13.72 GB, 13.67 GB, 13.65 GB, 13.60 GB, 13.55 GB, 13.52 GB, 13.46 GB, 13.40 GB, 13.35 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.95 GB (14975846183) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.11 GB (86016953678) - RowsProduced: 270.31M (270310400) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m29s - TotalStorageWaitTime: 26m10s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 26.447ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 26.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s123ms - OpenTime: 26.448ms - ExecTreeOpenTime: 192.127us - PrepareTime: 235.231ms - ExecTreePrepareTime: 1.903ms KrpcDataStreamSender (dst_id=1):(Total: 4m36s, non-child: 4m36s, % non-child: 100.00%) - BytesSent: 35.47 GB (38090928130) - EosSent: 0 (0) - OverallThroughput: 131.42 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 270.31M (270309376) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m35s - UncompressedRowBatchSize: 69.68 GB (74816226498) HDFS_SCAN_NODE (id=0):(Total: 2s956ms, non-child: 2s956ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:29/7.05 GB 5:19/4.62 GB 2:24/5.90 GB 4:33/8.04 GB 6:29/7.18 GB 1:33/8.00 GB 3:31/7.50 GB 7:26/6.36 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.01 GB, 12.74 GB, 13.07 GB, 13.44 GB, 13.65 GB, 13.92 GB, 14.29 GB, 14.83 GB, 15.44 GB, 16.07 GB, 16.40 GB, 16.59 GB, 16.72 GB, 16.75 GB, 16.78 GB, 16.82 GB, 16.87 GB, 16.93 GB, 16.97 GB, 17.06 GB, 17.16 GB, 17.26 GB, 17.40 GB, 17.45 GB, 17.49 GB, 17.55 GB, 17.59 GB, 17.64 GB, 17.71 GB, 17.79 GB, 17.89 GB, 18.03 GB, 18.13 GB, 18.27 GB, 18.55 GB, 18.80 GB, 19.04 GB, 19.25 GB, 19.37 GB, 19.44 GB, 19.50 GB, 19.55 GB, 19.62 GB, 19.69 GB, 19.73 GB - FooterProcessingTime: (Avg: 4s588ms ; Min: 202.452ms ; Max: 10s437ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.79 GB (21245108868) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 59s966ms - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.94 GB (14972763244) - PerReadThreadRawHdfsThroughput: 46.77 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 270.52M (270523392) - RowsReturned: 270.31M (270310400) - RowsReturnedRate: 91.44 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 11s069ms - TotalRawHdfsReadTime(*): 7m13s - TotalReadThroughput: 6.94 MB/sec CodeGen:(Total: 26.007ms, non-child: 26.007ms, % non-child: 100.00%) - CodegenTime: 357.035us - CompileTime: 4.122ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.467ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 14.937ms Instance 844a0200d7876345:20bb38b900000067 (host=vc1527.foo.com:22000):(Total: 240.154ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:25/6.03 GB 1:30/7.28 GB 6:29/7.08 GB 3:29/6.99 GB 4:27/6.61 GB 7:28/6.78 GB 2:26/6.39 GB 5:32/7.73 GB Fragment Instance Lifecycle Event Timeline: 1s442ms - Prepare Finished: 215.220ms (215.220ms) - Open Finished: 240.609ms (25.388ms) - First Batch Produced: 1s440ms (1s199ms) - First Batch Sent: 1s442ms (2.154ms) MemoryUsage(1m4s): 9.31 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.91 GB, 13.91 GB, 13.90 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.90 GB, 13.90 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.88 GB, 13.87 GB, 13.85 GB, 13.82 GB, 13.80 GB, 13.77 GB, 13.75 GB, 13.72 GB, 13.68 GB, 13.63 GB, 13.58 GB, 13.53 GB, 13.46 GB, 13.40 GB, 13.33 GB, 13.29 GB, 13.24 GB, 13.19 GB, 13.16 GB, 13.15 GB, 13.12 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.92 GB (14951156034) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.89 GB (85786418755) - RowsProduced: 280.30M (280303616) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m27s - TotalStorageWaitTime: 19m35s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 25.397ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.997ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s174ms - OpenTime: 25.414ms - ExecTreeOpenTime: 138.094us - PrepareTime: 214.664ms - ExecTreePrepareTime: 2.236ms KrpcDataStreamSender (dst_id=1):(Total: 4m31s, non-child: 4m31s, % non-child: 100.00%) - BytesSent: 36.80 GB (39515093304) - EosSent: 0 (0) - OverallThroughput: 138.95 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 280.30M (280302592) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m30s - UncompressedRowBatchSize: 72.25 GB (77582428932) HDFS_SCAN_NODE (id=0):(Total: 3s007ms, non-child: 3s007ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:25/6.03 GB 1:30/7.28 GB 6:29/7.08 GB 3:29/6.99 GB 4:27/6.61 GB 7:28/6.78 GB 2:26/6.39 GB 5:32/7.73 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 8.24 GB, 12.83 GB, 13.29 GB, 13.54 GB, 13.90 GB, 14.39 GB, 15.08 GB, 15.80 GB, 16.24 GB, 16.53 GB, 16.63 GB, 16.69 GB, 16.73 GB, 16.78 GB, 16.84 GB, 16.91 GB, 16.99 GB, 17.07 GB, 17.18 GB, 17.26 GB, 17.29 GB, 17.35 GB, 17.41 GB, 17.46 GB, 17.53 GB, 17.61 GB, 17.72 GB, 17.82 GB, 17.95 GB, 18.11 GB, 18.30 GB, 18.49 GB, 18.75 GB, 18.97 GB, 19.11 GB, 19.22 GB, 19.34 GB, 19.41 GB, 19.49 GB, 19.53 GB, 19.58 GB, 19.64 GB, 19.67 GB, 19.71 GB, 19.74 GB - FooterProcessingTime: (Avg: 3s138ms ; Min: 132.505ms ; Max: 6s365ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.78 GB (21237205221) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m4s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.92 GB (14948101535) - PerReadThreadRawHdfsThroughput: 54.52 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 280.52M (280516608) - RowsReturned: 280.30M (280303616) - RowsReturnedRate: 93.20 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s115ms - TotalRawHdfsReadTime(*): 6m11s - TotalReadThroughput: 6.93 MB/sec CodeGen:(Total: 24.987ms, non-child: 24.987ms, % non-child: 100.00%) - CodegenTime: 378.936us - CompileTime: 3.891ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.735ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 13.907ms Instance 844a0200d7876345:20bb38b900000034 (host=vc1528.foo.com:22000):(Total: 274.043ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:27/6.51 GB 7:27/6.64 GB 0:29/6.98 GB 6:29/7.11 GB 1:26/6.32 GB 2:27/6.61 GB 5:28/6.80 GB 3:32/7.73 GB Fragment Instance Lifecycle Event Timeline: 1s737ms - Prepare Finished: 249.432ms (249.432ms) - Open Finished: 274.556ms (25.124ms) - First Batch Produced: 1s735ms (1s460ms) - First Batch Sent: 1s737ms (2.274ms) MemoryUsage(1m4s): 7.80 GB, 13.90 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.90 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.88 GB, 13.88 GB, 13.88 GB, 13.87 GB, 13.87 GB, 13.87 GB, 13.86 GB, 13.86 GB, 13.92 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.92 GB, 13.90 GB, 13.87 GB, 13.84 GB, 13.81 GB, 13.79 GB, 13.76 GB, 13.70 GB, 13.67 GB, 13.63 GB, 13.61 GB, 13.58 GB, 13.53 GB, 13.48 GB, 13.44 GB, 13.41 GB, 13.37 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.95 GB (14979353499) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.31 GB (86234439842) - RowsProduced: 281.00M (281003656) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m34s - TotalStorageWaitTime: 27m25s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 25.120ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 19.997ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s168ms - OpenTime: 25.121ms - ExecTreeOpenTime: 145.074us - PrepareTime: 248.836ms - ExecTreePrepareTime: 2.124ms KrpcDataStreamSender (dst_id=1):(Total: 4m38s, non-child: 4m38s, % non-child: 100.00%) - BytesSent: 36.92 GB (39640466262) - EosSent: 0 (0) - OverallThroughput: 135.63 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 281.00M (281002632) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m38s - UncompressedRowBatchSize: 72.43 GB (77776210412) HDFS_SCAN_NODE (id=0):(Total: 2s967ms, non-child: 2s967ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:27/6.51 GB 7:27/6.64 GB 0:29/6.98 GB 6:29/7.11 GB 1:26/6.32 GB 2:27/6.61 GB 5:28/6.80 GB 3:32/7.73 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.84 GB, 12.85 GB, 13.35 GB, 13.80 GB, 14.22 GB, 14.64 GB, 15.14 GB, 15.66 GB, 16.15 GB, 16.45 GB, 16.64 GB, 16.77 GB, 16.81 GB, 16.84 GB, 16.92 GB, 16.99 GB, 17.04 GB, 17.11 GB, 17.20 GB, 17.27 GB, 17.35 GB, 17.44 GB, 17.55 GB, 17.67 GB, 17.87 GB, 17.95 GB, 18.01 GB, 18.11 GB, 18.23 GB, 18.37 GB, 18.49 GB, 18.61 GB, 18.77 GB, 18.94 GB, 19.13 GB, 19.30 GB, 19.49 GB, 19.60 GB, 19.67 GB, 19.72 GB, 19.80 GB, 19.87 GB, 19.92 GB, 19.95 GB, 19.99 GB - FooterProcessingTime: (Avg: 5s500ms ; Min: 80.714ms ; Max: 12s935ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 20.04 GB (21513170532) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 58s456ms - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.95 GB (14976262161) - PerReadThreadRawHdfsThroughput: 46.44 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 281.22M (281216648) - RowsReturned: 281.00M (281003656) - RowsReturnedRate: 94.71 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 1s086ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s463ms - TotalRawHdfsReadTime(*): 7m21s - TotalReadThroughput: 6.98 MB/sec CodeGen:(Total: 24.676ms, non-child: 24.676ms, % non-child: 100.00%) - CodegenTime: 375.255us - CompileTime: 3.843ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.411ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 13.972ms Instance 844a0200d7876345:20bb38b900000080 (host=vc1529.foo.com:22000):(Total: 258.287ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:26/6.40 GB 2:37/9.01 GB 3:29/7.10 GB 0:24/5.94 GB 1:29/7.10 GB 4:26/6.36 GB 6:24/5.78 GB 7:29/7.14 GB Fragment Instance Lifecycle Event Timeline: 1s840ms - Prepare Finished: 233.237ms (233.237ms) - Open Finished: 258.748ms (25.511ms) - First Batch Produced: 1s838ms (1s580ms) - First Batch Sent: 1s840ms (1.897ms) MemoryUsage(1m4s): 8.27 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.98 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.93 GB, 13.91 GB, 13.89 GB, 13.87 GB, 13.84 GB, 13.81 GB, 13.78 GB, 13.74 GB, 13.71 GB, 13.66 GB, 13.62 GB, 13.57 GB, 13.50 GB, 13.46 GB, 13.42 GB, 13.37 GB, 13.36 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.99 GB (15018540629) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.24 GB (86152273180) - RowsProduced: 281.20M (281198592) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m26s - TotalStorageWaitTime: 24m48s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 25.507ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 23.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s293ms - OpenTime: 25.508ms - ExecTreeOpenTime: 148.022us - PrepareTime: 232.708ms - ExecTreePrepareTime: 2.034ms KrpcDataStreamSender (dst_id=1):(Total: 4m35s, non-child: 4m35s, % non-child: 100.00%) - BytesSent: 36.91 GB (39628859793) - EosSent: 0 (0) - OverallThroughput: 137.34 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 281.20M (281197568) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m34s - UncompressedRowBatchSize: 72.48 GB (77829871689) HDFS_SCAN_NODE (id=0):(Total: 3s093ms, non-child: 3s093ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:26/6.40 GB 2:37/9.01 GB 3:29/7.10 GB 0:24/5.94 GB 1:29/7.10 GB 4:26/6.36 GB 6:24/5.78 GB 7:29/7.14 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.27 GB, 12.86 GB, 13.40 GB, 13.88 GB, 14.25 GB, 14.65 GB, 15.21 GB, 15.95 GB, 16.43 GB, 16.72 GB, 16.83 GB, 16.87 GB, 16.89 GB, 16.92 GB, 16.95 GB, 17.01 GB, 17.10 GB, 17.20 GB, 17.29 GB, 17.42 GB, 17.52 GB, 17.59 GB, 17.69 GB, 17.78 GB, 17.87 GB, 17.94 GB, 17.99 GB, 18.09 GB, 18.17 GB, 18.31 GB, 18.49 GB, 18.66 GB, 18.84 GB, 19.02 GB, 19.29 GB, 19.47 GB, 19.56 GB, 19.64 GB, 19.68 GB, 19.75 GB, 19.83 GB, 19.88 GB, 19.93 GB, 19.96 GB, 19.98 GB - FooterProcessingTime: (Avg: 4s211ms ; Min: 145.012ms ; Max: 11s117ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 20.02 GB (21492429340) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m13s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.98 GB (15015416523) - PerReadThreadRawHdfsThroughput: 46.06 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 281.41M (281411584) - RowsReturned: 281.20M (281198592) - RowsReturnedRate: 90.91 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s059ms - TotalRawHdfsReadTime(*): 7m24s - TotalReadThroughput: 6.99 MB/sec CodeGen:(Total: 25.072ms, non-child: 25.072ms, % non-child: 100.00%) - CodegenTime: 372.842us - CompileTime: 4.037ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.672ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 13.887ms Instance 844a0200d7876345:20bb38b90000000e (host=vc1531.foo.com:22000):(Total: 246.156ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:20/4.84 GB 7:25/6.19 GB 1:24/5.86 GB 2:27/6.43 GB 3:27/6.61 GB 6:29/7.06 GB 0:40/9.79 GB 5:32/7.81 GB Fragment Instance Lifecycle Event Timeline: 1s922ms - Prepare Finished: 216.757ms (216.757ms) - Open Finished: 246.628ms (29.870ms) - First Batch Produced: 1s920ms (1s674ms) - First Batch Sent: 1s922ms (1.728ms) MemoryUsage(1m4s): 6.86 GB, 13.84 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.92 GB, 13.90 GB, 13.89 GB, 13.87 GB, 13.84 GB, 13.81 GB, 13.77 GB, 13.75 GB, 13.75 GB, 13.73 GB, 13.69 GB, 13.66 GB, 13.61 GB, 13.55 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.98 GB (15006486029) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.10 GB (93518220112) - RowsProduced: 265.94M (265940992) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m12s - TotalStorageWaitTime: 31m43s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 29.866ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 28.996ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s350ms - OpenTime: 29.868ms - ExecTreeOpenTime: 192.883us - PrepareTime: 216.218ms - ExecTreePrepareTime: 2.056ms KrpcDataStreamSender (dst_id=1):(Total: 4m40s, non-child: 4m40s, % non-child: 100.00%) - BytesSent: 34.91 GB (37485205428) - EosSent: 0 (0) - OverallThroughput: 127.35 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 265.94M (265939968) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m40s - UncompressedRowBatchSize: 68.55 GB (73606908326) HDFS_SCAN_NODE (id=0):(Total: 3s138ms, non-child: 3s138ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:20/4.84 GB 7:25/6.19 GB 1:24/5.86 GB 2:27/6.43 GB 3:27/6.61 GB 6:29/7.06 GB 0:40/9.79 GB 5:32/7.81 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 5.97 GB, 12.70 GB, 13.12 GB, 13.59 GB, 13.82 GB, 14.06 GB, 14.30 GB, 14.65 GB, 15.06 GB, 15.65 GB, 16.14 GB, 16.43 GB, 16.68 GB, 16.81 GB, 16.86 GB, 16.89 GB, 16.94 GB, 16.96 GB, 17.00 GB, 17.03 GB, 17.10 GB, 17.18 GB, 17.31 GB, 17.51 GB, 17.60 GB, 17.66 GB, 17.71 GB, 17.75 GB, 17.81 GB, 17.88 GB, 17.98 GB, 18.04 GB, 18.08 GB, 18.17 GB, 18.30 GB, 18.47 GB, 18.66 GB, 18.84 GB, 19.10 GB, 19.32 GB, 19.46 GB, 19.54 GB, 19.60 GB, 19.64 GB, 19.69 GB - FooterProcessingTime: (Avg: 5s697ms ; Min: 106.008ms ; Max: 17s005ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.19 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.79 GB (21251720130) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m15s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.97 GB (15003382428) - PerReadThreadRawHdfsThroughput: 38.09 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 266.15M (266152960) - RowsReturned: 265.94M (265940992) - RowsReturnedRate: 84.73 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s979ms - TotalRawHdfsReadTime(*): 8m52s - TotalReadThroughput: 6.91 MB/sec CodeGen:(Total: 29.379ms, non-child: 29.379ms, % non-child: 100.00%) - CodegenTime: 463.506us - CompileTime: 5.046ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.172ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 16.610ms Instance 844a0200d7876345:20bb38b900000011 (host=vc1532.foo.com:22000):(Total: 249.298ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:27/6.64 GB 0:20/4.87 GB 2:31/7.55 GB 5:29/7.14 GB 1:25/6.19 GB 3:29/6.79 GB 4:36/8.61 GB 6:27/6.61 GB Fragment Instance Lifecycle Event Timeline: 1s549ms - Prepare Finished: 222.258ms (222.258ms) - Open Finished: 250.045ms (27.786ms) - First Batch Produced: 1s547ms (1s297ms) - First Batch Sent: 1s549ms (1.952ms) MemoryUsage(1m4s): 9.13 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.98 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.94 GB, 13.93 GB, 13.92 GB, 13.91 GB, 13.90 GB, 13.87 GB, 13.82 GB, 13.79 GB, 13.77 GB, 13.75 GB, 13.71 GB, 13.67 GB, 13.61 GB, 13.54 GB, 13.49 GB, 13.45 GB, 13.40 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.99 GB (15025920900) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.95 GB (93366767506) - RowsProduced: 274.41M (274405376) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m50s - TotalStorageWaitTime: 21m3s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 27.784ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 25.996ms - TotalThreadsVoluntaryContextSwitches: 7 (7) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s991ms - OpenTime: 27.785ms - ExecTreeOpenTime: 144.842us - PrepareTime: 221.429ms - ExecTreePrepareTime: 1.817ms KrpcDataStreamSender (dst_id=1):(Total: 4m37s, non-child: 4m37s, % non-child: 100.00%) - BytesSent: 36.00 GB (38656672646) - EosSent: 0 (0) - OverallThroughput: 132.65 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 274.40M (274404352) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m37s - UncompressedRowBatchSize: 70.73 GB (75949857816) HDFS_SCAN_NODE (id=0):(Total: 3s808ms, non-child: 3s808ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:27/6.64 GB 0:20/4.87 GB 2:31/7.55 GB 5:29/7.14 GB 1:25/6.19 GB 3:29/6.79 GB 4:36/8.61 GB 6:27/6.61 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 8.07 GB, 12.86 GB, 13.41 GB, 13.69 GB, 14.01 GB, 14.40 GB, 15.01 GB, 15.81 GB, 16.32 GB, 16.65 GB, 16.75 GB, 16.79 GB, 16.84 GB, 16.87 GB, 16.91 GB, 16.96 GB, 17.00 GB, 17.07 GB, 17.19 GB, 17.33 GB, 17.46 GB, 17.51 GB, 17.55 GB, 17.57 GB, 17.60 GB, 17.68 GB, 17.77 GB, 17.85 GB, 17.94 GB, 18.01 GB, 18.09 GB, 18.21 GB, 18.37 GB, 18.62 GB, 18.97 GB, 19.25 GB, 19.41 GB, 19.50 GB, 19.56 GB, 19.62 GB, 19.68 GB, 19.75 GB, 19.80 GB, 19.86 GB, 19.91 GB - FooterProcessingTime: (Avg: 3s752ms ; Min: 133.959ms ; Max: 8s399ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.95 GB (21419074472) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m41s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.99 GB (15022845964) - PerReadThreadRawHdfsThroughput: 51.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 274.62M (274618368) - RowsReturned: 274.41M (274405376) - RowsReturnedRate: 72.06 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s640ms - TotalRawHdfsReadTime(*): 6m34s - TotalReadThroughput: 6.97 MB/sec CodeGen:(Total: 27.305ms, non-child: 27.305ms, % non-child: 100.00%) - CodegenTime: 439.363us - CompileTime: 4.103ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.017ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 15.642ms Instance 844a0200d7876345:20bb38b900000029 (host=vc1533.foo.com:22000):(Total: 259.787ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:16/3.89 GB 3:25/6.12 GB 5:27/6.60 GB 1:28/6.93 GB 6:33/8.13 GB 4:31/7.61 GB 2:29/7.14 GB 0:32/7.89 GB Fragment Instance Lifecycle Event Timeline: 2s030ms - Prepare Finished: 235.660ms (235.660ms) - Open Finished: 260.228ms (24.568ms) - First Batch Produced: 2s028ms (1s768ms) - First Batch Sent: 2s030ms (1.930ms) MemoryUsage(1m4s): 7.47 GB, 13.91 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.91 GB, 13.89 GB, 13.88 GB, 13.86 GB, 13.83 GB, 13.81 GB, 13.78 GB, 13.75 GB, 13.71 GB, 13.68 GB, 13.65 GB, 13.62 GB, 13.59 GB, 13.54 GB, 13.50 GB, 13.47 GB, 13.44 GB, 13.42 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.99 GB (15019982253) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.86 GB (93265977018) - RowsProduced: 281.34M (281335808) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m13s - TotalStorageWaitTime: 29m24s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 24.547ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 23.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s923ms - OpenTime: 24.549ms - ExecTreeOpenTime: 208.209us - PrepareTime: 235.166ms - ExecTreePrepareTime: 2.008ms KrpcDataStreamSender (dst_id=1):(Total: 4m28s, non-child: 4m28s, % non-child: 100.00%) - BytesSent: 36.92 GB (39643789152) - EosSent: 0 (0) - OverallThroughput: 140.84 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 281.33M (281334784) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m27s - UncompressedRowBatchSize: 72.52 GB (77868161751) HDFS_SCAN_NODE (id=0):(Total: 3s747ms, non-child: 3s747ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:16/3.89 GB 3:25/6.12 GB 5:27/6.60 GB 1:28/6.93 GB 6:33/8.13 GB 4:31/7.61 GB 2:29/7.14 GB 0:32/7.89 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.55 GB, 12.83 GB, 13.28 GB, 13.76 GB, 14.18 GB, 14.65 GB, 15.09 GB, 15.62 GB, 16.02 GB, 16.49 GB, 16.66 GB, 16.83 GB, 16.92 GB, 16.96 GB, 17.01 GB, 17.08 GB, 17.13 GB, 17.17 GB, 17.25 GB, 17.33 GB, 17.41 GB, 17.53 GB, 17.67 GB, 17.74 GB, 17.83 GB, 17.93 GB, 18.02 GB, 18.11 GB, 18.22 GB, 18.38 GB, 18.50 GB, 18.60 GB, 18.73 GB, 18.91 GB, 19.12 GB, 19.24 GB, 19.44 GB, 19.62 GB, 19.71 GB, 19.75 GB, 19.81 GB, 19.86 GB, 19.92 GB, 19.98 GB, 20.01 GB - FooterProcessingTime: (Avg: 3s994ms ; Min: 109.289ms ; Max: 7s803ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 20.06 GB (21540481327) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m26s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.99 GB (15016915325) - PerReadThreadRawHdfsThroughput: 46.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 281.55M (281548800) - RowsReturned: 281.34M (281335808) - RowsReturnedRate: 75.08 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 11s841ms - TotalRawHdfsReadTime(*): 7m25s - TotalReadThroughput: 7.03 MB/sec CodeGen:(Total: 24.124ms, non-child: 24.124ms, % non-child: 100.00%) - CodegenTime: 332.025us - CompileTime: 4.012ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.218ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 13.449ms Instance 844a0200d7876345:20bb38b90000001a (host=vc1534.foo.com:22000):(Total: 280.518ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:31/7.17 GB 4:30/7.34 GB 3:25/6.14 GB 5:21/4.97 GB 0:34/8.30 GB 1:29/7.10 GB 2:29/7.14 GB 7:27/6.52 GB Fragment Instance Lifecycle Event Timeline: 1s865ms - Prepare Finished: 253.190ms (253.190ms) - Open Finished: 281.006ms (27.816ms) - First Batch Produced: 1s863ms (1s582ms) - First Batch Sent: 1s865ms (2.495ms) MemoryUsage(1m4s): 8.06 GB, 13.82 GB, 13.81 GB, 13.81 GB, 13.81 GB, 13.81 GB, 13.81 GB, 13.79 GB, 13.78 GB, 13.76 GB, 13.75 GB, 13.75 GB, 13.74 GB, 13.74 GB, 13.74 GB, 13.74 GB, 13.74 GB, 13.74 GB, 13.74 GB, 13.73 GB, 13.73 GB, 13.79 GB, 13.85 GB, 13.85 GB, 13.84 GB, 13.83 GB, 13.82 GB, 13.86 GB, 13.92 GB, 13.90 GB, 13.89 GB, 13.88 GB, 13.86 GB, 13.86 GB, 13.84 GB, 13.80 GB, 13.77 GB, 13.73 GB, 13.69 GB, 13.68 GB, 13.67 GB, 13.64 GB, 13.60 GB, 13.54 GB, 13.46 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.92 GB (14945796419) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.97 GB (93380727677) - RowsProduced: 266.02M (266022877) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m7s - TotalStorageWaitTime: 25m33s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 27.809ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 26.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s344ms - OpenTime: 27.811ms - ExecTreeOpenTime: 247.725us - PrepareTime: 252.644ms - ExecTreePrepareTime: 2.102ms KrpcDataStreamSender (dst_id=1):(Total: 4m39s, non-child: 4m39s, % non-child: 100.00%) - BytesSent: 34.90 GB (37473329477) - EosSent: 0 (0) - OverallThroughput: 127.75 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 266.02M (266021853) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m39s - UncompressedRowBatchSize: 68.57 GB (73630280571) HDFS_SCAN_NODE (id=0):(Total: 3s146ms, non-child: 3s146ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:31/7.17 GB 4:30/7.34 GB 3:25/6.14 GB 5:21/4.97 GB 0:34/8.30 GB 1:29/7.10 GB 2:29/7.14 GB 7:27/6.52 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.09 GB, 12.61 GB, 13.01 GB, 13.36 GB, 13.51 GB, 13.77 GB, 14.02 GB, 14.54 GB, 15.21 GB, 15.84 GB, 16.18 GB, 16.41 GB, 16.51 GB, 16.55 GB, 16.55 GB, 16.60 GB, 16.64 GB, 16.66 GB, 16.71 GB, 16.80 GB, 16.91 GB, 17.10 GB, 17.30 GB, 17.38 GB, 17.43 GB, 17.45 GB, 17.49 GB, 17.60 GB, 17.69 GB, 17.76 GB, 17.87 GB, 17.93 GB, 17.99 GB, 18.09 GB, 18.27 GB, 18.51 GB, 18.82 GB, 19.07 GB, 19.26 GB, 19.38 GB, 19.44 GB, 19.48 GB, 19.56 GB, 19.61 GB, 19.68 GB - FooterProcessingTime: (Avg: 4s688ms ; Min: 103.124ms ; Max: 13s976ms ; Number of samples: 90) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.77 GB (21228777484) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m19s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 90 (90) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.92 GB (14942754360) - PerReadThreadRawHdfsThroughput: 48.08 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 266.24M (266235869) - RowsReturned: 266.02M (266022877) - RowsReturnedRate: 84.54 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 2s123ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s112ms - TotalRawHdfsReadTime(*): 7m1s - TotalReadThroughput: 6.91 MB/sec CodeGen:(Total: 27.274ms, non-child: 27.274ms, % non-child: 100.00%) - CodegenTime: 349.921us - CompileTime: 4.535ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.797ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 15.479ms Instance 844a0200d7876345:20bb38b90000006a (host=vc1535.foo.com:22000):(Total: 241.741ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:24/5.86 GB 6:28/6.82 GB 4:25/6.08 GB 3:31/7.27 GB 0:20/4.83 GB 7:32/7.81 GB 1:41/10.00 GB 5:26/6.24 GB Fragment Instance Lifecycle Event Timeline: 1s584ms - Prepare Finished: 213.999ms (213.999ms) - Open Finished: 242.459ms (28.460ms) - First Batch Produced: 1s582ms (1s340ms) - First Batch Sent: 1s584ms (2.005ms) MemoryUsage(1m4s): 8.15 GB, 13.82 GB, 13.83 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.95 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.91 GB, 13.90 GB, 13.89 GB, 13.87 GB, 13.85 GB, 13.83 GB, 13.78 GB, 13.74 GB, 13.69 GB, 13.63 GB, 13.60 GB, 13.55 GB, 13.51 GB, 13.46 GB, 13.42 GB, 13.35 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.95 GB (14974488237) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.15 GB (86058303482) - RowsProduced: 267.40M (267397265) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m50s - TotalStorageWaitTime: 24m6s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 28.432ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 27.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s328ms - OpenTime: 28.434ms - ExecTreeOpenTime: 280.962us - PrepareTime: 213.233ms - ExecTreePrepareTime: 1.878ms KrpcDataStreamSender (dst_id=1):(Total: 4m37s, non-child: 4m37s, % non-child: 100.00%) - BytesSent: 35.10 GB (37690557513) - EosSent: 0 (0) - OverallThroughput: 129.36 MB/sec - PeakMemoryUsage: 3.58 MB (3752608) - RowsReturned: 267.40M (267396241) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m37s - UncompressedRowBatchSize: 68.93 GB (74009785334) HDFS_SCAN_NODE (id=0):(Total: 3s126ms, non-child: 3s126ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:24/5.86 GB 6:28/6.82 GB 4:25/6.08 GB 3:31/7.27 GB 0:20/4.83 GB 7:32/7.81 GB 1:41/10.00 GB 5:26/6.24 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.13 GB, 12.65 GB, 13.03 GB, 13.40 GB, 13.62 GB, 13.94 GB, 14.37 GB, 14.95 GB, 15.53 GB, 16.06 GB, 16.43 GB, 16.55 GB, 16.66 GB, 16.75 GB, 16.79 GB, 16.82 GB, 16.88 GB, 16.93 GB, 17.00 GB, 17.07 GB, 17.18 GB, 17.24 GB, 17.31 GB, 17.41 GB, 17.46 GB, 17.48 GB, 17.53 GB, 17.64 GB, 17.72 GB, 17.78 GB, 17.85 GB, 17.95 GB, 18.08 GB, 18.25 GB, 18.48 GB, 18.76 GB, 18.95 GB, 19.03 GB, 19.17 GB, 19.33 GB, 19.42 GB, 19.50 GB, 19.55 GB, 19.58 GB, 19.64 GB - FooterProcessingTime: (Avg: 3s496ms ; Min: 137.064ms ; Max: 8s949ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.72 GB (21170099355) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m25s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.94 GB (14971315004) - PerReadThreadRawHdfsThroughput: 46.08 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 267.61M (267610257) - RowsReturned: 267.40M (267397265) - RowsReturnedRate: 85.54 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 389.345ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s259ms - TotalRawHdfsReadTime(*): 7m18s - TotalReadThroughput: 6.90 MB/sec CodeGen:(Total: 27.898ms, non-child: 27.898ms, % non-child: 100.00%) - CodegenTime: 347.850us - CompileTime: 4.433ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.063ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 15.869ms Instance 844a0200d7876345:20bb38b90000004a (host=vc1536.foo.com:22000):(Total: 231.595ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:18/4.46 GB 3:32/7.84 GB 1:26/6.07 GB 6:28/6.90 GB 7:30/7.34 GB 4:32/7.85 GB 2:31/7.53 GB 5:28/6.82 GB Fragment Instance Lifecycle Event Timeline: 1s432ms - Prepare Finished: 204.590ms (204.590ms) - Open Finished: 231.989ms (27.398ms) - First Batch Produced: 1s429ms (1s197ms) - First Batch Sent: 1s432ms (2.734ms) MemoryUsage(1m4s): 7.69 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.91 GB, 13.89 GB, 13.87 GB, 13.87 GB, 13.86 GB, 13.85 GB, 13.81 GB, 13.77 GB, 13.73 GB, 13.71 GB, 13.67 GB, 13.64 GB, 13.60 GB, 13.56 GB, 13.49 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.98 GB (15012456533) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.35 GB (86276924229) - RowsProduced: 264.66M (264656896) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m11s - TotalStorageWaitTime: 27m48s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 27.394ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 26.996ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s485ms - OpenTime: 27.396ms - ExecTreeOpenTime: 213.326us - PrepareTime: 204.134ms - ExecTreePrepareTime: 2.139ms KrpcDataStreamSender (dst_id=1):(Total: 4m46s, non-child: 4m46s, % non-child: 100.00%) - BytesSent: 34.75 GB (37314638820) - EosSent: 0 (0) - OverallThroughput: 124.25 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 264.66M (264655872) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m45s - UncompressedRowBatchSize: 68.22 GB (73251503725) HDFS_SCAN_NODE (id=0):(Total: 3s287ms, non-child: 3s287ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:18/4.46 GB 3:32/7.84 GB 1:26/6.07 GB 6:28/6.90 GB 7:30/7.34 GB 4:32/7.85 GB 2:31/7.53 GB 5:28/6.82 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.74 GB, 12.79 GB, 13.19 GB, 13.48 GB, 13.63 GB, 13.91 GB, 14.28 GB, 14.81 GB, 15.29 GB, 15.83 GB, 16.28 GB, 16.46 GB, 16.64 GB, 16.76 GB, 16.81 GB, 16.86 GB, 16.91 GB, 16.96 GB, 17.01 GB, 17.07 GB, 17.18 GB, 17.23 GB, 17.32 GB, 17.43 GB, 17.51 GB, 17.54 GB, 17.55 GB, 17.58 GB, 17.67 GB, 17.75 GB, 17.84 GB, 17.91 GB, 18.01 GB, 18.12 GB, 18.29 GB, 18.53 GB, 18.74 GB, 18.85 GB, 19.02 GB, 19.20 GB, 19.38 GB, 19.50 GB, 19.56 GB, 19.59 GB, 19.63 GB - FooterProcessingTime: (Avg: 4s155ms ; Min: 66.110ms ; Max: 10s666ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.70 GB (21151623424) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m9s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.98 GB (15009332427) - PerReadThreadRawHdfsThroughput: 48.09 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 264.87M (264869888) - RowsReturned: 264.66M (264656896) - RowsReturnedRate: 80.51 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s711ms - TotalRawHdfsReadTime(*): 6m59s - TotalReadThroughput: 6.87 MB/sec CodeGen:(Total: 26.910ms, non-child: 26.910ms, % non-child: 100.00%) - CodegenTime: 387.171us - CompileTime: 3.932ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.430ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 14.880ms Instance 844a0200d7876345:20bb38b900000024 (host=vc1537.foo.com:22000):(Total: 233.388ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:19/4.70 GB 1:26/6.37 GB 0:27/6.46 GB 4:37/8.92 GB 3:20/4.95 GB 7:32/7.79 GB 6:29/7.14 GB 2:34/8.34 GB Fragment Instance Lifecycle Event Timeline: 1s988ms - Prepare Finished: 206.033ms (206.033ms) - Open Finished: 233.859ms (27.826ms) - First Batch Produced: 1s986ms (1s752ms) - First Batch Sent: 1s988ms (1.706ms) MemoryUsage(1m4s): 7.73 GB, 13.97 GB, 13.99 GB, 13.99 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 13.99 GB, 13.99 GB, 13.98 GB, 13.97 GB, 13.96 GB, 13.94 GB, 13.91 GB, 13.89 GB, 13.85 GB, 13.83 GB, 13.81 GB, 13.78 GB, 13.75 GB, 13.70 GB, 13.66 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.01 GB (15047797772) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.02 GB (93432768803) - RowsProduced: 265.49M (265493504) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m50s - TotalStorageWaitTime: 27m16s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 27.822ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 23.997ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s841ms - OpenTime: 27.823ms - ExecTreeOpenTime: 267.096us - PrepareTime: 205.510ms - ExecTreePrepareTime: 1.906ms KrpcDataStreamSender (dst_id=1):(Total: 4m34s, non-child: 4m34s, % non-child: 100.00%) - BytesSent: 34.84 GB (37412513144) - EosSent: 0 (0) - OverallThroughput: 130.16 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 265.49M (265492480) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m33s - UncompressedRowBatchSize: 68.44 GB (73483010856) HDFS_SCAN_NODE (id=0):(Total: 4s629ms, non-child: 4s629ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:19/4.70 GB 1:26/6.37 GB 0:27/6.46 GB 4:37/8.92 GB 3:20/4.95 GB 7:32/7.79 GB 6:29/7.14 GB 2:34/8.34 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.74 GB, 12.77 GB, 13.14 GB, 13.45 GB, 13.63 GB, 13.93 GB, 14.30 GB, 14.73 GB, 15.29 GB, 15.82 GB, 16.27 GB, 16.52 GB, 16.69 GB, 16.80 GB, 16.85 GB, 16.89 GB, 16.95 GB, 16.98 GB, 17.04 GB, 17.10 GB, 17.16 GB, 17.26 GB, 17.36 GB, 17.45 GB, 17.53 GB, 17.59 GB, 17.62 GB, 17.68 GB, 17.77 GB, 17.86 GB, 17.95 GB, 18.04 GB, 18.15 GB, 18.28 GB, 18.45 GB, 18.65 GB, 18.93 GB, 19.13 GB, 19.29 GB, 19.45 GB, 19.58 GB, 19.64 GB, 19.71 GB, 19.76 GB, 19.81 GB - FooterProcessingTime: (Avg: 4s108ms ; Min: 141.411ms ; Max: 8s689ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.87 GB (21338503606) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m42s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 14.01 GB (15044714602) - PerReadThreadRawHdfsThroughput: 42.18 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 265.71M (265706496) - RowsReturned: 265.49M (265493504) - RowsReturnedRate: 57.34 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s862ms - TotalRawHdfsReadTime(*): 8m2s - TotalReadThroughput: 6.98 MB/sec CodeGen:(Total: 27.291ms, non-child: 27.291ms, % non-child: 100.00%) - CodegenTime: 418.466us - CompileTime: 4.424ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.502ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 14.852ms Instance 844a0200d7876345:20bb38b900000051 (host=vc1538.foo.com:22000):(Total: 285.262ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:23/5.49 GB 4:26/6.28 GB 7:23/5.69 GB 5:23/5.65 GB 0:36/8.87 GB 3:31/7.63 GB 2:33/8.10 GB 6:29/7.07 GB Fragment Instance Lifecycle Event Timeline: 1s722ms - Prepare Finished: 261.183ms (261.183ms) - Open Finished: 285.692ms (24.509ms) - First Batch Produced: 1s719ms (1s434ms) - First Batch Sent: 1s722ms (2.332ms) MemoryUsage(1m4s): 7.33 GB, 13.89 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.92 GB, 13.90 GB, 13.88 GB, 13.88 GB, 13.85 GB, 13.83 GB, 13.80 GB, 13.79 GB, 13.77 GB, 13.74 GB, 13.70 GB, 13.67 GB, 13.62 GB, 13.57 GB, 13.53 GB, 13.49 GB, 13.44 GB, 13.39 GB, 13.33 GB, 13.30 GB, 13.26 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.98 GB (15007952742) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.16 GB (86067781817) - RowsProduced: 281.65M (281646080) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m32s - TotalStorageWaitTime: 30m26s - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 24.504ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 23.997ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s049ms - OpenTime: 24.506ms - ExecTreeOpenTime: 247.536us - PrepareTime: 260.685ms - ExecTreePrepareTime: 1.868ms KrpcDataStreamSender (dst_id=1):(Total: 4m31s, non-child: 4m31s, % non-child: 100.00%) - BytesSent: 36.99 GB (39717686339) - EosSent: 0 (0) - OverallThroughput: 139.40 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 281.65M (281645056) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m31s - UncompressedRowBatchSize: 72.60 GB (77954154724) HDFS_SCAN_NODE (id=0):(Total: 3s859ms, non-child: 3s859ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:23/5.49 GB 4:26/6.28 GB 7:23/5.69 GB 5:23/5.65 GB 0:36/8.87 GB 3:31/7.63 GB 2:33/8.10 GB 6:29/7.07 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.44 GB, 12.84 GB, 13.42 GB, 13.79 GB, 14.10 GB, 14.52 GB, 15.12 GB, 15.75 GB, 16.23 GB, 16.58 GB, 16.70 GB, 16.81 GB, 16.89 GB, 16.95 GB, 17.01 GB, 17.06 GB, 17.14 GB, 17.23 GB, 17.35 GB, 17.47 GB, 17.53 GB, 17.60 GB, 17.68 GB, 17.73 GB, 17.81 GB, 17.87 GB, 17.99 GB, 18.07 GB, 18.15 GB, 18.24 GB, 18.37 GB, 18.56 GB, 18.78 GB, 18.98 GB, 19.14 GB, 19.27 GB, 19.41 GB, 19.55 GB, 19.63 GB, 19.68 GB, 19.74 GB, 19.78 GB, 19.83 GB, 19.87 GB, 19.92 GB - FooterProcessingTime: (Avg: 6s060ms ; Min: 122.064ms ; Max: 12s239ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.97 GB (21444074255) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m9s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.97 GB (15004805925) - PerReadThreadRawHdfsThroughput: 43.85 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 281.86M (281859072) - RowsReturned: 281.65M (281646080) - RowsReturnedRate: 72.98 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 11s153ms - TotalRawHdfsReadTime(*): 7m46s - TotalReadThroughput: 6.97 MB/sec CodeGen:(Total: 23.996ms, non-child: 23.996ms, % non-child: 100.00%) - CodegenTime: 353.846us - CompileTime: 4.180ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.583ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 12.773ms Instance 844a0200d7876345:20bb38b90000007c (host=vc1539.foo.com:22000):(Total: 250.167ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:25/6.12 GB 2:31/7.67 GB 6:18/4.46 GB 4:32/7.76 GB 3:27/6.61 GB 1:38/9.23 GB 7:26/6.32 GB 0:26/6.32 GB Fragment Instance Lifecycle Event Timeline: 1s648ms - Prepare Finished: 224.521ms (224.521ms) - Open Finished: 250.655ms (26.133ms) - First Batch Produced: 1s646ms (1s395ms) - First Batch Sent: 1s648ms (2.115ms) MemoryUsage(1m4s): 7.45 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.92 GB, 13.89 GB, 13.87 GB, 13.84 GB, 13.81 GB, 13.79 GB, 13.78 GB, 13.75 GB, 13.72 GB, 13.69 GB, 13.65 GB, 13.61 GB, 13.55 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.98 GB (15015035019) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.21 GB (86126780424) - RowsProduced: 264.12M (264119296) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m52s - TotalStorageWaitTime: 27m52s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 26.125ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 20.997ms - TotalThreadsVoluntaryContextSwitches: 9 (9) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s532ms - OpenTime: 26.127ms - ExecTreeOpenTime: 187.462us - PrepareTime: 223.957ms - ExecTreePrepareTime: 1.949ms KrpcDataStreamSender (dst_id=1):(Total: 4m37s, non-child: 4m37s, % non-child: 100.00%) - BytesSent: 34.65 GB (37202176094) - EosSent: 0 (0) - OverallThroughput: 127.99 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 264.12M (264118272) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m36s - UncompressedRowBatchSize: 68.08 GB (73102525537) HDFS_SCAN_NODE (id=0):(Total: 3s344ms, non-child: 3s344ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:25/6.12 GB 2:31/7.67 GB 6:18/4.46 GB 4:32/7.76 GB 3:27/6.61 GB 1:38/9.23 GB 7:26/6.32 GB 0:26/6.32 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.49 GB, 12.77 GB, 13.16 GB, 13.53 GB, 13.74 GB, 13.96 GB, 14.24 GB, 14.71 GB, 15.24 GB, 15.82 GB, 16.27 GB, 16.49 GB, 16.68 GB, 16.80 GB, 16.83 GB, 16.87 GB, 16.89 GB, 16.93 GB, 16.97 GB, 17.05 GB, 17.16 GB, 17.26 GB, 17.35 GB, 17.43 GB, 17.54 GB, 17.60 GB, 17.66 GB, 17.70 GB, 17.75 GB, 17.82 GB, 17.87 GB, 17.94 GB, 18.04 GB, 18.12 GB, 18.31 GB, 18.54 GB, 18.73 GB, 18.92 GB, 19.09 GB, 19.24 GB, 19.43 GB, 19.54 GB, 19.59 GB, 19.63 GB, 19.69 GB - FooterProcessingTime: (Avg: 4s098ms ; Min: 80.740ms ; Max: 13s934ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.74 GB (21195237129) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m19s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.98 GB (15012005152) - PerReadThreadRawHdfsThroughput: 42.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 264.33M (264332288) - RowsReturned: 264.12M (264119296) - RowsReturnedRate: 78.96 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s337ms - TotalRawHdfsReadTime(*): 7m53s - TotalReadThroughput: 6.94 MB/sec CodeGen:(Total: 25.657ms, non-child: 25.657ms, % non-child: 100.00%) - CodegenTime: 424.188us - CompileTime: 4.256ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.487ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 14.433ms Instance 844a0200d7876345:20bb38b900000057 (host=vc1540.foo.com:22000):(Total: 266.729ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:30/7.43 GB 3:24/5.94 GB 1:26/6.30 GB 0:24/5.85 GB 6:33/8.13 GB 7:31/7.64 GB 4:25/5.97 GB 5:31/7.59 GB Fragment Instance Lifecycle Event Timeline: 1s583ms - Prepare Finished: 242.630ms (242.630ms) - Open Finished: 267.338ms (24.707ms) - First Batch Produced: 1s581ms (1s313ms) - First Batch Sent: 1s583ms (2.257ms) MemoryUsage(1m4s): 8.56 GB, 13.91 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.91 GB, 13.90 GB, 13.90 GB, 13.89 GB, 13.89 GB, 13.90 GB, 13.90 GB, 13.90 GB, 13.90 GB, 13.90 GB, 13.90 GB, 13.90 GB, 13.89 GB, 13.89 GB, 13.88 GB, 13.88 GB, 13.88 GB, 13.88 GB, 13.88 GB, 13.88 GB, 13.88 GB, 13.88 GB, 13.87 GB, 13.86 GB, 13.92 GB, 13.94 GB, 13.93 GB, 13.92 GB, 13.88 GB, 13.83 GB, 13.81 GB, 13.78 GB, 13.75 GB, 13.72 GB, 13.67 GB, 13.62 GB, 13.57 GB, 13.52 GB, 13.47 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.95 GB (14981220273) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.40 GB (86328825013) - RowsProduced: 272.36M (272362825) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m51s - TotalStorageWaitTime: 23m38s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 24.683ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 23.997ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 2s797ms - OpenTime: 24.685ms - ExecTreeOpenTime: 162.628us - PrepareTime: 241.964ms - ExecTreePrepareTime: 1.803ms KrpcDataStreamSender (dst_id=1):(Total: 4m38s, non-child: 4m38s, % non-child: 100.00%) - BytesSent: 35.70 GB (38336696614) - EosSent: 0 (0) - OverallThroughput: 131.33 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 272.36M (272361801) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m37s - UncompressedRowBatchSize: 70.21 GB (75384795318) HDFS_SCAN_NODE (id=0):(Total: 2s633ms, non-child: 2s633ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:30/7.43 GB 3:24/5.94 GB 1:26/6.30 GB 0:24/5.85 GB 6:33/8.13 GB 7:31/7.64 GB 4:25/5.97 GB 5:31/7.59 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.52 GB, 12.73 GB, 13.09 GB, 13.38 GB, 13.57 GB, 13.89 GB, 14.30 GB, 14.82 GB, 15.43 GB, 16.04 GB, 16.37 GB, 16.58 GB, 16.67 GB, 16.70 GB, 16.75 GB, 16.80 GB, 16.85 GB, 16.90 GB, 16.95 GB, 17.04 GB, 17.13 GB, 17.25 GB, 17.35 GB, 17.40 GB, 17.44 GB, 17.47 GB, 17.53 GB, 17.63 GB, 17.72 GB, 17.81 GB, 18.04 GB, 18.18 GB, 18.31 GB, 18.50 GB, 18.76 GB, 19.05 GB, 19.31 GB, 19.47 GB, 19.54 GB, 19.60 GB, 19.65 GB, 19.71 GB, 19.78 GB, 19.83 GB, 19.89 GB - FooterProcessingTime: (Avg: 3s473ms ; Min: 104.546ms ; Max: 9s615ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.97 GB (21440323558) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 56s162ms - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.95 GB (14978137148) - PerReadThreadRawHdfsThroughput: 48.63 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 272.58M (272575817) - RowsReturned: 272.36M (272362825) - RowsReturnedRate: 103.44 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 1s099ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s512ms - TotalRawHdfsReadTime(*): 7m - TotalReadThroughput: 6.96 MB/sec CodeGen:(Total: 24.274ms, non-child: 24.274ms, % non-child: 100.00%) - CodegenTime: 303.575us - CompileTime: 4.327ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 5.891ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 13.551ms Instance 844a0200d7876345:20bb38b90000002a (host=vc1541.foo.com:22000):(Total: 271.721ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:26/6.36 GB 7:32/7.88 GB 3:20/4.82 GB 2:23/5.55 GB 5:26/6.35 GB 6:27/6.61 GB 0:33/8.13 GB 1:37/9.04 GB Fragment Instance Lifecycle Event Timeline: 1s654ms - Prepare Finished: 245.005ms (245.005ms) - Open Finished: 272.198ms (27.192ms) - First Batch Produced: 1s652ms (1s380ms) - First Batch Sent: 1s654ms (2.006ms) MemoryUsage(1m4s): 8.32 GB, 13.94 GB, 13.94 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.92 GB, 13.92 GB, 13.91 GB, 13.90 GB, 13.90 GB, 13.87 GB, 13.86 GB, 13.83 GB, 13.83 GB, 13.80 GB, 13.74 GB, 13.69 GB, 13.64 GB, 13.60 GB, 13.57 GB, 13.53 GB, 13.49 GB, 13.44 GB, 13.40 GB, 13.36 GB, 13.31 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.95 GB (14983875286) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.84 GB (93242276766) - RowsProduced: 272.15M (272145408) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m4s - TotalStorageWaitTime: 24m56s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 27.190ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 24.996ms - TotalThreadsVoluntaryContextSwitches: 6 (6) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s274ms - OpenTime: 27.191ms - ExecTreeOpenTime: 146.014us - PrepareTime: 244.428ms - ExecTreePrepareTime: 1.844ms KrpcDataStreamSender (dst_id=1):(Total: 4m40s, non-child: 4m40s, % non-child: 100.00%) - BytesSent: 35.74 GB (38379818833) - EosSent: 0 (0) - OverallThroughput: 130.55 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 272.14M (272144384) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m39s - UncompressedRowBatchSize: 70.15 GB (75324178654) HDFS_SCAN_NODE (id=0):(Total: 3s078ms, non-child: 3s078ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:26/6.36 GB 7:32/7.88 GB 3:20/4.82 GB 2:23/5.55 GB 5:26/6.35 GB 6:27/6.61 GB 0:33/8.13 GB 1:37/9.04 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.33 GB, 12.86 GB, 13.28 GB, 13.56 GB, 13.86 GB, 14.26 GB, 14.81 GB, 15.35 GB, 15.80 GB, 16.23 GB, 16.48 GB, 16.61 GB, 16.72 GB, 16.79 GB, 16.84 GB, 16.89 GB, 16.95 GB, 17.05 GB, 17.12 GB, 17.17 GB, 17.25 GB, 17.29 GB, 17.40 GB, 17.48 GB, 17.54 GB, 17.60 GB, 17.65 GB, 17.73 GB, 17.84 GB, 17.92 GB, 18.02 GB, 18.17 GB, 18.35 GB, 18.51 GB, 18.66 GB, 18.84 GB, 19.01 GB, 19.16 GB, 19.33 GB, 19.44 GB, 19.52 GB, 19.57 GB, 19.61 GB, 19.66 GB, 19.70 GB - FooterProcessingTime: (Avg: 4s255ms ; Min: 157.889ms ; Max: 8s564ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.78 GB (21233642790) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m22s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.95 GB (14980898591) - PerReadThreadRawHdfsThroughput: 49.73 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 272.36M (272358400) - RowsReturned: 272.15M (272145408) - RowsReturnedRate: 88.41 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 11s110ms - TotalRawHdfsReadTime(*): 6m47s - TotalReadThroughput: 6.92 MB/sec CodeGen:(Total: 26.763ms, non-child: 26.763ms, % non-child: 100.00%) - CodegenTime: 407.955us - CompileTime: 3.937ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.389ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 15.913ms Instance 844a0200d7876345:20bb38b900000059 (host=vc1542.foo.com:22000):(Total: 197.203ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:25/6.07 GB 7:29/6.92 GB 0:25/6.15 GB 3:21/5.20 GB 1:28/6.89 GB 6:36/8.88 GB 2:29/7.13 GB 4:32/7.78 GB Fragment Instance Lifecycle Event Timeline: 1s604ms - Prepare Finished: 167.655ms (167.655ms) - Open Finished: 197.617ms (29.961ms) - First Batch Produced: 1s602ms (1s405ms) - First Batch Sent: 1s604ms (2.024ms) MemoryUsage(1m4s): 8.27 GB, 13.89 GB, 13.95 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.94 GB, 13.92 GB, 13.91 GB, 13.90 GB, 13.89 GB, 13.87 GB, 13.82 GB, 13.79 GB, 13.74 GB, 13.71 GB, 13.69 GB, 13.67 GB, 13.64 GB, 13.61 GB, 13.57 GB, 13.52 GB, 13.48 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.97 GB (15005432580) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.38 GB (86303280227) - RowsProduced: 264.05M (264048640) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m49s - TotalStorageWaitTime: 24m37s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 29.957ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 27.996ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s056ms - OpenTime: 29.958ms - ExecTreeOpenTime: 144.980us - PrepareTime: 167.173ms - ExecTreePrepareTime: 2.045ms KrpcDataStreamSender (dst_id=1):(Total: 4m36s, non-child: 4m36s, % non-child: 100.00%) - BytesSent: 34.65 GB (37205259419) - EosSent: 0 (0) - OverallThroughput: 128.44 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 264.05M (264047616) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m35s - UncompressedRowBatchSize: 68.06 GB (73083303811) HDFS_SCAN_NODE (id=0):(Total: 2s867ms, non-child: 2s867ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:25/6.07 GB 7:29/6.92 GB 0:25/6.15 GB 3:21/5.20 GB 1:28/6.89 GB 6:36/8.88 GB 2:29/7.13 GB 4:32/7.78 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.25 GB, 12.69 GB, 13.13 GB, 13.39 GB, 13.59 GB, 13.89 GB, 14.26 GB, 14.77 GB, 15.35 GB, 15.89 GB, 16.23 GB, 16.49 GB, 16.63 GB, 16.71 GB, 16.78 GB, 16.84 GB, 16.86 GB, 16.89 GB, 16.96 GB, 17.04 GB, 17.12 GB, 17.20 GB, 17.30 GB, 17.37 GB, 17.43 GB, 17.49 GB, 17.53 GB, 17.57 GB, 17.63 GB, 17.73 GB, 17.79 GB, 17.85 GB, 17.94 GB, 18.10 GB, 18.31 GB, 18.51 GB, 18.75 GB, 18.97 GB, 19.14 GB, 19.23 GB, 19.32 GB, 19.43 GB, 19.52 GB, 19.59 GB, 19.65 GB - FooterProcessingTime: (Avg: 4s427ms ; Min: 120.748ms ; Max: 11s698ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.71 GB (21162184207) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m43s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.97 GB (15002259344) - PerReadThreadRawHdfsThroughput: 45.92 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 264.26M (264261632) - RowsReturned: 264.05M (264048640) - RowsReturnedRate: 92.09 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s649ms - TotalRawHdfsReadTime(*): 7m19s - TotalReadThroughput: 6.87 MB/sec CodeGen:(Total: 29.548ms, non-child: 29.548ms, % non-child: 100.00%) - CodegenTime: 413.620us - CompileTime: 4.178ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.777ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 16.892ms Instance 844a0200d7876345:20bb38b900000018 (host=vd1101.foo.com:22000):(Total: 280.739ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:24/5.90 GB 0:33/8.10 GB 3:36/8.64 GB 2:33/8.09 GB 7:30/7.28 GB 6:24/5.90 GB 4:14/3.38 GB 1:30/7.23 GB Fragment Instance Lifecycle Event Timeline: 1s712ms - Prepare Finished: 240.901ms (240.901ms) - Open Finished: 281.236ms (40.334ms) - First Batch Produced: 1s711ms (1s429ms) - First Batch Sent: 1s712ms (1.818ms) MemoryUsage(1m4s): 7.47 GB, 13.79 GB, 13.90 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.91 GB, 13.87 GB, 13.84 GB, 13.78 GB, 13.73 GB, 13.71 GB, 13.69 GB, 13.66 GB, 13.62 GB, 13.57 GB, 13.53 GB, 13.47 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.99 GB (15017378019) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.09 GB (93513767706) - RowsProduced: 271.73M (271731762) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m28s - TotalStorageWaitTime: 30m11s - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 40.330ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 37.994ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s103ms - OpenTime: 40.331ms - ExecTreeOpenTime: 266.450us - PrepareTime: 240.342ms - ExecTreePrepareTime: 2.186ms KrpcDataStreamSender (dst_id=1):(Total: 4m35s, non-child: 4m35s, % non-child: 100.00%) - BytesSent: 35.66 GB (38286200438) - EosSent: 0 (0) - OverallThroughput: 132.65 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 271.73M (271730738) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m34s - UncompressedRowBatchSize: 70.04 GB (75210066725) HDFS_SCAN_NODE (id=0):(Total: 2s908ms, non-child: 2s908ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:24/5.90 GB 0:33/8.10 GB 3:36/8.64 GB 2:33/8.09 GB 7:30/7.28 GB 6:24/5.90 GB 4:14/3.38 GB 1:30/7.23 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.51 GB, 12.64 GB, 13.09 GB, 13.50 GB, 13.80 GB, 14.23 GB, 14.61 GB, 15.13 GB, 15.70 GB, 16.16 GB, 16.49 GB, 16.64 GB, 16.77 GB, 16.86 GB, 16.91 GB, 16.96 GB, 16.99 GB, 17.03 GB, 17.11 GB, 17.20 GB, 17.30 GB, 17.38 GB, 17.46 GB, 17.54 GB, 17.61 GB, 17.70 GB, 17.78 GB, 17.87 GB, 17.98 GB, 18.08 GB, 18.17 GB, 18.24 GB, 18.33 GB, 18.49 GB, 18.71 GB, 18.91 GB, 19.15 GB, 19.31 GB, 19.42 GB, 19.52 GB, 19.61 GB, 19.66 GB, 19.72 GB, 19.78 GB, 19.82 GB - FooterProcessingTime: (Avg: 5s325ms ; Min: 100.086ms ; Max: 19s174ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.91 GB (21378401457) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m7s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.98 GB (15014303065) - PerReadThreadRawHdfsThroughput: 28.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 271.93M (271934514) - RowsReturned: 271.73M (271731762) - RowsReturnedRate: 93.42 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 458.289ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 19s994ms - TotalRawHdfsReadTime(*): 11m51s - TotalReadThroughput: 6.93 MB/sec CodeGen:(Total: 39.749ms, non-child: 39.749ms, % non-child: 100.00%) - CodegenTime: 454.386us - CompileTime: 4.541ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.142ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 27.603ms Instance 844a0200d7876345:20bb38b900000054 (host=vd1102.foo.com:22000):(Total: 256.445ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:32/7.84 GB 5:32/7.82 GB 2:39/9.54 GB 0:22/5.33 GB 7:23/5.50 GB 1:23/5.50 GB 4:29/6.91 GB 6:26/6.25 GB Fragment Instance Lifecycle Event Timeline: 2s063ms - Prepare Finished: 215.870ms (215.870ms) - Open Finished: 256.874ms (41.003ms) - First Batch Produced: 2s061ms (1s804ms) - First Batch Sent: 2s063ms (1.725ms) MemoryUsage(1m4s): 7.42 GB, 13.90 GB, 13.92 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.91 GB, 13.90 GB, 13.89 GB, 13.86 GB, 13.82 GB, 13.80 GB, 13.75 GB, 13.70 GB, 13.66 GB, 13.62 GB, 13.58 GB, 13.55 GB, 13.52 GB, 13.46 GB, 13.41 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.95 GB (14973342651) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.22 GB (86136902145) - RowsProduced: 267.17M (267169792) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m16s - TotalStorageWaitTime: 28m22s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 40.996ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 36.994ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s481ms - OpenTime: 40.997ms - ExecTreeOpenTime: 209.714us - PrepareTime: 215.376ms - ExecTreePrepareTime: 2.025ms KrpcDataStreamSender (dst_id=1):(Total: 4m41s, non-child: 4m41s, % non-child: 100.00%) - BytesSent: 35.08 GB (37663962098) - EosSent: 0 (0) - OverallThroughput: 127.81 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 267.17M (267168768) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m40s - UncompressedRowBatchSize: 68.87 GB (73947077164) HDFS_SCAN_NODE (id=0):(Total: 3s285ms, non-child: 3s285ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:32/7.84 GB 5:32/7.82 GB 2:39/9.54 GB 0:22/5.33 GB 7:23/5.50 GB 1:23/5.50 GB 4:29/6.91 GB 6:26/6.25 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.47 GB, 12.75 GB, 13.10 GB, 13.44 GB, 13.67 GB, 14.00 GB, 14.38 GB, 14.86 GB, 15.27 GB, 15.86 GB, 16.27 GB, 16.46 GB, 16.68 GB, 16.77 GB, 16.81 GB, 16.84 GB, 16.88 GB, 16.94 GB, 16.99 GB, 17.06 GB, 17.13 GB, 17.18 GB, 17.29 GB, 17.39 GB, 17.48 GB, 17.54 GB, 17.61 GB, 17.68 GB, 17.77 GB, 17.86 GB, 17.92 GB, 18.01 GB, 18.14 GB, 18.29 GB, 18.48 GB, 18.64 GB, 18.75 GB, 18.90 GB, 19.09 GB, 19.31 GB, 19.43 GB, 19.49 GB, 19.52 GB, 19.57 GB, 19.62 GB - FooterProcessingTime: (Avg: 4s498ms ; Min: 126.709ms ; Max: 9s961ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.68 GB (21130722979) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m3s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.94 GB (14970231500) - PerReadThreadRawHdfsThroughput: 41.15 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 267.38M (267382784) - RowsReturned: 267.17M (267169792) - RowsReturnedRate: 81.31 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 12s154ms - TotalRawHdfsReadTime(*): 8m9s - TotalReadThroughput: 6.88 MB/sec CodeGen:(Total: 40.395ms, non-child: 40.395ms, % non-child: 100.00%) - CodegenTime: 491.462us - CompileTime: 4.796ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 9.017ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 25.979ms Instance 844a0200d7876345:20bb38b900000016 (host=vd1103.foo.com:22000):(Total: 233.844ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:20/4.85 GB 1:25/6.11 GB 6:25/6.07 GB 0:33/8.13 GB 7:35/8.44 GB 4:27/6.65 GB 5:24/5.87 GB 3:34/8.16 GB Fragment Instance Lifecycle Event Timeline: 1s912ms - Prepare Finished: 206.101ms (206.101ms) - Open Finished: 234.364ms (28.262ms) - First Batch Produced: 1s910ms (1s676ms) - First Batch Sent: 1s912ms (2.058ms) MemoryUsage(1m4s): 8.11 GB, 13.94 GB, 13.95 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.92 GB, 13.91 GB, 13.89 GB, 13.87 GB, 13.87 GB, 13.85 GB, 13.81 GB, 13.77 GB, 13.74 GB, 13.71 GB, 13.68 GB, 13.64 GB, 13.58 GB, 13.54 GB, 13.49 GB, 13.44 GB, 13.39 GB, 13.34 GB, 13.31 GB, 13.28 GB, 13.26 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.97 GB (15001573938) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.96 GB (93370994073) - RowsProduced: 282.87M (282868736) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m35s - TotalStorageWaitTime: 24m47s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 28.231ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 25.996ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s314ms - OpenTime: 28.232ms - ExecTreeOpenTime: 197.446us - PrepareTime: 205.532ms - ExecTreePrepareTime: 2.074ms KrpcDataStreamSender (dst_id=1):(Total: 4m33s, non-child: 4m33s, % non-child: 100.00%) - BytesSent: 37.13 GB (39862802376) - EosSent: 0 (0) - OverallThroughput: 139.00 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 282.87M (282867712) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m32s - UncompressedRowBatchSize: 72.92 GB (78292061692) HDFS_SCAN_NODE (id=0):(Total: 3s129ms, non-child: 3s129ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:20/4.85 GB 1:25/6.11 GB 6:25/6.07 GB 0:33/8.13 GB 7:35/8.44 GB 4:27/6.65 GB 5:24/5.87 GB 3:34/8.16 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.12 GB, 12.86 GB, 13.39 GB, 13.72 GB, 14.13 GB, 14.69 GB, 15.44 GB, 16.11 GB, 16.50 GB, 16.68 GB, 16.78 GB, 16.84 GB, 16.90 GB, 16.95 GB, 17.00 GB, 17.07 GB, 17.16 GB, 17.27 GB, 17.36 GB, 17.43 GB, 17.52 GB, 17.56 GB, 17.60 GB, 17.67 GB, 17.78 GB, 17.88 GB, 17.96 GB, 18.04 GB, 18.17 GB, 18.34 GB, 18.52 GB, 18.75 GB, 18.94 GB, 19.08 GB, 19.28 GB, 19.44 GB, 19.54 GB, 19.60 GB, 19.65 GB, 19.69 GB, 19.75 GB, 19.81 GB, 19.85 GB, 19.89 GB, 19.94 GB - FooterProcessingTime: (Avg: 4s283ms ; Min: 109.770ms ; Max: 9s920ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.97 GB (21446960716) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m9s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.97 GB (14998359720) - PerReadThreadRawHdfsThroughput: 49.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 283.08M (283081728) - RowsReturned: 282.87M (282868736) - RowsReturnedRate: 90.39 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s709ms - TotalRawHdfsReadTime(*): 6m54s - TotalReadThroughput: 6.95 MB/sec CodeGen:(Total: 27.643ms, non-child: 27.643ms, % non-child: 100.00%) - CodegenTime: 475.935us - CompileTime: 4.514ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.504ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 16.133ms Instance 844a0200d7876345:20bb38b900000070 (host=vd1104.foo.com:22000):(Total: 262.332ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:25/6.15 GB 7:35/8.60 GB 5:27/6.57 GB 4:31/7.67 GB 1:25/6.03 GB 3:27/6.54 GB 6:24/5.90 GB 0:29/7.15 GB Fragment Instance Lifecycle Event Timeline: 1s669ms - Prepare Finished: 229.348ms (229.348ms) - Open Finished: 262.851ms (33.502ms) - First Batch Produced: 1s667ms (1s404ms) - First Batch Sent: 1s669ms (2.137ms) MemoryUsage(1m4s): 8.04 GB, 13.99 GB, 13.99 GB, 13.99 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.00 GB, 14.00 GB, 14.00 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.98 GB, 13.97 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.92 GB, 13.92 GB, 13.89 GB, 13.87 GB, 13.84 GB, 13.81 GB, 13.78 GB, 13.75 GB, 13.70 GB, 13.67 GB, 13.62 GB, 13.56 GB, 13.50 GB, 13.48 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.01 GB (15046663099) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.40 GB (86331670197) - RowsProduced: 274.96M (274959360) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m14s - TotalStorageWaitTime: 26m30s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 33.500ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 32.995ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s998ms - OpenTime: 33.501ms - ExecTreeOpenTime: 160.600us - PrepareTime: 228.756ms - ExecTreePrepareTime: 2.037ms KrpcDataStreamSender (dst_id=1):(Total: 4m33s, non-child: 4m33s, % non-child: 100.00%) - BytesSent: 36.11 GB (38772432311) - EosSent: 0 (0) - OverallThroughput: 135.15 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 274.96M (274958336) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m33s - UncompressedRowBatchSize: 70.88 GB (76103118936) HDFS_SCAN_NODE (id=0):(Total: 3s803ms, non-child: 3s803ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:25/6.15 GB 7:35/8.60 GB 5:27/6.57 GB 4:31/7.67 GB 1:25/6.03 GB 3:27/6.54 GB 6:24/5.90 GB 0:29/7.15 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.06 GB, 12.83 GB, 13.31 GB, 13.66 GB, 13.94 GB, 14.27 GB, 14.77 GB, 15.43 GB, 16.12 GB, 16.51 GB, 16.72 GB, 16.82 GB, 16.87 GB, 16.90 GB, 16.95 GB, 17.00 GB, 17.06 GB, 17.12 GB, 17.21 GB, 17.31 GB, 17.43 GB, 17.55 GB, 17.60 GB, 17.65 GB, 17.69 GB, 17.77 GB, 17.83 GB, 17.89 GB, 17.97 GB, 18.02 GB, 18.13 GB, 18.29 GB, 18.44 GB, 18.64 GB, 18.92 GB, 19.11 GB, 19.37 GB, 19.55 GB, 19.61 GB, 19.67 GB, 19.73 GB, 19.79 GB, 19.85 GB, 19.92 GB, 19.97 GB - FooterProcessingTime: (Avg: 4s320ms ; Min: 189.234ms ; Max: 13s465ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 20.02 GB (21498290514) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m23s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 14.01 GB (15043574007) - PerReadThreadRawHdfsThroughput: 46.25 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 275.17M (275172352) - RowsReturned: 274.96M (274959360) - RowsReturnedRate: 72.29 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s117ms - TotalRawHdfsReadTime(*): 7m23s - TotalReadThroughput: 6.98 MB/sec CodeGen:(Total: 33.030ms, non-child: 33.030ms, % non-child: 100.00%) - CodegenTime: 427.892us - CompileTime: 4.187ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.435ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 20.835ms Instance 844a0200d7876345:20bb38b900000007 (host=vd1105.foo.com:22000):(Total: 252.526ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:28/6.82 GB 2:25/6.10 GB 5:23/5.61 GB 3:40/9.80 GB 7:29/7.10 GB 6:26/6.39 GB 1:27/6.54 GB 4:27/6.17 GB Fragment Instance Lifecycle Event Timeline: 1s520ms - Prepare Finished: 217.595ms (217.595ms) - Open Finished: 253.143ms (35.547ms) - First Batch Produced: 1s518ms (1s265ms) - First Batch Sent: 1s520ms (1.675ms) MemoryUsage(1m4s): 8.28 GB, 13.93 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.94 GB, 13.93 GB, 13.91 GB, 13.90 GB, 13.90 GB, 13.90 GB, 13.89 GB, 13.89 GB, 13.86 GB, 13.85 GB, 13.82 GB, 13.77 GB, 13.74 GB, 13.73 GB, 13.71 GB, 13.68 GB, 13.65 GB, 13.60 GB, 13.56 GB, 13.51 GB, 13.46 GB, 13.42 GB, 13.38 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.97 GB (15002331590) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.81 GB (93208211375) - RowsProduced: 271.24M (271243264) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m6s - TotalStorageWaitTime: 24m48s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 35.544ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 34.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s319ms - OpenTime: 35.545ms - ExecTreeOpenTime: 195.204us - PrepareTime: 216.881ms - ExecTreePrepareTime: 1.997ms KrpcDataStreamSender (dst_id=1):(Total: 4m34s, non-child: 4m34s, % non-child: 100.00%) - BytesSent: 35.60 GB (38229156559) - EosSent: 0 (0) - OverallThroughput: 132.92 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 271.24M (271242240) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m33s - UncompressedRowBatchSize: 69.92 GB (75075143300) HDFS_SCAN_NODE (id=0):(Total: 3s140ms, non-child: 3s140ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:28/6.82 GB 2:25/6.10 GB 5:23/5.61 GB 3:40/9.80 GB 7:29/7.10 GB 6:26/6.39 GB 1:27/6.54 GB 4:27/6.17 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.30 GB, 12.83 GB, 13.26 GB, 13.53 GB, 13.82 GB, 14.14 GB, 14.54 GB, 15.13 GB, 15.65 GB, 16.09 GB, 16.42 GB, 16.58 GB, 16.72 GB, 16.82 GB, 16.87 GB, 16.92 GB, 16.96 GB, 17.03 GB, 17.11 GB, 17.19 GB, 17.28 GB, 17.32 GB, 17.39 GB, 17.46 GB, 17.53 GB, 17.60 GB, 17.68 GB, 17.75 GB, 17.82 GB, 17.91 GB, 17.99 GB, 18.11 GB, 18.25 GB, 18.42 GB, 18.68 GB, 18.89 GB, 19.06 GB, 19.18 GB, 19.28 GB, 19.41 GB, 19.52 GB, 19.59 GB, 19.65 GB, 19.71 GB, 19.76 GB - FooterProcessingTime: (Avg: 3s962ms ; Min: 109.756ms ; Max: 11s287ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.81 GB (21272438110) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m7s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.97 GB (14999043659) - PerReadThreadRawHdfsThroughput: 48.72 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 271.46M (271456256) - RowsReturned: 271.24M (271243264) - RowsReturnedRate: 86.36 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s813ms - TotalRawHdfsReadTime(*): 6m56s - TotalReadThroughput: 6.94 MB/sec CodeGen:(Total: 35.064ms, non-child: 35.064ms, % non-child: 100.00%) - CodegenTime: 366.001us - CompileTime: 4.183ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.719ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.650ms Instance 844a0200d7876345:20bb38b90000000d (host=vd1107.foo.com:22000):(Total: 268.022ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:27/6.67 GB 2:32/7.92 GB 0:28/6.93 GB 4:24/5.90 GB 7:29/7.14 GB 5:31/7.63 GB 1:29/7.01 GB 3:23/5.39 GB Fragment Instance Lifecycle Event Timeline: 1s659ms - Prepare Finished: 234.036ms (234.036ms) - Open Finished: 268.562ms (34.526ms) - First Batch Produced: 1s657ms (1s388ms) - First Batch Sent: 1s659ms (2.208ms) MemoryUsage(1m4s): 8.51 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.92 GB, 13.92 GB, 13.91 GB, 13.90 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.89 GB, 13.88 GB, 13.88 GB, 13.88 GB, 13.86 GB, 13.84 GB, 13.83 GB, 13.82 GB, 13.81 GB, 13.79 GB, 13.76 GB, 13.73 GB, 13.69 GB, 13.67 GB, 13.65 GB, 13.60 GB, 13.68 GB, 13.65 GB, 13.60 GB, 13.58 GB, 13.54 GB, 13.49 GB, 13.46 GB, 13.42 GB, 13.38 GB, 13.37 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.92 GB (14949090572) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.96 GB (93371632446) - RowsProduced: 278.86M (278863264) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m20s - TotalStorageWaitTime: 23m34s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 34.520ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 32.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s311ms - OpenTime: 34.521ms - ExecTreeOpenTime: 140.389us - PrepareTime: 233.403ms - ExecTreePrepareTime: 1.981ms KrpcDataStreamSender (dst_id=1):(Total: 4m32s, non-child: 4m32s, % non-child: 100.00%) - BytesSent: 36.60 GB (39300109224) - EosSent: 0 (0) - OverallThroughput: 137.42 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 278.86M (278863264) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m32s - UncompressedRowBatchSize: 71.88 GB (77183790617) HDFS_SCAN_NODE (id=0):(Total: 3s122ms, non-child: 3s122ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:27/6.67 GB 2:32/7.92 GB 0:28/6.93 GB 4:24/5.90 GB 7:29/7.14 GB 5:31/7.63 GB 1:29/7.01 GB 3:23/5.39 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.50 GB, 12.81 GB, 13.27 GB, 13.68 GB, 14.07 GB, 14.49 GB, 15.02 GB, 15.69 GB, 16.22 GB, 16.49 GB, 16.65 GB, 16.74 GB, 16.78 GB, 16.81 GB, 16.85 GB, 16.91 GB, 16.96 GB, 17.04 GB, 17.13 GB, 17.22 GB, 17.28 GB, 17.36 GB, 17.45 GB, 17.53 GB, 17.62 GB, 17.71 GB, 17.79 GB, 17.87 GB, 17.96 GB, 18.08 GB, 18.21 GB, 18.34 GB, 18.55 GB, 18.75 GB, 19.00 GB, 19.30 GB, 19.47 GB, 19.57 GB, 19.62 GB, 19.68 GB, 19.75 GB, 19.80 GB, 19.88 GB, 19.92 GB, 19.96 GB - FooterProcessingTime: (Avg: 3s409ms ; Min: 76.936ms ; Max: 7s510ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.99 GB (21469280361) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m22s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.92 GB (14945941919) - PerReadThreadRawHdfsThroughput: 48.91 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 279.08M (279076256) - RowsReturned: 278.86M (278864288) - RowsReturnedRate: 89.30 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 1s198ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s233ms - TotalRawHdfsReadTime(*): 6m58s - TotalReadThroughput: 6.98 MB/sec CodeGen:(Total: 34.089ms, non-child: 34.089ms, % non-child: 100.00%) - CodegenTime: 445.658us - CompileTime: 4.161ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.907ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.524ms Instance 844a0200d7876345:20bb38b900000038 (host=vd1108.foo.com:22000):(Total: 256.305ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:25/6.07 GB 6:37/9.01 GB 3:34/8.30 GB 1:26/6.28 GB 4:20/4.87 GB 5:33/8.04 GB 0:23/5.66 GB 2:25/6.11 GB Fragment Instance Lifecycle Event Timeline: 2s010ms - Prepare Finished: 225.087ms (225.087ms) - Open Finished: 256.727ms (31.639ms) - First Batch Produced: 2s008ms (1s752ms) - First Batch Sent: 2s010ms (1.924ms) MemoryUsage(1m4s): 8.08 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.92 GB, 13.91 GB, 13.89 GB, 13.88 GB, 13.86 GB, 13.84 GB, 13.82 GB, 13.81 GB, 13.79 GB, 13.73 GB, 13.70 GB, 13.67 GB, 13.62 GB, 13.59 GB, 13.54 GB, 13.48 GB, 13.44 GB, 13.40 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.97 GB (15002805695) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.27 GB (86192403699) - RowsProduced: 273.67M (273671168) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m59s - TotalStorageWaitTime: 24m43s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 31.623ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 29.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s440ms - OpenTime: 31.624ms - ExecTreeOpenTime: 153.125us - PrepareTime: 224.595ms - ExecTreePrepareTime: 1.961ms KrpcDataStreamSender (dst_id=1):(Total: 4m32s, non-child: 4m32s, % non-child: 100.00%) - BytesSent: 35.90 GB (38542282664) - EosSent: 0 (0) - OverallThroughput: 134.70 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 273.67M (273670144) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m32s - UncompressedRowBatchSize: 70.54 GB (75746542583) HDFS_SCAN_NODE (id=0):(Total: 3s240ms, non-child: 3s240ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:25/6.07 GB 6:37/9.01 GB 3:34/8.30 GB 1:26/6.28 GB 4:20/4.87 GB 5:33/8.04 GB 0:23/5.66 GB 2:25/6.11 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.09 GB, 12.85 GB, 13.36 GB, 13.64 GB, 13.84 GB, 14.19 GB, 14.65 GB, 15.29 GB, 15.96 GB, 16.40 GB, 16.65 GB, 16.76 GB, 16.79 GB, 16.82 GB, 16.88 GB, 16.93 GB, 16.99 GB, 17.05 GB, 17.16 GB, 17.25 GB, 17.36 GB, 17.47 GB, 17.55 GB, 17.60 GB, 17.64 GB, 17.67 GB, 17.70 GB, 17.78 GB, 17.87 GB, 17.99 GB, 18.09 GB, 18.18 GB, 18.32 GB, 18.51 GB, 18.77 GB, 19.00 GB, 19.26 GB, 19.42 GB, 19.49 GB, 19.55 GB, 19.61 GB, 19.66 GB, 19.72 GB, 19.77 GB, 19.81 GB - FooterProcessingTime: (Avg: 4s004ms ; Min: 132.046ms ; Max: 14s882ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.86 GB (21325955725) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m45s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.97 GB (14999739037) - PerReadThreadRawHdfsThroughput: 45.19 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 273.88M (273884160) - RowsReturned: 273.67M (273671168) - RowsReturnedRate: 84.45 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s582ms - TotalRawHdfsReadTime(*): 7m30s - TotalReadThroughput: 6.93 MB/sec CodeGen:(Total: 31.100ms, non-child: 31.100ms, % non-child: 100.00%) - CodegenTime: 479.920us - CompileTime: 4.316ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.682ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 18.556ms Instance 844a0200d7876345:20bb38b90000003d (host=vd1109.foo.com:22000):(Total: 257.412ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:35/8.56 GB 3:31/7.51 GB 6:24/5.94 GB 0:25/6.14 GB 4:23/5.57 GB 7:28/6.81 GB 2:32/7.85 GB 5:26/6.23 GB Fragment Instance Lifecycle Event Timeline: 1s987ms - Prepare Finished: 230.482ms (230.482ms) - Open Finished: 257.892ms (27.410ms) - First Batch Produced: 1s985ms (1s727ms) - First Batch Sent: 1s987ms (2.026ms) MemoryUsage(1m4s): 7.80 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.92 GB, 13.92 GB, 13.91 GB, 13.89 GB, 13.89 GB, 13.88 GB, 13.87 GB, 13.85 GB, 13.83 GB, 13.81 GB, 13.78 GB, 13.75 GB, 13.73 GB, 13.70 GB, 13.67 GB, 13.65 GB, 13.60 GB, 13.58 GB, 13.54 GB, 13.51 GB, 13.47 GB, 13.43 GB, 13.39 GB, 13.35 GB, 13.31 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.96 GB (14988365508) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.22 GB (86130325302) - RowsProduced: 276.34M (276337664) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m25s - TotalStorageWaitTime: 27m21s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 27.405ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 25.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s621ms - OpenTime: 27.406ms - ExecTreeOpenTime: 141.501us - PrepareTime: 229.911ms - ExecTreePrepareTime: 2.006ms KrpcDataStreamSender (dst_id=1):(Total: 4m34s, non-child: 4m34s, % non-child: 100.00%) - BytesSent: 36.26 GB (38938054530) - EosSent: 0 (0) - OverallThroughput: 135.30 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 276.34M (276336640) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m33s - UncompressedRowBatchSize: 71.23 GB (76484502292) HDFS_SCAN_NODE (id=0):(Total: 4s426ms, non-child: 4s426ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:35/8.56 GB 3:31/7.51 GB 6:24/5.94 GB 0:25/6.14 GB 4:23/5.57 GB 7:28/6.81 GB 2:32/7.85 GB 5:26/6.23 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.86 GB, 12.86 GB, 13.25 GB, 13.64 GB, 14.00 GB, 14.32 GB, 14.72 GB, 15.28 GB, 15.85 GB, 16.36 GB, 16.60 GB, 16.76 GB, 16.84 GB, 16.87 GB, 16.91 GB, 16.92 GB, 17.00 GB, 17.08 GB, 17.17 GB, 17.24 GB, 17.31 GB, 17.43 GB, 17.54 GB, 17.60 GB, 17.72 GB, 17.80 GB, 17.87 GB, 17.93 GB, 17.99 GB, 18.04 GB, 18.15 GB, 18.27 GB, 18.43 GB, 18.61 GB, 18.81 GB, 19.00 GB, 19.21 GB, 19.37 GB, 19.48 GB, 19.54 GB, 19.58 GB, 19.65 GB, 19.72 GB, 19.77 GB, 19.82 GB - FooterProcessingTime: (Avg: 4s103ms ; Min: 152.007ms ; Max: 7s972ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 87.99 - BytesRead: 19.87 GB (21336762815) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m2s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.96 GB (14985145159) - PerReadThreadRawHdfsThroughput: 44.49 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 276.55M (276550656) - RowsReturned: 276.34M (276337664) - RowsReturnedRate: 62.43 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 11s264ms - TotalRawHdfsReadTime(*): 7m37s - TotalReadThroughput: 6.93 MB/sec CodeGen:(Total: 27.000ms, non-child: 27.000ms, % non-child: 100.00%) - CodegenTime: 372.810us - CompileTime: 4.156ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.654ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 15.709ms Instance 844a0200d7876345:20bb38b900000008 (host=vd1110.foo.com:22000):(Total: 248.785ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:31/7.60 GB 3:29/7.06 GB 6:22/5.34 GB 5:34/8.30 GB 0:25/6.07 GB 4:28/6.75 GB 1:32/7.35 GB 2:26/6.24 GB Fragment Instance Lifecycle Event Timeline: 1s305ms - Prepare Finished: 215.141ms (215.141ms) - Open Finished: 249.544ms (34.403ms) - First Batch Produced: 1s303ms (1s053ms) - First Batch Sent: 1s305ms (2.114ms) MemoryUsage(1m4s): 8.34 GB, 13.84 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.92 GB, 13.91 GB, 13.91 GB, 13.90 GB, 13.89 GB, 13.89 GB, 13.85 GB, 13.84 GB, 13.82 GB, 13.79 GB, 13.75 GB, 13.71 GB, 13.65 GB, 13.61 GB, 13.57 GB, 13.51 GB, 13.47 GB, 13.43 GB, 13.38 GB, 13.36 GB, 13.33 GB, 13.31 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.97 GB (14997660879) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.74 GB (93138974067) - RowsProduced: 280.52M (280519616) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m58s - TotalStorageWaitTime: 24m46s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 34.391ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 33.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 2s690ms - OpenTime: 34.393ms - ExecTreeOpenTime: 158.025us - PrepareTime: 214.305ms - ExecTreePrepareTime: 1.895ms KrpcDataStreamSender (dst_id=1):(Total: 4m33s, non-child: 4m33s, % non-child: 100.00%) - BytesSent: 36.83 GB (39548031276) - EosSent: 0 (0) - OverallThroughput: 137.74 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 280.52M (280518592) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m33s - UncompressedRowBatchSize: 72.31 GB (77642114697) HDFS_SCAN_NODE (id=0):(Total: 2s503ms, non-child: 2s503ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:31/7.60 GB 3:29/7.06 GB 6:22/5.34 GB 5:34/8.30 GB 0:25/6.07 GB 4:28/6.75 GB 1:32/7.35 GB 2:26/6.24 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.36 GB, 12.80 GB, 13.47 GB, 13.77 GB, 14.15 GB, 14.63 GB, 15.32 GB, 15.97 GB, 16.35 GB, 16.62 GB, 16.70 GB, 16.78 GB, 16.84 GB, 16.91 GB, 16.98 GB, 17.05 GB, 17.15 GB, 17.23 GB, 17.34 GB, 17.44 GB, 17.48 GB, 17.54 GB, 17.64 GB, 17.67 GB, 17.74 GB, 17.83 GB, 17.94 GB, 18.06 GB, 18.16 GB, 18.26 GB, 18.43 GB, 18.61 GB, 18.81 GB, 19.02 GB, 19.21 GB, 19.32 GB, 19.43 GB, 19.55 GB, 19.64 GB, 19.69 GB, 19.73 GB, 19.78 GB, 19.81 GB, 19.86 GB, 19.91 GB - FooterProcessingTime: (Avg: 4s167ms ; Min: 113.159ms ; Max: 11s372ms ; Number of samples: 90) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.96 GB (21430421338) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m30s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 90 (90) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.96 GB (14994518562) - PerReadThreadRawHdfsThroughput: 48.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 280.73M (280732608) - RowsReturned: 280.52M (280519616) - RowsReturnedRate: 112.07 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 368.215ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s878ms - TotalRawHdfsReadTime(*): 7m5s - TotalReadThroughput: 7.00 MB/sec CodeGen:(Total: 33.872ms, non-child: 33.872ms, % non-child: 100.00%) - CodegenTime: 441.101us - CompileTime: 4.210ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.575ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 20.475ms Instance 844a0200d7876345:20bb38b90000003a (host=vd1111.foo.com:22000):(Total: 234.527ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:28/6.85 GB 1:31/7.39 GB 7:29/6.83 GB 3:36/8.76 GB 5:18/4.41 GB 6:33/8.10 GB 2:24/5.90 GB 4:27/6.37 GB Fragment Instance Lifecycle Event Timeline: 1s156ms - Prepare Finished: 203.102ms (203.102ms) - Open Finished: 234.916ms (31.814ms) - First Batch Produced: 1s154ms (919.991ms) - First Batch Sent: 1s156ms (1.899ms) MemoryUsage(1m4s): 7.90 GB, 13.89 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.91 GB, 13.89 GB, 13.87 GB, 13.85 GB, 13.83 GB, 13.77 GB, 13.73 GB, 13.69 GB, 13.65 GB, 13.62 GB, 13.57 GB, 13.53 GB, 13.48 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.99 GB (15023857611) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.28 GB (86196855469) - RowsProduced: 270.42M (270420537) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m21s - TotalStorageWaitTime: 26m7s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 31.810ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 28.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 2s513ms - OpenTime: 31.812ms - ExecTreeOpenTime: 314.536us - PrepareTime: 202.587ms - ExecTreePrepareTime: 1.898ms KrpcDataStreamSender (dst_id=1):(Total: 4m40s, non-child: 4m40s, % non-child: 100.00%) - BytesSent: 35.51 GB (38124727045) - EosSent: 0 (0) - OverallThroughput: 129.55 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 270.42M (270419513) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m40s - UncompressedRowBatchSize: 69.71 GB (74846689988) HDFS_SCAN_NODE (id=0):(Total: 2s335ms, non-child: 2s335ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:28/6.85 GB 1:31/7.39 GB 7:29/6.83 GB 3:36/8.76 GB 5:18/4.41 GB 6:33/8.10 GB 2:24/5.90 GB 4:27/6.37 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.92 GB, 12.74 GB, 13.20 GB, 13.45 GB, 13.64 GB, 13.97 GB, 14.43 GB, 15.01 GB, 15.58 GB, 16.08 GB, 16.43 GB, 16.62 GB, 16.72 GB, 16.82 GB, 16.87 GB, 16.92 GB, 16.97 GB, 17.03 GB, 17.09 GB, 17.18 GB, 17.26 GB, 17.34 GB, 17.41 GB, 17.46 GB, 17.54 GB, 17.58 GB, 17.63 GB, 17.71 GB, 17.79 GB, 17.88 GB, 17.99 GB, 18.11 GB, 18.26 GB, 18.43 GB, 18.68 GB, 18.90 GB, 19.13 GB, 19.27 GB, 19.38 GB, 19.50 GB, 19.61 GB, 19.67 GB, 19.73 GB, 19.78 GB, 19.82 GB - FooterProcessingTime: (Avg: 3s546ms ; Min: 152.974ms ; Max: 8s547ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.90 GB (21362627793) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m8s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.99 GB (15020782526) - PerReadThreadRawHdfsThroughput: 48.73 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 270.63M (270633529) - RowsReturned: 270.42M (270420537) - RowsReturnedRate: 115.78 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 157.542ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 11s503ms - TotalRawHdfsReadTime(*): 6m58s - TotalReadThroughput: 6.96 MB/sec CodeGen:(Total: 31.169ms, non-child: 31.169ms, % non-child: 100.00%) - CodegenTime: 422.763us - CompileTime: 4.645ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.183ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 17.677ms Instance 844a0200d7876345:20bb38b900000004 (host=vd1112.foo.com:22000):(Total: 253.382ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:26/6.36 GB 4:26/6.39 GB 6:24/5.83 GB 3:37/8.88 GB 7:20/4.88 GB 5:33/8.09 GB 1:26/6.37 GB 2:31/7.59 GB Fragment Instance Lifecycle Event Timeline: 2s360ms - Prepare Finished: 218.130ms (218.130ms) - Open Finished: 253.887ms (35.757ms) - First Batch Produced: 2s359ms (2s105ms) - First Batch Sent: 2s360ms (1.194ms) MemoryUsage(1m4s): 6.81 GB, 13.88 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.91 GB, 13.89 GB, 13.86 GB, 13.84 GB, 13.82 GB, 13.81 GB, 13.79 GB, 13.75 GB, 13.71 GB, 13.68 GB, 13.64 GB, 13.62 GB, 13.59 GB, 13.57 GB, 13.55 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.98 GB (15012964631) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.16 GB (93590363106) - RowsProduced: 267.42M (267417600) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m25s - TotalStorageWaitTime: 32m23s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 35.748ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 33.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 5s793ms - OpenTime: 35.749ms - ExecTreeOpenTime: 280.241us - PrepareTime: 217.574ms - ExecTreePrepareTime: 1.838ms KrpcDataStreamSender (dst_id=1):(Total: 4m36s, non-child: 4m36s, % non-child: 100.00%) - BytesSent: 35.11 GB (37703360349) - EosSent: 0 (0) - OverallThroughput: 130.00 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 267.42M (267416576) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m36s - UncompressedRowBatchSize: 68.93 GB (74015315865) HDFS_SCAN_NODE (id=0):(Total: 5s592ms, non-child: 5s592ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:26/6.36 GB 4:26/6.39 GB 6:24/5.83 GB 3:37/8.88 GB 7:20/4.88 GB 5:33/8.09 GB 1:26/6.37 GB 2:31/7.59 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 5.92 GB, 12.70 GB, 13.09 GB, 13.52 GB, 13.78 GB, 14.02 GB, 14.38 GB, 14.83 GB, 15.19 GB, 15.70 GB, 16.16 GB, 16.41 GB, 16.66 GB, 16.81 GB, 16.83 GB, 16.87 GB, 16.92 GB, 16.98 GB, 17.03 GB, 17.09 GB, 17.14 GB, 17.20 GB, 17.31 GB, 17.43 GB, 17.57 GB, 17.66 GB, 17.72 GB, 17.75 GB, 17.78 GB, 17.87 GB, 17.99 GB, 18.10 GB, 18.22 GB, 18.34 GB, 18.46 GB, 18.56 GB, 18.72 GB, 18.92 GB, 19.12 GB, 19.34 GB, 19.50 GB, 19.57 GB, 19.61 GB, 19.66 GB, 19.71 GB - FooterProcessingTime: (Avg: 6s962ms ; Min: 122.629ms ; Max: 13s931ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.18 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.78 GB (21234576731) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m12s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.98 GB (15009881512) - PerReadThreadRawHdfsThroughput: 38.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 267.63M (267630592) - RowsReturned: 267.42M (267417600) - RowsReturnedRate: 47.82 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 11s899ms - TotalRawHdfsReadTime(*): 8m48s - TotalReadThroughput: 6.89 MB/sec CodeGen:(Total: 35.163ms, non-child: 35.163ms, % non-child: 100.00%) - CodegenTime: 428.210us - CompileTime: 4.760ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.521ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 21.276ms Instance 844a0200d7876345:20bb38b900000001 (host=vd1113.foo.com:22000):(Total: 248.885ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:30/7.26 GB 4:26/6.25 GB 7:29/7.04 GB 3:26/6.36 GB 0:27/6.57 GB 6:22/5.36 GB 2:27/6.30 GB 1:40/9.71 GB Fragment Instance Lifecycle Event Timeline: 1s737ms - Prepare Finished: 212.479ms (212.479ms) - Open Finished: 249.503ms (37.023ms) - First Batch Produced: 1s735ms (1s486ms) - First Batch Sent: 1s737ms (2.022ms) MemoryUsage(1m4s): 8.26 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.91 GB, 13.90 GB, 13.88 GB, 13.86 GB, 13.85 GB, 13.83 GB, 13.81 GB, 13.79 GB, 13.75 GB, 13.71 GB, 13.67 GB, 13.62 GB, 13.57 GB, 13.53 GB, 13.49 GB, 13.44 GB, 13.40 GB, 13.37 GB, 13.34 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.97 GB (15002909907) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.98 GB (93398336270) - RowsProduced: 281.70M (281697280) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m21s - TotalStorageWaitTime: 25m55s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 37.012ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 32.995ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s402ms - OpenTime: 37.013ms - ExecTreeOpenTime: 146.104us - PrepareTime: 211.780ms - ExecTreePrepareTime: 1.790ms KrpcDataStreamSender (dst_id=1):(Total: 4m35s, non-child: 4m35s, % non-child: 100.00%) - BytesSent: 36.96 GB (39684729887) - EosSent: 0 (0) - OverallThroughput: 137.28 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 281.70M (281696256) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m35s - UncompressedRowBatchSize: 72.61 GB (77968202072) HDFS_SCAN_NODE (id=0):(Total: 3s206ms, non-child: 3s206ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:30/7.26 GB 4:26/6.25 GB 7:29/7.04 GB 3:26/6.36 GB 0:27/6.57 GB 6:22/5.36 GB 2:27/6.30 GB 1:40/9.71 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.29 GB, 12.90 GB, 13.46 GB, 13.78 GB, 14.11 GB, 14.61 GB, 15.28 GB, 16.00 GB, 16.45 GB, 16.69 GB, 16.79 GB, 16.82 GB, 16.86 GB, 16.91 GB, 16.98 GB, 17.08 GB, 17.18 GB, 17.24 GB, 17.34 GB, 17.43 GB, 17.54 GB, 17.60 GB, 17.65 GB, 17.72 GB, 17.77 GB, 17.83 GB, 17.91 GB, 18.00 GB, 18.09 GB, 18.23 GB, 18.43 GB, 18.61 GB, 18.79 GB, 18.99 GB, 19.22 GB, 19.40 GB, 19.54 GB, 19.60 GB, 19.65 GB, 19.71 GB, 19.77 GB, 19.83 GB, 19.87 GB, 19.91 GB, 19.94 GB - FooterProcessingTime: (Avg: 5s839ms ; Min: 110.217ms ; Max: 13s185ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.98 GB (21454873087) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m12s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.97 GB (14999753033) - PerReadThreadRawHdfsThroughput: 47.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 281.91M (281910272) - RowsReturned: 281.70M (281697280) - RowsReturnedRate: 87.85 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s602ms - TotalRawHdfsReadTime(*): 7m12s - TotalReadThroughput: 6.97 MB/sec CodeGen:(Total: 36.566ms, non-child: 36.566ms, % non-child: 100.00%) - CodegenTime: 410.002us - CompileTime: 4.321ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.750ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.991ms Instance 844a0200d7876345:20bb38b900000077 (host=vd1114.foo.com:22000):(Total: 246.512ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:20/4.95 GB 1:41/10.01 GB 5:29/7.18 GB 3:27/6.58 GB 4:19/4.63 GB 7:30/7.24 GB 2:34/8.26 GB 6:24/5.86 GB Fragment Instance Lifecycle Event Timeline: 1s528ms - Prepare Finished: 213.287ms (213.287ms) - Open Finished: 246.962ms (33.675ms) - First Batch Produced: 1s527ms (1s280ms) - First Batch Sent: 1s528ms (1.275ms) MemoryUsage(1m4s): 8.83 GB, 13.94 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.92 GB, 13.90 GB, 13.86 GB, 13.81 GB, 13.78 GB, 13.76 GB, 13.74 GB, 13.69 GB, 13.63 GB, 13.57 GB, 13.52 GB, 13.47 GB, 13.42 GB, 13.39 GB, 13.35 GB, 13.32 GB, 13.30 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.97 GB (14995638852) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.16 GB (86075700210) - RowsProduced: 279.78M (279776256) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m35s - TotalStorageWaitTime: 22m30s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 33.668ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 31.996ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s361ms - OpenTime: 33.669ms - ExecTreeOpenTime: 162.485us - PrepareTime: 212.758ms - ExecTreePrepareTime: 1.870ms KrpcDataStreamSender (dst_id=1):(Total: 4m37s, non-child: 4m37s, % non-child: 100.00%) - BytesSent: 36.71 GB (39417426192) - EosSent: 0 (0) - OverallThroughput: 135.25 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 279.78M (279775232) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m37s - UncompressedRowBatchSize: 72.12 GB (77436632019) HDFS_SCAN_NODE (id=0):(Total: 3s185ms, non-child: 3s185ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:20/4.95 GB 1:41/10.01 GB 5:29/7.18 GB 3:27/6.58 GB 4:19/4.63 GB 7:30/7.24 GB 2:34/8.26 GB 6:24/5.86 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.81 GB, 12.86 GB, 13.35 GB, 13.68 GB, 14.08 GB, 14.66 GB, 15.33 GB, 15.98 GB, 16.38 GB, 16.63 GB, 16.74 GB, 16.81 GB, 16.84 GB, 16.88 GB, 16.95 GB, 17.01 GB, 17.10 GB, 17.20 GB, 17.28 GB, 17.36 GB, 17.44 GB, 17.49 GB, 17.54 GB, 17.61 GB, 17.70 GB, 17.76 GB, 17.83 GB, 17.93 GB, 18.05 GB, 18.20 GB, 18.37 GB, 18.54 GB, 18.73 GB, 18.92 GB, 19.15 GB, 19.33 GB, 19.46 GB, 19.55 GB, 19.59 GB, 19.64 GB, 19.71 GB, 19.76 GB, 19.81 GB, 19.85 GB, 19.89 GB - FooterProcessingTime: (Avg: 3s613ms ; Min: 87.206ms ; Max: 10s778ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.93 GB (21396146973) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 49s994ms - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.96 GB (14992604870) - PerReadThreadRawHdfsThroughput: 56.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 279.99M (279989248) - RowsReturned: 279.78M (279776256) - RowsReturnedRate: 87.83 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s900ms - TotalRawHdfsReadTime(*): 6m4s - TotalReadThroughput: 6.96 MB/sec CodeGen:(Total: 33.156ms, non-child: 33.156ms, % non-child: 100.00%) - CodegenTime: 447.368us - CompileTime: 3.971ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.896ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 21.788ms Instance 844a0200d7876345:20bb38b900000074 (host=vd1115.foo.com:22000):(Total: 230.177ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:28/6.65 GB 1:30/7.30 GB 3:21/5.09 GB 0:31/7.60 GB 5:31/7.63 GB 6:30/7.38 GB 4:32/7.88 GB 2:21/5.12 GB Fragment Instance Lifecycle Event Timeline: 1s602ms - Prepare Finished: 193.387ms (193.387ms) - Open Finished: 230.849ms (37.462ms) - First Batch Produced: 1s599ms (1s368ms) - First Batch Sent: 1s602ms (2.329ms) MemoryUsage(1m4s): 7.29 GB, 13.92 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.91 GB, 13.89 GB, 13.88 GB, 13.86 GB, 13.85 GB, 13.83 GB, 13.80 GB, 13.79 GB, 13.76 GB, 13.74 GB, 13.72 GB, 13.68 GB, 13.67 GB, 13.61 GB, 13.55 GB, 13.51 GB, 13.45 GB, 13.40 GB, 13.35 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.98 GB (15011809734) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.22 GB (86136810920) - RowsProduced: 279.16M (279156736) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m5s - TotalStorageWaitTime: 28m58s - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 37.459ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 34.995ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s151ms - OpenTime: 37.460ms - ExecTreeOpenTime: 189.024us - PrepareTime: 192.594ms - ExecTreePrepareTime: 1.608ms KrpcDataStreamSender (dst_id=1):(Total: 4m35s, non-child: 4m35s, % non-child: 100.00%) - BytesSent: 36.63 GB (39327153824) - EosSent: 0 (0) - OverallThroughput: 136.24 MB/sec - PeakMemoryUsage: 3.59 MB (3760800) - RowsReturned: 279.16M (279155712) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m34s - UncompressedRowBatchSize: 71.96 GB (77264413525) HDFS_SCAN_NODE (id=0):(Total: 3s965ms, non-child: 3s965ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:28/6.65 GB 1:30/7.30 GB 3:21/5.09 GB 0:31/7.60 GB 5:31/7.63 GB 6:30/7.38 GB 4:32/7.88 GB 2:21/5.12 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.38 GB, 12.85 GB, 13.47 GB, 13.93 GB, 14.21 GB, 14.49 GB, 14.91 GB, 15.61 GB, 16.18 GB, 16.59 GB, 16.80 GB, 16.87 GB, 16.90 GB, 16.94 GB, 16.97 GB, 17.00 GB, 17.06 GB, 17.16 GB, 17.25 GB, 17.39 GB, 17.54 GB, 17.63 GB, 17.72 GB, 17.77 GB, 17.85 GB, 17.91 GB, 17.96 GB, 18.01 GB, 18.08 GB, 18.16 GB, 18.26 GB, 18.36 GB, 18.51 GB, 18.70 GB, 19.01 GB, 19.28 GB, 19.46 GB, 19.54 GB, 19.61 GB, 19.66 GB, 19.73 GB, 19.81 GB, 19.87 GB, 19.91 GB, 19.96 GB - FooterProcessingTime: (Avg: 4s819ms ; Min: 151.773ms ; Max: 14s821ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.99 GB (21461223173) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m11s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.98 GB (15008629989) - PerReadThreadRawHdfsThroughput: 41.09 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 279.37M (279369728) - RowsReturned: 279.16M (279156736) - RowsReturnedRate: 70.39 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s251ms - TotalRawHdfsReadTime(*): 8m18s - TotalReadThroughput: 6.99 MB/sec CodeGen:(Total: 36.971ms, non-child: 36.971ms, % non-child: 100.00%) - CodegenTime: 427.712us - CompileTime: 4.203ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.338ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 24.833ms Instance 844a0200d7876345:20bb38b90000000c (host=vd1116.foo.com:22000):(Total: 257.811ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:32/7.85 GB 4:27/6.60 GB 6:24/5.87 GB 0:40/9.79 GB 2:32/7.80 GB 5:23/5.58 GB 3:19/4.67 GB 7:27/6.68 GB Fragment Instance Lifecycle Event Timeline: 1s853ms - Prepare Finished: 225.506ms (225.506ms) - Open Finished: 258.254ms (32.748ms) - First Batch Produced: 1s851ms (1s593ms) - First Batch Sent: 1s853ms (1.728ms) MemoryUsage(1m4s): 8.51 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.92 GB, 13.89 GB, 13.87 GB, 13.86 GB, 13.85 GB, 13.84 GB, 13.83 GB, 13.79 GB, 13.75 GB, 13.72 GB, 13.70 GB, 13.67 GB, 13.64 GB, 13.60 GB, 13.55 GB, 13.52 GB, 13.46 GB, 13.41 GB, 13.38 GB, 13.33 GB, 13.29 GB, 13.26 GB, 13.22 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.95 GB (14981141277) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.77 GB (93164442443) - RowsProduced: 279.40M (279398400) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m35s - TotalStorageWaitTime: 22m53s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 32.744ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 29.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s590ms - OpenTime: 32.745ms - ExecTreeOpenTime: 192.835us - PrepareTime: 224.986ms - ExecTreePrepareTime: 1.985ms KrpcDataStreamSender (dst_id=1):(Total: 4m34s, non-child: 4m34s, % non-child: 100.00%) - BytesSent: 36.66 GB (39361442666) - EosSent: 0 (0) - OverallThroughput: 136.92 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 279.40M (279397376) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m33s - UncompressedRowBatchSize: 72.02 GB (77331811422) HDFS_SCAN_NODE (id=0):(Total: 3s418ms, non-child: 3s418ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:32/7.85 GB 4:27/6.60 GB 6:24/5.87 GB 0:40/9.79 GB 2:32/7.80 GB 5:23/5.58 GB 3:19/4.67 GB 7:27/6.68 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.50 GB, 12.85 GB, 13.33 GB, 13.69 GB, 14.12 GB, 14.66 GB, 15.36 GB, 16.11 GB, 16.49 GB, 16.69 GB, 16.77 GB, 16.81 GB, 16.86 GB, 16.91 GB, 16.95 GB, 17.02 GB, 17.09 GB, 17.16 GB, 17.28 GB, 17.37 GB, 17.44 GB, 17.48 GB, 17.51 GB, 17.58 GB, 17.67 GB, 17.77 GB, 17.85 GB, 17.95 GB, 18.06 GB, 18.18 GB, 18.33 GB, 18.49 GB, 18.67 GB, 18.90 GB, 19.15 GB, 19.33 GB, 19.42 GB, 19.47 GB, 19.53 GB, 19.58 GB, 19.64 GB, 19.71 GB, 19.77 GB, 19.81 GB, 19.85 GB - FooterProcessingTime: (Avg: 3s503ms ; Min: 134.741ms ; Max: 9s001ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.87 GB (21338374900) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2m22s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.95 GB (14977959820) - PerReadThreadRawHdfsThroughput: 46.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 279.61M (279611392) - RowsReturned: 279.40M (279398400) - RowsReturnedRate: 81.73 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s031ms - TotalRawHdfsReadTime(*): 7m13s - TotalReadThroughput: 6.95 MB/sec CodeGen:(Total: 32.193ms, non-child: 32.193ms, % non-child: 100.00%) - CodegenTime: 469.113us - CompileTime: 4.318ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.986ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 19.260ms Instance 844a0200d7876345:20bb38b900000003 (host=vd1117.foo.com:22000):(Total: 238.770ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:22/5.45 GB 1:26/6.40 GB 7:26/6.37 GB 4:21/5.16 GB 5:15/3.71 GB 2:36/8.45 GB 3:41/10.00 GB 0:37/9.04 GB Fragment Instance Lifecycle Event Timeline: 1s757ms - Prepare Finished: 206.417ms (206.417ms) - Open Finished: 239.289ms (32.872ms) - First Batch Produced: 1s755ms (1s516ms) - First Batch Sent: 1s757ms (1.868ms) MemoryUsage(1m4s): 8.28 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.98 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.93 GB, 13.91 GB, 13.87 GB, 13.85 GB, 13.83 GB, 13.81 GB, 13.76 GB, 13.73 GB, 13.69 GB, 13.64 GB, 13.58 GB, 13.53 GB, 13.47 GB, 13.43 GB, 13.40 GB, 13.37 GB, 13.37 GB, 13.36 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.99 GB (15017721437) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 87.04 GB (93460358592) - RowsProduced: 282.78M (282781696) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m37s - TotalStorageWaitTime: 23m17s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 32.869ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 30.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s005ms - OpenTime: 32.871ms - ExecTreeOpenTime: 158.900us - PrepareTime: 205.822ms - ExecTreePrepareTime: 1.797ms KrpcDataStreamSender (dst_id=1):(Total: 4m32s, non-child: 4m32s, % non-child: 100.00%) - BytesSent: 37.15 GB (39885788569) - EosSent: 0 (0) - OverallThroughput: 139.77 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 282.78M (282780672) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m31s - UncompressedRowBatchSize: 72.89 GB (78267837211) HDFS_SCAN_NODE (id=0):(Total: 3s816ms, non-child: 3s816ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:22/5.45 GB 1:26/6.40 GB 7:26/6.37 GB 4:21/5.16 GB 5:15/3.71 GB 2:36/8.45 GB 3:41/10.00 GB 0:37/9.04 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.26 GB, 12.84 GB, 13.35 GB, 13.70 GB, 14.08 GB, 14.62 GB, 15.41 GB, 16.08 GB, 16.48 GB, 16.68 GB, 16.78 GB, 16.82 GB, 16.87 GB, 16.90 GB, 16.95 GB, 17.03 GB, 17.14 GB, 17.26 GB, 17.35 GB, 17.42 GB, 17.46 GB, 17.52 GB, 17.61 GB, 17.67 GB, 17.74 GB, 17.84 GB, 17.93 GB, 18.03 GB, 18.15 GB, 18.28 GB, 18.48 GB, 18.73 GB, 18.96 GB, 19.17 GB, 19.32 GB, 19.43 GB, 19.56 GB, 19.64 GB, 19.70 GB, 19.77 GB, 19.81 GB, 19.86 GB, 19.90 GB, 19.94 GB, 19.96 GB - FooterProcessingTime: (Avg: 3s851ms ; Min: 109.330ms ; Max: 8s964ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 20.01 GB (21482339236) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m20s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.98 GB (15014613711) - PerReadThreadRawHdfsThroughput: 42.91 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 282.99M (282994688) - RowsReturned: 282.78M (282781696) - RowsReturnedRate: 74.09 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s360ms - TotalRawHdfsReadTime(*): 7m57s - TotalReadThroughput: 6.97 MB/sec CodeGen:(Total: 32.430ms, non-child: 32.430ms, % non-child: 100.00%) - CodegenTime: 428.631us - CompileTime: 4.231ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.819ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 20.829ms Instance 844a0200d7876345:20bb38b900000002 (host=vd1118.foo.com:22000):(Total: 241.749ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:30/7.32 GB 2:30/7.34 GB 5:30/7.38 GB 0:31/7.55 GB 6:29/7.03 GB 3:24/5.86 GB 7:20/4.95 GB 4:30/7.32 GB Fragment Instance Lifecycle Event Timeline: 1s597ms - Prepare Finished: 207.944ms (207.944ms) - Open Finished: 242.435ms (34.491ms) - First Batch Produced: 1s595ms (1s352ms) - First Batch Sent: 1s597ms (2.219ms) MemoryUsage(1m4s): 8.86 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.92 GB, 13.90 GB, 13.87 GB, 13.84 GB, 13.80 GB, 13.78 GB, 13.76 GB, 13.72 GB, 13.69 GB, 13.64 GB, 13.60 GB, 13.55 GB, 13.50 GB, 13.48 GB, 13.43 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.99 GB (15018395381) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.89 GB (93301263747) - RowsProduced: 271.24M (271238144) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m7s - TotalStorageWaitTime: 21m31s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 34.486ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 31.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s261ms - OpenTime: 34.487ms - ExecTreeOpenTime: 169.454us - PrepareTime: 207.183ms - ExecTreePrepareTime: 1.773ms KrpcDataStreamSender (dst_id=1):(Total: 4m41s, non-child: 4m41s, % non-child: 100.00%) - BytesSent: 35.61 GB (38234275440) - EosSent: 0 (0) - OverallThroughput: 129.32 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 271.24M (271237120) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m41s - UncompressedRowBatchSize: 69.92 GB (75073894245) HDFS_SCAN_NODE (id=0):(Total: 3s073ms, non-child: 3s073ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:30/7.32 GB 2:30/7.34 GB 5:30/7.38 GB 0:31/7.55 GB 6:29/7.03 GB 3:24/5.86 GB 7:20/4.95 GB 4:30/7.32 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.81 GB, 12.86 GB, 13.28 GB, 13.50 GB, 13.80 GB, 14.18 GB, 14.63 GB, 15.25 GB, 15.89 GB, 16.35 GB, 16.59 GB, 16.71 GB, 16.79 GB, 16.84 GB, 16.88 GB, 16.93 GB, 16.97 GB, 17.02 GB, 17.09 GB, 17.18 GB, 17.30 GB, 17.39 GB, 17.46 GB, 17.48 GB, 17.51 GB, 17.59 GB, 17.68 GB, 17.78 GB, 17.85 GB, 17.93 GB, 18.03 GB, 18.14 GB, 18.27 GB, 18.46 GB, 18.71 GB, 18.99 GB, 19.25 GB, 19.40 GB, 19.49 GB, 19.55 GB, 19.58 GB, 19.63 GB, 19.71 GB, 19.77 GB, 19.83 GB - FooterProcessingTime: (Avg: 3s472ms ; Min: 131.844ms ; Max: 7s502ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.92 GB (21383940950) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m8s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.98 GB (15015320427) - PerReadThreadRawHdfsThroughput: 51.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 271.45M (271451136) - RowsReturned: 271.24M (271238144) - RowsReturnedRate: 88.26 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s189ms - TotalRawHdfsReadTime(*): 6m38s - TotalReadThroughput: 6.98 MB/sec CodeGen:(Total: 33.991ms, non-child: 33.991ms, % non-child: 100.00%) - CodegenTime: 419.082us - CompileTime: 4.203ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.640ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 21.668ms Instance 844a0200d7876345:20bb38b900000075 (host=vd1119.foo.com:22000):(Total: 254.661ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:25/6.15 GB 2:21/5.16 GB 4:31/7.64 GB 0:28/6.68 GB 3:32/7.84 GB 7:35/8.52 GB 6:19/4.63 GB 1:34/8.26 GB Fragment Instance Lifecycle Event Timeline: 1s716ms - Prepare Finished: 222.966ms (222.966ms) - Open Finished: 255.361ms (32.394ms) - First Batch Produced: 1s714ms (1s459ms) - First Batch Sent: 1s716ms (1.823ms) MemoryUsage(1m4s): 7.09 GB, 13.82 GB, 13.91 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.92 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.89 GB, 13.88 GB, 13.87 GB, 13.82 GB, 13.80 GB, 13.79 GB, 13.77 GB, 13.75 GB, 13.73 GB, 13.70 GB, 13.67 GB, 13.64 GB, 13.59 GB, 13.57 GB, 13.55 GB, 13.52 GB, 13.47 GB, 13.42 GB, 13.38 GB, 13.33 GB, 13.27 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.93 GB (14962178662) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.00 GB (85895983011) - RowsProduced: 269.53M (269530112) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m54s - TotalStorageWaitTime: 30m38s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 32.388ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 28.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s216ms - OpenTime: 32.389ms - ExecTreeOpenTime: 131.165us - PrepareTime: 222.188ms - ExecTreePrepareTime: 2.122ms KrpcDataStreamSender (dst_id=1):(Total: 4m35s, non-child: 4m35s, % non-child: 100.00%) - BytesSent: 35.40 GB (38005428725) - EosSent: 0 (0) - OverallThroughput: 131.39 MB/sec - PeakMemoryUsage: 3.59 MB (3760800) - RowsReturned: 269.53M (269529088) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m35s - UncompressedRowBatchSize: 69.48 GB (74600661209) HDFS_SCAN_NODE (id=0):(Total: 3s031ms, non-child: 3s031ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:25/6.15 GB 2:21/5.16 GB 4:31/7.64 GB 0:28/6.68 GB 3:32/7.84 GB 7:35/8.52 GB 6:19/4.63 GB 1:34/8.26 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.21 GB, 12.79 GB, 13.30 GB, 13.71 GB, 14.01 GB, 14.22 GB, 14.49 GB, 14.88 GB, 15.37 GB, 15.89 GB, 16.26 GB, 16.52 GB, 16.69 GB, 16.81 GB, 16.88 GB, 16.90 GB, 16.91 GB, 16.98 GB, 17.03 GB, 17.11 GB, 17.20 GB, 17.28 GB, 17.40 GB, 17.50 GB, 17.60 GB, 17.69 GB, 17.74 GB, 17.79 GB, 17.85 GB, 17.90 GB, 17.93 GB, 17.96 GB, 18.06 GB, 18.18 GB, 18.36 GB, 18.52 GB, 18.73 GB, 18.91 GB, 19.07 GB, 19.19 GB, 19.29 GB, 19.39 GB, 19.48 GB, 19.54 GB, 19.59 GB - FooterProcessingTime: (Avg: 4s526ms ; Min: 93.185ms ; Max: 15s650ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.64 GB (21084244752) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m19s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.93 GB (14958999551) - PerReadThreadRawHdfsThroughput: 41.93 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 269.74M (269743104) - RowsReturned: 269.53M (269530112) - RowsReturnedRate: 88.92 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 11s817ms - TotalRawHdfsReadTime(*): 7m59s - TotalReadThroughput: 6.89 MB/sec CodeGen:(Total: 31.964ms, non-child: 31.964ms, % non-child: 100.00%) - CodegenTime: 408.948us - CompileTime: 3.980ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.458ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 21.061ms Instance 844a0200d7876345:20bb38b90000003f (host=vd1120.foo.com:22000):(Total: 217.199ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:27/6.65 GB 3:37/9.08 GB 4:34/8.38 GB 7:22/5.40 GB 5:34/8.26 GB 6:27/6.43 GB 2:22/5.36 GB 0:22/5.38 GB Fragment Instance Lifecycle Event Timeline: 1s976ms - Prepare Finished: 188.986ms (188.986ms) - Open Finished: 217.542ms (28.556ms) - First Batch Produced: 1s974ms (1s756ms) - First Batch Sent: 1s976ms (2.080ms) MemoryUsage(1m4s): 7.13 GB, 13.90 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.93 GB, 13.92 GB, 13.90 GB, 13.89 GB, 13.88 GB, 13.86 GB, 13.85 GB, 13.84 GB, 13.81 GB, 13.80 GB, 13.80 GB, 13.78 GB, 13.77 GB, 13.74 GB, 13.72 GB, 13.70 GB, 13.66 GB, 13.63 GB, 13.57 GB, 13.50 GB, 13.46 GB, 13.42 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.99 GB (15020274506) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.19 GB (86103239213) - RowsProduced: 274.83M (274825216) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m13s - TotalStorageWaitTime: 30m28s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 28.544ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 27.996ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s455ms - OpenTime: 28.555ms - ExecTreeOpenTime: 222.101us - PrepareTime: 188.571ms - ExecTreePrepareTime: 1.860ms KrpcDataStreamSender (dst_id=1):(Total: 4m29s, non-child: 4m29s, % non-child: 100.00%) - BytesSent: 36.07 GB (38734767212) - EosSent: 0 (0) - OverallThroughput: 137.28 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 274.82M (274824192) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m28s - UncompressedRowBatchSize: 70.84 GB (76066344044) HDFS_SCAN_NODE (id=0):(Total: 4s270ms, non-child: 4s270ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:27/6.65 GB 3:37/9.08 GB 4:34/8.38 GB 7:22/5.40 GB 5:34/8.26 GB 6:27/6.43 GB 2:22/5.36 GB 0:22/5.38 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.24 GB, 12.80 GB, 13.36 GB, 13.81 GB, 14.02 GB, 14.18 GB, 14.46 GB, 14.96 GB, 15.54 GB, 16.08 GB, 16.46 GB, 16.68 GB, 16.82 GB, 16.91 GB, 16.92 GB, 16.94 GB, 16.97 GB, 17.04 GB, 17.14 GB, 17.24 GB, 17.37 GB, 17.49 GB, 17.60 GB, 17.68 GB, 17.76 GB, 17.81 GB, 17.86 GB, 17.90 GB, 17.94 GB, 17.99 GB, 18.06 GB, 18.17 GB, 18.31 GB, 18.47 GB, 18.74 GB, 18.95 GB, 19.19 GB, 19.36 GB, 19.47 GB, 19.59 GB, 19.69 GB, 19.74 GB, 19.80 GB, 19.86 GB, 19.90 GB - FooterProcessingTime: (Avg: 5s598ms ; Min: 107.562ms ; Max: 15s515ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.93 GB (21403800459) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m30s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.99 GB (15017163960) - PerReadThreadRawHdfsThroughput: 42.97 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 275.04M (275038208) - RowsReturned: 274.83M (274825216) - RowsReturnedRate: 64.35 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s008ms - TotalRawHdfsReadTime(*): 7m55s - TotalReadThroughput: 6.98 MB/sec CodeGen:(Total: 28.030ms, non-child: 28.030ms, % non-child: 100.00%) - CodegenTime: 427.828us - CompileTime: 4.362ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.636ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 16.538ms Instance 844a0200d7876345:20bb38b900000062 (host=vd1121.foo.com:22000):(Total: 211.997ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:28/6.89 GB 3:31/7.67 GB 2:27/6.53 GB 7:25/6.11 GB 1:24/5.85 GB 0:32/7.92 GB 4:31/7.48 GB 6:24/5.90 GB Fragment Instance Lifecycle Event Timeline: 1s771ms - Prepare Finished: 177.869ms (177.869ms) - Open Finished: 212.490ms (34.620ms) - First Batch Produced: 1s769ms (1s556ms) - First Batch Sent: 1s771ms (2.066ms) MemoryUsage(1m4s): 8.31 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.01 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 14.00 GB, 13.99 GB, 13.98 GB, 13.95 GB, 13.92 GB, 13.89 GB, 13.88 GB, 13.85 GB, 13.83 GB, 13.80 GB, 13.77 GB, 13.75 GB, 13.70 GB, 13.67 GB, 13.62 GB, 13.57 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.01 GB (15041905612) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.52 GB (86456934902) - RowsProduced: 267.23M (267233280) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m52s - TotalStorageWaitTime: 24m33s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 34.612ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 32.995ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s420ms - OpenTime: 34.614ms - ExecTreeOpenTime: 155.980us - PrepareTime: 177.318ms - ExecTreePrepareTime: 1.865ms KrpcDataStreamSender (dst_id=1):(Total: 4m36s, non-child: 4m36s, % non-child: 100.00%) - BytesSent: 35.08 GB (37662006727) - EosSent: 0 (0) - OverallThroughput: 130.08 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 267.23M (267232256) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m35s - UncompressedRowBatchSize: 68.89 GB (73964729990) HDFS_SCAN_NODE (id=0):(Total: 3s225ms, non-child: 3s225ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:28/6.89 GB 3:31/7.67 GB 2:27/6.53 GB 7:25/6.11 GB 1:24/5.85 GB 0:32/7.92 GB 4:31/7.48 GB 6:24/5.90 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.27 GB, 12.78 GB, 13.12 GB, 13.44 GB, 13.66 GB, 13.95 GB, 14.31 GB, 14.87 GB, 15.51 GB, 16.12 GB, 16.47 GB, 16.66 GB, 16.77 GB, 16.83 GB, 16.85 GB, 16.88 GB, 16.93 GB, 16.95 GB, 17.01 GB, 17.09 GB, 17.19 GB, 17.28 GB, 17.39 GB, 17.48 GB, 17.53 GB, 17.57 GB, 17.64 GB, 17.70 GB, 17.78 GB, 17.84 GB, 17.94 GB, 18.04 GB, 18.11 GB, 18.23 GB, 18.47 GB, 18.75 GB, 19.06 GB, 19.27 GB, 19.41 GB, 19.51 GB, 19.58 GB, 19.64 GB, 19.69 GB, 19.75 GB, 19.82 GB - FooterProcessingTime: (Avg: 4s096ms ; Min: 112.162ms ; Max: 9s955ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.91 GB (21381188139) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m44s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 14.01 GB (15038806050) - PerReadThreadRawHdfsThroughput: 44.05 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 267.45M (267446272) - RowsReturned: 267.23M (267233280) - RowsReturnedRate: 82.85 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 11s303ms - TotalRawHdfsReadTime(*): 7m42s - TotalReadThroughput: 6.93 MB/sec CodeGen:(Total: 34.084ms, non-child: 34.084ms, % non-child: 100.00%) - CodegenTime: 485.213us - CompileTime: 5.030ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.700ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 19.804ms Instance 844a0200d7876345:20bb38b90000006e (host=vd1122.foo.com:22000):(Total: 272.465ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:29/7.01 GB 1:29/7.10 GB 6:32/7.92 GB 3:20/4.91 GB 7:30/7.38 GB 5:31/7.59 GB 2:32/7.66 GB 0:22/5.38 GB Fragment Instance Lifecycle Event Timeline: 1s216ms - Prepare Finished: 239.757ms (239.757ms) - Open Finished: 273.258ms (33.500ms) - First Batch Produced: 1s214ms (941.514ms) - First Batch Sent: 1s216ms (2.149ms) MemoryUsage(1m4s): 7.84 GB, 13.76 GB, 13.86 GB, 13.86 GB, 13.86 GB, 13.90 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.99 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.96 GB, 13.93 GB, 13.91 GB, 13.90 GB, 13.90 GB, 13.87 GB, 13.85 GB, 13.83 GB, 13.82 GB, 13.80 GB, 13.78 GB, 13.74 GB, 13.72 GB, 13.69 GB, 13.66 GB, 13.60 GB, 13.54 GB, 13.51 GB, 13.46 GB, 13.43 GB, 13.41 GB, 13.40 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.99 GB (15019503427) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.22 GB (86139414649) - RowsProduced: 281.09M (281087815) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m17s - TotalStorageWaitTime: 27m1s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 33.489ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 29.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 2s534ms - OpenTime: 33.490ms - ExecTreeOpenTime: 197.285us - PrepareTime: 238.878ms - ExecTreePrepareTime: 1.786ms KrpcDataStreamSender (dst_id=1):(Total: 4m31s, non-child: 4m31s, % non-child: 100.00%) - BytesSent: 36.86 GB (39577063453) - EosSent: 0 (0) - OverallThroughput: 139.12 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 281.09M (281086791) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m30s - UncompressedRowBatchSize: 72.46 GB (77799533923) HDFS_SCAN_NODE (id=0):(Total: 2s361ms, non-child: 2s361ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:29/7.01 GB 1:29/7.10 GB 6:32/7.92 GB 3:20/4.91 GB 7:30/7.38 GB 5:31/7.59 GB 2:32/7.66 GB 0:22/5.38 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.89 GB, 12.70 GB, 13.37 GB, 13.77 GB, 14.11 GB, 14.61 GB, 15.26 GB, 15.93 GB, 16.28 GB, 16.64 GB, 16.74 GB, 16.83 GB, 16.90 GB, 16.94 GB, 16.97 GB, 17.04 GB, 17.15 GB, 17.24 GB, 17.38 GB, 17.48 GB, 17.51 GB, 17.58 GB, 17.69 GB, 17.76 GB, 17.82 GB, 17.87 GB, 17.97 GB, 18.04 GB, 18.13 GB, 18.28 GB, 18.48 GB, 18.64 GB, 18.84 GB, 19.09 GB, 19.30 GB, 19.38 GB, 19.46 GB, 19.59 GB, 19.71 GB, 19.79 GB, 19.84 GB, 19.88 GB, 19.93 GB, 19.95 GB, 19.99 GB - FooterProcessingTime: (Avg: 4s505ms ; Min: 119.386ms ; Max: 13s287ms ; Number of samples: 89) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 20.03 GB (21505694570) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m17s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 89 (89) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.99 GB (15016367306) - PerReadThreadRawHdfsThroughput: 44.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 281.30M (281300807) - RowsReturned: 281.09M (281087815) - RowsReturnedRate: 119.03 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 551.508ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 11s081ms - TotalRawHdfsReadTime(*): 7m38s - TotalReadThroughput: 7.02 MB/sec CodeGen:(Total: 33.020ms, non-child: 33.020ms, % non-child: 100.00%) - CodegenTime: 457.837us - CompileTime: 4.321ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.790ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 20.406ms Instance 844a0200d7876345:20bb38b90000002d (host=vd1123.foo.com:22000):(Total: 208.976ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:29/6.83 GB 3:30/7.35 GB 5:26/6.39 GB 2:24/5.91 GB 6:23/5.62 GB 4:34/8.27 GB 0:26/6.29 GB 7:33/7.98 GB Fragment Instance Lifecycle Event Timeline: 1s972ms - Prepare Finished: 174.250ms (174.250ms) - Open Finished: 209.692ms (35.441ms) - First Batch Produced: 1s970ms (1s760ms) - First Batch Sent: 1s972ms (2.076ms) MemoryUsage(1m4s): 8.52 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.91 GB, 13.90 GB, 13.90 GB, 13.89 GB, 13.88 GB, 13.87 GB, 13.86 GB, 13.84 GB, 13.81 GB, 13.79 GB, 13.76 GB, 13.73 GB, 13.68 GB, 13.64 GB, 13.60 GB, 13.55 GB, 13.50 GB, 13.45 GB, 13.39 GB, 13.33 GB, 13.30 GB, 13.26 GB, 13.24 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.96 GB (14986673088) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.86 GB (93261022934) - RowsProduced: 277.81M (277814272) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m52s - TotalStorageWaitTime: 23m5s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 35.437ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 32.995ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s622ms - OpenTime: 35.439ms - ExecTreeOpenTime: 172.253us - PrepareTime: 173.427ms - ExecTreePrepareTime: 2.064ms KrpcDataStreamSender (dst_id=1):(Total: 4m35s, non-child: 4m35s, % non-child: 100.00%) - BytesSent: 36.47 GB (39162607020) - EosSent: 0 (0) - OverallThroughput: 135.39 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 277.81M (277813248) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m35s - UncompressedRowBatchSize: 71.61 GB (76893545845) HDFS_SCAN_NODE (id=0):(Total: 3s445ms, non-child: 3s445ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:29/6.83 GB 3:30/7.35 GB 5:26/6.39 GB 2:24/5.91 GB 6:23/5.62 GB 4:34/8.27 GB 0:26/6.29 GB 7:33/7.98 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.50 GB, 12.85 GB, 13.35 GB, 13.71 GB, 14.11 GB, 14.60 GB, 15.28 GB, 15.97 GB, 16.37 GB, 16.61 GB, 16.73 GB, 16.79 GB, 16.83 GB, 16.87 GB, 16.92 GB, 16.98 GB, 17.05 GB, 17.15 GB, 17.23 GB, 17.33 GB, 17.41 GB, 17.44 GB, 17.50 GB, 17.58 GB, 17.66 GB, 17.72 GB, 17.80 GB, 17.89 GB, 17.98 GB, 18.08 GB, 18.23 GB, 18.43 GB, 18.65 GB, 18.83 GB, 19.05 GB, 19.23 GB, 19.36 GB, 19.45 GB, 19.52 GB, 19.56 GB, 19.64 GB, 19.70 GB, 19.74 GB, 19.78 GB, 19.81 GB - FooterProcessingTime: (Avg: 4s478ms ; Min: 115.908ms ; Max: 8s680ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.87 GB (21334313477) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m49s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.95 GB (14983483446) - PerReadThreadRawHdfsThroughput: 47.32 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 278.03M (278027264) - RowsReturned: 277.81M (277814272) - RowsReturnedRate: 80.62 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s232ms - TotalRawHdfsReadTime(*): 7m9s - TotalReadThroughput: 6.93 MB/sec CodeGen:(Total: 34.942ms, non-child: 34.942ms, % non-child: 100.00%) - CodegenTime: 441.757us - CompileTime: 4.211ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 9.364ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 20.850ms Instance 844a0200d7876345:20bb38b900000030 (host=vd1124.foo.com:22000):(Total: 204.156ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:29/7.14 GB 2:37/9.12 GB 4:30/7.34 GB 6:25/6.15 GB 5:23/5.57 GB 0:33/8.09 GB 3:24/5.84 GB 7:23/5.52 GB Fragment Instance Lifecycle Event Timeline: 1s807ms - Prepare Finished: 167.801ms (167.801ms) - Open Finished: 204.644ms (36.842ms) - First Batch Produced: 1s805ms (1s600ms) - First Batch Sent: 1s807ms (2.106ms) MemoryUsage(1m4s): 8.36 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.94 GB, 13.92 GB, 13.91 GB, 13.89 GB, 13.86 GB, 13.83 GB, 13.81 GB, 13.77 GB, 13.74 GB, 13.71 GB, 13.68 GB, 13.65 GB, 13.61 GB, 13.56 GB, 13.51 GB, 13.45 GB, 13.40 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.98 GB (15008623305) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 86.91 GB (93314709332) - RowsProduced: 273.31M (273307648) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m9s - TotalStorageWaitTime: 24m5s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 36.840ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 33.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s505ms - OpenTime: 36.841ms - ExecTreeOpenTime: 249.724us - PrepareTime: 167.240ms - ExecTreePrepareTime: 2.122ms KrpcDataStreamSender (dst_id=1):(Total: 4m32s, non-child: 4m32s, % non-child: 100.00%) - BytesSent: 35.86 GB (38499839068) - EosSent: 0 (0) - OverallThroughput: 134.79 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 273.31M (273306624) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m31s - UncompressedRowBatchSize: 70.45 GB (75645839694) HDFS_SCAN_NODE (id=0):(Total: 3s319ms, non-child: 3s319ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:29/7.14 GB 2:37/9.12 GB 4:30/7.34 GB 6:25/6.15 GB 5:23/5.57 GB 0:33/8.09 GB 3:24/5.84 GB 7:23/5.52 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.36 GB, 12.86 GB, 13.27 GB, 13.55 GB, 13.83 GB, 14.16 GB, 14.60 GB, 15.30 GB, 15.87 GB, 16.39 GB, 16.58 GB, 16.71 GB, 16.80 GB, 16.85 GB, 16.90 GB, 16.95 GB, 17.00 GB, 17.04 GB, 17.11 GB, 17.23 GB, 17.36 GB, 17.42 GB, 17.48 GB, 17.54 GB, 17.60 GB, 17.68 GB, 17.75 GB, 17.83 GB, 17.90 GB, 17.99 GB, 18.10 GB, 18.23 GB, 18.34 GB, 18.54 GB, 18.87 GB, 19.06 GB, 19.23 GB, 19.38 GB, 19.48 GB, 19.55 GB, 19.61 GB, 19.68 GB, 19.73 GB, 19.80 GB, 19.85 GB - FooterProcessingTime: (Avg: 3s941ms ; Min: 135.225ms ; Max: 8s584ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.91 GB (21380763920) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m28s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.97 GB (15005294427) - PerReadThreadRawHdfsThroughput: 48.87 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 273.52M (273520640) - RowsReturned: 273.31M (273307648) - RowsReturnedRate: 82.33 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s074ms - TotalRawHdfsReadTime(*): 6m57s - TotalReadThroughput: 6.97 MB/sec CodeGen:(Total: 36.208ms, non-child: 36.208ms, % non-child: 100.00%) - CodegenTime: 487.960us - CompileTime: 4.552ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.427ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.710ms Instance 844a0200d7876345:20bb38b900000033 (host=vd1125.foo.com:22000):(Total: 251.345ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:24/5.69 GB 4:37/9.01 GB 5:17/4.21 GB 6:22/5.37 GB 7:36/8.84 GB 2:31/7.55 GB 0:32/7.85 GB 3:25/6.19 GB Fragment Instance Lifecycle Event Timeline: 1s514ms - Prepare Finished: 216.816ms (216.816ms) - Open Finished: 251.820ms (35.004ms) - First Batch Produced: 1s512ms (1s261ms) - First Batch Sent: 1s514ms (2.064ms) MemoryUsage(1m4s): 8.30 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.98 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.97 GB, 13.96 GB, 13.96 GB, 13.96 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.95 GB, 13.94 GB, 13.94 GB, 13.94 GB, 13.93 GB, 13.92 GB, 13.91 GB, 13.89 GB, 13.88 GB, 13.85 GB, 13.82 GB, 13.77 GB, 13.74 GB, 13.71 GB, 13.69 GB, 13.67 GB, 13.63 GB, 13.59 GB, 13.56 GB, 13.49 GB ThreadUsage(1m4s): 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 89.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.98 GB (15009822272) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.25 GB (86166158496) - RowsProduced: 266.41M (266414080) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m7s - TotalStorageWaitTime: 24m28s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 34.993ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 34.995ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s059ms - OpenTime: 34.994ms - ExecTreeOpenTime: 165.482us - PrepareTime: 216.273ms - ExecTreePrepareTime: 2.048ms KrpcDataStreamSender (dst_id=1):(Total: 4m39s, non-child: 4m39s, % non-child: 100.00%) - BytesSent: 34.97 GB (37552525385) - EosSent: 0 (0) - OverallThroughput: 127.90 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 266.41M (266413056) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m39s - UncompressedRowBatchSize: 68.67 GB (73737577418) HDFS_SCAN_NODE (id=0):(Total: 3s846ms, non-child: 3s846ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:24/5.69 GB 4:37/9.01 GB 5:17/4.21 GB 6:22/5.37 GB 7:36/8.84 GB 2:31/7.55 GB 0:32/7.85 GB 3:25/6.19 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.29 GB, 12.79 GB, 13.18 GB, 13.50 GB, 13.69 GB, 13.97 GB, 14.29 GB, 14.68 GB, 15.21 GB, 15.80 GB, 16.26 GB, 16.50 GB, 16.69 GB, 16.78 GB, 16.82 GB, 16.86 GB, 16.90 GB, 16.93 GB, 16.97 GB, 17.06 GB, 17.15 GB, 17.25 GB, 17.35 GB, 17.45 GB, 17.52 GB, 17.55 GB, 17.61 GB, 17.66 GB, 17.74 GB, 17.83 GB, 17.91 GB, 18.00 GB, 18.09 GB, 18.19 GB, 18.35 GB, 18.56 GB, 18.84 GB, 19.07 GB, 19.28 GB, 19.42 GB, 19.49 GB, 19.53 GB, 19.59 GB, 19.63 GB, 19.70 GB - FooterProcessingTime: (Avg: 3s989ms ; Min: 119.551ms ; Max: 14s102ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.78 GB (21234603638) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m11s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.98 GB (15006757825) - PerReadThreadRawHdfsThroughput: 46.30 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 266.63M (266627072) - RowsReturned: 266.41M (266414080) - RowsReturnedRate: 69.26 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s473ms - TotalRawHdfsReadTime(*): 7m17s - TotalReadThroughput: 6.93 MB/sec CodeGen:(Total: 34.485ms, non-child: 34.485ms, % non-child: 100.00%) - CodegenTime: 446.872us - CompileTime: 4.506ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.581ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 21.851ms Instance 844a0200d7876345:20bb38b90000007b (host=vd1126.foo.com:22000):(Total: 246.075ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:23/5.63 GB 6:22/5.32 GB 0:31/7.59 GB 5:29/7.10 GB 7:32/7.89 GB 1:27/6.55 GB 3:31/7.52 GB 4:29/7.11 GB Fragment Instance Lifecycle Event Timeline: 1s961ms - Prepare Finished: 210.517ms (210.517ms) - Open Finished: 246.788ms (36.271ms) - First Batch Produced: 1s959ms (1s712ms) - First Batch Sent: 1s961ms (1.976ms) MemoryUsage(1m4s): 7.45 GB, 13.92 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.93 GB, 13.94 GB, 13.93 GB, 13.93 GB, 13.92 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.91 GB, 13.90 GB, 13.90 GB, 13.90 GB, 13.89 GB, 13.88 GB, 13.88 GB, 13.88 GB, 13.88 GB, 13.88 GB, 13.87 GB, 13.85 GB, 13.84 GB, 13.81 GB, 13.81 GB, 13.79 GB, 13.78 GB, 13.72 GB, 13.68 GB, 13.64 GB, 13.60 GB, 13.57 GB, 13.53 GB, 13.50 GB, 13.43 GB, 13.38 GB, 13.31 GB ThreadUsage(1m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.94 GB (14966092585) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 80.14 GB (86044700640) - RowsProduced: 272.72M (272720896) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m10s - TotalStorageWaitTime: 26m30s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 36.267ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 33.995ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s963ms - OpenTime: 36.268ms - ExecTreeOpenTime: 138.313us - PrepareTime: 209.684ms - ExecTreePrepareTime: 1.757ms KrpcDataStreamSender (dst_id=1):(Total: 4m37s, non-child: 4m37s, % non-child: 100.00%) - BytesSent: 35.81 GB (38451690194) - EosSent: 0 (0) - OverallThroughput: 132.01 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 272.72M (272719872) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m37s - UncompressedRowBatchSize: 70.30 GB (75483893232) HDFS_SCAN_NODE (id=0):(Total: 3s787ms, non-child: 3s787ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:23/5.63 GB 6:22/5.32 GB 0:31/7.59 GB 5:29/7.10 GB 7:32/7.89 GB 1:27/6.55 GB 3:31/7.52 GB 4:29/7.11 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.49 GB, 12.83 GB, 13.26 GB, 13.63 GB, 13.83 GB, 14.10 GB, 14.48 GB, 15.12 GB, 15.76 GB, 16.28 GB, 16.54 GB, 16.67 GB, 16.75 GB, 16.78 GB, 16.81 GB, 16.87 GB, 16.94 GB, 16.97 GB, 17.02 GB, 17.12 GB, 17.23 GB, 17.34 GB, 17.45 GB, 17.54 GB, 17.58 GB, 17.64 GB, 17.69 GB, 17.71 GB, 17.77 GB, 17.84 GB, 17.97 GB, 18.09 GB, 18.19 GB, 18.32 GB, 18.58 GB, 18.82 GB, 19.08 GB, 19.26 GB, 19.39 GB, 19.46 GB, 19.53 GB, 19.57 GB, 19.64 GB, 19.70 GB, 19.74 GB - FooterProcessingTime: (Avg: 4s408ms ; Min: 89.509ms ; Max: 17s106ms ; Number of samples: 88) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 88.00 - BytesRead: 19.79 GB (21244917163) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m27s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 88 (88) - NumScannerThreadsStarted: 88 (88) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.94 GB (14963034373) - PerReadThreadRawHdfsThroughput: 40.19 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 272.93M (272933888) - RowsReturned: 272.72M (272720896) - RowsReturnedRate: 72.00 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s860ms - TotalRawHdfsReadTime(*): 8m24s - TotalReadThroughput: 6.92 MB/sec CodeGen:(Total: 35.830ms, non-child: 35.830ms, % non-child: 100.00%) - CodegenTime: 407.698us - CompileTime: 4.301ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.466ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 23.495ms Instance 844a0200d7876345:20bb38b900000037 (host=vd1127.foo.com:22000):(Total: 252.165ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:30/7.31 GB 1:25/6.06 GB 7:29/7.06 GB 5:27/6.54 GB 3:28/6.84 GB 2:28/6.79 GB 4:25/6.08 GB 6:33/8.02 GB Fragment Instance Lifecycle Event Timeline: 1s874ms - Prepare Finished: 219.564ms (219.564ms) - Open Finished: 252.901ms (33.336ms) - First Batch Produced: 1s873ms (1s620ms) - First Batch Sent: 1s874ms (1.207ms) MemoryUsage(1m4s): 7.42 GB, 12.67 GB, 12.67 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.67 GB, 12.66 GB, 12.63 GB, 12.62 GB, 12.60 GB, 12.56 GB, 12.55 GB, 12.51 GB, 12.49 GB, 12.47 GB, 12.42 GB, 12.38 GB, 12.30 GB, 12.24 GB, 12.17 GB, 12.12 GB, 12.09 GB, 12.07 GB, 12.05 GB, 12.03 GB, 12.02 GB, 12.02 GB, 12.01 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.69 GB (13626259969) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.90 GB (84714370196) - RowsProduced: 270.89M (270887936) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m7s - TotalStorageWaitTime: 23m52s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 33.327ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 31.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s368ms - OpenTime: 33.328ms - ExecTreeOpenTime: 165.839us - PrepareTime: 218.755ms - ExecTreePrepareTime: 2.013ms KrpcDataStreamSender (dst_id=1):(Total: 4m39s, non-child: 4m39s, % non-child: 100.00%) - BytesSent: 35.52 GB (38139083733) - EosSent: 0 (0) - OverallThroughput: 130.03 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 270.89M (270886912) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m39s - UncompressedRowBatchSize: 69.83 GB (74976276242) HDFS_SCAN_NODE (id=0):(Total: 3s164ms, non-child: 3s164ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:30/7.31 GB 1:25/6.06 GB 7:29/7.06 GB 5:27/6.54 GB 3:28/6.84 GB 2:28/6.79 GB 4:25/6.08 GB 6:33/8.02 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.55 GB, 11.81 GB, 12.35 GB, 12.71 GB, 13.03 GB, 13.46 GB, 14.05 GB, 14.61 GB, 15.00 GB, 15.20 GB, 15.32 GB, 15.36 GB, 15.39 GB, 15.44 GB, 15.53 GB, 15.61 GB, 15.74 GB, 15.82 GB, 15.91 GB, 16.02 GB, 16.11 GB, 16.16 GB, 16.23 GB, 16.32 GB, 16.39 GB, 16.49 GB, 16.59 GB, 16.71 GB, 16.87 GB, 17.05 GB, 17.24 GB, 17.40 GB, 17.56 GB, 17.68 GB, 17.80 GB, 17.88 GB, 17.94 GB, 18.00 GB, 18.05 GB, 18.08 GB, 18.12 GB, 18.15 GB, 18.17 GB, 18.22 GB, 18.25 GB - FooterProcessingTime: (Avg: 4s513ms ; Min: 160.088ms ; Max: 14s689ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.31 GB (19662929783) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m4s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.69 GB (13623135795) - PerReadThreadRawHdfsThroughput: 44.78 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 271.09M (271092736) - RowsReturned: 270.89M (270887936) - RowsReturnedRate: 85.60 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s827ms - TotalRawHdfsReadTime(*): 6m58s - TotalReadThroughput: 6.39 MB/sec CodeGen:(Total: 32.831ms, non-child: 32.831ms, % non-child: 100.00%) - CodegenTime: 446.089us - CompileTime: 4.402ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.503ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 20.338ms Instance 844a0200d7876345:20bb38b900000028 (host=vd1129.foo.com:22000):(Total: 264.990ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/6.86 GB 7:18/4.41 GB 4:22/5.40 GB 1:27/6.68 GB 3:24/5.91 GB 6:32/7.80 GB 5:35/8.35 GB 0:37/9.13 GB Fragment Instance Lifecycle Event Timeline: 1s723ms - Prepare Finished: 227.536ms (227.536ms) - Open Finished: 265.409ms (37.872ms) - First Batch Produced: 1s721ms (1s456ms) - First Batch Sent: 1s723ms (2.076ms) MemoryUsage(1m4s): 7.40 GB, 12.71 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.75 GB, 12.75 GB, 12.75 GB, 12.76 GB, 12.76 GB, 12.76 GB, 12.76 GB, 12.76 GB, 12.75 GB, 12.75 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.73 GB, 12.72 GB, 12.71 GB, 12.69 GB, 12.68 GB, 12.66 GB, 12.65 GB, 12.63 GB, 12.60 GB, 12.58 GB, 12.55 GB, 12.51 GB, 12.47 GB, 12.42 GB, 12.36 GB, 12.31 GB, 12.28 GB, 12.26 GB, 12.24 GB, 12.22 GB, 12.22 GB, 12.22 GB, 12.22 GB, 12.19 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.76 GB (13697965197) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.69 GB (92007291992) - RowsProduced: 273.47M (273474560) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m43s - TotalStorageWaitTime: 23m19s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 37.863ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 34.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 6s173ms - OpenTime: 37.872ms - ExecTreeOpenTime: 170.973us - PrepareTime: 227.045ms - ExecTreePrepareTime: 2.092ms KrpcDataStreamSender (dst_id=1):(Total: 4m40s, non-child: 4m40s, % non-child: 100.00%) - BytesSent: 35.93 GB (38577628184) - EosSent: 0 (0) - OverallThroughput: 130.93 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 273.47M (273473536) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m40s - UncompressedRowBatchSize: 70.49 GB (75692116319) HDFS_SCAN_NODE (id=0):(Total: 5s977ms, non-child: 5s977ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:28/6.86 GB 7:18/4.41 GB 4:22/5.40 GB 1:27/6.68 GB 3:24/5.91 GB 6:32/7.80 GB 5:35/8.35 GB 0:37/9.13 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.51 GB, 11.81 GB, 12.40 GB, 12.80 GB, 13.20 GB, 13.76 GB, 14.35 GB, 14.89 GB, 15.15 GB, 15.33 GB, 15.42 GB, 15.46 GB, 15.50 GB, 15.56 GB, 15.64 GB, 15.76 GB, 15.84 GB, 15.95 GB, 16.04 GB, 16.12 GB, 16.17 GB, 16.23 GB, 16.35 GB, 16.46 GB, 16.58 GB, 16.70 GB, 16.86 GB, 17.05 GB, 17.23 GB, 17.41 GB, 17.53 GB, 17.65 GB, 17.84 GB, 17.96 GB, 18.05 GB, 18.11 GB, 18.17 GB, 18.23 GB, 18.28 GB, 18.31 GB, 18.36 GB, 18.39 GB, 18.42 GB, 18.47 GB, 18.53 GB - FooterProcessingTime: (Avg: 4s169ms ; Min: 173.592ms ; Max: 13s303ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.60 GB (19969188085) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m43s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.75 GB (13694998612) - PerReadThreadRawHdfsThroughput: 44.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 273.68M (273679360) - RowsReturned: 273.47M (273474560) - RowsReturnedRate: 45.75 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s622ms - TotalRawHdfsReadTime(*): 7m12s - TotalReadThroughput: 6.51 MB/sec CodeGen:(Total: 37.245ms, non-child: 37.245ms, % non-child: 100.00%) - CodegenTime: 557.650us - CompileTime: 4.279ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.665ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 24.475ms Instance 844a0200d7876345:20bb38b90000007e (host=vd1130.foo.com:22000):(Total: 244.232ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:25/6.19 GB 3:39/9.58 GB 1:32/7.76 GB 6:33/8.13 GB 4:16/3.93 GB 5:24/5.82 GB 7:27/6.63 GB 2:29/6.95 GB Fragment Instance Lifecycle Event Timeline: 1s939ms - Prepare Finished: 207.911ms (207.911ms) - Open Finished: 244.727ms (36.816ms) - First Batch Produced: 1s937ms (1s692ms) - First Batch Sent: 1s939ms (2.300ms) MemoryUsage(1m4s): 7.67 GB, 12.72 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.73 GB, 12.72 GB, 12.71 GB, 12.71 GB, 12.70 GB, 12.69 GB, 12.68 GB, 12.64 GB, 12.61 GB, 12.59 GB, 12.56 GB, 12.55 GB, 12.51 GB, 12.47 GB, 12.43 GB, 12.38 GB, 12.35 GB, 12.32 GB, 12.25 GB, 12.23 GB, 12.22 GB, 12.21 GB, 12.20 GB, 12.20 GB, 12.18 GB, 12.18 GB, 12.17 GB, 12.15 GB, 12.14 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.75 GB (13685338184) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.04 GB (84864361396) - RowsProduced: 281.90M (281903104) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m24s - TotalStorageWaitTime: 22m10s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 36.813ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 34.995ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s690ms - OpenTime: 36.815ms - ExecTreeOpenTime: 153.290us - PrepareTime: 207.344ms - ExecTreePrepareTime: 1.780ms KrpcDataStreamSender (dst_id=1):(Total: 4m30s, non-child: 4m30s, % non-child: 100.00%) - BytesSent: 37.02 GB (39745129875) - EosSent: 0 (0) - OverallThroughput: 139.88 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 281.90M (281902080) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m30s - UncompressedRowBatchSize: 72.67 GB (78024546865) HDFS_SCAN_NODE (id=0):(Total: 3s508ms, non-child: 3s508ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:25/6.19 GB 3:39/9.58 GB 1:32/7.76 GB 6:33/8.13 GB 4:16/3.93 GB 5:24/5.82 GB 7:27/6.63 GB 2:29/6.95 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.74 GB, 11.79 GB, 12.28 GB, 12.82 GB, 13.40 GB, 14.10 GB, 14.71 GB, 15.13 GB, 15.30 GB, 15.41 GB, 15.45 GB, 15.51 GB, 15.59 GB, 15.67 GB, 15.81 GB, 15.86 GB, 15.92 GB, 16.02 GB, 16.12 GB, 16.24 GB, 16.33 GB, 16.40 GB, 16.53 GB, 16.70 GB, 16.88 GB, 17.02 GB, 17.27 GB, 17.49 GB, 17.61 GB, 17.70 GB, 17.80 GB, 17.92 GB, 18.01 GB, 18.07 GB, 18.16 GB, 18.21 GB, 18.25 GB, 18.29 GB, 18.34 GB, 18.39 GB, 18.42 GB, 18.45 GB, 18.52 GB, 18.59 GB, 18.63 GB - FooterProcessingTime: (Avg: 3s669ms ; Min: 82.408ms ; Max: 11s109ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.67 GB (20046020151) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m12s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.74 GB (13682230126) - PerReadThreadRawHdfsThroughput: 42.93 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 282.11M (282107904) - RowsReturned: 281.90M (281903104) - RowsReturnedRate: 80.36 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s596ms - TotalRawHdfsReadTime(*): 7m25s - TotalReadThroughput: 6.52 MB/sec CodeGen:(Total: 36.161ms, non-child: 36.161ms, % non-child: 100.00%) - CodegenTime: 741.147us - CompileTime: 4.318ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.712ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.790ms Instance 844a0200d7876345:20bb38b90000007a (host=vd1131.foo.com:22000):(Total: 245.468ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:23/5.46 GB 3:34/8.33 GB 6:30/7.28 GB 4:32/7.81 GB 7:33/8.06 GB 2:21/5.16 GB 5:23/5.63 GB 0:28/6.89 GB Fragment Instance Lifecycle Event Timeline: 1s821ms - Prepare Finished: 214.787ms (214.787ms) - Open Finished: 246.056ms (31.269ms) - First Batch Produced: 1s819ms (1s573ms) - First Batch Sent: 1s821ms (2.128ms) MemoryUsage(1m4s): 7.92 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.70 GB, 12.70 GB, 12.68 GB, 12.67 GB, 12.66 GB, 12.66 GB, 12.63 GB, 12.60 GB, 12.57 GB, 12.53 GB, 12.51 GB, 12.47 GB, 12.43 GB, 12.36 GB, 12.29 GB, 12.24 GB, 12.19 GB, 12.17 GB, 12.15 GB, 12.15 GB, 12.15 GB, 12.14 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.72 GB (13654700423) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.89 GB (84711583941) - RowsProduced: 261.60M (261599232) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m11s - TotalStorageWaitTime: 20m22s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 31.266ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 31.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s248ms - OpenTime: 31.268ms - ExecTreeOpenTime: 299.119us - PrepareTime: 214.124ms - ExecTreePrepareTime: 1.831ms KrpcDataStreamSender (dst_id=1):(Total: 4m36s, non-child: 4m36s, % non-child: 100.00%) - BytesSent: 34.34 GB (36871673767) - EosSent: 0 (0) - OverallThroughput: 127.01 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 261.60M (261598208) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m36s - UncompressedRowBatchSize: 67.43 GB (72405314461) HDFS_SCAN_NODE (id=0):(Total: 3s058ms, non-child: 3s058ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:23/5.46 GB 3:34/8.33 GB 6:30/7.28 GB 4:32/7.81 GB 7:33/8.06 GB 2:21/5.16 GB 5:23/5.63 GB 0:28/6.89 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.96 GB, 11.62 GB, 12.05 GB, 12.24 GB, 12.47 GB, 12.84 GB, 13.31 GB, 14.11 GB, 14.71 GB, 15.09 GB, 15.21 GB, 15.25 GB, 15.30 GB, 15.34 GB, 15.39 GB, 15.44 GB, 15.53 GB, 15.67 GB, 15.80 GB, 15.85 GB, 15.88 GB, 15.89 GB, 15.95 GB, 16.01 GB, 16.13 GB, 16.21 GB, 16.29 GB, 16.39 GB, 16.50 GB, 16.68 GB, 16.92 GB, 17.21 GB, 17.45 GB, 17.59 GB, 17.72 GB, 17.78 GB, 17.86 GB, 17.93 GB, 18.00 GB, 18.05 GB, 18.10 GB, 18.14 GB, 18.16 GB, 18.20 GB, 18.21 GB - FooterProcessingTime: (Avg: 3s876ms ; Min: 123.840ms ; Max: 13s715ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.25 GB (19598909834) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 56s815ms - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.71 GB (13651568110) - PerReadThreadRawHdfsThroughput: 45.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 261.80M (261804032) - RowsReturned: 261.60M (261599232) - RowsReturnedRate: 85.53 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s568ms - TotalRawHdfsReadTime(*): 6m50s - TotalReadThroughput: 6.41 MB/sec CodeGen:(Total: 30.633ms, non-child: 30.633ms, % non-child: 100.00%) - CodegenTime: 442.872us - CompileTime: 4.153ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.789ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 19.164ms Instance 844a0200d7876345:20bb38b90000000a (host=vd1132.foo.com:22000):(Total: 253.109ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:36/8.82 GB 4:29/7.04 GB 6:23/5.66 GB 3:31/7.47 GB 1:34/8.38 GB 2:18/4.35 GB 7:26/6.36 GB 0:27/6.52 GB Fragment Instance Lifecycle Event Timeline: 1s755ms - Prepare Finished: 217.487ms (217.487ms) - Open Finished: 253.444ms (35.957ms) - First Batch Produced: 1s754ms (1s500ms) - First Batch Sent: 1s755ms (1.827ms) MemoryUsage(1m4s): 7.83 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.68 GB, 12.67 GB, 12.65 GB, 12.64 GB, 12.62 GB, 12.60 GB, 12.58 GB, 12.55 GB, 12.52 GB, 12.50 GB, 12.46 GB, 12.42 GB, 12.36 GB, 12.30 GB, 12.23 GB, 12.19 GB, 12.14 GB, 12.09 GB, 12.05 GB, 12.02 GB, 12.00 GB, 11.99 GB, 11.98 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.69 GB (13626925077) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.44 GB (91744617721) - RowsProduced: 259.23M (259234816) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m3s - TotalStorageWaitTime: 21m3s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 35.953ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 33.995ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 6s597ms - OpenTime: 35.955ms - ExecTreeOpenTime: 299.750us - PrepareTime: 217.085ms - ExecTreePrepareTime: 1.854ms KrpcDataStreamSender (dst_id=1):(Total: 4m39s, non-child: 4m39s, % non-child: 100.00%) - BytesSent: 34.05 GB (36558372073) - EosSent: 0 (0) - OverallThroughput: 124.94 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 259.23M (259233792) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m38s - UncompressedRowBatchSize: 66.82 GB (71750755017) HDFS_SCAN_NODE (id=0):(Total: 6s399ms, non-child: 6s399ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:36/8.82 GB 4:29/7.04 GB 6:23/5.66 GB 3:31/7.47 GB 1:34/8.38 GB 2:18/4.35 GB 7:26/6.36 GB 0:27/6.52 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.89 GB, 11.62 GB, 12.01 GB, 12.25 GB, 12.46 GB, 12.82 GB, 13.43 GB, 14.09 GB, 14.64 GB, 15.01 GB, 15.16 GB, 15.22 GB, 15.26 GB, 15.30 GB, 15.34 GB, 15.42 GB, 15.50 GB, 15.58 GB, 15.65 GB, 15.74 GB, 15.83 GB, 15.88 GB, 15.91 GB, 15.94 GB, 16.00 GB, 16.10 GB, 16.19 GB, 16.30 GB, 16.43 GB, 16.60 GB, 16.78 GB, 16.98 GB, 17.15 GB, 17.34 GB, 17.54 GB, 17.65 GB, 17.72 GB, 17.76 GB, 17.83 GB, 17.88 GB, 17.93 GB, 17.98 GB, 18.01 GB, 18.04 GB, 18.08 GB - FooterProcessingTime: (Avg: 3s427ms ; Min: 97.799ms ; Max: 9s620ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.13 GB (19464953270) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2m37s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.69 GB (13623833739) - PerReadThreadRawHdfsThroughput: 46.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 259.44M (259439616) - RowsReturned: 259.23M (259234816) - RowsReturnedRate: 40.51 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s194ms - TotalRawHdfsReadTime(*): 6m36s - TotalReadThroughput: 6.36 MB/sec CodeGen:(Total: 35.391ms, non-child: 35.391ms, % non-child: 100.00%) - CodegenTime: 413.847us - CompileTime: 4.559ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.806ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.434ms Instance 844a0200d7876345:20bb38b900000044 (host=vd1133.foo.com:22000):(Total: 269.480ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:21/5.16 GB 4:26/6.33 GB 3:24/5.87 GB 0:43/10.30 GB 5:33/8.04 GB 2:23/5.69 GB 7:26/6.44 GB 6:26/6.44 GB Fragment Instance Lifecycle Event Timeline: 1s689ms - Prepare Finished: 233.195ms (233.195ms) - Open Finished: 270.280ms (37.084ms) - First Batch Produced: 1s686ms (1s416ms) - First Batch Sent: 1s689ms (2.643ms) MemoryUsage(1m4s): 8.26 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.71 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.68 GB, 12.67 GB, 12.66 GB, 12.64 GB, 12.62 GB, 12.60 GB, 12.58 GB, 12.53 GB, 12.49 GB, 12.46 GB, 12.44 GB, 12.41 GB, 12.37 GB, 12.32 GB, 12.26 GB, 12.20 GB, 12.18 GB, 12.17 GB, 12.17 GB, 12.16 GB, 12.15 GB, 12.15 GB, 12.13 GB, 12.12 GB, 12.12 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.72 GB (13654669247) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.88 GB (84700504724) - RowsProduced: 277.60M (277598208) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m45s - TotalStorageWaitTime: 18m46s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 37.078ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 34.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s654ms - OpenTime: 37.079ms - ExecTreeOpenTime: 186.781us - PrepareTime: 232.301ms - ExecTreePrepareTime: 1.966ms KrpcDataStreamSender (dst_id=1):(Total: 4m38s, non-child: 4m38s, % non-child: 100.00%) - BytesSent: 36.42 GB (39105872339) - EosSent: 0 (0) - OverallThroughput: 133.96 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 277.60M (277597184) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m37s - UncompressedRowBatchSize: 71.56 GB (76833406833) HDFS_SCAN_NODE (id=0):(Total: 3s459ms, non-child: 3s459ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:21/5.16 GB 4:26/6.33 GB 3:24/5.87 GB 0:43/10.30 GB 5:33/8.04 GB 2:23/5.69 GB 7:26/6.44 GB 6:26/6.44 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.30 GB, 11.76 GB, 12.29 GB, 12.73 GB, 13.38 GB, 14.25 GB, 14.87 GB, 15.18 GB, 15.27 GB, 15.33 GB, 15.38 GB, 15.43 GB, 15.51 GB, 15.59 GB, 15.71 GB, 15.82 GB, 15.89 GB, 15.92 GB, 15.99 GB, 16.04 GB, 16.09 GB, 16.20 GB, 16.35 GB, 16.47 GB, 16.67 GB, 16.85 GB, 17.06 GB, 17.33 GB, 17.54 GB, 17.67 GB, 17.77 GB, 17.83 GB, 17.90 GB, 17.97 GB, 18.04 GB, 18.09 GB, 18.15 GB, 18.20 GB, 18.23 GB, 18.27 GB, 18.32 GB, 18.36 GB, 18.40 GB, 18.47 GB, 18.56 GB - FooterProcessingTime: (Avg: 3s231ms ; Min: 126.066ms ; Max: 12s542ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.62 GB (19991913602) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m44s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.71 GB (13651537150) - PerReadThreadRawHdfsThroughput: 46.96 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 277.80M (277803008) - RowsReturned: 277.60M (277598208) - RowsReturnedRate: 80.25 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 7s897ms - TotalRawHdfsReadTime(*): 6m46s - TotalReadThroughput: 6.53 MB/sec CodeGen:(Total: 36.504ms, non-child: 36.504ms, % non-child: 100.00%) - CodegenTime: 505.556us - CompileTime: 4.320ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.763ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 23.871ms Instance 844a0200d7876345:20bb38b900000076 (host=vd1134.foo.com:22000):(Total: 249.875ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:27/6.68 GB 7:25/6.11 GB 1:28/6.75 GB 6:27/6.48 GB 4:24/5.90 GB 5:25/6.11 GB 0:33/7.91 GB 2:36/8.84 GB Fragment Instance Lifecycle Event Timeline: 1s935ms - Prepare Finished: 212.098ms (212.098ms) - Open Finished: 250.563ms (38.464ms) - First Batch Produced: 1s933ms (1s682ms) - First Batch Sent: 1s935ms (2.149ms) MemoryUsage(1m4s): 7.46 GB, 12.64 GB, 12.64 GB, 12.64 GB, 12.64 GB, 12.65 GB, 12.65 GB, 12.64 GB, 12.64 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.61 GB, 12.61 GB, 12.60 GB, 12.60 GB, 12.59 GB, 12.58 GB, 12.58 GB, 12.57 GB, 12.57 GB, 12.56 GB, 12.53 GB, 12.52 GB, 12.50 GB, 12.48 GB, 12.44 GB, 12.40 GB, 12.35 GB, 12.30 GB, 12.26 GB, 12.21 GB, 12.14 GB, 12.07 GB, 12.04 GB, 12.00 GB, 12.00 GB, 12.08 GB, 12.07 GB, 12.06 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.65 GB (13585115729) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.91 GB (84724200019) - RowsProduced: 262.70M (262700976) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m8s - TotalStorageWaitTime: 22m53s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 38.457ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 33.994ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s582ms - OpenTime: 38.458ms - ExecTreeOpenTime: 238.482us - PrepareTime: 211.346ms - ExecTreePrepareTime: 1.920ms KrpcDataStreamSender (dst_id=1):(Total: 4m41s, non-child: 4m41s, % non-child: 100.00%) - BytesSent: 34.46 GB (36999017913) - EosSent: 0 (0) - OverallThroughput: 125.24 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 262.70M (262699952) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m41s - UncompressedRowBatchSize: 67.72 GB (72710441068) HDFS_SCAN_NODE (id=0):(Total: 3s381ms, non-child: 3s381ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:27/6.68 GB 7:25/6.11 GB 1:28/6.75 GB 6:27/6.48 GB 4:24/5.90 GB 5:25/6.11 GB 0:33/7.91 GB 2:36/8.84 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.56 GB, 11.59 GB, 12.05 GB, 12.28 GB, 12.46 GB, 12.86 GB, 13.37 GB, 14.05 GB, 14.62 GB, 14.96 GB, 15.12 GB, 15.16 GB, 15.19 GB, 15.26 GB, 15.34 GB, 15.39 GB, 15.48 GB, 15.60 GB, 15.69 GB, 15.78 GB, 15.83 GB, 15.84 GB, 15.88 GB, 15.92 GB, 16.00 GB, 16.11 GB, 16.24 GB, 16.35 GB, 16.44 GB, 16.63 GB, 16.86 GB, 17.06 GB, 17.28 GB, 17.47 GB, 17.60 GB, 17.65 GB, 17.71 GB, 17.77 GB, 17.83 GB, 17.87 GB, 17.90 GB, 17.99 GB, 18.14 GB, 18.18 GB, 18.21 GB - FooterProcessingTime: (Avg: 4s626ms ; Min: 113.078ms ; Max: 11s343ms ; Number of samples: 81) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.25 GB (19593617517) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m3s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 81 (81) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.65 GB (13582065371) - PerReadThreadRawHdfsThroughput: 42.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 262.91M (262905776) - RowsReturned: 262.70M (262700976) - RowsReturnedRate: 77.70 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 1s427ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s543ms - TotalRawHdfsReadTime(*): 7m18s - TotalReadThroughput: 6.39 MB/sec CodeGen:(Total: 37.943ms, non-child: 37.943ms, % non-child: 100.00%) - CodegenTime: 400.520us - CompileTime: 4.236ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.700ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 24.433ms Instance 844a0200d7876345:20bb38b90000006d (host=vd1135.foo.com:22000):(Total: 218.341ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:29/7.18 GB 7:26/6.23 GB 3:31/7.63 GB 5:35/8.54 GB 4:33/8.14 GB 1:25/6.19 GB 6:19/4.66 GB 0:26/6.40 GB Fragment Instance Lifecycle Event Timeline: 1s488ms - Prepare Finished: 187.870ms (187.870ms) - Open Finished: 218.816ms (30.946ms) - First Batch Produced: 1s487ms (1s268ms) - First Batch Sent: 1s488ms (1.322ms) MemoryUsage(1m4s): 8.22 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.72 GB, 12.71 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.68 GB, 12.66 GB, 12.63 GB, 12.61 GB, 12.59 GB, 12.57 GB, 12.54 GB, 12.52 GB, 12.49 GB, 12.47 GB, 12.44 GB, 12.38 GB, 12.33 GB, 12.28 GB, 12.24 GB, 12.21 GB, 12.21 GB, 12.21 GB, 12.21 GB, 12.20 GB, 12.18 GB, 12.18 GB, 12.18 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.74 GB (13676157250) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.93 GB (84752758942) - RowsProduced: 275.30M (275296256) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m54s - TotalStorageWaitTime: 19m32s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 30.944ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 29.996ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 2s972ms - OpenTime: 30.945ms - ExecTreeOpenTime: 139.174us - PrepareTime: 187.307ms - ExecTreePrepareTime: 2.203ms KrpcDataStreamSender (dst_id=1):(Total: 4m40s, non-child: 4m40s, % non-child: 100.00%) - BytesSent: 36.15 GB (38810868268) - EosSent: 0 (0) - OverallThroughput: 132.14 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 275.30M (275295232) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m39s - UncompressedRowBatchSize: 70.96 GB (76196882821) HDFS_SCAN_NODE (id=0):(Total: 2s779ms, non-child: 2s779ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:29/7.18 GB 7:26/6.23 GB 3:31/7.63 GB 5:35/8.54 GB 4:33/8.14 GB 1:25/6.19 GB 6:19/4.66 GB 0:26/6.40 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.26 GB, 11.79 GB, 12.33 GB, 12.85 GB, 13.48 GB, 14.12 GB, 14.76 GB, 15.13 GB, 15.29 GB, 15.35 GB, 15.40 GB, 15.44 GB, 15.51 GB, 15.60 GB, 15.68 GB, 15.78 GB, 15.88 GB, 15.96 GB, 16.00 GB, 16.06 GB, 16.14 GB, 16.24 GB, 16.37 GB, 16.47 GB, 16.64 GB, 16.81 GB, 16.96 GB, 17.13 GB, 17.36 GB, 17.57 GB, 17.74 GB, 17.83 GB, 17.89 GB, 17.96 GB, 18.03 GB, 18.11 GB, 18.18 GB, 18.24 GB, 18.26 GB, 18.29 GB, 18.33 GB, 18.37 GB, 18.42 GB, 18.45 GB, 18.51 GB - FooterProcessingTime: (Avg: 3s546ms ; Min: 56.229ms ; Max: 8s920ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.57 GB (19942917826) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m12s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.73 GB (13673049779) - PerReadThreadRawHdfsThroughput: 47.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 275.50M (275501056) - RowsReturned: 275.30M (275297280) - RowsReturnedRate: 99.06 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 7s804ms - TotalRawHdfsReadTime(*): 6m41s - TotalReadThroughput: 6.52 MB/sec CodeGen:(Total: 30.513ms, non-child: 30.513ms, % non-child: 100.00%) - CodegenTime: 405.615us - CompileTime: 4.444ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.091ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 17.490ms Instance 844a0200d7876345:20bb38b900000021 (host=vd1136.foo.com:22000):(Total: 260.074ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:29/7.06 GB 1:25/6.12 GB 3:33/8.01 GB 0:32/7.86 GB 5:33/7.84 GB 7:25/6.16 GB 6:29/7.05 GB 4:19/4.63 GB Fragment Instance Lifecycle Event Timeline: 1s662ms - Prepare Finished: 226.677ms (226.677ms) - Open Finished: 260.773ms (34.095ms) - First Batch Produced: 1s660ms (1s399ms) - First Batch Sent: 1s662ms (1.995ms) MemoryUsage(1m4s): 7.95 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.66 GB, 12.66 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.66 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.64 GB, 12.64 GB, 12.62 GB, 12.61 GB, 12.61 GB, 12.57 GB, 12.54 GB, 12.49 GB, 12.47 GB, 12.43 GB, 12.40 GB, 12.33 GB, 12.26 GB, 12.19 GB, 12.11 GB, 12.07 GB, 12.04 GB, 12.00 GB, 11.97 GB, 11.95 GB, 11.95 GB, 11.95 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.68 GB (13610463889) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.63 GB (91944613177) - RowsProduced: 263.61M (263614464) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m8s - TotalStorageWaitTime: 21m13s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 34.091ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 30.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s054ms - OpenTime: 34.093ms - ExecTreeOpenTime: 241.132us - PrepareTime: 225.912ms - ExecTreePrepareTime: 2.156ms KrpcDataStreamSender (dst_id=1):(Total: 4m48s, non-child: 4m48s, % non-child: 100.00%) - BytesSent: 34.64 GB (37195097325) - EosSent: 0 (0) - OverallThroughput: 122.93 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 263.61M (263613440) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m48s - UncompressedRowBatchSize: 67.95 GB (72963798875) HDFS_SCAN_NODE (id=0):(Total: 3s856ms, non-child: 3s856ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:29/7.06 GB 1:25/6.12 GB 3:33/8.01 GB 0:32/7.86 GB 5:33/7.84 GB 7:25/6.16 GB 6:29/7.05 GB 4:19/4.63 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.01 GB, 11.63 GB, 12.04 GB, 12.27 GB, 12.61 GB, 13.05 GB, 13.66 GB, 14.29 GB, 14.78 GB, 15.02 GB, 15.15 GB, 15.21 GB, 15.25 GB, 15.31 GB, 15.36 GB, 15.42 GB, 15.52 GB, 15.63 GB, 15.68 GB, 15.76 GB, 15.81 GB, 15.85 GB, 15.91 GB, 15.98 GB, 16.09 GB, 16.18 GB, 16.25 GB, 16.39 GB, 16.52 GB, 16.70 GB, 16.95 GB, 17.13 GB, 17.28 GB, 17.43 GB, 17.59 GB, 17.68 GB, 17.74 GB, 17.81 GB, 17.87 GB, 17.91 GB, 17.96 GB, 18.01 GB, 18.03 GB, 18.07 GB, 18.10 GB - FooterProcessingTime: (Avg: 4s041ms ; Min: 148.291ms ; Max: 8s881ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.17 GB (19508870384) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m23s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.67 GB (13607292828) - PerReadThreadRawHdfsThroughput: 50.24 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 263.82M (263819264) - RowsReturned: 263.61M (263614464) - RowsReturnedRate: 68.36 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s625ms - TotalRawHdfsReadTime(*): 6m10s - TotalReadThroughput: 6.32 MB/sec CodeGen:(Total: 33.482ms, non-child: 33.482ms, % non-child: 100.00%) - CodegenTime: 510.270us - CompileTime: 4.926ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.967ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 19.042ms Instance 844a0200d7876345:20bb38b900000000 (host=vd1138.foo.com:22000):(Total: 261.568ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:34/8.26 GB 2:21/5.07 GB 1:21/5.16 GB 0:30/7.27 GB 3:27/6.56 GB 4:29/7.13 GB 5:30/7.25 GB 7:32/7.92 GB Fragment Instance Lifecycle Event Timeline: 1s884ms - Prepare Finished: 226.146ms (226.146ms) - Open Finished: 262.198ms (36.051ms) - First Batch Produced: 1s882ms (1s620ms) - First Batch Sent: 1s884ms (2.065ms) MemoryUsage(1m4s): 7.71 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.69 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.67 GB, 12.67 GB, 12.65 GB, 12.64 GB, 12.62 GB, 12.61 GB, 12.59 GB, 12.56 GB, 12.52 GB, 12.49 GB, 12.47 GB, 12.44 GB, 12.39 GB, 12.35 GB, 12.29 GB, 12.25 GB, 12.22 GB, 12.19 GB, 12.15 GB, 12.12 GB, 12.11 GB, 12.10 GB, 12.10 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.71 GB (13652366629) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.58 GB (91893049072) - RowsProduced: 269.96M (269957120) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m10s - TotalStorageWaitTime: 22m59s - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 36.044ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 32.995ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s334ms - OpenTime: 36.045ms - ExecTreeOpenTime: 156.830us - PrepareTime: 225.416ms - ExecTreePrepareTime: 1.755ms KrpcDataStreamSender (dst_id=1):(Total: 4m38s, non-child: 4m38s, % non-child: 100.00%) - BytesSent: 35.43 GB (38045423813) - EosSent: 0 (0) - OverallThroughput: 130.34 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 269.96M (269956096) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m37s - UncompressedRowBatchSize: 69.59 GB (74717994205) HDFS_SCAN_NODE (id=0):(Total: 3s134ms, non-child: 3s134ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:34/8.26 GB 2:21/5.07 GB 1:21/5.16 GB 0:30/7.27 GB 3:27/6.56 GB 4:29/7.13 GB 5:30/7.25 GB 7:32/7.92 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.82 GB, 11.74 GB, 12.17 GB, 12.55 GB, 12.86 GB, 13.25 GB, 13.81 GB, 14.40 GB, 14.91 GB, 15.17 GB, 15.30 GB, 15.35 GB, 15.39 GB, 15.45 GB, 15.53 GB, 15.60 GB, 15.67 GB, 15.75 GB, 15.88 GB, 15.99 GB, 16.06 GB, 16.11 GB, 16.20 GB, 16.30 GB, 16.41 GB, 16.52 GB, 16.63 GB, 16.79 GB, 16.95 GB, 17.10 GB, 17.25 GB, 17.38 GB, 17.57 GB, 17.76 GB, 17.87 GB, 17.93 GB, 17.99 GB, 18.06 GB, 18.12 GB, 18.15 GB, 18.19 GB, 18.23 GB, 18.26 GB, 18.30 GB, 18.35 GB - FooterProcessingTime: (Avg: 4s292ms ; Min: 157.821ms ; Max: 9s800ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.40 GB (19759942279) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m5s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.71 GB (13649203604) - PerReadThreadRawHdfsThroughput: 48.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 270.16M (270161920) - RowsReturned: 269.96M (269957120) - RowsReturnedRate: 86.11 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s341ms - TotalRawHdfsReadTime(*): 6m30s - TotalReadThroughput: 6.45 MB/sec CodeGen:(Total: 35.530ms, non-child: 35.530ms, % non-child: 100.00%) - CodegenTime: 482.059us - CompileTime: 4.370ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.562ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 23.038ms Instance 844a0200d7876345:20bb38b90000001b (host=vd1139.foo.com:22000):(Total: 259.498ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:24/5.91 GB 4:27/6.65 GB 2:29/7.03 GB 7:20/4.88 GB 6:20/4.80 GB 3:37/8.66 GB 0:33/8.01 GB 1:36/8.84 GB Fragment Instance Lifecycle Event Timeline: 1s744ms - Prepare Finished: 221.493ms (221.493ms) - Open Finished: 260.001ms (38.508ms) - First Batch Produced: 1s742ms (1s482ms) - First Batch Sent: 1s744ms (2.088ms) MemoryUsage(1m4s): 7.76 GB, 12.63 GB, 12.64 GB, 12.64 GB, 12.64 GB, 12.64 GB, 12.64 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.60 GB, 12.59 GB, 12.59 GB, 12.57 GB, 12.56 GB, 12.54 GB, 12.49 GB, 12.45 GB, 12.41 GB, 12.37 GB, 12.35 GB, 12.30 GB, 12.26 GB, 12.22 GB, 12.17 GB, 12.12 GB, 12.06 GB, 12.00 GB, 11.96 GB, 11.93 GB, 11.92 GB, 11.91 GB, 11.91 GB, 11.91 GB, 11.91 GB, 11.90 GB, 11.87 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.64 GB (13576580266) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.35 GB (91646707211) - RowsProduced: 275.84M (275838976) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m46s - TotalStorageWaitTime: 20m11s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 38.497ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 35.995ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s386ms - OpenTime: 38.499ms - ExecTreeOpenTime: 140.128us - PrepareTime: 220.921ms - ExecTreePrepareTime: 2.090ms KrpcDataStreamSender (dst_id=1):(Total: 4m37s, non-child: 4m37s, % non-child: 100.00%) - BytesSent: 36.19 GB (38859350872) - EosSent: 0 (0) - OverallThroughput: 133.76 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 275.84M (275837952) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m36s - UncompressedRowBatchSize: 71.10 GB (76346347988) HDFS_SCAN_NODE (id=0):(Total: 3s207ms, non-child: 3s207ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:24/5.91 GB 4:27/6.65 GB 2:29/7.03 GB 7:20/4.88 GB 6:20/4.80 GB 3:37/8.66 GB 0:33/8.01 GB 1:36/8.84 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.85 GB, 11.75 GB, 12.28 GB, 12.78 GB, 13.31 GB, 13.95 GB, 14.57 GB, 14.96 GB, 15.15 GB, 15.24 GB, 15.29 GB, 15.33 GB, 15.39 GB, 15.45 GB, 15.55 GB, 15.67 GB, 15.76 GB, 15.83 GB, 15.90 GB, 15.97 GB, 16.05 GB, 16.13 GB, 16.24 GB, 16.33 GB, 16.45 GB, 16.60 GB, 16.78 GB, 16.98 GB, 17.14 GB, 17.32 GB, 17.47 GB, 17.57 GB, 17.64 GB, 17.72 GB, 17.79 GB, 17.85 GB, 17.91 GB, 17.96 GB, 17.99 GB, 18.01 GB, 18.06 GB, 18.09 GB, 18.14 GB, 18.19 GB, 18.25 GB - FooterProcessingTime: (Avg: 3s634ms ; Min: 155.180ms ; Max: 8s555ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.30 GB (19644151814) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m45s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.64 GB (13573502814) - PerReadThreadRawHdfsThroughput: 42.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 276.04M (276043776) - RowsReturned: 275.84M (275838976) - RowsReturnedRate: 86.00 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s162ms - TotalRawHdfsReadTime(*): 7m16s - TotalReadThroughput: 6.41 MB/sec CodeGen:(Total: 38.025ms, non-child: 38.025ms, % non-child: 100.00%) - CodegenTime: 458.191us - CompileTime: 4.549ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.849ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 25.042ms Instance 844a0200d7876345:20bb38b900000073 (host=vd1140.foo.com:22000):(Total: 240.286ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:25/6.15 GB 2:32/7.80 GB 5:23/5.65 GB 4:31/7.60 GB 7:20/4.83 GB 3:33/7.99 GB 1:30/7.29 GB 6:30/7.36 GB Fragment Instance Lifecycle Event Timeline: 1s665ms - Prepare Finished: 205.748ms (205.748ms) - Open Finished: 241.099ms (35.351ms) - First Batch Produced: 1s663ms (1s422ms) - First Batch Sent: 1s665ms (1.988ms) MemoryUsage(1m4s): 7.06 GB, 12.66 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.68 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.66 GB, 12.65 GB, 12.63 GB, 12.62 GB, 12.60 GB, 12.60 GB, 12.57 GB, 12.56 GB, 12.55 GB, 12.52 GB, 12.50 GB, 12.47 GB, 12.44 GB, 12.40 GB, 12.34 GB, 12.29 GB, 12.25 GB, 12.21 GB, 12.17 GB, 12.14 GB, 12.12 GB, 12.10 GB, 12.07 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.69 GB (13630020025) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.83 GB (84647352048) - RowsProduced: 260.17M (260167680) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m42s - TotalStorageWaitTime: 26m26s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 35.348ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 33.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s264ms - OpenTime: 35.349ms - ExecTreeOpenTime: 262.644us - PrepareTime: 204.845ms - ExecTreePrepareTime: 2.065ms KrpcDataStreamSender (dst_id=1):(Total: 4m40s, non-child: 4m40s, % non-child: 100.00%) - BytesSent: 34.15 GB (36663120750) - EosSent: 0 (0) - OverallThroughput: 124.82 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 260.17M (260166656) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m39s - UncompressedRowBatchSize: 67.06 GB (72008624532) HDFS_SCAN_NODE (id=0):(Total: 4s063ms, non-child: 4s063ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:25/6.15 GB 2:32/7.80 GB 5:23/5.65 GB 4:31/7.60 GB 7:20/4.83 GB 3:33/7.99 GB 1:30/7.29 GB 6:30/7.36 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.22 GB, 11.62 GB, 12.07 GB, 12.40 GB, 12.62 GB, 12.93 GB, 13.38 GB, 14.03 GB, 14.54 GB, 14.99 GB, 15.14 GB, 15.24 GB, 15.30 GB, 15.34 GB, 15.38 GB, 15.43 GB, 15.54 GB, 15.63 GB, 15.73 GB, 15.82 GB, 15.89 GB, 15.97 GB, 16.03 GB, 16.07 GB, 16.14 GB, 16.23 GB, 16.32 GB, 16.40 GB, 16.47 GB, 16.60 GB, 16.79 GB, 16.96 GB, 17.20 GB, 17.40 GB, 17.54 GB, 17.68 GB, 17.77 GB, 17.85 GB, 17.90 GB, 17.94 GB, 18.00 GB, 18.05 GB, 18.08 GB, 18.12 GB, 18.15 GB - FooterProcessingTime: (Avg: 5s556ms ; Min: 171.680ms ; Max: 13s345ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.17 GB (19504760517) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m27s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.69 GB (13627012688) - PerReadThreadRawHdfsThroughput: 43.55 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 260.37M (260372480) - RowsReturned: 260.17M (260167680) - RowsReturnedRate: 64.03 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 11s982ms - TotalRawHdfsReadTime(*): 7m7s - TotalReadThroughput: 6.38 MB/sec CodeGen:(Total: 34.832ms, non-child: 34.832ms, % non-child: 100.00%) - CodegenTime: 381.279us - CompileTime: 4.773ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.462ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 21.972ms Instance 844a0200d7876345:20bb38b900000025 (host=vd1141.foo.com:22000):(Total: 235.317ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:22/5.35 GB 1:30/7.35 GB 6:29/7.06 GB 5:32/7.84 GB 3:24/5.82 GB 0:35/8.50 GB 7:25/6.12 GB 2:27/6.57 GB Fragment Instance Lifecycle Event Timeline: 1s702ms - Prepare Finished: 207.781ms (207.781ms) - Open Finished: 235.733ms (27.951ms) - First Batch Produced: 1s700ms (1s464ms) - First Batch Sent: 1s702ms (2.176ms) MemoryUsage(1m4s): 8.83 GB, 12.65 GB, 12.65 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.65 GB, 12.65 GB, 12.64 GB, 12.63 GB, 12.59 GB, 12.54 GB, 12.48 GB, 12.43 GB, 12.39 GB, 12.35 GB, 12.32 GB, 12.25 GB, 12.17 GB, 12.06 GB, 12.00 GB, 11.97 GB, 11.97 GB, 11.97 GB, 11.97 GB, 11.97 GB, 11.97 GB, 11.97 GB, 11.97 GB, 11.96 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.67 GB (13605273685) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.43 GB (91734991326) - RowsProduced: 276.06M (276061184) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m24s - TotalStorageWaitTime: 16m24s - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 27.959ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 27.996ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s359ms - OpenTime: 27.960ms - ExecTreeOpenTime: 154.474us - PrepareTime: 207.281ms - ExecTreePrepareTime: 1.820ms KrpcDataStreamSender (dst_id=1):(Total: 4m29s, non-child: 4m29s, % non-child: 100.00%) - BytesSent: 36.22 GB (38890174469) - EosSent: 0 (0) - OverallThroughput: 137.58 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 276.06M (276060160) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m29s - UncompressedRowBatchSize: 71.16 GB (76408063771) HDFS_SCAN_NODE (id=0):(Total: 3s181ms, non-child: 3s181ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:22/5.35 GB 1:30/7.35 GB 6:29/7.06 GB 5:32/7.84 GB 3:24/5.82 GB 0:35/8.50 GB 7:25/6.12 GB 2:27/6.57 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.83 GB, 11.70 GB, 12.12 GB, 12.47 GB, 12.95 GB, 13.65 GB, 14.47 GB, 14.97 GB, 15.16 GB, 15.20 GB, 15.26 GB, 15.30 GB, 15.35 GB, 15.40 GB, 15.51 GB, 15.64 GB, 15.76 GB, 15.79 GB, 15.82 GB, 15.87 GB, 15.92 GB, 15.99 GB, 16.17 GB, 16.28 GB, 16.38 GB, 16.52 GB, 16.75 GB, 17.02 GB, 17.31 GB, 17.50 GB, 17.58 GB, 17.62 GB, 17.68 GB, 17.76 GB, 17.85 GB, 17.90 GB, 17.98 GB, 18.01 GB, 18.04 GB, 18.06 GB, 18.09 GB, 18.16 GB, 18.22 GB, 18.31 GB, 18.38 GB - FooterProcessingTime: (Avg: 3s048ms ; Min: 120.348ms ; Max: 11s723ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.46 GB (19817975324) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m10s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.67 GB (13602174290) - PerReadThreadRawHdfsThroughput: 50.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 276.27M (276265984) - RowsReturned: 276.06M (276061184) - RowsReturnedRate: 86.78 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s842ms - TotalRawHdfsReadTime(*): 6m14s - TotalReadThroughput: 6.47 MB/sec CodeGen:(Total: 27.561ms, non-child: 27.561ms, % non-child: 100.00%) - CodegenTime: 319.392us - CompileTime: 3.683ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 5.282ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 18.121ms Instance 844a0200d7876345:20bb38b900000045 (host=vd1142.foo.com:22000):(Total: 237.339ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:30/7.32 GB 0:24/5.81 GB 4:25/6.02 GB 7:29/7.07 GB 2:30/7.34 GB 6:25/6.03 GB 5:25/6.11 GB 1:37/9.12 GB Fragment Instance Lifecycle Event Timeline: 1s500ms - Prepare Finished: 205.181ms (205.181ms) - Open Finished: 237.831ms (32.649ms) - First Batch Produced: 1s498ms (1s260ms) - First Batch Sent: 1s500ms (2.217ms) MemoryUsage(1m4s): 8.33 GB, 12.67 GB, 12.67 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.66 GB, 12.65 GB, 12.61 GB, 12.59 GB, 12.57 GB, 12.55 GB, 12.53 GB, 12.47 GB, 12.44 GB, 12.39 GB, 12.35 GB, 12.30 GB, 12.24 GB, 12.20 GB, 12.13 GB, 12.08 GB, 12.04 GB, 12.02 GB, 12.01 GB, 12.01 GB, 12.00 GB, 11.99 GB, 11.99 GB, 11.99 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.69 GB (13628045730) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.93 GB (84746034822) - RowsProduced: 272.49M (272487424) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m53s - TotalStorageWaitTime: 18m41s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 32.637ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 31.995ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s970ms - OpenTime: 32.638ms - ExecTreeOpenTime: 140.607us - PrepareTime: 204.621ms - ExecTreePrepareTime: 2.039ms KrpcDataStreamSender (dst_id=1):(Total: 4m42s, non-child: 4m42s, % non-child: 100.00%) - BytesSent: 35.80 GB (38435921660) - EosSent: 0 (0) - OverallThroughput: 129.68 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 272.49M (272486400) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m42s - UncompressedRowBatchSize: 70.24 GB (75419299012) HDFS_SCAN_NODE (id=0):(Total: 3s764ms, non-child: 3s764ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:30/7.32 GB 0:24/5.81 GB 4:25/6.02 GB 7:29/7.07 GB 2:30/7.34 GB 6:25/6.03 GB 5:25/6.11 GB 1:37/9.12 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.38 GB, 11.75 GB, 12.26 GB, 12.65 GB, 13.16 GB, 13.78 GB, 14.44 GB, 14.94 GB, 15.16 GB, 15.26 GB, 15.31 GB, 15.36 GB, 15.41 GB, 15.49 GB, 15.55 GB, 15.65 GB, 15.76 GB, 15.85 GB, 15.89 GB, 15.95 GB, 16.01 GB, 16.10 GB, 16.20 GB, 16.31 GB, 16.44 GB, 16.57 GB, 16.71 GB, 16.88 GB, 17.09 GB, 17.31 GB, 17.49 GB, 17.62 GB, 17.70 GB, 17.75 GB, 17.82 GB, 17.89 GB, 17.96 GB, 18.02 GB, 18.05 GB, 18.10 GB, 18.13 GB, 18.17 GB, 18.20 GB, 18.24 GB, 18.28 GB - FooterProcessingTime: (Avg: 3s226ms ; Min: 132.192ms ; Max: 8s861ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.36 GB (19717373327) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m32s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.69 GB (13624984877) - PerReadThreadRawHdfsThroughput: 49.58 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 272.69M (272692224) - RowsReturned: 272.49M (272487424) - RowsReturnedRate: 72.38 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s786ms - TotalRawHdfsReadTime(*): 6m19s - TotalReadThroughput: 6.40 MB/sec CodeGen:(Total: 32.161ms, non-child: 32.161ms, % non-child: 100.00%) - CodegenTime: 480.138us - CompileTime: 4.170ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.476ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 20.965ms Instance 844a0200d7876345:20bb38b900000023 (host=vd1326.foo.com:22000):(Total: 270.035ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:28/6.84 GB 7:22/5.32 GB 2:26/6.35 GB 6:27/6.64 GB 3:37/9.12 GB 0:26/6.44 GB 5:21/5.15 GB 4:37/9.08 GB Fragment Instance Lifecycle Event Timeline: 1s730ms - Prepare Finished: 244.485ms (244.485ms) - Open Finished: 270.478ms (25.993ms) - First Batch Produced: 1s728ms (1s457ms) - First Batch Sent: 1s730ms (1.758ms) MemoryUsage(1m4s): 7.86 GB, 12.71 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.73 GB, 12.73 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.71 GB, 12.71 GB, 12.69 GB, 12.67 GB, 12.66 GB, 12.63 GB, 12.61 GB, 12.58 GB, 12.55 GB, 12.51 GB, 12.47 GB, 12.40 GB, 12.35 GB, 12.27 GB, 12.23 GB, 12.18 GB, 12.16 GB, 12.15 GB, 12.15 GB, 12.15 GB, 12.15 GB, 12.15 GB, 12.15 GB, 12.12 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.74 GB (13675818931) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.54 GB (91848772725) - RowsProduced: 277.59M (277587968) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m40s - TotalStorageWaitTime: 21m6s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 25.990ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 23.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s321ms - OpenTime: 25.992ms - ExecTreeOpenTime: 136.114us - PrepareTime: 243.967ms - ExecTreePrepareTime: 1.797ms KrpcDataStreamSender (dst_id=1):(Total: 4m37s, non-child: 4m37s, % non-child: 100.00%) - BytesSent: 36.43 GB (39113192761) - EosSent: 0 (0) - OverallThroughput: 134.35 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 277.59M (277586944) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m37s - UncompressedRowBatchSize: 71.55 GB (76830209238) HDFS_SCAN_NODE (id=0):(Total: 3s121ms, non-child: 3s121ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:28/6.84 GB 7:22/5.32 GB 2:26/6.35 GB 6:27/6.64 GB 3:37/9.12 GB 0:26/6.44 GB 5:21/5.15 GB 4:37/9.08 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.94 GB, 11.81 GB, 12.37 GB, 12.80 GB, 13.31 GB, 14.08 GB, 14.73 GB, 15.14 GB, 15.28 GB, 15.35 GB, 15.42 GB, 15.48 GB, 15.54 GB, 15.64 GB, 15.77 GB, 15.87 GB, 15.94 GB, 16.01 GB, 16.08 GB, 16.15 GB, 16.21 GB, 16.25 GB, 16.33 GB, 16.49 GB, 16.66 GB, 16.85 GB, 17.09 GB, 17.34 GB, 17.50 GB, 17.62 GB, 17.74 GB, 17.85 GB, 17.94 GB, 18.01 GB, 18.09 GB, 18.13 GB, 18.17 GB, 18.20 GB, 18.26 GB, 18.29 GB, 18.32 GB, 18.37 GB, 18.44 GB, 18.52 GB, 18.58 GB - FooterProcessingTime: (Avg: 4s553ms ; Min: 174.672ms ; Max: 12s521ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.63 GB (20003919265) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m45s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.73 GB (13672694852) - PerReadThreadRawHdfsThroughput: 46.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 277.79M (277792768) - RowsReturned: 277.59M (277587968) - RowsReturnedRate: 88.92 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s463ms - TotalRawHdfsReadTime(*): 6m48s - TotalReadThroughput: 6.54 MB/sec CodeGen:(Total: 25.578ms, non-child: 25.578ms, % non-child: 100.00%) - CodegenTime: 393.229us - CompileTime: 4.028ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.547ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 14.386ms Instance 844a0200d7876345:20bb38b90000002c (host=vd1327.foo.com:22000):(Total: 253.896ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:26/6.31 GB 7:27/6.65 GB 0:37/9.08 GB 2:28/6.53 GB 5:25/6.12 GB 1:26/6.36 GB 6:33/7.88 GB 4:25/5.96 GB Fragment Instance Lifecycle Event Timeline: 2s026ms - Prepare Finished: 225.332ms (225.332ms) - Open Finished: 254.677ms (29.345ms) - First Batch Produced: 2s024ms (1s769ms) - First Batch Sent: 2s026ms (2.037ms) MemoryUsage(1m4s): 7.85 GB, 12.64 GB, 12.64 GB, 12.65 GB, 12.63 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.61 GB, 12.61 GB, 12.60 GB, 12.60 GB, 12.60 GB, 12.59 GB, 12.58 GB, 12.57 GB, 12.54 GB, 12.52 GB, 12.50 GB, 12.55 GB, 12.53 GB, 12.50 GB, 12.47 GB, 12.45 GB, 12.40 GB, 12.34 GB, 12.26 GB, 12.21 GB, 12.18 GB, 12.15 GB, 12.13 GB, 12.13 GB, 12.12 GB, 12.11 GB, 12.11 GB, 12.09 GB, 12.07 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.65 GB (13580731498) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.44 GB (91744990194) - RowsProduced: 277.81M (277806691) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m5s - TotalStorageWaitTime: 21m37s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 29.341ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 25.996ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s431ms - OpenTime: 29.342ms - ExecTreeOpenTime: 173.718us - PrepareTime: 224.436ms - ExecTreePrepareTime: 1.910ms KrpcDataStreamSender (dst_id=1):(Total: 4m34s, non-child: 4m34s, % non-child: 100.00%) - BytesSent: 36.45 GB (39141265625) - EosSent: 0 (0) - OverallThroughput: 135.87 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 277.81M (277805667) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m34s - UncompressedRowBatchSize: 71.61 GB (76891456678) HDFS_SCAN_NODE (id=0):(Total: 3s240ms, non-child: 3s240ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:26/6.31 GB 7:27/6.65 GB 0:37/9.08 GB 2:28/6.53 GB 5:25/6.12 GB 1:26/6.36 GB 6:33/7.88 GB 4:25/5.96 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.95 GB, 11.74 GB, 12.33 GB, 12.71 GB, 13.23 GB, 13.93 GB, 14.66 GB, 15.05 GB, 15.19 GB, 15.22 GB, 15.26 GB, 15.34 GB, 15.42 GB, 15.50 GB, 15.60 GB, 15.77 GB, 15.86 GB, 15.92 GB, 15.96 GB, 16.01 GB, 16.07 GB, 16.14 GB, 16.25 GB, 16.37 GB, 16.52 GB, 16.69 GB, 16.88 GB, 17.25 GB, 17.52 GB, 17.72 GB, 17.80 GB, 17.86 GB, 17.92 GB, 17.99 GB, 18.07 GB, 18.11 GB, 18.16 GB, 18.20 GB, 18.23 GB, 18.27 GB, 18.31 GB, 18.35 GB, 18.41 GB, 18.46 GB, 18.55 GB - FooterProcessingTime: (Avg: 5s323ms ; Min: 109.106ms ; Max: 10s859ms ; Number of samples: 81) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.63 GB (20007558917) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m6s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 81 (81) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.65 GB (13577631784) - PerReadThreadRawHdfsThroughput: 45.47 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 278.01M (278011491) - RowsReturned: 277.81M (277806691) - RowsReturnedRate: 85.73 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 1s236ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s558ms - TotalRawHdfsReadTime(*): 6m59s - TotalReadThroughput: 6.55 MB/sec CodeGen:(Total: 28.876ms, non-child: 28.876ms, % non-child: 100.00%) - CodegenTime: 409.547us - CompileTime: 4.573ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.042ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 16.734ms Instance 844a0200d7876345:20bb38b900000052 (host=vd1328.foo.com:22000):(Total: 271.307ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:24/5.87 GB 4:33/7.98 GB 1:23/5.66 GB 6:40/9.84 GB 5:28/6.84 GB 2:33/8.09 GB 0:28/6.80 GB 7:15/3.68 GB Fragment Instance Lifecycle Event Timeline: 1s643ms - Prepare Finished: 237.591ms (237.591ms) - Open Finished: 271.768ms (34.177ms) - First Batch Produced: 1s641ms (1s369ms) - First Batch Sent: 1s643ms (2.147ms) MemoryUsage(1m4s): 7.35 GB, 12.62 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.64 GB, 12.64 GB, 12.64 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.61 GB, 12.61 GB, 12.60 GB, 12.60 GB, 12.60 GB, 12.60 GB, 12.59 GB, 12.59 GB, 12.58 GB, 12.57 GB, 12.56 GB, 12.52 GB, 12.49 GB, 12.47 GB, 12.47 GB, 12.52 GB, 12.49 GB, 12.43 GB, 12.38 GB, 12.33 GB, 12.29 GB, 12.25 GB, 12.21 GB, 12.18 GB, 12.15 GB, 12.11 GB, 12.07 GB, 12.07 GB, 12.07 GB, 12.05 GB, 12.04 GB, 12.02 GB, 12.02 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.64 GB (13574167010) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.99 GB (84815647494) - RowsProduced: 281.07M (281069835) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m16s - TotalStorageWaitTime: 24m40s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 34.174ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 32.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s056ms - OpenTime: 34.176ms - ExecTreeOpenTime: 181.646us - PrepareTime: 237.048ms - ExecTreePrepareTime: 1.786ms KrpcDataStreamSender (dst_id=1):(Total: 4m33s, non-child: 4m33s, % non-child: 100.00%) - BytesSent: 36.86 GB (39582186618) - EosSent: 0 (0) - OverallThroughput: 137.88 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 281.07M (281068811) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m33s - UncompressedRowBatchSize: 72.45 GB (77793641076) HDFS_SCAN_NODE (id=0):(Total: 3s875ms, non-child: 3s875ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:24/5.87 GB 4:33/7.98 GB 1:23/5.66 GB 6:40/9.84 GB 5:28/6.84 GB 2:33/8.09 GB 0:28/6.80 GB 7:15/3.68 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.49 GB, 11.73 GB, 12.27 GB, 12.75 GB, 13.34 GB, 14.04 GB, 14.60 GB, 15.00 GB, 15.18 GB, 15.27 GB, 15.31 GB, 15.39 GB, 15.48 GB, 15.56 GB, 15.66 GB, 15.72 GB, 15.81 GB, 15.90 GB, 15.99 GB, 16.09 GB, 16.17 GB, 16.24 GB, 16.39 GB, 16.54 GB, 16.72 GB, 16.91 GB, 17.12 GB, 17.34 GB, 17.45 GB, 17.58 GB, 17.72 GB, 17.85 GB, 17.92 GB, 17.98 GB, 18.04 GB, 18.09 GB, 18.14 GB, 18.19 GB, 18.23 GB, 18.29 GB, 18.34 GB, 18.39 GB, 18.44 GB, 18.48 GB, 18.52 GB - FooterProcessingTime: (Avg: 4s514ms ; Min: 95.171ms ; Max: 12s531ms ; Number of samples: 81) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.56 GB (19928673778) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m23s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 81 (81) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.64 GB (13571010111) - PerReadThreadRawHdfsThroughput: 46.87 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 281.27M (281274635) - RowsReturned: 281.07M (281069835) - RowsReturnedRate: 72.52 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 2s835ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s727ms - TotalRawHdfsReadTime(*): 6m45s - TotalReadThroughput: 6.46 MB/sec CodeGen:(Total: 33.691ms, non-child: 33.691ms, % non-child: 100.00%) - CodegenTime: 450.382us - CompileTime: 4.623ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.602ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 20.853ms Instance 844a0200d7876345:20bb38b90000005e (host=vd1329.foo.com:22000):(Total: 249.265ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:18/4.42 GB 2:17/4.14 GB 6:32/7.86 GB 5:32/7.81 GB 0:36/8.88 GB 3:28/6.85 GB 1:26/6.37 GB 4:34/8.34 GB Fragment Instance Lifecycle Event Timeline: 1s813ms - Prepare Finished: 214.817ms (214.817ms) - Open Finished: 249.765ms (34.947ms) - First Batch Produced: 1s811ms (1s561ms) - First Batch Sent: 1s813ms (2.065ms) MemoryUsage(1m4s): 7.09 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.70 GB, 12.68 GB, 12.68 GB, 12.67 GB, 12.66 GB, 12.65 GB, 12.64 GB, 12.62 GB, 12.61 GB, 12.60 GB, 12.57 GB, 12.55 GB, 12.53 GB, 12.52 GB, 12.47 GB, 12.46 GB, 12.42 GB, 12.37 GB, 12.34 GB, 12.30 GB, 12.27 GB, 12.23 GB, 12.20 GB, 12.16 GB, 12.14 GB, 12.11 GB, 12.10 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.73 GB (13664163487) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.03 GB (84854146736) - RowsProduced: 267.82M (267817984) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m17s - TotalStorageWaitTime: 25m27s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 34.941ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 31.995ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s887ms - OpenTime: 34.942ms - ExecTreeOpenTime: 175.107us - PrepareTime: 214.245ms - ExecTreePrepareTime: 1.998ms KrpcDataStreamSender (dst_id=1):(Total: 4m43s, non-child: 4m43s, % non-child: 100.00%) - BytesSent: 35.16 GB (37752761983) - EosSent: 0 (0) - OverallThroughput: 126.89 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 267.82M (267816960) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m43s - UncompressedRowBatchSize: 69.04 GB (74126807206) HDFS_SCAN_NODE (id=0):(Total: 3s689ms, non-child: 3s689ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:18/4.42 GB 2:17/4.14 GB 6:32/7.86 GB 5:32/7.81 GB 0:36/8.88 GB 3:28/6.85 GB 1:26/6.37 GB 4:34/8.34 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.25 GB, 11.79 GB, 12.23 GB, 12.66 GB, 12.98 GB, 13.34 GB, 13.73 GB, 14.25 GB, 14.76 GB, 15.10 GB, 15.31 GB, 15.38 GB, 15.42 GB, 15.45 GB, 15.52 GB, 15.61 GB, 15.66 GB, 15.73 GB, 15.83 GB, 15.96 GB, 16.03 GB, 16.12 GB, 16.25 GB, 16.32 GB, 16.39 GB, 16.46 GB, 16.53 GB, 16.69 GB, 16.82 GB, 16.93 GB, 17.06 GB, 17.18 GB, 17.36 GB, 17.60 GB, 17.80 GB, 17.89 GB, 17.95 GB, 18.04 GB, 18.09 GB, 18.14 GB, 18.19 GB, 18.22 GB, 18.24 GB, 18.28 GB, 18.33 GB - FooterProcessingTime: (Avg: 4s649ms ; Min: 200.807ms ; Max: 14s148ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.37 GB (19725207054) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m3s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.72 GB (13661064007) - PerReadThreadRawHdfsThroughput: 42.63 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 268.02M (268022784) - RowsReturned: 267.82M (267817984) - RowsReturnedRate: 72.59 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s353ms - TotalRawHdfsReadTime(*): 7m21s - TotalReadThroughput: 6.41 MB/sec CodeGen:(Total: 34.316ms, non-child: 34.316ms, % non-child: 100.00%) - CodegenTime: 724.981us - CompileTime: 4.087ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.900ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.535ms Instance 844a0200d7876345:20bb38b90000002e (host=vd1330.foo.com:22000):(Total: 233.591ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:27/6.32 GB 7:31/7.60 GB 1:33/7.82 GB 6:29/7.06 GB 3:28/6.90 GB 2:34/8.42 GB 0:23/5.56 GB 4:21/5.13 GB Fragment Instance Lifecycle Event Timeline: 1s689ms - Prepare Finished: 197.775ms (197.775ms) - Open Finished: 234.175ms (36.400ms) - First Batch Produced: 1s688ms (1s453ms) - First Batch Sent: 1s689ms (1.850ms) MemoryUsage(1m4s): 7.77 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.68 GB, 12.68 GB, 12.67 GB, 12.66 GB, 12.66 GB, 12.65 GB, 12.62 GB, 12.59 GB, 12.57 GB, 12.55 GB, 12.53 GB, 12.53 GB, 12.50 GB, 12.47 GB, 12.43 GB, 12.39 GB, 12.35 GB, 12.32 GB, 12.26 GB, 12.21 GB, 12.16 GB, 12.10 GB, 12.06 GB, 12.05 GB, 12.03 GB, 12.01 GB, 12.01 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.69 GB (13622946875) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.64 GB (91954163132) - RowsProduced: 261.75M (261753088) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m58s - TotalStorageWaitTime: 21m30s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 36.394ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 33.995ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s083ms - OpenTime: 36.395ms - ExecTreeOpenTime: 301.143us - PrepareTime: 197.111ms - ExecTreePrepareTime: 2.095ms KrpcDataStreamSender (dst_id=1):(Total: 4m43s, non-child: 4m43s, % non-child: 100.00%) - BytesSent: 34.36 GB (36891811127) - EosSent: 0 (0) - OverallThroughput: 124.32 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 261.75M (261752064) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m42s - UncompressedRowBatchSize: 67.47 GB (72448288626) HDFS_SCAN_NODE (id=0):(Total: 3s899ms, non-child: 3s899ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:27/6.32 GB 7:31/7.60 GB 1:33/7.82 GB 6:29/7.06 GB 3:28/6.90 GB 2:34/8.42 GB 0:23/5.56 GB 4:21/5.13 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.86 GB, 11.64 GB, 12.05 GB, 12.29 GB, 12.52 GB, 12.90 GB, 13.42 GB, 14.14 GB, 14.65 GB, 15.03 GB, 15.16 GB, 15.23 GB, 15.27 GB, 15.31 GB, 15.37 GB, 15.44 GB, 15.50 GB, 15.58 GB, 15.70 GB, 15.79 GB, 15.86 GB, 15.89 GB, 15.92 GB, 15.96 GB, 16.03 GB, 16.08 GB, 16.18 GB, 16.27 GB, 16.40 GB, 16.56 GB, 16.73 GB, 16.95 GB, 17.21 GB, 17.38 GB, 17.54 GB, 17.65 GB, 17.74 GB, 17.82 GB, 17.86 GB, 17.92 GB, 17.98 GB, 18.01 GB, 18.05 GB, 18.09 GB, 18.13 GB - FooterProcessingTime: (Avg: 4s550ms ; Min: 90.282ms ; Max: 23s214ms ; Number of samples: 82) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.19 GB (19535212199) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m34s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 82 (82) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.68 GB (13619955831) - PerReadThreadRawHdfsThroughput: 46.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 261.96M (261957888) - RowsReturned: 261.75M (261753088) - RowsReturnedRate: 67.12 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 166.015ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s001ms - TotalRawHdfsReadTime(*): 6m42s - TotalReadThroughput: 6.35 MB/sec CodeGen:(Total: 35.779ms, non-child: 35.779ms, % non-child: 100.00%) - CodegenTime: 469.321us - CompileTime: 4.712ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.364ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.076ms Instance 844a0200d7876345:20bb38b90000001e (host=vd1331.foo.com:22000):(Total: 232.248ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:35/8.47 GB 4:15/3.68 GB 2:39/9.62 GB 3:26/6.32 GB 7:24/5.94 GB 6:28/6.81 GB 0:30/7.35 GB 5:27/6.65 GB Fragment Instance Lifecycle Event Timeline: 1s634ms - Prepare Finished: 199.044ms (199.044ms) - Open Finished: 232.871ms (33.827ms) - First Batch Produced: 1s632ms (1s399ms) - First Batch Sent: 1s634ms (1.905ms) MemoryUsage(1m4s): 8.69 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.72 GB, 12.71 GB, 12.70 GB, 12.67 GB, 12.65 GB, 12.61 GB, 12.59 GB, 12.56 GB, 12.54 GB, 12.47 GB, 12.40 GB, 12.30 GB, 12.25 GB, 12.19 GB, 12.17 GB, 12.16 GB, 12.16 GB, 12.16 GB, 12.16 GB, 12.16 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.73 GB (13669913597) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.62 GB (91936363186) - RowsProduced: 264.13M (264126464) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m1s - TotalStorageWaitTime: 17m24s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 33.825ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 32.995ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 2s990ms - OpenTime: 33.826ms - ExecTreeOpenTime: 225.404us - PrepareTime: 198.354ms - ExecTreePrepareTime: 2.208ms KrpcDataStreamSender (dst_id=1):(Total: 4m38s, non-child: 4m38s, % non-child: 100.00%) - BytesSent: 34.68 GB (37239040544) - EosSent: 0 (0) - OverallThroughput: 127.42 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 264.13M (264125440) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m38s - UncompressedRowBatchSize: 68.08 GB (73104440891) HDFS_SCAN_NODE (id=0):(Total: 2s810ms, non-child: 2s810ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:35/8.47 GB 4:15/3.68 GB 2:39/9.62 GB 3:26/6.32 GB 7:24/5.94 GB 6:28/6.81 GB 0:30/7.35 GB 5:27/6.65 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.69 GB, 11.62 GB, 12.03 GB, 12.23 GB, 12.53 GB, 12.84 GB, 13.49 GB, 14.43 GB, 14.91 GB, 15.20 GB, 15.24 GB, 15.27 GB, 15.32 GB, 15.34 GB, 15.37 GB, 15.46 GB, 15.57 GB, 15.68 GB, 15.81 GB, 15.84 GB, 15.86 GB, 15.92 GB, 15.96 GB, 16.04 GB, 16.15 GB, 16.22 GB, 16.29 GB, 16.44 GB, 16.66 GB, 16.93 GB, 17.17 GB, 17.46 GB, 17.65 GB, 17.71 GB, 17.79 GB, 17.86 GB, 17.98 GB, 18.02 GB, 18.08 GB, 18.13 GB, 18.16 GB, 18.17 GB, 18.18 GB, 18.22 GB, 18.27 GB - FooterProcessingTime: (Avg: 4s017ms ; Min: 94.929ms ; Max: 9s247ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.35 GB (19700196353) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m17s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.73 GB (13666855027) - PerReadThreadRawHdfsThroughput: 51.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 264.33M (264331264) - RowsReturned: 264.13M (264126464) - RowsReturnedRate: 93.96 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s504ms - TotalRawHdfsReadTime(*): 6m7s - TotalReadThroughput: 6.43 MB/sec CodeGen:(Total: 33.361ms, non-child: 33.361ms, % non-child: 100.00%) - CodegenTime: 319.269us - CompileTime: 4.254ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.120ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 21.427ms Instance 844a0200d7876345:20bb38b900000079 (host=vd1332.foo.com:22000):(Total: 131.851ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:28/6.77 GB 6:33/7.99 GB 1:27/6.29 GB 5:23/5.58 GB 2:25/6.03 GB 0:32/7.84 GB 3:23/5.62 GB 7:37/8.59 GB Fragment Instance Lifecycle Event Timeline: 1s617ms - Prepare Finished: 95.819ms (95.819ms) - Open Finished: 132.504ms (36.684ms) - First Batch Produced: 1s615ms (1s482ms) - First Batch Sent: 1s617ms (2.018ms) MemoryUsage(1m4s): 7.85 GB, 12.57 GB, 12.57 GB, 12.59 GB, 12.68 GB, 12.68 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.67 GB, 12.66 GB, 12.64 GB, 12.61 GB, 12.61 GB, 12.59 GB, 12.57 GB, 12.53 GB, 12.48 GB, 12.43 GB, 12.38 GB, 12.33 GB, 12.28 GB, 12.22 GB, 12.17 GB, 12.12 GB, 12.09 GB, 12.06 GB, 12.05 GB, 12.05 GB, 12.05 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.70 GB (13632925012) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.84 GB (84648962399) - RowsProduced: 261.52M (261516804) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m58s - TotalStorageWaitTime: 20m24s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 36.660ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 35.994ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s928ms - OpenTime: 36.661ms - ExecTreeOpenTime: 258.505us - PrepareTime: 95.112ms - ExecTreePrepareTime: 2.329ms KrpcDataStreamSender (dst_id=1):(Total: 4m43s, non-child: 4m43s, % non-child: 100.00%) - BytesSent: 34.34 GB (36871970130) - EosSent: 0 (0) - OverallThroughput: 124.02 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 261.52M (261515780) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m42s - UncompressedRowBatchSize: 67.41 GB (72381948326) HDFS_SCAN_NODE (id=0):(Total: 3s742ms, non-child: 3s742ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:28/6.77 GB 6:33/7.99 GB 1:27/6.29 GB 5:23/5.58 GB 2:25/6.03 GB 0:32/7.84 GB 3:23/5.62 GB 7:37/8.59 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.91 GB, 11.54 GB, 11.94 GB, 12.16 GB, 12.53 GB, 12.93 GB, 13.47 GB, 14.18 GB, 14.73 GB, 15.05 GB, 15.18 GB, 15.23 GB, 15.26 GB, 15.33 GB, 15.38 GB, 15.43 GB, 15.49 GB, 15.58 GB, 15.67 GB, 15.80 GB, 15.86 GB, 15.88 GB, 15.91 GB, 15.97 GB, 16.07 GB, 16.19 GB, 16.28 GB, 16.39 GB, 16.52 GB, 16.68 GB, 16.88 GB, 17.11 GB, 17.37 GB, 17.54 GB, 17.67 GB, 17.72 GB, 17.79 GB, 17.87 GB, 17.92 GB, 17.97 GB, 18.02 GB, 18.07 GB, 18.10 GB, 18.13 GB, 18.17 GB - FooterProcessingTime: (Avg: 3s569ms ; Min: 106.363ms ; Max: 9s459ms ; Number of samples: 81) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.21 GB (19556712807) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m10s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 81 (81) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.69 GB (13629899210) - PerReadThreadRawHdfsThroughput: 46.28 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 261.72M (261721604) - RowsReturned: 261.52M (261516804) - RowsReturnedRate: 69.89 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 563.066ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s199ms - TotalRawHdfsReadTime(*): 6m43s - TotalReadThroughput: 6.39 MB/sec CodeGen:(Total: 36.105ms, non-child: 36.105ms, % non-child: 100.00%) - CodegenTime: 427.367us - CompileTime: 4.415ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.667ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 23.510ms Instance 844a0200d7876345:20bb38b900000005 (host=vd1333.foo.com:22000):(Total: 235.511ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:24/5.76 GB 4:31/7.61 GB 5:26/6.24 GB 7:31/7.51 GB 3:25/6.15 GB 1:31/7.55 GB 0:34/8.29 GB 2:23/5.62 GB Fragment Instance Lifecycle Event Timeline: 1s722ms - Prepare Finished: 200.970ms (200.970ms) - Open Finished: 236.004ms (35.033ms) - First Batch Produced: 1s720ms (1s484ms) - First Batch Sent: 1s722ms (1.875ms) MemoryUsage(1m4s): 9.12 GB, 12.62 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.62 GB, 12.61 GB, 12.61 GB, 12.61 GB, 12.61 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.61 GB, 12.60 GB, 12.60 GB, 12.60 GB, 12.60 GB, 12.60 GB, 12.59 GB, 12.59 GB, 12.59 GB, 12.58 GB, 12.56 GB, 12.53 GB, 12.51 GB, 12.49 GB, 12.43 GB, 12.40 GB, 12.35 GB, 12.28 GB, 12.24 GB, 12.16 GB, 12.09 GB, 12.00 GB, 11.92 GB, 11.86 GB, 11.83 GB, 11.82 GB, 11.82 GB, 11.82 GB, 11.82 GB, 11.81 GB, 11.79 GB, 11.79 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.63 GB (13563623775) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.30 GB (91585605635) - RowsProduced: 270.79M (270789632) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m26s - TotalStorageWaitTime: 15m12s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 35.029ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 32.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s586ms - OpenTime: 35.030ms - ExecTreeOpenTime: 224.903us - PrepareTime: 200.403ms - ExecTreePrepareTime: 2.046ms KrpcDataStreamSender (dst_id=1):(Total: 4m34s, non-child: 4m34s, % non-child: 100.00%) - BytesSent: 35.56 GB (38182137331) - EosSent: 0 (0) - OverallThroughput: 132.70 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 270.79M (270788608) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m33s - UncompressedRowBatchSize: 69.80 GB (74948882720) HDFS_SCAN_NODE (id=0):(Total: 3s391ms, non-child: 3s391ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:24/5.76 GB 4:31/7.61 GB 5:26/6.24 GB 7:31/7.51 GB 3:25/6.15 GB 1:31/7.55 GB 0:34/8.29 GB 2:23/5.62 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 8.12 GB, 11.72 GB, 12.14 GB, 12.40 GB, 12.90 GB, 13.77 GB, 14.56 GB, 14.98 GB, 15.11 GB, 15.14 GB, 15.17 GB, 15.22 GB, 15.28 GB, 15.34 GB, 15.45 GB, 15.58 GB, 15.67 GB, 15.72 GB, 15.75 GB, 15.78 GB, 15.82 GB, 15.85 GB, 15.95 GB, 16.06 GB, 16.20 GB, 16.36 GB, 16.54 GB, 16.78 GB, 17.04 GB, 17.25 GB, 17.38 GB, 17.45 GB, 17.51 GB, 17.58 GB, 17.65 GB, 17.72 GB, 17.76 GB, 17.79 GB, 17.82 GB, 17.86 GB, 17.90 GB, 17.94 GB, 17.98 GB, 18.04 GB, 18.14 GB - FooterProcessingTime: (Avg: 2s979ms ; Min: 141.312ms ; Max: 6s936ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.22 GB (19568333285) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m59s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.63 GB (13560466820) - PerReadThreadRawHdfsThroughput: 56.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 270.99M (270994432) - RowsReturned: 270.79M (270789632) - RowsReturnedRate: 79.86 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s156ms - TotalRawHdfsReadTime(*): 5m28s - TotalReadThroughput: 6.38 MB/sec CodeGen:(Total: 34.539ms, non-child: 34.539ms, % non-child: 100.00%) - CodegenTime: 357.819us - CompileTime: 4.474ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.607ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.854ms Instance 844a0200d7876345:20bb38b900000026 (host=vd1334.foo.com:22000):(Total: 263.658ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:23/5.69 GB 5:31/7.67 GB 4:19/4.58 GB 0:31/7.56 GB 2:33/8.13 GB 6:28/6.78 GB 1:29/7.06 GB 7:30/7.31 GB Fragment Instance Lifecycle Event Timeline: 1s927ms - Prepare Finished: 226.841ms (226.841ms) - Open Finished: 264.222ms (37.380ms) - First Batch Produced: 1s925ms (1s661ms) - First Batch Sent: 1s927ms (1.923ms) MemoryUsage(1m4s): 5.77 GB, 12.62 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.68 GB, 12.68 GB, 12.67 GB, 12.66 GB, 12.66 GB, 12.65 GB, 12.65 GB, 12.64 GB, 12.63 GB, 12.61 GB, 12.57 GB, 12.56 GB, 12.55 GB, 12.53 GB, 12.50 GB, 12.44 GB, 12.39 GB, 12.33 GB, 12.28 GB, 12.24 GB, 12.18 GB, 12.13 GB, 12.09 GB, 12.06 GB, 12.03 GB, 12.03 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.71 GB (13646234426) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.44 GB (91741688682) - RowsProduced: 264.13M (264130560) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m34s - TotalStorageWaitTime: 32m3s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 37.374ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 33.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s355ms - OpenTime: 37.376ms - ExecTreeOpenTime: 236.214us - PrepareTime: 226.211ms - ExecTreePrepareTime: 1.969ms KrpcDataStreamSender (dst_id=1):(Total: 4m41s, non-child: 4m41s, % non-child: 100.00%) - BytesSent: 34.66 GB (37214517116) - EosSent: 0 (0) - OverallThroughput: 126.23 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 264.13M (264129536) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m40s - UncompressedRowBatchSize: 68.09 GB (73106213960) HDFS_SCAN_NODE (id=0):(Total: 3s152ms, non-child: 3s152ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:23/5.69 GB 5:31/7.67 GB 4:19/4.58 GB 0:31/7.56 GB 2:33/8.13 GB 6:28/6.78 GB 1:29/7.06 GB 7:30/7.31 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 5.00 GB, 11.68 GB, 12.13 GB, 12.50 GB, 12.76 GB, 13.02 GB, 13.37 GB, 13.98 GB, 14.60 GB, 15.07 GB, 15.29 GB, 15.37 GB, 15.41 GB, 15.44 GB, 15.49 GB, 15.55 GB, 15.60 GB, 15.70 GB, 15.82 GB, 15.92 GB, 16.01 GB, 16.08 GB, 16.19 GB, 16.25 GB, 16.32 GB, 16.38 GB, 16.44 GB, 16.52 GB, 16.61 GB, 16.71 GB, 16.84 GB, 17.03 GB, 17.28 GB, 17.51 GB, 17.67 GB, 17.77 GB, 17.84 GB, 17.94 GB, 18.00 GB, 18.06 GB, 18.12 GB, 18.15 GB, 18.17 GB, 18.19 GB, 18.22 GB - FooterProcessingTime: (Avg: 6s133ms ; Min: 135.664ms ; Max: 20s653ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.18 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.26 GB (19606186401) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m34s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.71 GB (13643225157) - PerReadThreadRawHdfsThroughput: 36.88 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 264.34M (264335360) - RowsReturned: 264.13M (264130560) - RowsReturnedRate: 83.79 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s942ms - TotalRawHdfsReadTime(*): 8m27s - TotalReadThroughput: 6.41 MB/sec CodeGen:(Total: 36.840ms, non-child: 36.840ms, % non-child: 100.00%) - CodegenTime: 460.386us - CompileTime: 4.422ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.902ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.893ms Instance 844a0200d7876345:20bb38b900000012 (host=vd1335.foo.com:22000):(Total: 254.166ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:16/3.93 GB 6:36/8.87 GB 3:29/7.06 GB 1:28/6.66 GB 2:25/5.95 GB 5:23/5.69 GB 0:34/8.30 GB 7:32/7.75 GB Fragment Instance Lifecycle Event Timeline: 1s569ms - Prepare Finished: 218.846ms (218.846ms) - Open Finished: 254.969ms (36.123ms) - First Batch Produced: 1s567ms (1s312ms) - First Batch Sent: 1s569ms (1.559ms) MemoryUsage(1m4s): 6.78 GB, 12.64 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.72 GB, 12.70 GB, 12.69 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.67 GB, 12.66 GB, 12.64 GB, 12.61 GB, 12.59 GB, 12.58 GB, 12.56 GB, 12.53 GB, 12.51 GB, 12.49 GB, 12.46 GB, 12.44 GB, 12.41 GB, 12.37 GB, 12.33 GB, 12.29 GB, 12.26 GB, 12.20 GB, 12.16 GB, 12.14 GB, 12.12 GB, 12.10 GB, 12.09 GB, 12.09 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.73 GB (13672275855) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.65 GB (91967083788) - RowsProduced: 271.74M (271740928) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m59s - TotalStorageWaitTime: 26m43s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 36.120ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 35.995ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s368ms - OpenTime: 36.121ms - ExecTreeOpenTime: 163.722us - PrepareTime: 217.953ms - ExecTreePrepareTime: 1.929ms KrpcDataStreamSender (dst_id=1):(Total: 4m41s, non-child: 4m41s, % non-child: 100.00%) - BytesSent: 35.69 GB (38317313039) - EosSent: 0 (0) - OverallThroughput: 129.91 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 271.74M (271739904) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m40s - UncompressedRowBatchSize: 70.05 GB (75212337930) HDFS_SCAN_NODE (id=0):(Total: 3s165ms, non-child: 3s165ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:16/3.93 GB 6:36/8.87 GB 3:29/7.06 GB 1:28/6.66 GB 2:25/5.95 GB 5:23/5.69 GB 0:34/8.30 GB 7:32/7.75 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 5.94 GB, 11.77 GB, 12.38 GB, 12.85 GB, 13.23 GB, 13.69 GB, 14.11 GB, 14.63 GB, 15.00 GB, 15.24 GB, 15.35 GB, 15.44 GB, 15.51 GB, 15.53 GB, 15.60 GB, 15.69 GB, 15.73 GB, 15.80 GB, 15.91 GB, 16.02 GB, 16.14 GB, 16.23 GB, 16.28 GB, 16.37 GB, 16.52 GB, 16.63 GB, 16.70 GB, 16.86 GB, 17.06 GB, 17.17 GB, 17.27 GB, 17.43 GB, 17.59 GB, 17.73 GB, 17.89 GB, 17.98 GB, 18.04 GB, 18.09 GB, 18.13 GB, 18.20 GB, 18.26 GB, 18.29 GB, 18.31 GB, 18.34 GB, 18.40 GB - FooterProcessingTime: (Avg: 4s467ms ; Min: 117.381ms ; Max: 10s140ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.45 GB (19812169681) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m11s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.73 GB (13669209072) - PerReadThreadRawHdfsThroughput: 39.32 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 271.95M (271945728) - RowsReturned: 271.74M (271740928) - RowsReturnedRate: 85.84 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s120ms - TotalRawHdfsReadTime(*): 8m - TotalReadThroughput: 6.45 MB/sec CodeGen:(Total: 35.652ms, non-child: 35.652ms, % non-child: 100.00%) - CodegenTime: 419.546us - CompileTime: 4.275ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.883ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.998ms Instance 844a0200d7876345:20bb38b90000005d (host=vd1336.foo.com:22000):(Total: 248.194ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:28/6.86 GB 4:25/6.19 GB 7:24/5.91 GB 3:37/9.12 GB 5:28/6.86 GB 6:28/6.77 GB 2:32/7.92 GB 0:21/5.01 GB Fragment Instance Lifecycle Event Timeline: 2s010ms - Prepare Finished: 207.192ms (207.192ms) - Open Finished: 248.650ms (41.457ms) - First Batch Produced: 2s008ms (1s759ms) - First Batch Sent: 2s010ms (1.611ms) MemoryUsage(1m4s): 7.79 GB, 12.65 GB, 12.65 GB, 12.66 GB, 12.65 GB, 12.63 GB, 12.62 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.68 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.71 GB, 12.69 GB, 12.68 GB, 12.67 GB, 12.65 GB, 12.63 GB, 12.59 GB, 12.56 GB, 12.53 GB, 12.50 GB, 12.46 GB, 12.39 GB, 12.34 GB, 12.28 GB, 12.24 GB, 12.22 GB, 12.20 GB, 12.20 GB, 12.20 GB, 12.20 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.72 GB (13659992791) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.01 GB (84840715546) - RowsProduced: 263.80M (263796208) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m54s - TotalStorageWaitTime: 20m44s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 41.448ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 37.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s307ms - OpenTime: 41.449ms - ExecTreeOpenTime: 257.046us - PrepareTime: 206.680ms - ExecTreePrepareTime: 1.995ms KrpcDataStreamSender (dst_id=1):(Total: 4m41s, non-child: 4m41s, % non-child: 100.00%) - BytesSent: 34.62 GB (37169971780) - EosSent: 0 (0) - OverallThroughput: 126.08 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 263.80M (263795184) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m40s - UncompressedRowBatchSize: 68.00 GB (73013264462) HDFS_SCAN_NODE (id=0):(Total: 4s121ms, non-child: 4s121ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:28/6.86 GB 4:25/6.19 GB 7:24/5.91 GB 3:37/9.12 GB 5:28/6.86 GB 6:28/6.77 GB 2:32/7.92 GB 0:21/5.01 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.84 GB, 11.59 GB, 11.97 GB, 12.23 GB, 12.55 GB, 12.89 GB, 13.38 GB, 14.16 GB, 14.73 GB, 15.06 GB, 15.16 GB, 15.20 GB, 15.25 GB, 15.28 GB, 15.32 GB, 15.39 GB, 15.49 GB, 15.60 GB, 15.69 GB, 15.76 GB, 15.92 GB, 15.99 GB, 16.07 GB, 16.16 GB, 16.28 GB, 16.36 GB, 16.43 GB, 16.53 GB, 16.69 GB, 16.89 GB, 17.15 GB, 17.41 GB, 17.59 GB, 17.70 GB, 17.81 GB, 17.89 GB, 17.96 GB, 18.03 GB, 18.10 GB, 18.15 GB, 18.19 GB, 18.23 GB, 18.24 GB, 18.26 GB, 18.29 GB - FooterProcessingTime: (Avg: 3s949ms ; Min: 85.875ms ; Max: 12s330ms ; Number of samples: 81) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.36 GB (19715405988) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m16s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 81 (81) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.72 GB (13656836191) - PerReadThreadRawHdfsThroughput: 43.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 264.00M (264001008) - RowsReturned: 263.80M (263796208) - RowsReturnedRate: 64.01 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 1s297ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s590ms - TotalRawHdfsReadTime(*): 7m9s - TotalReadThroughput: 6.43 MB/sec CodeGen:(Total: 40.862ms, non-child: 40.862ms, % non-child: 100.00%) - CodegenTime: 437.068us - CompileTime: 4.650ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 9.107ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 26.250ms Instance 844a0200d7876345:20bb38b90000003e (host=vd1337.foo.com:22000):(Total: 244.191ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:34/8.38 GB 7:28/6.77 GB 4:28/6.74 GB 3:27/6.61 GB 2:30/7.35 GB 6:21/5.16 GB 1:31/7.54 GB 5:25/6.11 GB Fragment Instance Lifecycle Event Timeline: 1s534ms - Prepare Finished: 210.092ms (210.092ms) - Open Finished: 244.684ms (34.591ms) - First Batch Produced: 1s533ms (1s288ms) - First Batch Sent: 1s534ms (1.704ms) MemoryUsage(1m4s): 6.89 GB, 12.61 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.69 GB, 12.69 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.67 GB, 12.66 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.64 GB, 12.64 GB, 12.63 GB, 12.62 GB, 12.61 GB, 12.59 GB, 12.59 GB, 12.57 GB, 12.52 GB, 12.50 GB, 12.48 GB, 12.45 GB, 12.41 GB, 12.35 GB, 12.31 GB, 12.27 GB, 12.25 GB, 12.20 GB, 12.15 GB, 12.10 GB, 12.08 GB, 12.05 GB, 12.03 GB, 12.01 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.70 GB (13639258808) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.87 GB (84681866801) - RowsProduced: 269.13M (269134848) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m - TotalStorageWaitTime: 26m55s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 34.589ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 33.995ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s325ms - OpenTime: 34.590ms - ExecTreeOpenTime: 157.254us - PrepareTime: 209.522ms - ExecTreePrepareTime: 1.846ms KrpcDataStreamSender (dst_id=1):(Total: 4m40s, non-child: 4m40s, % non-child: 100.00%) - BytesSent: 35.32 GB (37919723943) - EosSent: 0 (0) - OverallThroughput: 128.94 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 269.13M (269133824) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m39s - UncompressedRowBatchSize: 69.38 GB (74490988394) HDFS_SCAN_NODE (id=0):(Total: 4s126ms, non-child: 4s126ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:34/8.38 GB 7:28/6.77 GB 4:28/6.74 GB 3:27/6.61 GB 2:30/7.35 GB 6:21/5.16 GB 1:31/7.54 GB 5:25/6.11 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.06 GB, 11.77 GB, 12.31 GB, 12.63 GB, 13.00 GB, 13.45 GB, 13.94 GB, 14.41 GB, 14.72 GB, 15.04 GB, 15.16 GB, 15.30 GB, 15.40 GB, 15.47 GB, 15.54 GB, 15.64 GB, 15.73 GB, 15.80 GB, 15.88 GB, 15.94 GB, 16.01 GB, 16.07 GB, 16.20 GB, 16.32 GB, 16.40 GB, 16.49 GB, 16.61 GB, 16.73 GB, 16.93 GB, 17.07 GB, 17.18 GB, 17.33 GB, 17.47 GB, 17.57 GB, 17.70 GB, 17.83 GB, 17.91 GB, 17.97 GB, 18.04 GB, 18.08 GB, 18.14 GB, 18.18 GB, 18.23 GB, 18.26 GB, 18.31 GB - FooterProcessingTime: (Avg: 5s948ms ; Min: 132.086ms ; Max: 19s663ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.39 GB (19745617184) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m14s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.70 GB (13636044619) - PerReadThreadRawHdfsThroughput: 41.75 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 269.34M (269339648) - RowsReturned: 269.13M (269134848) - RowsReturnedRate: 65.22 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s723ms - TotalRawHdfsReadTime(*): 7m31s - TotalReadThroughput: 6.43 MB/sec CodeGen:(Total: 34.114ms, non-child: 34.114ms, % non-child: 100.00%) - CodegenTime: 421.164us - CompileTime: 4.529ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.368ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 21.648ms Instance 844a0200d7876345:20bb38b90000005c (host=vd1338.foo.com:22000):(Total: 251.398ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:25/6.04 GB 4:36/8.75 GB 3:27/6.54 GB 7:35/8.50 GB 6:26/6.22 GB 5:25/6.15 GB 0:24/5.86 GB 1:27/6.58 GB Fragment Instance Lifecycle Event Timeline: 1s607ms - Prepare Finished: 217.794ms (217.794ms) - Open Finished: 251.852ms (34.058ms) - First Batch Produced: 1s605ms (1s353ms) - First Batch Sent: 1s607ms (2.177ms) MemoryUsage(1m4s): 5.80 GB, 12.58 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.69 GB, 12.69 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.67 GB, 12.66 GB, 12.66 GB, 12.65 GB, 12.62 GB, 12.59 GB, 12.58 GB, 12.55 GB, 12.53 GB, 12.50 GB, 12.48 GB, 12.46 GB, 12.43 GB, 12.41 GB, 12.38 GB, 12.35 GB, 12.31 GB, 12.29 GB, 12.28 GB, 12.26 GB, 12.24 GB, 12.20 GB, 12.16 GB, 12.10 GB, 12.07 GB, 12.04 GB, 12.01 GB, 11.98 GB, 11.98 GB, 11.96 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.70 GB (13638428883) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.73 GB (84534285720) - RowsProduced: 273.34M (273343488) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m49s - TotalStorageWaitTime: 30m28s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 34.055ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 32.995ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s438ms - OpenTime: 34.056ms - ExecTreeOpenTime: 159.968us - PrepareTime: 217.265ms - ExecTreePrepareTime: 1.780ms KrpcDataStreamSender (dst_id=1):(Total: 4m45s, non-child: 4m45s, % non-child: 100.00%) - BytesSent: 35.90 GB (38546188052) - EosSent: 0 (0) - OverallThroughput: 128.77 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 273.34M (273342464) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m44s - UncompressedRowBatchSize: 70.46 GB (75656029461) HDFS_SCAN_NODE (id=0):(Total: 3s249ms, non-child: 3s249ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:25/6.04 GB 4:36/8.75 GB 3:27/6.54 GB 7:35/8.50 GB 6:26/6.22 GB 5:25/6.15 GB 0:24/5.86 GB 1:27/6.58 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 5.04 GB, 11.74 GB, 12.50 GB, 13.08 GB, 13.45 GB, 13.74 GB, 14.12 GB, 14.58 GB, 14.99 GB, 15.23 GB, 15.40 GB, 15.50 GB, 15.53 GB, 15.56 GB, 15.60 GB, 15.70 GB, 15.82 GB, 15.94 GB, 16.04 GB, 16.12 GB, 16.20 GB, 16.29 GB, 16.44 GB, 16.56 GB, 16.64 GB, 16.69 GB, 16.74 GB, 16.83 GB, 16.93 GB, 17.05 GB, 17.21 GB, 17.34 GB, 17.47 GB, 17.64 GB, 17.81 GB, 17.91 GB, 17.97 GB, 18.02 GB, 18.10 GB, 18.15 GB, 18.20 GB, 18.23 GB, 18.25 GB, 18.28 GB, 18.30 GB - FooterProcessingTime: (Avg: 4s867ms ; Min: 149.703ms ; Max: 23s990ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.32 GB (19675774614) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m16s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.70 GB (13635312976) - PerReadThreadRawHdfsThroughput: 32.87 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 273.55M (273547264) - RowsReturned: 273.34M (273343488) - RowsReturnedRate: 84.12 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s918ms - TotalRawHdfsReadTime(*): 9m30s - TotalReadThroughput: 6.42 MB/sec CodeGen:(Total: 33.615ms, non-child: 33.615ms, % non-child: 100.00%) - CodegenTime: 396.995us - CompileTime: 4.170ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.204ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 21.626ms Instance 844a0200d7876345:20bb38b90000005a (host=vd1339.foo.com:22000):(Total: 254.400ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:19/4.70 GB 7:30/7.36 GB 1:34/8.39 GB 2:22/5.45 GB 0:40/9.79 GB 3:21/5.17 GB 6:32/7.63 GB 5:25/6.10 GB Fragment Instance Lifecycle Event Timeline: 1s608ms - Prepare Finished: 214.733ms (214.733ms) - Open Finished: 254.840ms (40.106ms) - First Batch Produced: 1s606ms (1s351ms) - First Batch Sent: 1s608ms (2.035ms) MemoryUsage(1m4s): 6.80 GB, 12.61 GB, 12.62 GB, 12.72 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.73 GB, 12.73 GB, 12.72 GB, 12.72 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.70 GB, 12.70 GB, 12.69 GB, 12.68 GB, 12.66 GB, 12.64 GB, 12.61 GB, 12.60 GB, 12.58 GB, 12.57 GB, 12.54 GB, 12.50 GB, 12.45 GB, 12.40 GB, 12.33 GB, 12.28 GB, 12.25 GB, 12.23 GB, 12.21 GB, 12.19 GB, 12.18 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.74 GB (13680348562) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.06 GB (84888643685) - RowsProduced: 264.32M (264322580) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m10s - TotalStorageWaitTime: 26m7s - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 40.103ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 38.994ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s247ms - OpenTime: 40.104ms - ExecTreeOpenTime: 263.587us - PrepareTime: 214.224ms - ExecTreePrepareTime: 2.114ms KrpcDataStreamSender (dst_id=1):(Total: 4m37s, non-child: 4m37s, % non-child: 100.00%) - BytesSent: 34.67 GB (37226629752) - EosSent: 0 (0) - OverallThroughput: 128.06 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 264.32M (264321556) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m36s - UncompressedRowBatchSize: 68.13 GB (73159068705) HDFS_SCAN_NODE (id=0):(Total: 4s036ms, non-child: 4s036ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:19/4.70 GB 7:30/7.36 GB 1:34/8.39 GB 2:22/5.45 GB 0:40/9.79 GB 3:21/5.17 GB 6:32/7.63 GB 5:25/6.10 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 5.93 GB, 11.59 GB, 12.02 GB, 12.43 GB, 12.72 GB, 13.08 GB, 13.48 GB, 14.19 GB, 14.69 GB, 15.11 GB, 15.26 GB, 15.34 GB, 15.40 GB, 15.43 GB, 15.50 GB, 15.57 GB, 15.61 GB, 15.71 GB, 15.85 GB, 15.94 GB, 16.00 GB, 16.06 GB, 16.14 GB, 16.21 GB, 16.30 GB, 16.37 GB, 16.43 GB, 16.56 GB, 16.70 GB, 16.82 GB, 16.98 GB, 17.25 GB, 17.53 GB, 17.68 GB, 17.81 GB, 17.89 GB, 17.98 GB, 18.06 GB, 18.12 GB, 18.19 GB, 18.24 GB, 18.26 GB, 18.28 GB, 18.32 GB, 18.36 GB - FooterProcessingTime: (Avg: 4s930ms ; Min: 89.410ms ; Max: 17s503ms ; Number of samples: 81) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.40 GB (19761366836) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m19s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 81 (81) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.74 GB (13677199889) - PerReadThreadRawHdfsThroughput: 38.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 264.53M (264527380) - RowsReturned: 264.32M (264322580) - RowsReturnedRate: 65.48 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 473.869ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s745ms - TotalRawHdfsReadTime(*): 8m10s - TotalReadThroughput: 6.43 MB/sec CodeGen:(Total: 39.263ms, non-child: 39.263ms, % non-child: 100.00%) - CodegenTime: 744.391us - CompileTime: 5.198ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 9.444ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 23.732ms Instance 844a0200d7876345:20bb38b900000056 (host=vd1340.foo.com:22000):(Total: 227.318ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:18/4.46 GB 1:31/7.63 GB 3:30/7.31 GB 2:34/8.15 GB 6:21/5.13 GB 4:35/8.56 GB 5:40/9.49 GB 7:16/3.89 GB Fragment Instance Lifecycle Event Timeline: 1s774ms - Prepare Finished: 193.872ms (193.872ms) - Open Finished: 228.096ms (34.224ms) - First Batch Produced: 1s772ms (1s544ms) - First Batch Sent: 1s774ms (1.327ms) MemoryUsage(1m4s): 7.33 GB, 12.64 GB, 12.72 GB, 12.72 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.73 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.71 GB, 12.71 GB, 12.70 GB, 12.69 GB, 12.69 GB, 12.68 GB, 12.65 GB, 12.64 GB, 12.63 GB, 12.60 GB, 12.58 GB, 12.53 GB, 12.48 GB, 12.45 GB, 12.42 GB, 12.39 GB, 12.37 GB, 12.34 GB, 12.29 GB, 12.26 GB, 12.25 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.74 GB (13679455258) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.10 GB (84937687442) - RowsProduced: 261.41M (261413725) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m17s - TotalStorageWaitTime: 23m43s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 34.220ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 33.994ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s081ms - OpenTime: 34.222ms - ExecTreeOpenTime: 179.938us - PrepareTime: 193.001ms - ExecTreePrepareTime: 1.746ms KrpcDataStreamSender (dst_id=1):(Total: 4m40s, non-child: 4m40s, % non-child: 100.00%) - BytesSent: 34.28 GB (36805130951) - EosSent: 0 (0) - OverallThroughput: 125.01 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 261.41M (261412701) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m40s - UncompressedRowBatchSize: 67.38 GB (72354001808) HDFS_SCAN_NODE (id=0):(Total: 3s866ms, non-child: 3s866ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:18/4.46 GB 1:31/7.63 GB 3:30/7.31 GB 2:34/8.15 GB 6:21/5.13 GB 4:35/8.56 GB 5:40/9.49 GB 7:16/3.89 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.44 GB, 11.69 GB, 12.21 GB, 12.50 GB, 12.80 GB, 13.23 GB, 13.75 GB, 14.31 GB, 14.76 GB, 15.05 GB, 15.22 GB, 15.30 GB, 15.35 GB, 15.43 GB, 15.50 GB, 15.58 GB, 15.64 GB, 15.73 GB, 15.82 GB, 15.90 GB, 15.99 GB, 16.03 GB, 16.10 GB, 16.17 GB, 16.24 GB, 16.32 GB, 16.43 GB, 16.53 GB, 16.70 GB, 16.85 GB, 17.01 GB, 17.16 GB, 17.34 GB, 17.52 GB, 17.72 GB, 17.86 GB, 17.96 GB, 18.01 GB, 18.07 GB, 18.12 GB, 18.17 GB, 18.21 GB, 18.26 GB, 18.30 GB, 18.34 GB - FooterProcessingTime: (Avg: 5s006ms ; Min: 97.928ms ; Max: 12s919ms ; Number of samples: 81) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.42 GB (19781221349) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m49s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 81 (81) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.74 GB (13676355728) - PerReadThreadRawHdfsThroughput: 44.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 261.62M (261618525) - RowsReturned: 261.41M (261413725) - RowsReturnedRate: 67.61 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 352.600ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s099ms - TotalRawHdfsReadTime(*): 7m8s - TotalReadThroughput: 6.45 MB/sec CodeGen:(Total: 33.770ms, non-child: 33.770ms, % non-child: 100.00%) - CodegenTime: 372.155us - CompileTime: 4.176ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.422ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 21.625ms Instance 844a0200d7876345:20bb38b900000055 (host=vd1341.foo.com:22000):(Total: 224.406ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:26/6.31 GB 1:27/6.65 GB 4:28/6.83 GB 0:33/8.06 GB 6:32/7.88 GB 3:34/8.12 GB 7:27/6.62 GB 2:18/4.42 GB Fragment Instance Lifecycle Event Timeline: 1s895ms - Prepare Finished: 191.933ms (191.933ms) - Open Finished: 224.879ms (32.945ms) - First Batch Produced: 1s893ms (1s668ms) - First Batch Sent: 1s895ms (1.752ms) MemoryUsage(1m4s): 8.06 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.68 GB, 12.65 GB, 12.64 GB, 12.62 GB, 12.59 GB, 12.57 GB, 12.54 GB, 12.52 GB, 12.50 GB, 12.48 GB, 12.43 GB, 12.37 GB, 12.30 GB, 12.24 GB, 12.18 GB, 12.14 GB, 12.12 GB, 12.09 GB, 12.08 GB, 12.08 GB, 12.08 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.70 GB (13636537873) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.00 GB (84822144409) - RowsProduced: 262.96M (262958080) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m10s - TotalStorageWaitTime: 21m7s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 32.942ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 31.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s324ms - OpenTime: 32.944ms - ExecTreeOpenTime: 159.336us - PrepareTime: 191.378ms - ExecTreePrepareTime: 2.264ms KrpcDataStreamSender (dst_id=1):(Total: 4m35s, non-child: 4m35s, % non-child: 100.00%) - BytesSent: 34.52 GB (37062216771) - EosSent: 0 (0) - OverallThroughput: 128.37 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 262.96M (262957056) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m34s - UncompressedRowBatchSize: 67.78 GB (72781573866) HDFS_SCAN_NODE (id=0):(Total: 3s145ms, non-child: 3s145ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:26/6.31 GB 1:27/6.65 GB 4:28/6.83 GB 0:33/8.06 GB 6:32/7.88 GB 3:34/8.12 GB 7:27/6.62 GB 2:18/4.42 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.14 GB, 11.62 GB, 12.03 GB, 12.35 GB, 12.55 GB, 12.80 GB, 13.19 GB, 13.98 GB, 14.62 GB, 15.06 GB, 15.21 GB, 15.26 GB, 15.28 GB, 15.31 GB, 15.36 GB, 15.41 GB, 15.47 GB, 15.56 GB, 15.73 GB, 15.85 GB, 15.92 GB, 15.96 GB, 16.03 GB, 16.08 GB, 16.14 GB, 16.18 GB, 16.25 GB, 16.36 GB, 16.49 GB, 16.66 GB, 16.88 GB, 17.17 GB, 17.42 GB, 17.56 GB, 17.69 GB, 17.75 GB, 17.85 GB, 17.92 GB, 17.98 GB, 18.03 GB, 18.06 GB, 18.08 GB, 18.10 GB, 18.14 GB, 18.17 GB - FooterProcessingTime: (Avg: 4s271ms ; Min: 127.613ms ; Max: 13s827ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.23 GB (19569921543) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m19s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.70 GB (13633487476) - PerReadThreadRawHdfsThroughput: 50.13 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 263.16M (263162880) - RowsReturned: 262.96M (262958080) - RowsReturnedRate: 83.59 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 7s744ms - TotalRawHdfsReadTime(*): 6m12s - TotalReadThroughput: 6.36 MB/sec CodeGen:(Total: 32.486ms, non-child: 32.486ms, % non-child: 100.00%) - CodegenTime: 381.308us - CompileTime: 4.324ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.451ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 20.202ms Instance 844a0200d7876345:20bb38b90000004f (host=vd1342.foo.com:22000):(Total: 253.239ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:19/4.63 GB 4:22/5.37 GB 5:28/6.81 GB 2:30/7.39 GB 1:29/7.02 GB 7:30/7.34 GB 0:33/8.02 GB 3:33/8.08 GB Fragment Instance Lifecycle Event Timeline: 1s467ms - Prepare Finished: 213.991ms (213.991ms) - Open Finished: 253.811ms (39.819ms) - First Batch Produced: 1s465ms (1s212ms) - First Batch Sent: 1s467ms (1.989ms) MemoryUsage(1m4s): 8.65 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.67 GB, 12.67 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.67 GB, 12.66 GB, 12.64 GB, 12.63 GB, 12.62 GB, 12.61 GB, 12.58 GB, 12.57 GB, 12.51 GB, 12.45 GB, 12.41 GB, 12.36 GB, 12.31 GB, 12.25 GB, 12.18 GB, 12.08 GB, 12.03 GB, 12.00 GB, 11.99 GB, 11.99 GB, 11.99 GB, 11.98 GB, 11.97 GB, 11.97 GB, 11.97 GB, 11.97 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.68 GB (13614889657) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.86 GB (84670060561) - RowsProduced: 274.69M (274688000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m11s - TotalStorageWaitTime: 17m1s - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 39.816ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 36.994ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s622ms - OpenTime: 39.817ms - ExecTreeOpenTime: 208.241us - PrepareTime: 213.350ms - ExecTreePrepareTime: 1.902ms KrpcDataStreamSender (dst_id=1):(Total: 4m32s, non-child: 4m32s, % non-child: 100.00%) - BytesSent: 36.05 GB (38707887125) - EosSent: 0 (0) - OverallThroughput: 135.60 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 274.69M (274686976) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m31s - UncompressedRowBatchSize: 70.81 GB (76028358634) HDFS_SCAN_NODE (id=0):(Total: 3s421ms, non-child: 3s421ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:19/4.63 GB 4:22/5.37 GB 5:28/6.81 GB 2:30/7.39 GB 1:29/7.02 GB 7:30/7.34 GB 0:33/8.02 GB 3:33/8.08 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.66 GB, 11.64 GB, 12.12 GB, 12.35 GB, 12.83 GB, 13.71 GB, 14.61 GB, 15.08 GB, 15.18 GB, 15.21 GB, 15.26 GB, 15.32 GB, 15.39 GB, 15.50 GB, 15.65 GB, 15.74 GB, 15.80 GB, 15.83 GB, 15.86 GB, 15.89 GB, 15.93 GB, 16.00 GB, 16.09 GB, 16.23 GB, 16.40 GB, 16.57 GB, 16.84 GB, 17.13 GB, 17.33 GB, 17.48 GB, 17.57 GB, 17.65 GB, 17.72 GB, 17.79 GB, 17.86 GB, 17.91 GB, 17.95 GB, 17.97 GB, 18.01 GB, 18.06 GB, 18.10 GB, 18.14 GB, 18.23 GB, 18.33 GB, 18.40 GB - FooterProcessingTime: (Avg: 2s820ms ; Min: 66.844ms ; Max: 7s257ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.46 GB (19816799014) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m24s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.68 GB (13611724593) - PerReadThreadRawHdfsThroughput: 54.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 274.89M (274892800) - RowsReturned: 274.69M (274688000) - RowsReturnedRate: 80.29 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 7s462ms - TotalRawHdfsReadTime(*): 5m47s - TotalReadThroughput: 6.45 MB/sec CodeGen:(Total: 39.266ms, non-child: 39.266ms, % non-child: 100.00%) - CodegenTime: 427.236us - CompileTime: 4.716ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 9.455ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 24.471ms Instance 844a0200d7876345:20bb38b900000069 (host=ve1125.foo.com:22000):(Total: 236.550ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:32/7.50 GB 7:21/5.16 GB 1:20/4.91 GB 2:32/7.59 GB 4:40/9.60 GB 6:35/8.51 GB 3:27/6.27 GB 5:22/5.40 GB Fragment Instance Lifecycle Event Timeline: 1s806ms - Prepare Finished: 202.563ms (202.563ms) - Open Finished: 237.021ms (34.457ms) - First Batch Produced: 1s805ms (1s568ms) - First Batch Sent: 1s806ms (1.310ms) MemoryUsage(1m4s): 8.07 GB, 12.47 GB, 12.46 GB, 12.48 GB, 12.54 GB, 12.54 GB, 12.54 GB, 12.55 GB, 12.55 GB, 12.55 GB, 12.54 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.64 GB, 12.63 GB, 12.63 GB, 12.61 GB, 12.60 GB, 12.59 GB, 12.56 GB, 12.51 GB, 12.47 GB, 12.42 GB, 12.35 GB, 12.29 GB, 12.23 GB, 12.17 GB, 12.10 GB, 12.05 GB, 12.01 GB, 11.96 GB, 11.92 GB, 11.92 GB, 11.92 GB, 11.91 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.67 GB (13599932128) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.87 GB (84680876934) - RowsProduced: 261.29M (261294710) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m23s - TotalStorageWaitTime: 19m56s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 34.454ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 32.995ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s377ms - OpenTime: 34.455ms - ExecTreeOpenTime: 289.479us - PrepareTime: 202.038ms - ExecTreePrepareTime: 2.281ms KrpcDataStreamSender (dst_id=1):(Total: 4m42s, non-child: 4m42s, % non-child: 100.00%) - BytesSent: 34.32 GB (36846212481) - EosSent: 0 (0) - OverallThroughput: 124.20 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 261.29M (261293686) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m42s - UncompressedRowBatchSize: 67.35 GB (72321181792) HDFS_SCAN_NODE (id=0):(Total: 3s192ms, non-child: 3s192ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:32/7.50 GB 7:21/5.16 GB 1:20/4.91 GB 2:32/7.59 GB 4:40/9.60 GB 6:35/8.51 GB 3:27/6.27 GB 5:22/5.40 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.12 GB, 11.43 GB, 11.82 GB, 12.02 GB, 12.36 GB, 12.77 GB, 13.36 GB, 13.94 GB, 14.52 GB, 14.81 GB, 14.98 GB, 15.18 GB, 15.23 GB, 15.29 GB, 15.34 GB, 15.39 GB, 15.49 GB, 15.59 GB, 15.65 GB, 15.72 GB, 15.80 GB, 15.82 GB, 15.83 GB, 15.89 GB, 16.01 GB, 16.14 GB, 16.25 GB, 16.33 GB, 16.47 GB, 16.66 GB, 16.87 GB, 17.04 GB, 17.18 GB, 17.39 GB, 17.56 GB, 17.62 GB, 17.67 GB, 17.73 GB, 17.78 GB, 17.84 GB, 17.91 GB, 17.97 GB, 18.01 GB, 18.04 GB, 18.06 GB - FooterProcessingTime: (Avg: 3s017ms ; Min: 80.949ms ; Max: 9s633ms ; Number of samples: 82) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.13 GB (19468097597) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 58s187ms - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 82 (82) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.66 GB (13596799822) - PerReadThreadRawHdfsThroughput: 49.79 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 261.50M (261499510) - RowsReturned: 261.29M (261294710) - RowsReturnedRate: 81.83 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 1s363ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s231ms - TotalRawHdfsReadTime(*): 6m12s - TotalReadThroughput: 6.32 MB/sec CodeGen:(Total: 33.911ms, non-child: 33.911ms, % non-child: 100.00%) - CodegenTime: 365.945us - CompileTime: 4.970ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.520ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 19.775ms Instance 844a0200d7876345:20bb38b900000065 (host=ve1126.foo.com:22000):(Total: 252.177ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/6.72 GB 4:20/4.83 GB 6:38/9.18 GB 3:21/5.16 GB 0:28/6.85 GB 1:32/7.77 GB 7:34/8.33 GB 5:24/5.84 GB Fragment Instance Lifecycle Event Timeline: 1s541ms - Prepare Finished: 221.167ms (221.167ms) - Open Finished: 252.659ms (31.491ms) - First Batch Produced: 1s538ms (1s286ms) - First Batch Sent: 1s541ms (2.350ms) MemoryUsage(1m4s): 8.07 GB, 12.65 GB, 12.65 GB, 12.64 GB, 12.64 GB, 12.63 GB, 12.62 GB, 12.61 GB, 12.61 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.62 GB, 12.61 GB, 12.61 GB, 12.60 GB, 12.59 GB, 12.58 GB, 12.58 GB, 12.56 GB, 12.55 GB, 12.54 GB, 12.54 GB, 12.52 GB, 12.50 GB, 12.46 GB, 12.41 GB, 12.39 GB, 12.37 GB, 12.33 GB, 12.30 GB, 12.23 GB, 12.18 GB, 12.12 GB, 12.06 GB, 12.02 GB, 12.00 GB, 11.97 GB, 11.95 GB, 11.94 GB, 11.91 GB, 11.91 GB, 11.90 GB, 11.95 GB, 11.99 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.66 GB (13595820469) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.81 GB (84626015662) - RowsProduced: 276.43M (276427421) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m4s - TotalStorageWaitTime: 19m44s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 31.488ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 28.995ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s053ms - OpenTime: 31.490ms - ExecTreeOpenTime: 185.063us - PrepareTime: 220.616ms - ExecTreePrepareTime: 2.013ms KrpcDataStreamSender (dst_id=1):(Total: 4m42s, non-child: 4m42s, % non-child: 100.00%) - BytesSent: 36.29 GB (38970594801) - EosSent: 0 (0) - OverallThroughput: 131.36 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 276.43M (276426397) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m42s - UncompressedRowBatchSize: 71.25 GB (76509472243) HDFS_SCAN_NODE (id=0):(Total: 2s851ms, non-child: 2s851ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:28/6.72 GB 4:20/4.83 GB 6:38/9.18 GB 3:21/5.16 GB 0:28/6.85 GB 1:32/7.77 GB 7:34/8.33 GB 5:24/5.84 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.13 GB, 11.75 GB, 12.20 GB, 12.65 GB, 13.40 GB, 14.17 GB, 14.64 GB, 14.94 GB, 15.07 GB, 15.19 GB, 15.27 GB, 15.33 GB, 15.41 GB, 15.53 GB, 15.64 GB, 15.68 GB, 15.71 GB, 15.75 GB, 15.80 GB, 15.86 GB, 15.93 GB, 16.03 GB, 16.17 GB, 16.29 GB, 16.46 GB, 16.64 GB, 16.88 GB, 17.10 GB, 17.24 GB, 17.32 GB, 17.41 GB, 17.51 GB, 17.64 GB, 17.72 GB, 17.79 GB, 17.83 GB, 17.88 GB, 17.94 GB, 17.99 GB, 18.03 GB, 18.09 GB, 18.14 GB, 18.22 GB, 18.39 GB, 18.48 GB - FooterProcessingTime: (Avg: 3s473ms ; Min: 116.300ms ; Max: 7s800ms ; Number of samples: 81) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.50 GB (19862714059) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m10s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 81 (81) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.66 GB (13592671769) - PerReadThreadRawHdfsThroughput: 50.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 276.63M (276632221) - RowsReturned: 276.43M (276427421) - RowsReturnedRate: 96.95 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 1s681ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s705ms - TotalRawHdfsReadTime(*): 6m16s - TotalReadThroughput: 6.48 MB/sec CodeGen:(Total: 30.997ms, non-child: 30.997ms, % non-child: 100.00%) - CodegenTime: 416.573us - CompileTime: 4.377ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.971ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 19.140ms Instance 844a0200d7876345:20bb38b900000066 (host=ve1127.foo.com:22000):(Total: 239.114ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:22/5.45 GB 4:25/6.11 GB 7:31/7.56 GB 0:25/6.03 GB 2:35/8.45 GB 5:25/6.08 GB 6:23/5.58 GB 1:38/9.33 GB Fragment Instance Lifecycle Event Timeline: 1s646ms - Prepare Finished: 199.974ms (199.974ms) - Open Finished: 239.635ms (39.660ms) - First Batch Produced: 1s644ms (1s404ms) - First Batch Sent: 1s646ms (2.133ms) MemoryUsage(1m4s): 8.36 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.74 GB, 12.71 GB, 12.71 GB, 12.69 GB, 12.68 GB, 12.67 GB, 12.65 GB, 12.62 GB, 12.60 GB, 12.56 GB, 12.52 GB, 12.46 GB, 12.41 GB, 12.35 GB, 12.30 GB, 12.26 GB, 12.22 GB, 12.20 GB, 12.20 GB, 12.20 GB, 12.20 GB, 12.20 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.74 GB (13678508667) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.16 GB (85001161977) - RowsProduced: 264.12M (264123392) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m23s - TotalStorageWaitTime: 18m19s - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 39.651ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 35.994ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s111ms - OpenTime: 39.653ms - ExecTreeOpenTime: 216.370us - PrepareTime: 199.387ms - ExecTreePrepareTime: 1.950ms KrpcDataStreamSender (dst_id=1):(Total: 4m41s, non-child: 4m41s, % non-child: 100.00%) - BytesSent: 34.67 GB (37221391488) - EosSent: 0 (0) - OverallThroughput: 126.01 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 264.12M (264122368) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m41s - UncompressedRowBatchSize: 68.08 GB (73103857120) HDFS_SCAN_NODE (id=0):(Total: 2s888ms, non-child: 2s888ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:22/5.45 GB 4:25/6.11 GB 7:31/7.56 GB 0:25/6.03 GB 2:35/8.45 GB 5:25/6.08 GB 6:23/5.58 GB 1:38/9.33 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.36 GB, 11.63 GB, 12.02 GB, 12.24 GB, 12.59 GB, 13.12 GB, 13.76 GB, 14.55 GB, 14.93 GB, 15.19 GB, 15.25 GB, 15.28 GB, 15.32 GB, 15.37 GB, 15.42 GB, 15.51 GB, 15.59 GB, 15.67 GB, 15.79 GB, 15.85 GB, 15.86 GB, 15.88 GB, 15.95 GB, 16.02 GB, 16.10 GB, 16.22 GB, 16.33 GB, 16.50 GB, 16.69 GB, 16.88 GB, 17.08 GB, 17.33 GB, 17.60 GB, 17.74 GB, 17.81 GB, 17.87 GB, 17.96 GB, 18.03 GB, 18.09 GB, 18.12 GB, 18.17 GB, 18.20 GB, 18.23 GB, 18.27 GB, 18.33 GB - FooterProcessingTime: (Avg: 3s407ms ; Min: 139.319ms ; Max: 8s341ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.39 GB (19751114423) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 56s857ms - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.74 GB (13675278072) - PerReadThreadRawHdfsThroughput: 47.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 264.33M (264328192) - RowsReturned: 264.12M (264123392) - RowsReturnedRate: 91.43 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s332ms - TotalRawHdfsReadTime(*): 6m39s - TotalReadThroughput: 6.41 MB/sec CodeGen:(Total: 39.171ms, non-child: 39.171ms, % non-child: 100.00%) - CodegenTime: 350.156us - CompileTime: 4.502ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.776ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 27.346ms Instance 844a0200d7876345:20bb38b900000042 (host=ve1128.foo.com:22000):(Total: 236.189ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:23/5.55 GB 0:28/6.82 GB 4:40/9.73 GB 3:33/8.01 GB 5:30/7.36 GB 6:29/7.10 GB 2:20/4.87 GB 7:22/5.37 GB Fragment Instance Lifecycle Event Timeline: 1s635ms - Prepare Finished: 201.599ms (201.599ms) - Open Finished: 236.640ms (35.041ms) - First Batch Produced: 1s632ms (1s395ms) - First Batch Sent: 1s635ms (2.901ms) MemoryUsage(1m4s): 8.38 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.67 GB, 12.66 GB, 12.65 GB, 12.64 GB, 12.62 GB, 12.60 GB, 12.58 GB, 12.53 GB, 12.50 GB, 12.47 GB, 12.43 GB, 12.40 GB, 12.35 GB, 12.31 GB, 12.24 GB, 12.18 GB, 12.13 GB, 12.08 GB, 12.04 GB, 12.03 GB, 12.03 GB, 12.03 GB, 12.03 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.69 GB (13627074672) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.89 GB (84707533811) - RowsProduced: 261.39M (261386240) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m55s - TotalStorageWaitTime: 18m43s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 35.027ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 32.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s665ms - OpenTime: 35.029ms - ExecTreeOpenTime: 352.610us - PrepareTime: 201.095ms - ExecTreePrepareTime: 2.101ms KrpcDataStreamSender (dst_id=1):(Total: 4m51s, non-child: 4m51s, % non-child: 100.00%) - BytesSent: 34.32 GB (36851811784) - EosSent: 0 (0) - OverallThroughput: 120.39 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 261.39M (261385216) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m51s - UncompressedRowBatchSize: 67.38 GB (72346158811) HDFS_SCAN_NODE (id=0):(Total: 3s464ms, non-child: 3s464ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:23/5.55 GB 0:28/6.82 GB 4:40/9.73 GB 3:33/8.01 GB 5:30/7.36 GB 6:29/7.10 GB 2:20/4.87 GB 7:22/5.37 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.41 GB, 11.63 GB, 12.01 GB, 12.22 GB, 12.51 GB, 12.95 GB, 13.48 GB, 14.28 GB, 14.75 GB, 15.10 GB, 15.20 GB, 15.23 GB, 15.26 GB, 15.32 GB, 15.37 GB, 15.43 GB, 15.49 GB, 15.56 GB, 15.69 GB, 15.80 GB, 15.81 GB, 15.84 GB, 15.89 GB, 15.93 GB, 16.02 GB, 16.11 GB, 16.22 GB, 16.33 GB, 16.47 GB, 16.61 GB, 16.75 GB, 17.02 GB, 17.34 GB, 17.56 GB, 17.63 GB, 17.66 GB, 17.74 GB, 17.83 GB, 17.89 GB, 17.95 GB, 18.00 GB, 18.03 GB, 18.07 GB, 18.10 GB, 18.14 GB - FooterProcessingTime: (Avg: 3s710ms ; Min: 174.661ms ; Max: 13s222ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.19 GB (19526891935) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m8s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.69 GB (13623917801) - PerReadThreadRawHdfsThroughput: 48.67 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 261.59M (261591040) - RowsReturned: 261.39M (261386240) - RowsReturnedRate: 75.44 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s039ms - TotalRawHdfsReadTime(*): 6m22s - TotalReadThroughput: 6.36 MB/sec CodeGen:(Total: 34.298ms, non-child: 34.298ms, % non-child: 100.00%) - CodegenTime: 522.477us - CompileTime: 5.040ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.394ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 20.351ms Instance 844a0200d7876345:20bb38b90000003b (host=ve1129.foo.com:22000):(Total: 240.181ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:26/6.37 GB 2:30/7.22 GB 6:29/7.10 GB 4:24/5.86 GB 1:24/5.94 GB 0:35/8.41 GB 5:25/6.11 GB 7:32/7.82 GB Fragment Instance Lifecycle Event Timeline: 1s841ms - Prepare Finished: 206.681ms (206.681ms) - Open Finished: 240.642ms (33.961ms) - First Batch Produced: 1s839ms (1s599ms) - First Batch Sent: 1s841ms (2.105ms) MemoryUsage(1m4s): 8.10 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.73 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.71 GB, 12.70 GB, 12.69 GB, 12.68 GB, 12.67 GB, 12.66 GB, 12.63 GB, 12.57 GB, 12.53 GB, 12.50 GB, 12.47 GB, 12.43 GB, 12.38 GB, 12.32 GB, 12.25 GB, 12.21 GB, 12.17 GB, 12.15 GB, 12.13 GB, 12.11 GB, 12.11 GB, 12.11 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.73 GB (13665427323) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.98 GB (84803559732) - RowsProduced: 266.51M (266505216) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m10s - TotalStorageWaitTime: 19m51s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 33.959ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 32.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s352ms - OpenTime: 33.960ms - ExecTreeOpenTime: 166.140us - PrepareTime: 206.149ms - ExecTreePrepareTime: 2.091ms KrpcDataStreamSender (dst_id=1):(Total: 4m40s, non-child: 4m40s, % non-child: 100.00%) - BytesSent: 35.01 GB (37590623818) - EosSent: 0 (0) - OverallThroughput: 127.83 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 266.50M (266504192) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m39s - UncompressedRowBatchSize: 68.70 GB (73762843658) HDFS_SCAN_NODE (id=0):(Total: 3s157ms, non-child: 3s157ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:26/6.37 GB 2:30/7.22 GB 6:29/7.10 GB 4:24/5.86 GB 1:24/5.94 GB 0:35/8.41 GB 5:25/6.11 GB 7:32/7.82 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.15 GB, 11.71 GB, 12.13 GB, 12.48 GB, 12.79 GB, 13.21 GB, 13.75 GB, 14.37 GB, 14.84 GB, 15.12 GB, 15.25 GB, 15.30 GB, 15.34 GB, 15.39 GB, 15.46 GB, 15.52 GB, 15.59 GB, 15.69 GB, 15.83 GB, 15.92 GB, 15.97 GB, 16.04 GB, 16.10 GB, 16.17 GB, 16.25 GB, 16.37 GB, 16.48 GB, 16.61 GB, 16.75 GB, 16.93 GB, 17.13 GB, 17.33 GB, 17.53 GB, 17.69 GB, 17.82 GB, 17.88 GB, 17.96 GB, 18.01 GB, 18.06 GB, 18.11 GB, 18.15 GB, 18.19 GB, 18.22 GB, 18.26 GB, 18.30 GB - FooterProcessingTime: (Avg: 4s021ms ; Min: 107.711ms ; Max: 10s306ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.35 GB (19706952675) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m10s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.72 GB (13662360588) - PerReadThreadRawHdfsThroughput: 44.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 266.71M (266710016) - RowsReturned: 266.51M (266505216) - RowsReturnedRate: 84.39 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s641ms - TotalRawHdfsReadTime(*): 7m4s - TotalReadThroughput: 6.42 MB/sec CodeGen:(Total: 33.503ms, non-child: 33.503ms, % non-child: 100.00%) - CodegenTime: 363.612us - CompileTime: 4.458ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.474ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 20.953ms Instance 844a0200d7876345:20bb38b90000006c (host=ve1130.foo.com:22000):(Total: 253.399ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:26/6.28 GB 0:33/8.05 GB 6:31/7.60 GB 2:28/6.81 GB 1:31/7.43 GB 5:27/6.61 GB 3:26/6.44 GB 7:23/5.54 GB Fragment Instance Lifecycle Event Timeline: 1s802ms - Prepare Finished: 215.839ms (215.839ms) - Open Finished: 254.108ms (38.268ms) - First Batch Produced: 1s799ms (1s545ms) - First Batch Sent: 1s802ms (2.632ms) MemoryUsage(1m4s): 7.89 GB, 12.64 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.64 GB, 12.63 GB, 12.63 GB, 12.62 GB, 12.61 GB, 12.59 GB, 12.58 GB, 12.57 GB, 12.54 GB, 12.50 GB, 12.46 GB, 12.41 GB, 12.39 GB, 12.37 GB, 12.30 GB, 12.27 GB, 12.20 GB, 12.14 GB, 12.08 GB, 12.02 GB, 11.97 GB, 11.93 GB, 11.91 GB, 11.91 GB, 11.91 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.66 GB (13597587521) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.87 GB (84688563711) - RowsProduced: 259.21M (259214336) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m24s - TotalStorageWaitTime: 20m35s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 38.256ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 35.994ms - TotalThreadsVoluntaryContextSwitches: 6 (6) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4s272ms - OpenTime: 38.257ms - ExecTreeOpenTime: 264.697us - PrepareTime: 215.047ms - ExecTreePrepareTime: 2.007ms KrpcDataStreamSender (dst_id=1):(Total: 4m43s, non-child: 4m43s, % non-child: 100.00%) - BytesSent: 34.02 GB (36530437183) - EosSent: 0 (0) - OverallThroughput: 122.76 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 259.21M (259213312) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m43s - UncompressedRowBatchSize: 66.82 GB (71744753651) HDFS_SCAN_NODE (id=0):(Total: 4s093ms, non-child: 4s093ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:26/6.28 GB 0:33/8.05 GB 6:31/7.60 GB 2:28/6.81 GB 1:31/7.43 GB 5:27/6.61 GB 3:26/6.44 GB 7:23/5.54 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.95 GB, 11.60 GB, 12.00 GB, 12.24 GB, 12.53 GB, 12.87 GB, 13.31 GB, 14.00 GB, 14.58 GB, 14.96 GB, 15.12 GB, 15.19 GB, 15.24 GB, 15.27 GB, 15.31 GB, 15.35 GB, 15.40 GB, 15.49 GB, 15.60 GB, 15.72 GB, 15.79 GB, 15.81 GB, 15.82 GB, 15.91 GB, 16.02 GB, 16.10 GB, 16.16 GB, 16.24 GB, 16.33 GB, 16.44 GB, 16.60 GB, 16.80 GB, 17.08 GB, 17.31 GB, 17.48 GB, 17.55 GB, 17.60 GB, 17.66 GB, 17.73 GB, 17.80 GB, 17.87 GB, 17.91 GB, 17.94 GB, 17.96 GB, 17.98 GB - FooterProcessingTime: (Avg: 3s809ms ; Min: 97.239ms ; Max: 10s549ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.02 GB (19347826138) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2m5s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.66 GB (13594528967) - PerReadThreadRawHdfsThroughput: 45.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 259.42M (259419136) - RowsReturned: 259.21M (259214336) - RowsReturnedRate: 63.33 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s563ms - TotalRawHdfsReadTime(*): 6m46s - TotalReadThroughput: 6.28 MB/sec CodeGen:(Total: 37.583ms, non-child: 37.583ms, % non-child: 100.00%) - CodegenTime: 589.773us - CompileTime: 4.564ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.790ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 24.580ms Instance 844a0200d7876345:20bb38b900000072 (host=ve1131.foo.com:22000):(Total: 278.750ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:24/5.59 GB 1:27/6.36 GB 7:26/6.32 GB 6:31/7.59 GB 4:31/7.60 GB 3:27/6.61 GB 0:30/7.34 GB 5:31/7.28 GB Fragment Instance Lifecycle Event Timeline: 1s940ms - Prepare Finished: 245.884ms (245.884ms) - Open Finished: 279.215ms (33.331ms) - First Batch Produced: 1s939ms (1s660ms) - First Batch Sent: 1s940ms (1.062ms) MemoryUsage(1m4s): 7.60 GB, 12.66 GB, 12.66 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.66 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.64 GB, 12.64 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.62 GB, 12.61 GB, 12.60 GB, 12.58 GB, 12.57 GB, 12.55 GB, 12.54 GB, 12.51 GB, 12.48 GB, 12.45 GB, 12.43 GB, 12.39 GB, 12.36 GB, 12.31 GB, 12.27 GB, 12.21 GB, 12.14 GB, 12.09 GB, 12.06 GB, 12.04 GB, 12.01 GB, 12.09 GB, 12.12 GB, 12.11 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.67 GB (13604820498) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.00 GB (84830594831) - RowsProduced: 267.73M (267731167) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m11s - TotalStorageWaitTime: 22m15s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 33.328ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 30.995ms - TotalThreadsVoluntaryContextSwitches: 2 (2) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s409ms - OpenTime: 33.329ms - ExecTreeOpenTime: 215.537us - PrepareTime: 245.359ms - ExecTreePrepareTime: 2.861ms KrpcDataStreamSender (dst_id=1):(Total: 4m44s, non-child: 4m44s, % non-child: 100.00%) - BytesSent: 35.15 GB (37741056870) - EosSent: 0 (0) - OverallThroughput: 126.57 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 267.73M (267730143) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m43s - UncompressedRowBatchSize: 69.01 GB (74102060844) HDFS_SCAN_NODE (id=0):(Total: 3s201ms, non-child: 3s201ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:24/5.59 GB 1:27/6.36 GB 7:26/6.32 GB 6:31/7.59 GB 4:31/7.60 GB 3:27/6.61 GB 0:30/7.34 GB 5:31/7.28 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.71 GB, 11.72 GB, 12.20 GB, 12.54 GB, 12.84 GB, 13.18 GB, 13.72 GB, 14.43 GB, 14.89 GB, 15.13 GB, 15.24 GB, 15.28 GB, 15.32 GB, 15.37 GB, 15.41 GB, 15.50 GB, 15.57 GB, 15.69 GB, 15.80 GB, 15.87 GB, 15.97 GB, 16.03 GB, 16.10 GB, 16.14 GB, 16.23 GB, 16.32 GB, 16.41 GB, 16.50 GB, 16.64 GB, 16.81 GB, 17.00 GB, 17.23 GB, 17.40 GB, 17.54 GB, 17.69 GB, 17.77 GB, 17.86 GB, 17.92 GB, 17.98 GB, 18.03 GB, 18.07 GB, 18.10 GB, 18.24 GB, 18.30 GB, 18.33 GB - FooterProcessingTime: (Avg: 4s284ms ; Min: 93.591ms ; Max: 12s002ms ; Number of samples: 82) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.41 GB (19762238649) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m5s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 82 (82) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.67 GB (13601704607) - PerReadThreadRawHdfsThroughput: 45.09 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 267.94M (267935967) - RowsReturned: 267.73M (267731167) - RowsReturnedRate: 83.63 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 1s679ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s787ms - TotalRawHdfsReadTime(*): 6m57s - TotalReadThroughput: 6.43 MB/sec CodeGen:(Total: 32.809ms, non-child: 32.809ms, % non-child: 100.00%) - CodegenTime: 407.034us - CompileTime: 4.184ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.705ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 21.414ms Instance 844a0200d7876345:20bb38b900000071 (host=ve1132.foo.com:22000):(Total: 234.944ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:25/6.07 GB 7:37/9.05 GB 3:29/6.81 GB 1:30/7.34 GB 0:35/8.62 GB 2:28/6.89 GB 6:22/5.38 GB 4:21/5.00 GB Fragment Instance Lifecycle Event Timeline: 1s570ms - Prepare Finished: 209.064ms (209.064ms) - Open Finished: 235.566ms (26.501ms) - First Batch Produced: 1s568ms (1s332ms) - First Batch Sent: 1s570ms (2.228ms) MemoryUsage(1m4s): 7.48 GB, 12.67 GB, 12.68 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.69 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.67 GB, 12.66 GB, 12.66 GB, 12.64 GB, 12.63 GB, 12.61 GB, 12.60 GB, 12.56 GB, 12.54 GB, 12.50 GB, 12.46 GB, 12.43 GB, 12.40 GB, 12.33 GB, 12.28 GB, 12.22 GB, 12.20 GB, 12.17 GB, 12.15 GB, 12.13 GB, 12.10 GB, 12.08 GB, 12.06 GB, 12.05 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.70 GB (13638936332) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.75 GB (84559629208) - RowsProduced: 267.60M (267601015) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m49s - TotalStorageWaitTime: 22m1s - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 26.499ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 23.997ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s155ms - OpenTime: 26.500ms - ExecTreeOpenTime: 180.227us - PrepareTime: 208.348ms - ExecTreePrepareTime: 1.894ms KrpcDataStreamSender (dst_id=1):(Total: 4m48s, non-child: 4m48s, % non-child: 100.00%) - BytesSent: 35.10 GB (37688285562) - EosSent: 0 (0) - OverallThroughput: 124.48 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 267.60M (267599991) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m48s - UncompressedRowBatchSize: 68.98 GB (74066164330) HDFS_SCAN_NODE (id=0):(Total: 2s947ms, non-child: 2s947ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:25/6.07 GB 7:37/9.05 GB 3:29/6.81 GB 1:30/7.34 GB 0:35/8.62 GB 2:28/6.89 GB 6:22/5.38 GB 4:21/5.00 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.58 GB, 11.78 GB, 12.17 GB, 12.54 GB, 12.93 GB, 13.40 GB, 13.99 GB, 14.45 GB, 14.81 GB, 15.08 GB, 15.23 GB, 15.33 GB, 15.40 GB, 15.46 GB, 15.53 GB, 15.62 GB, 15.70 GB, 15.75 GB, 15.80 GB, 15.85 GB, 15.96 GB, 16.04 GB, 16.12 GB, 16.22 GB, 16.33 GB, 16.45 GB, 16.58 GB, 16.72 GB, 16.90 GB, 17.11 GB, 17.25 GB, 17.35 GB, 17.44 GB, 17.57 GB, 17.75 GB, 17.85 GB, 17.93 GB, 17.98 GB, 18.03 GB, 18.08 GB, 18.13 GB, 18.18 GB, 18.21 GB, 18.26 GB, 18.29 GB - FooterProcessingTime: (Avg: 3s691ms ; Min: 143.934ms ; Max: 7s803ms ; Number of samples: 81) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.36 GB (19716664521) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 58s231ms - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 81 (81) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.70 GB (13635906171) - PerReadThreadRawHdfsThroughput: 44.54 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 267.81M (267805815) - RowsReturned: 267.60M (267601015) - RowsReturnedRate: 90.78 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 177.022ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 8s791ms - TotalRawHdfsReadTime(*): 7m2s - TotalReadThroughput: 6.45 MB/sec CodeGen:(Total: 26.024ms, non-child: 26.024ms, % non-child: 100.00%) - CodegenTime: 433.047us - CompileTime: 4.385ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.054ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 14.100ms Instance 844a0200d7876345:20bb38b900000058 (host=ve1134.foo.com:22000):(Total: 240.606ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:27/6.65 GB 2:30/7.39 GB 7:31/7.51 GB 1:19/4.70 GB 0:27/6.60 GB 5:31/7.56 GB 4:28/6.86 GB 6:31/7.55 GB Fragment Instance Lifecycle Event Timeline: 1s624ms - Prepare Finished: 201.504ms (201.504ms) - Open Finished: 241.202ms (39.698ms) - First Batch Produced: 1s622ms (1s381ms) - First Batch Sent: 1s624ms (2.062ms) MemoryUsage(1m4s): 7.01 GB, 12.61 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.66 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.63 GB, 12.63 GB, 12.61 GB, 12.61 GB, 12.59 GB, 12.56 GB, 12.54 GB, 12.50 GB, 12.48 GB, 12.47 GB, 12.44 GB, 12.41 GB, 12.37 GB, 12.35 GB, 12.32 GB, 12.29 GB, 12.27 GB, 12.22 GB, 12.17 GB, 12.10 GB, 12.07 GB, 12.04 GB, 12.02 GB, 11.98 GB, 11.96 GB, 11.94 GB, 11.92 GB, 11.89 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.67 GB (13607701051) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.62 GB (84422062955) - RowsProduced: 273.07M (273070080) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m44s - TotalStorageWaitTime: 25m47s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 39.695ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 37.994ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s751ms - OpenTime: 39.697ms - ExecTreeOpenTime: 155.138us - PrepareTime: 200.780ms - ExecTreePrepareTime: 1.869ms KrpcDataStreamSender (dst_id=1):(Total: 4m43s, non-child: 4m43s, % non-child: 100.00%) - BytesSent: 35.84 GB (38484954206) - EosSent: 0 (0) - OverallThroughput: 129.32 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 273.07M (273069056) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m43s - UncompressedRowBatchSize: 70.39 GB (75579844742) HDFS_SCAN_NODE (id=0):(Total: 3s553ms, non-child: 3s553ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:27/6.65 GB 2:30/7.39 GB 7:31/7.51 GB 1:19/4.70 GB 0:27/6.60 GB 5:31/7.56 GB 4:28/6.86 GB 6:31/7.55 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.17 GB, 11.73 GB, 12.37 GB, 12.86 GB, 13.23 GB, 13.62 GB, 14.20 GB, 14.70 GB, 15.02 GB, 15.19 GB, 15.31 GB, 15.37 GB, 15.42 GB, 15.47 GB, 15.53 GB, 15.67 GB, 15.75 GB, 15.84 GB, 15.92 GB, 16.00 GB, 16.09 GB, 16.18 GB, 16.29 GB, 16.37 GB, 16.46 GB, 16.55 GB, 16.65 GB, 16.76 GB, 16.95 GB, 17.16 GB, 17.32 GB, 17.44 GB, 17.54 GB, 17.64 GB, 17.78 GB, 17.86 GB, 17.94 GB, 18.00 GB, 18.04 GB, 18.08 GB, 18.11 GB, 18.14 GB, 18.17 GB, 18.19 GB, 18.23 GB - FooterProcessingTime: (Avg: 4s454ms ; Min: 126.687ms ; Max: 11s164ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.33 GB (19676413764) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m8s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.67 GB (13604599305) - PerReadThreadRawHdfsThroughput: 40.53 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 273.27M (273273856) - RowsReturned: 273.07M (273070080) - RowsReturnedRate: 76.85 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s729ms - TotalRawHdfsReadTime(*): 7m43s - TotalReadThroughput: 6.44 MB/sec CodeGen:(Total: 39.266ms, non-child: 39.266ms, % non-child: 100.00%) - CodegenTime: 377.439us - CompileTime: 5.015ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.141ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 25.624ms Instance 844a0200d7876345:20bb38b900000032 (host=ve1135.foo.com:22000):(Total: 249.873ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:27/6.59 GB 1:27/6.53 GB 6:40/9.82 GB 5:19/4.57 GB 3:29/7.06 GB 2:32/7.54 GB 7:26/6.40 GB 0:25/6.15 GB Fragment Instance Lifecycle Event Timeline: 2s099ms - Prepare Finished: 217.145ms (217.145ms) - Open Finished: 250.570ms (33.424ms) - First Batch Produced: 2s097ms (1s846ms) - First Batch Sent: 2s099ms (1.972ms) MemoryUsage(1m4s): 7.44 GB, 12.70 GB, 12.70 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.71 GB, 12.71 GB, 12.70 GB, 12.69 GB, 12.68 GB, 12.68 GB, 12.67 GB, 12.66 GB, 12.66 GB, 12.64 GB, 12.63 GB, 12.62 GB, 12.58 GB, 12.56 GB, 12.52 GB, 12.49 GB, 12.47 GB, 12.43 GB, 12.40 GB, 12.36 GB, 12.31 GB, 12.24 GB, 12.17 GB, 12.11 GB, 12.08 GB, 12.03 GB, 12.02 GB, 12.01 GB, 12.01 GB, 12.01 GB, 12.01 GB, 11.99 GB, 11.98 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.72 GB (13654061616) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.91 GB (84727957566) - RowsProduced: 279.82M (279820288) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m15s - TotalStorageWaitTime: 23m12s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 33.415ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 29.996ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s764ms - OpenTime: 33.417ms - ExecTreeOpenTime: 144.373us - PrepareTime: 216.371ms - ExecTreePrepareTime: 1.834ms KrpcDataStreamSender (dst_id=1):(Total: 4m40s, non-child: 4m40s, % non-child: 100.00%) - BytesSent: 36.74 GB (39446711666) - EosSent: 0 (0) - OverallThroughput: 134.33 MB/sec - PeakMemoryUsage: 3.59 MB (3768992) - RowsReturned: 279.82M (279819264) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m39s - UncompressedRowBatchSize: 72.13 GB (77448551128) HDFS_SCAN_NODE (id=0):(Total: 3s565ms, non-child: 3s565ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:27/6.59 GB 1:27/6.53 GB 6:40/9.82 GB 5:19/4.57 GB 3:29/7.06 GB 2:32/7.54 GB 7:26/6.40 GB 0:25/6.15 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.54 GB, 11.82 GB, 12.38 GB, 12.78 GB, 13.28 GB, 14.06 GB, 14.79 GB, 15.17 GB, 15.30 GB, 15.35 GB, 15.43 GB, 15.51 GB, 15.58 GB, 15.67 GB, 15.78 GB, 15.90 GB, 15.98 GB, 16.05 GB, 16.10 GB, 16.15 GB, 16.22 GB, 16.28 GB, 16.40 GB, 16.52 GB, 16.64 GB, 16.79 GB, 17.00 GB, 17.24 GB, 17.44 GB, 17.60 GB, 17.71 GB, 17.78 GB, 17.83 GB, 17.91 GB, 17.98 GB, 18.06 GB, 18.10 GB, 18.15 GB, 18.19 GB, 18.22 GB, 18.26 GB, 18.29 GB, 18.36 GB, 18.42 GB, 18.49 GB - FooterProcessingTime: (Avg: 4s788ms ; Min: 186.352ms ; Max: 11s066ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.57 GB (19938561284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m13s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.71 GB (13650888383) - PerReadThreadRawHdfsThroughput: 41.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 280.03M (280025088) - RowsReturned: 279.82M (279820288) - RowsReturnedRate: 78.47 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s367ms - TotalRawHdfsReadTime(*): 7m36s - TotalReadThroughput: 6.48 MB/sec CodeGen:(Total: 32.972ms, non-child: 32.972ms, % non-child: 100.00%) - CodegenTime: 466.568us - CompileTime: 4.128ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.109ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 21.205ms Instance 844a0200d7876345:20bb38b90000000f (host=ve1136.foo.com:22000):(Total: 235.760ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:16/3.96 GB 2:27/6.60 GB 3:21/5.04 GB 0:30/7.38 GB 1:29/7.04 GB 6:31/7.59 GB 5:40/9.70 GB 7:31/7.55 GB Fragment Instance Lifecycle Event Timeline: 1s574ms - Prepare Finished: 199.953ms (199.953ms) - Open Finished: 236.480ms (36.527ms) - First Batch Produced: 1s573ms (1s337ms) - First Batch Sent: 1s574ms (1.437ms) MemoryUsage(1m4s): 7.59 GB, 12.65 GB, 12.67 GB, 12.67 GB, 12.66 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.64 GB, 12.65 GB, 12.64 GB, 12.64 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.61 GB, 12.59 GB, 12.57 GB, 12.55 GB, 12.52 GB, 12.49 GB, 12.47 GB, 12.44 GB, 12.41 GB, 12.39 GB, 12.36 GB, 12.33 GB, 12.37 GB, 12.38 GB, 12.33 GB, 12.29 GB, 12.24 GB, 12.22 GB, 12.21 GB, 12.20 GB, 12.19 GB, 12.18 GB, 12.18 GB, 12.18 GB, 12.17 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.67 GB (13605711790) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 85.63 GB (91949339415) - RowsProduced: 273.46M (273464987) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m6s - TotalStorageWaitTime: 22m37s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 36.529ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 35.994ms - TotalThreadsVoluntaryContextSwitches: 9 (9) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s325ms - OpenTime: 36.530ms - ExecTreeOpenTime: 160.877us - PrepareTime: 199.135ms - ExecTreePrepareTime: 1.858ms KrpcDataStreamSender (dst_id=1):(Total: 4m34s, non-child: 4m34s, % non-child: 100.00%) - BytesSent: 35.89 GB (38537706297) - EosSent: 0 (0) - OverallThroughput: 134.10 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 273.46M (273463963) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m33s - UncompressedRowBatchSize: 70.49 GB (75689442222) HDFS_SCAN_NODE (id=0):(Total: 3s136ms, non-child: 3s136ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:16/3.96 GB 2:27/6.60 GB 3:21/5.04 GB 0:30/7.38 GB 1:29/7.04 GB 6:31/7.59 GB 5:40/9.70 GB 7:31/7.55 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.68 GB, 11.72 GB, 12.19 GB, 12.65 GB, 13.08 GB, 13.66 GB, 14.36 GB, 14.82 GB, 15.08 GB, 15.23 GB, 15.30 GB, 15.34 GB, 15.37 GB, 15.45 GB, 15.51 GB, 15.60 GB, 15.71 GB, 15.74 GB, 15.80 GB, 15.93 GB, 16.04 GB, 16.11 GB, 16.17 GB, 16.25 GB, 16.35 GB, 16.54 GB, 16.71 GB, 16.85 GB, 17.06 GB, 17.27 GB, 17.39 GB, 17.49 GB, 17.71 GB, 17.90 GB, 18.02 GB, 18.08 GB, 18.15 GB, 18.18 GB, 18.22 GB, 18.25 GB, 18.29 GB, 18.34 GB, 18.38 GB, 18.42 GB, 18.45 GB - FooterProcessingTime: (Avg: 3s689ms ; Min: 100.819ms ; Max: 11s072ms ; Number of samples: 81) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.55 GB (19915717249) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m12s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 81 (81) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.67 GB (13602751643) - PerReadThreadRawHdfsThroughput: 45.13 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 273.67M (273669787) - RowsReturned: 273.46M (273464987) - RowsReturnedRate: 87.18 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 1s348ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s222ms - TotalRawHdfsReadTime(*): 7m - TotalReadThroughput: 6.50 MB/sec CodeGen:(Total: 36.045ms, non-child: 36.045ms, % non-child: 100.00%) - CodegenTime: 435.486us - CompileTime: 4.122ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.220ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 23.159ms Instance 844a0200d7876345:20bb38b900000039 (host=ve1137.foo.com:22000):(Total: 242.249ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:26/6.40 GB 4:34/8.24 GB 6:27/6.56 GB 3:27/6.61 GB 0:33/8.06 GB 1:28/6.89 GB 5:25/6.19 GB 2:24/5.82 GB Fragment Instance Lifecycle Event Timeline: 2s171ms - Prepare Finished: 216.951ms (216.951ms) - Open Finished: 242.721ms (25.769ms) - First Batch Produced: 2s169ms (1s926ms) - First Batch Sent: 2s171ms (1.800ms) MemoryUsage(1m4s): 7.59 GB, 12.70 GB, 12.70 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.71 GB, 12.70 GB, 12.69 GB, 12.69 GB, 12.68 GB, 12.68 GB, 12.66 GB, 12.62 GB, 12.59 GB, 12.55 GB, 12.54 GB, 12.51 GB, 12.47 GB, 12.41 GB, 12.34 GB, 12.27 GB, 12.23 GB, 12.20 GB, 12.18 GB, 12.16 GB, 12.16 GB, 12.16 GB, 12.16 GB ThreadUsage(1m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.72 GB (13661512901) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.03 GB (84858396036) - RowsProduced: 265.72M (265718784) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m5s - TotalStorageWaitTime: 21m43s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 25.754ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.996ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s806ms - OpenTime: 25.769ms - ExecTreeOpenTime: 272.718us - PrepareTime: 216.406ms - ExecTreePrepareTime: 2.068ms KrpcDataStreamSender (dst_id=1):(Total: 4m41s, non-child: 4m41s, % non-child: 100.00%) - BytesSent: 34.86 GB (37428874045) - EosSent: 0 (0) - OverallThroughput: 126.63 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 265.72M (265717760) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m41s - UncompressedRowBatchSize: 68.49 GB (73544994743) HDFS_SCAN_NODE (id=0):(Total: 3s603ms, non-child: 3s603ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:26/6.40 GB 4:34/8.24 GB 6:27/6.56 GB 3:27/6.61 GB 0:33/8.06 GB 1:28/6.89 GB 5:25/6.19 GB 2:24/5.82 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.65 GB, 11.64 GB, 12.05 GB, 12.29 GB, 12.60 GB, 12.98 GB, 13.60 GB, 14.41 GB, 14.89 GB, 15.14 GB, 15.24 GB, 15.29 GB, 15.34 GB, 15.39 GB, 15.44 GB, 15.49 GB, 15.59 GB, 15.71 GB, 15.80 GB, 15.85 GB, 15.92 GB, 15.95 GB, 16.01 GB, 16.08 GB, 16.20 GB, 16.29 GB, 16.38 GB, 16.50 GB, 16.62 GB, 16.84 GB, 17.09 GB, 17.34 GB, 17.55 GB, 17.66 GB, 17.79 GB, 17.86 GB, 17.95 GB, 18.02 GB, 18.08 GB, 18.14 GB, 18.16 GB, 18.20 GB, 18.23 GB, 18.26 GB, 18.29 GB - FooterProcessingTime: (Avg: 4s386ms ; Min: 153.782ms ; Max: 12s539ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.35 GB (19703643903) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m21s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.72 GB (13658298708) - PerReadThreadRawHdfsThroughput: 43.25 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 265.92M (265923584) - RowsReturned: 265.72M (265718784) - RowsReturnedRate: 73.74 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s527ms - TotalRawHdfsReadTime(*): 7m14s - TotalReadThroughput: 6.42 MB/sec CodeGen:(Total: 25.187ms, non-child: 25.187ms, % non-child: 100.00%) - CodegenTime: 377.067us - CompileTime: 3.887ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.800ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 13.927ms Instance 844a0200d7876345:20bb38b900000043 (host=ve1138.foo.com:22000):(Total: 237.577ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:21/5.08 GB 5:34/8.30 GB 2:28/6.90 GB 4:31/7.29 GB 3:20/4.86 GB 7:23/5.65 GB 0:34/8.18 GB 6:34/8.26 GB Fragment Instance Lifecycle Event Timeline: 1s575ms - Prepare Finished: 202.934ms (202.934ms) - Open Finished: 238.025ms (35.091ms) - First Batch Produced: 1s573ms (1s335ms) - First Batch Sent: 1s575ms (2.071ms) MemoryUsage(1m4s): 8.94 GB, 12.63 GB, 12.63 GB, 12.63 GB, 12.64 GB, 12.64 GB, 12.64 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.65 GB, 12.64 GB, 12.64 GB, 12.64 GB, 12.64 GB, 12.64 GB, 12.62 GB, 12.62 GB, 12.61 GB, 12.60 GB, 12.59 GB, 12.54 GB, 12.52 GB, 12.49 GB, 12.46 GB, 12.44 GB, 12.38 GB, 12.31 GB, 12.26 GB, 12.21 GB, 12.16 GB, 12.10 GB, 12.02 GB, 11.95 GB, 11.91 GB, 11.88 GB, 11.87 GB, 11.87 GB, 11.87 GB, 11.86 GB, 11.86 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.65 GB (13584366236) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.84 GB (84657099020) - RowsProduced: 267.68M (267679744) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m35s - TotalStorageWaitTime: 16m1s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 35.088ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 31.995ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 2s937ms - OpenTime: 35.089ms - ExecTreeOpenTime: 168.795us - PrepareTime: 202.403ms - ExecTreePrepareTime: 2.132ms KrpcDataStreamSender (dst_id=1):(Total: 4m37s, non-child: 4m37s, % non-child: 100.00%) - BytesSent: 35.13 GB (37725864421) - EosSent: 0 (0) - OverallThroughput: 129.72 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 267.68M (267678720) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m36s - UncompressedRowBatchSize: 69.00 GB (74088242663) HDFS_SCAN_NODE (id=0):(Total: 2s753ms, non-child: 2s753ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:21/5.08 GB 5:34/8.30 GB 2:28/6.90 GB 4:31/7.29 GB 3:20/4.86 GB 7:23/5.65 GB 0:34/8.18 GB 6:34/8.26 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 7.95 GB, 11.63 GB, 12.01 GB, 12.21 GB, 12.51 GB, 12.95 GB, 13.55 GB, 14.30 GB, 14.81 GB, 15.08 GB, 15.17 GB, 15.19 GB, 15.24 GB, 15.29 GB, 15.34 GB, 15.42 GB, 15.52 GB, 15.62 GB, 15.70 GB, 15.75 GB, 15.77 GB, 15.81 GB, 15.88 GB, 15.94 GB, 16.06 GB, 16.13 GB, 16.25 GB, 16.37 GB, 16.58 GB, 16.81 GB, 17.03 GB, 17.24 GB, 17.40 GB, 17.50 GB, 17.56 GB, 17.63 GB, 17.71 GB, 17.78 GB, 17.82 GB, 17.87 GB, 17.91 GB, 17.94 GB, 17.98 GB, 18.02 GB, 18.08 GB - FooterProcessingTime: (Avg: 3s239ms ; Min: 128.660ms ; Max: 7s542ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.16 GB (19497247528) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m1s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.65 GB (13581170846) - PerReadThreadRawHdfsThroughput: 54.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 267.88M (267884544) - RowsReturned: 267.68M (267679744) - RowsReturnedRate: 97.23 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s020ms - TotalRawHdfsReadTime(*): 5m43s - TotalReadThroughput: 6.32 MB/sec CodeGen:(Total: 34.590ms, non-child: 34.590ms, % non-child: 100.00%) - CodegenTime: 467.727us - CompileTime: 4.363ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 7.193ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.390ms Instance 844a0200d7876345:20bb38b900000053 (host=ve1139.foo.com:22000):(Total: 248.285ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:26/6.35 GB 6:34/8.27 GB 7:26/6.40 GB 5:32/7.85 GB 2:30/7.36 GB 3:27/6.56 GB 1:22/5.41 GB 4:27/6.60 GB Fragment Instance Lifecycle Event Timeline: 1s732ms - Prepare Finished: 216.751ms (216.751ms) - Open Finished: 248.635ms (31.884ms) - First Batch Produced: 1s730ms (1s481ms) - First Batch Sent: 1s732ms (2.163ms) MemoryUsage(1m4s): 7.18 GB, 12.69 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.72 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.70 GB, 12.69 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.68 GB, 12.67 GB, 12.67 GB, 12.65 GB, 12.63 GB, 12.62 GB, 12.60 GB, 12.58 GB, 12.54 GB, 12.52 GB, 12.51 GB, 12.48 GB, 12.45 GB, 12.42 GB, 12.38 GB, 12.33 GB, 12.28 GB, 12.22 GB, 12.18 GB, 12.17 GB, 12.15 GB, 12.13 GB, 12.12 GB, 12.12 GB, 12.12 GB, 12.09 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.72 GB (13660550530) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.81 GB (84626652701) - RowsProduced: 276.60M (276603904) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m5s - TotalStorageWaitTime: 25m15s - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 31.882ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 30.995ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s557ms - OpenTime: 31.883ms - ExecTreeOpenTime: 279.716us - PrepareTime: 216.354ms - ExecTreePrepareTime: 1.786ms KrpcDataStreamSender (dst_id=1):(Total: 4m35s, non-child: 4m35s, % non-child: 100.00%) - BytesSent: 36.29 GB (38965061519) - EosSent: 0 (0) - OverallThroughput: 134.71 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 276.60M (276602880) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m35s - UncompressedRowBatchSize: 71.30 GB (76558480952) HDFS_SCAN_NODE (id=0):(Total: 3s376ms, non-child: 3s376ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:26/6.35 GB 6:34/8.27 GB 7:26/6.40 GB 5:32/7.85 GB 2:30/7.36 GB 3:27/6.56 GB 1:22/5.41 GB 4:27/6.60 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.32 GB, 11.77 GB, 12.31 GB, 12.69 GB, 13.06 GB, 13.60 GB, 14.30 GB, 14.84 GB, 15.14 GB, 15.29 GB, 15.37 GB, 15.41 GB, 15.46 GB, 15.53 GB, 15.63 GB, 15.71 GB, 15.84 GB, 15.92 GB, 16.00 GB, 16.09 GB, 16.15 GB, 16.24 GB, 16.32 GB, 16.42 GB, 16.56 GB, 16.70 GB, 16.87 GB, 17.05 GB, 17.25 GB, 17.44 GB, 17.58 GB, 17.71 GB, 17.83 GB, 17.92 GB, 18.00 GB, 18.06 GB, 18.14 GB, 18.18 GB, 18.22 GB, 18.26 GB, 18.30 GB, 18.34 GB, 18.40 GB, 18.44 GB, 18.49 GB - FooterProcessingTime: (Avg: 4s850ms ; Min: 49.222ms ; Max: 11s510ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.56 GB (19924864306) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m16s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.72 GB (13657551014) - PerReadThreadRawHdfsThroughput: 41.75 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 276.81M (276808704) - RowsReturned: 276.60M (276603904) - RowsReturnedRate: 81.93 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 7s780ms - TotalRawHdfsReadTime(*): 7m35s - TotalReadThroughput: 6.51 MB/sec CodeGen:(Total: 31.322ms, non-child: 31.322ms, % non-child: 100.00%) - CodegenTime: 366.500us - CompileTime: 4.733ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.445ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 19.581ms Instance 844a0200d7876345:20bb38b90000004d (host=ve1140.foo.com:22000):(Total: 243.221ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:36/8.74 GB 6:28/6.90 GB 0:26/6.28 GB 4:29/7.14 GB 7:23/5.61 GB 5:21/5.09 GB 1:24/5.90 GB 2:38/9.18 GB Fragment Instance Lifecycle Event Timeline: 1s674ms - Prepare Finished: 212.874ms (212.874ms) - Open Finished: 243.896ms (31.022ms) - First Batch Produced: 1s672ms (1s428ms) - First Batch Sent: 1s674ms (2.111ms) MemoryUsage(1m4s): 7.75 GB, 12.68 GB, 12.68 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.69 GB, 12.69 GB, 12.67 GB, 12.66 GB, 12.64 GB, 12.61 GB, 12.58 GB, 12.56 GB, 12.52 GB, 12.48 GB, 12.42 GB, 12.35 GB, 12.30 GB, 12.25 GB, 12.20 GB, 12.18 GB, 12.15 GB, 12.13 GB, 12.12 GB, 12.09 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.70 GB (13640354262) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.87 GB (84685742833) - RowsProduced: 258.17M (258172928) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39m2s - TotalStorageWaitTime: 21m42s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 31.030ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 28.995ms - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s118ms - OpenTime: 31.032ms - ExecTreeOpenTime: 315.675us - PrepareTime: 212.116ms - ExecTreePrepareTime: 2.168ms KrpcDataStreamSender (dst_id=1):(Total: 4m46s, non-child: 4m46s, % non-child: 100.00%) - BytesSent: 33.90 GB (36400178199) - EosSent: 0 (0) - OverallThroughput: 121.06 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 258.17M (258171904) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m46s - UncompressedRowBatchSize: 66.55 GB (71456807125) HDFS_SCAN_NODE (id=0):(Total: 2s916ms, non-child: 2s916ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:36/8.74 GB 6:28/6.90 GB 0:26/6.28 GB 4:29/7.14 GB 7:23/5.61 GB 5:21/5.09 GB 1:24/5.90 GB 2:38/9.18 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.81 GB, 11.62 GB, 12.00 GB, 12.24 GB, 12.47 GB, 12.83 GB, 13.36 GB, 14.02 GB, 14.53 GB, 14.92 GB, 15.10 GB, 15.19 GB, 15.26 GB, 15.30 GB, 15.34 GB, 15.41 GB, 15.47 GB, 15.57 GB, 15.66 GB, 15.71 GB, 15.80 GB, 15.85 GB, 15.92 GB, 15.96 GB, 16.02 GB, 16.10 GB, 16.19 GB, 16.29 GB, 16.42 GB, 16.56 GB, 16.75 GB, 16.99 GB, 17.18 GB, 17.34 GB, 17.49 GB, 17.62 GB, 17.76 GB, 17.84 GB, 17.88 GB, 17.94 GB, 17.98 GB, 18.02 GB, 18.07 GB, 18.10 GB, 18.15 GB - FooterProcessingTime: (Avg: 3s751ms ; Min: 157.534ms ; Max: 8s749ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.19 GB (19526482150) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 52s142ms - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.70 GB (13637262945) - PerReadThreadRawHdfsThroughput: 43.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 258.38M (258377728) - RowsReturned: 258.17M (258172928) - RowsReturnedRate: 88.51 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s384ms - TotalRawHdfsReadTime(*): 7m12s - TotalReadThroughput: 6.38 MB/sec CodeGen:(Total: 30.425ms, non-child: 30.425ms, % non-child: 100.00%) - CodegenTime: 418.216us - CompileTime: 4.108ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.254ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 19.471ms Instance 844a0200d7876345:20bb38b90000004b (host=ve1141.foo.com:22000):(Total: 254.997ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:26/6.33 GB 1:30/7.43 GB 6:24/5.80 GB 0:32/7.80 GB 2:32/7.77 GB 4:20/4.85 GB 5:28/6.82 GB 3:32/7.88 GB Fragment Instance Lifecycle Event Timeline: 1s541ms - Prepare Finished: 219.581ms (219.581ms) - Open Finished: 255.700ms (36.118ms) - First Batch Produced: 1s539ms (1s283ms) - First Batch Sent: 1s541ms (2.313ms) MemoryUsage(1m4s): 7.36 GB, 12.67 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.71 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.69 GB, 12.68 GB, 12.68 GB, 12.66 GB, 12.66 GB, 12.65 GB, 12.63 GB, 12.61 GB, 12.59 GB, 12.57 GB, 12.56 GB, 12.54 GB, 12.50 GB, 12.46 GB, 12.42 GB, 12.36 GB, 12.31 GB, 12.27 GB, 12.24 GB, 12.21 GB, 12.19 GB, 12.18 GB, 12.14 GB, 12.13 GB, 12.13 GB, 12.12 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.71 GB (13650416719) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 79.03 GB (84861482883) - RowsProduced: 274.22M (274224128) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m53s - TotalStorageWaitTime: 22m58s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 36.119ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 32.995ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 3s228ms - OpenTime: 36.120ms - ExecTreeOpenTime: 191.255us - PrepareTime: 218.789ms - ExecTreePrepareTime: 1.849ms KrpcDataStreamSender (dst_id=1):(Total: 4m42s, non-child: 4m42s, % non-child: 100.00%) - BytesSent: 35.97 GB (38619545745) - EosSent: 0 (0) - OverallThroughput: 130.40 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 274.22M (274223104) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m41s - UncompressedRowBatchSize: 70.69 GB (75899659028) HDFS_SCAN_NODE (id=0):(Total: 3s037ms, non-child: 3s037ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:26/6.33 GB 1:30/7.43 GB 6:24/5.80 GB 0:32/7.80 GB 2:32/7.77 GB 4:20/4.85 GB 5:28/6.82 GB 3:32/7.88 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.47 GB, 11.78 GB, 12.41 GB, 12.81 GB, 13.22 GB, 13.86 GB, 14.44 GB, 14.92 GB, 15.16 GB, 15.30 GB, 15.35 GB, 15.40 GB, 15.44 GB, 15.54 GB, 15.66 GB, 15.76 GB, 15.83 GB, 15.91 GB, 16.00 GB, 16.09 GB, 16.16 GB, 16.23 GB, 16.29 GB, 16.37 GB, 16.48 GB, 16.64 GB, 16.81 GB, 17.07 GB, 17.25 GB, 17.36 GB, 17.51 GB, 17.62 GB, 17.77 GB, 17.90 GB, 17.98 GB, 18.04 GB, 18.10 GB, 18.12 GB, 18.17 GB, 18.20 GB, 18.23 GB, 18.28 GB, 18.33 GB, 18.40 GB, 18.47 GB - FooterProcessingTime: (Avg: 4s015ms ; Min: 164.671ms ; Max: 13s260ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.51 GB (19879078118) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m44s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.71 GB (13647407431) - PerReadThreadRawHdfsThroughput: 42.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 274.43M (274428928) - RowsReturned: 274.22M (274224128) - RowsReturnedRate: 90.27 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 10s071ms - TotalRawHdfsReadTime(*): 7m29s - TotalReadThroughput: 6.46 MB/sec CodeGen:(Total: 35.623ms, non-child: 35.623ms, % non-child: 100.00%) - CodegenTime: 420.655us - CompileTime: 4.436ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.172ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.332ms Instance 844a0200d7876345:20bb38b900000040 (host=ve1142.foo.com:22000):(Total: 242.134ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:26/6.39 GB 3:26/6.40 GB 6:27/6.53 GB 2:36/8.64 GB 4:34/8.31 GB 7:20/4.84 GB 1:31/7.48 GB 5:24/5.91 GB Fragment Instance Lifecycle Event Timeline: 1s746ms - Prepare Finished: 212.761ms (212.761ms) - Open Finished: 242.529ms (29.768ms) - First Batch Produced: 1s744ms (1s501ms) - First Batch Sent: 1s746ms (1.661ms) MemoryUsage(1m4s): 7.62 GB, 12.68 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.70 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.69 GB, 12.68 GB, 12.67 GB, 12.67 GB, 12.67 GB, 12.65 GB, 12.65 GB, 12.64 GB, 12.63 GB, 12.61 GB, 12.60 GB, 12.57 GB, 12.52 GB, 12.50 GB, 12.47 GB, 12.45 GB, 12.42 GB, 12.38 GB, 12.34 GB, 12.29 GB, 12.24 GB, 12.19 GB, 12.15 GB, 12.10 GB, 12.07 GB, 12.03 GB, 12.02 GB, 12.02 GB, 12.02 GB, 12.01 GB, 12.00 GB, 11.99 GB ThreadUsage(1m4s): 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 81.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.70 GB (13638935426) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 78.71 GB (84510482285) - RowsProduced: 275.85M (275853312) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 38m40s - TotalStorageWaitTime: 22m5s - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 29.765ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 26.995ms - TotalThreadsVoluntaryContextSwitches: 1 (1) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 5s748ms - OpenTime: 29.766ms - ExecTreeOpenTime: 203.739us - PrepareTime: 212.307ms - ExecTreePrepareTime: 2.397ms KrpcDataStreamSender (dst_id=1):(Total: 4m30s, non-child: 4m30s, % non-child: 100.00%) - BytesSent: 36.23 GB (38898479781) - EosSent: 0 (0) - OverallThroughput: 137.22 MB/sec - PeakMemoryUsage: 3.61 MB (3785376) - RowsReturned: 275.85M (275852288) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4m29s - UncompressedRowBatchSize: 71.11 GB (76350664094) HDFS_SCAN_NODE (id=0):(Total: 5s558ms, non-child: 5s558ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:26/6.39 GB 3:26/6.40 GB 6:27/6.53 GB 2:36/8.64 GB 4:34/8.31 GB 7:20/4.84 GB 1:31/7.48 GB 5:24/5.91 GB ExecOption: PARQUET Codegen Enabled BytesRead(1m4s): 6.71 GB, 11.79 GB, 12.30 GB, 12.78 GB, 13.32 GB, 13.98 GB, 14.57 GB, 15.01 GB, 15.20 GB, 15.32 GB, 15.36 GB, 15.42 GB, 15.48 GB, 15.57 GB, 15.66 GB, 15.74 GB, 15.80 GB, 15.88 GB, 15.97 GB, 16.05 GB, 16.13 GB, 16.20 GB, 16.30 GB, 16.41 GB, 16.53 GB, 16.73 GB, 16.91 GB, 17.09 GB, 17.26 GB, 17.38 GB, 17.52 GB, 17.67 GB, 17.78 GB, 17.85 GB, 17.93 GB, 17.98 GB, 18.04 GB, 18.09 GB, 18.14 GB, 18.17 GB, 18.21 GB, 18.26 GB, 18.31 GB, 18.37 GB, 18.41 GB - FooterProcessingTime: (Avg: 3s939ms ; Min: 92.215ms ; Max: 9s131ms ; Number of samples: 80) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 80.00 - BytesRead: 18.46 GB (19822148648) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1m37s - MaxCompressedTextFileLength: 0 - NumColumns: 15 (15) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 80 (80) - NumScannerThreadsStarted: 80 (80) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.70 GB (13635783241) - PerReadThreadRawHdfsThroughput: 42.93 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 276.06M (276058112) - RowsReturned: 275.85M (275853312) - RowsReturnedRate: 49.62 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 9s070ms - TotalRawHdfsReadTime(*): 7m20s - TotalReadThroughput: 6.49 MB/sec CodeGen:(Total: 29.309ms, non-child: 29.309ms, % non-child: 100.00%) - CodegenTime: 373.574us - CompileTime: 4.006ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039504) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 6.408ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 18.461ms