Query (id=ce441eb8218e9dbf:9de609a100000000): Summary: Session ID: 7f456c1079744c1f:da386a371cd17681 Session Type: BEESWAX Start Time: 2017-05-03 16:21:22.056201000 End Time: 2017-05-03 16:21:23.367780000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.9.0-SNAPSHOT RELEASE (build 8883bdb523a7ebe21c40f71835a98c886940a768) User: mmokhtar Connected User: mmokhtar Delegated User: Network Address: 10.17.193.10:51133 Default Db: tpch_300_parquet Sql Statement: select distinct(l_partkey) from lineitem where ((l_orderkey = 520 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 534 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 518 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 535 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 496 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 497 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 516 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 531 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 533 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 532 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 546 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 549 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 548 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 547 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 513 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 515 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 507 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 509 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 519 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 527 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 501 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 544 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 545 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 541 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 550 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 529 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 528 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 537 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 538 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 506 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 502 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 543 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 390 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 389 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 0 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 852 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 853 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 854 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 844 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 846 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 843 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 849 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 850 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 847 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 746 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 745 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 901 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 899 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 895 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 878 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 884 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 871 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 872 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 886 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 879 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 864 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 889 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 885 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 848 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 888 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 863 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 930 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 891 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 890 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 926 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 927 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 892 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 925 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 887 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 898 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 902 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 903 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 904 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 897 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 900 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 598 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 597 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 607 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02")) and l_partkey in (select distinct(l_partkey) from lineitem where ((l_orderkey = 288 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 289 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 281 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 287 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 290 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 264 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 292 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 241 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 291 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 286 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 148 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 298 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 278 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 284 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 285 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 283 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 295 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 296 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 293 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 294 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 282 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 263 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 297 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 299 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 300 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 265 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 267 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 520 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 534 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 518 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 535 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 496 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 497 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 516 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 531 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 533 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 532 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 546 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 549 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 548 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 547 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 513 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 515 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 507 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 509 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 519 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 527 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 503 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 498 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 501 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 544 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 545 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 540 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 541 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 550 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 529 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 528 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 537 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 538 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 506 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 500 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 539 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 512 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 502 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 504 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 543 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 390 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 389 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 0 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 844 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 846 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 894 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 843 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 744 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 847 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 746 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 745 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 893 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 901 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 899 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 878 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 884 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 883 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 879 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 929 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 885 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 891 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 892 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 882 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 898 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 876 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 743 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02") or (l_orderkey = 900 and l_shipdate between "2017-01-01 12:00:00" and "2017-04-17 02:22:02"))) Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): Plan: ---------------- Per-Host Resource Reservation: Memory=400.00MB Per-Host Resource Estimates: Memory=284.00MB F03:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 08:EXCHANGE [UNPARTITIONED] | mem-estimate=0B mem-reservation=0B | tuple-ids=4 row-size=8B cardinality=101 | F02:PLAN FRAGMENT [HASH((l_partkey))] hosts=14 instances=14 04:AGGREGATE [FINALIZE] | group by: (l_partkey) | mem-estimate=10.00MB mem-reservation=264.00MB | tuple-ids=4 row-size=8B cardinality=101 | 03:HASH JOIN [LEFT SEMI JOIN, PARTITIONED] | hash predicates: l_partkey = (l_partkey) | runtime filters: RF000 <- (l_partkey) | mem-estimate=76B mem-reservation=136.00MB | tuple-ids=0 row-size=42B cardinality=101 | |--06:AGGREGATE [FINALIZE] | | group by: (l_partkey) | | mem-estimate=10.00MB mem-reservation=264.00MB | | tuple-ids=2 row-size=8B cardinality=121 | | | 05:EXCHANGE [HASH((l_partkey))] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=2 row-size=8B cardinality=121 | | | F01:PLAN FRAGMENT [RANDOM] hosts=14 instances=14 | 02:AGGREGATE [STREAMING] | | group by: (l_partkey) | | mem-estimate=10.00MB mem-reservation=0B | | tuple-ids=2 row-size=8B cardinality=121 | | | 01:SCAN HDFS [tpch_300_parquet.lineitem, RANDOM] | partitions=1/1 files=264 size=64.36GB | predicates: l_shipdate <= '2017-04-17 02:22:02', l_shipdate >= '2017-01-01 12:00:00', ((l_orderkey = 288) OR (l_orderkey = 289) OR (l_orderkey = 281) OR (l_orderkey = 287) OR (l_orderkey = 290) OR (l_orderkey = 264) OR (l_orderkey = 292) OR (l_orderkey = 241) OR (l_orderkey = 291) OR (l_orderkey = 286) OR (l_orderkey = 148) OR (l_orderkey = 298) OR (l_orderkey = 278) OR (l_orderkey = 284) OR (l_orderkey = 285) OR (l_orderkey = 283) OR (l_orderkey = 295) OR (l_orderkey = 296) OR (l_orderkey = 293) OR (l_orderkey = 294) OR (l_orderkey = 282) OR (l_orderkey = 263) OR (l_orderkey = 297) OR (l_orderkey = 299) OR (l_orderkey = 300) OR (l_orderkey = 265) OR (l_orderkey = 267) OR (l_orderkey = 520) OR (l_orderkey = 534) OR (l_orderkey = 518) OR (l_orderkey = 535) OR (l_orderkey = 496) OR (l_orderkey = 497) OR (l_orderkey = 516) OR (l_orderkey = 531) OR (l_orderkey = 533) OR (l_orderkey = 532) OR (l_orderkey = 546) OR (l_orderkey = 549) OR (l_orderkey = 548) OR (l_orderkey = 547) OR (l_orderkey = 513) OR (l_orderkey = 515) OR (l_orderkey = 507) OR (l_orderkey = 509) OR (l_orderkey = 519) OR (l_orderkey = 527) OR (l_orderkey = 503) OR (l_orderkey = 498) OR (l_orderkey = 501) OR (l_orderkey = 544) OR (l_orderkey = 545) OR (l_orderkey = 540) OR (l_orderkey = 541) OR (l_orderkey = 550) OR (l_orderkey = 529) OR (l_orderkey = 528) OR (l_orderkey = 537) OR (l_orderkey = 538) OR (l_orderkey = 506) OR (l_orderkey = 500) OR (l_orderkey = 539) OR (l_orderkey = 512) OR (l_orderkey = 502) OR (l_orderkey = 504) OR (l_orderkey = 543) OR (l_orderkey = 390) OR (l_orderkey = 389) OR (l_orderkey = 0) OR (l_orderkey = 844) OR (l_orderkey = 846) OR (l_orderkey = 894) OR (l_orderkey = 843) OR (l_orderkey = 744) OR (l_orderkey = 847) OR (l_orderkey = 746) OR (l_orderkey = 745) OR (l_orderkey = 893) OR (l_orderkey = 901) OR (l_orderkey = 899) OR (l_orderkey = 878) OR (l_orderkey = 884) OR (l_orderkey = 883) OR (l_orderkey = 879) OR (l_orderkey = 929) OR (l_orderkey = 885) OR (l_orderkey = 891) OR (l_orderkey = 892) OR (l_orderkey = 882) OR (l_orderkey = 898) OR (l_orderkey = 876) OR (l_orderkey = 743) OR (l_orderkey = 900)) | table stats: 1799989091 rows total | column stats: all | parquet statistics predicates: l_shipdate <= '2017-04-17 02:22:02', l_shipdate >= '2017-01-01 12:00:00' | parquet dictionary predicates: l_shipdate <= '2017-04-17 02:22:02', l_shipdate >= '2017-01-01 12:00:00', ((l_orderkey = 288) OR (l_orderkey = 289) OR (l_orderkey = 281) OR (l_orderkey = 287) OR (l_orderkey = 290) OR (l_orderkey = 264) OR (l_orderkey = 292) OR (l_orderkey = 241) OR (l_orderkey = 291) OR (l_orderkey = 286) OR (l_orderkey = 148) OR (l_orderkey = 298) OR (l_orderkey = 278) OR (l_orderkey = 284) OR (l_orderkey = 285) OR (l_orderkey = 283) OR (l_orderkey = 295) OR (l_orderkey = 296) OR (l_orderkey = 293) OR (l_orderkey = 294) OR (l_orderkey = 282) OR (l_orderkey = 263) OR (l_orderkey = 297) OR (l_orderkey = 299) OR (l_orderkey = 300) OR (l_orderkey = 265) OR (l_orderkey = 267) OR (l_orderkey = 520) OR (l_orderkey = 534) OR (l_orderkey = 518) OR (l_orderkey = 535) OR (l_orderkey = 496) OR (l_orderkey = 497) OR (l_orderkey = 516) OR (l_orderkey = 531) OR (l_orderkey = 533) OR (l_orderkey = 532) OR (l_orderkey = 546) OR (l_orderkey = 549) OR (l_orderkey = 548) OR (l_orderkey = 547) OR (l_orderkey = 513) OR (l_orderkey = 515) OR (l_orderkey = 507) OR (l_orderkey = 509) OR (l_orderkey = 519) OR (l_orderkey = 527) OR (l_orderkey = 503) OR (l_orderkey = 498) OR (l_orderkey = 501) OR (l_orderkey = 544) OR (l_orderkey = 545) OR (l_orderkey = 540) OR (l_orderkey = 541) OR (l_orderkey = 550) OR (l_orderkey = 529) OR (l_orderkey = 528) OR (l_orderkey = 537) OR (l_orderkey = 538) OR (l_orderkey = 506) OR (l_orderkey = 500) OR (l_orderkey = 539) OR (l_orderkey = 512) OR (l_orderkey = 502) OR (l_orderkey = 504) OR (l_orderkey = 543) OR (l_orderkey = 390) OR (l_orderkey = 389) OR (l_orderkey = 0) OR (l_orderkey = 844) OR (l_orderkey = 846) OR (l_orderkey = 894) OR (l_orderkey = 843) OR (l_orderkey = 744) OR (l_orderkey = 847) OR (l_orderkey = 746) OR (l_orderkey = 745) OR (l_orderkey = 893) OR (l_orderkey = 901) OR (l_orderkey = 899) OR (l_orderkey = 878) OR (l_orderkey = 884) OR (l_orderkey = 883) OR (l_orderkey = 879) OR (l_orderkey = 929) OR (l_orderkey = 885) OR (l_orderkey = 891) OR (l_orderkey = 892) OR (l_orderkey = 882) OR (l_orderkey = 898) OR (l_orderkey = 876) OR (l_orderkey = 743) OR (l_orderkey = 900)) | mem-estimate=264.00MB mem-reservation=0B | tuple-ids=1 row-size=42B cardinality=121 | 07:EXCHANGE [HASH(l_partkey)] | mem-estimate=0B mem-reservation=0B | tuple-ids=0 row-size=42B cardinality=101 | F00:PLAN FRAGMENT [RANDOM] hosts=14 instances=14 00:SCAN HDFS [tpch_300_parquet.lineitem, RANDOM] partitions=1/1 files=264 size=64.36GB predicates: l_shipdate <= '2017-04-17 02:22:02', l_shipdate >= '2017-01-01 12:00:00', ((l_orderkey = 520) OR (l_orderkey = 534) OR (l_orderkey = 518) OR (l_orderkey = 535) OR (l_orderkey = 496) OR (l_orderkey = 497) OR (l_orderkey = 516) OR (l_orderkey = 531) OR (l_orderkey = 533) OR (l_orderkey = 532) OR (l_orderkey = 546) OR (l_orderkey = 549) OR (l_orderkey = 548) OR (l_orderkey = 547) OR (l_orderkey = 513) OR (l_orderkey = 515) OR (l_orderkey = 507) OR (l_orderkey = 509) OR (l_orderkey = 519) OR (l_orderkey = 527) OR (l_orderkey = 501) OR (l_orderkey = 544) OR (l_orderkey = 545) OR (l_orderkey = 541) OR (l_orderkey = 550) OR (l_orderkey = 529) OR (l_orderkey = 528) OR (l_orderkey = 537) OR (l_orderkey = 538) OR (l_orderkey = 506) OR (l_orderkey = 502) OR (l_orderkey = 543) OR (l_orderkey = 390) OR (l_orderkey = 389) OR (l_orderkey = 0) OR (l_orderkey = 852) OR (l_orderkey = 853) OR (l_orderkey = 854) OR (l_orderkey = 844) OR (l_orderkey = 846) OR (l_orderkey = 843) OR (l_orderkey = 849) OR (l_orderkey = 850) OR (l_orderkey = 847) OR (l_orderkey = 746) OR (l_orderkey = 745) OR (l_orderkey = 901) OR (l_orderkey = 899) OR (l_orderkey = 895) OR (l_orderkey = 878) OR (l_orderkey = 884) OR (l_orderkey = 871) OR (l_orderkey = 872) OR (l_orderkey = 886) OR (l_orderkey = 879) OR (l_orderkey = 864) OR (l_orderkey = 889) OR (l_orderkey = 885) OR (l_orderkey = 848) OR (l_orderkey = 888) OR (l_orderkey = 863) OR (l_orderkey = 930) OR (l_orderkey = 891) OR (l_orderkey = 890) OR (l_orderkey = 926) OR (l_orderkey = 927) OR (l_orderkey = 892) OR (l_orderkey = 925) OR (l_orderkey = 887) OR (l_orderkey = 898) OR (l_orderkey = 902) OR (l_orderkey = 903) OR (l_orderkey = 904) OR (l_orderkey = 897) OR (l_orderkey = 900) OR (l_orderkey = 598) OR (l_orderkey = 597) OR (l_orderkey = 607)) runtime filters: RF000 -> l_partkey table stats: 1799989091 rows total column stats: all parquet statistics predicates: l_shipdate <= '2017-04-17 02:22:02', l_shipdate >= '2017-01-01 12:00:00' parquet dictionary predicates: l_shipdate <= '2017-04-17 02:22:02', l_shipdate >= '2017-01-01 12:00:00', ((l_orderkey = 520) OR (l_orderkey = 534) OR (l_orderkey = 518) OR (l_orderkey = 535) OR (l_orderkey = 496) OR (l_orderkey = 497) OR (l_orderkey = 516) OR (l_orderkey = 531) OR (l_orderkey = 533) OR (l_orderkey = 532) OR (l_orderkey = 546) OR (l_orderkey = 549) OR (l_orderkey = 548) OR (l_orderkey = 547) OR (l_orderkey = 513) OR (l_orderkey = 515) OR (l_orderkey = 507) OR (l_orderkey = 509) OR (l_orderkey = 519) OR (l_orderkey = 527) OR (l_orderkey = 501) OR (l_orderkey = 544) OR (l_orderkey = 545) OR (l_orderkey = 541) OR (l_orderkey = 550) OR (l_orderkey = 529) OR (l_orderkey = 528) OR (l_orderkey = 537) OR (l_orderkey = 538) OR (l_orderkey = 506) OR (l_orderkey = 502) OR (l_orderkey = 543) OR (l_orderkey = 390) OR (l_orderkey = 389) OR (l_orderkey = 0) OR (l_orderkey = 852) OR (l_orderkey = 853) OR (l_orderkey = 854) OR (l_orderkey = 844) OR (l_orderkey = 846) OR (l_orderkey = 843) OR (l_orderkey = 849) OR (l_orderkey = 850) OR (l_orderkey = 847) OR (l_orderkey = 746) OR (l_orderkey = 745) OR (l_orderkey = 901) OR (l_orderkey = 899) OR (l_orderkey = 895) OR (l_orderkey = 878) OR (l_orderkey = 884) OR (l_orderkey = 871) OR (l_orderkey = 872) OR (l_orderkey = 886) OR (l_orderkey = 879) OR (l_orderkey = 864) OR (l_orderkey = 889) OR (l_orderkey = 885) OR (l_orderkey = 848) OR (l_orderkey = 888) OR (l_orderkey = 863) OR (l_orderkey = 930) OR (l_orderkey = 891) OR (l_orderkey = 890) OR (l_orderkey = 926) OR (l_orderkey = 927) OR (l_orderkey = 892) OR (l_orderkey = 925) OR (l_orderkey = 887) OR (l_orderkey = 898) OR (l_orderkey = 902) OR (l_orderkey = 903) OR (l_orderkey = 904) OR (l_orderkey = 897) OR (l_orderkey = 900) OR (l_orderkey = 598) OR (l_orderkey = 597) OR (l_orderkey = 607)) mem-estimate=264.00MB mem-reservation=0B tuple-ids=0 row-size=42B cardinality=101 ---------------- Estimated Per-Host Mem: 297795584 Per-Host Memory Reservation: 419430400 Request Pool: root.mmokhtar Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------- 08:EXCHANGE 1 6.490us 6.490us 0 101 0 0 UNPARTITIONED 04:AGGREGATE 14 2.686ms 4.041ms 0 101 2.27 MB 10.00 MB FINALIZE 03:HASH JOIN 14 1.684ms 2.646ms 0 101 1.04 MB 76.00 B LEFT SEMI JOIN, PARTITIONED |--06:AGGREGATE 14 2.327ms 3.491ms 0 121 2.27 MB 10.00 MB FINALIZE | 05:EXCHANGE 14 8.214us 10.148us 0 121 0 0 HASH((l_partkey)) | 02:AGGREGATE 14 5.138ms 11.280ms 0 121 1.30 MB 10.00 MB STREAMING | 01:SCAN HDFS 14 96.151ms 143.831ms 0 121 128.52 MB 264.00 MB tpch_300_parquet.lineitem 07:EXCHANGE 14 11.865us 22.245us 0 101 0 0 HASH(l_partkey) 00:SCAN HDFS 14 300.175ms 363.582ms 0 101 112.58 MB 264.00 MB tpch_300_parquet.lineitem Errors: Planner Timeline: 37.796ms - Analysis finished: 16.332ms (16.332ms) - Equivalence classes computed: 16.434ms (101.914us) - Single node plan created: 31.837ms (15.403ms) - Runtime filters computed: 32.089ms (251.972us) - Distributed plan created: 32.285ms (195.518us) - Lineage info computed: 32.354ms (68.988us) - Planning finished: 37.796ms (5.442ms) Query Timeline: 1s355ms - Query submitted: 225.930us (225.930us) - Planning finished: 44.115ms (43.889ms) - Submit for admission: 48.768ms (4.652ms) - Completed admission: 48.982ms (214.077us) - Ready to start 43 fragment instances: 50.954ms (1.972ms) - All 43 fragment instances started: 90.775ms (39.821ms) - First dynamic filter received: 1s252ms (1s161ms) - Rows available: 1s270ms (18.031ms) - First row fetched: 1s300ms (30.312ms) - Unregister query: 1s311ms (10.749ms) - ComputeScanRangeAssignmentTimer: 1.694ms ImpalaServer: - ClientFetchWaitTimer: 34.733ms - RowMaterializationTimer: 6.307ms Execution Profile ce441eb8218e9dbf:9de609a100000000:(Total: 1s226ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 1 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- 0 3 0 14 REMOTE false 14 (14) N/A N/A true Fragment instance start latencies: Count: 43, min / max: 1ms / 22ms, 25th %-ile: 2ms, 50th %-ile: 4ms, 75th %-ile: 5ms, 90th %-ile: 6ms, 95th %-ile: 6ms, 99.9th %-ile: 22ms Per Node Peak Memory Usage: vb0206.halxg.cloudera.com:22000(110.68 MB) vb0228.halxg.cloudera.com:22000(102.93 MB) vb0220.halxg.cloudera.com:22000(126.75 MB) vb0212.halxg.cloudera.com:22000(86.81 MB) vb0234.halxg.cloudera.com:22000(110.84 MB) vb0218.halxg.cloudera.com:22000(118.98 MB) vb0222.halxg.cloudera.com:22000(118.92 MB) vb0224.halxg.cloudera.com:22000(134.77 MB) vb0214.halxg.cloudera.com:22000(118.72 MB) vb0232.halxg.cloudera.com:22000(118.66 MB) vb0216.halxg.cloudera.com:22000(94.81 MB) vb0208.halxg.cloudera.com:22000(110.86 MB) vb0230.halxg.cloudera.com:22000(110.77 MB) vb0204.halxg.cloudera.com:22000(102.58 MB) Final filter table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- 0 3 0 14 REMOTE false 0 (14) 1s252ms 1s262ms false - FiltersReceived: 14 (14) - FinalizationTimer: 0.000ns Coordinator Fragment F03: Instance ce441eb8218e9dbf:9de609a100000000 (host=vb0204.halxg.cloudera.com:22000):(Total: 1s215ms, non-child: 2.092ms, % non-child: 0.17%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 102.58 MB (107561819) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s178ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 1s179ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 999.000us - TotalThreadsVoluntaryContextSwitches: 5 (5) Fragment Instance Lifecycle Timings: - ExecTime: 21.948us - ExecTreeExecTime: 4.229us - OpenTime: 1s179ms - ExecTreeOpenTime: 1s178ms - PrepareTime: 36.059ms - ExecTreePrepareTime: 50.923us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 80 (80) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 768.00 KB (786432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 35.560ms, non-child: 35.560ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 34.850ms EXCHANGE_NODE (id=8):(Total: 1s178ms, non-child: 6.490us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 867.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 1s178ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 1s210ms, non-child: 8.109ms, % non-child: 0.67%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1s209ms max:1s216ms mean: 1s213ms stddev:1.842ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 14 - AverageThreadTokens: 1.73 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 6.18 MB (6481632) - PerHostPeakMemUsage: 111.93 MB (117371877) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s678ms - TotalNetworkSendTime: 428.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 2s006ms - TotalThreadsSysTime: 6.712ms - TotalThreadsUserTime: 319.450ms - TotalThreadsVoluntaryContextSwitches: 12 (12) Fragment Instance Lifecycle Timings: - ExecTime: 532.001us - ExecTreeExecTime: 4.858us - OpenTime: 1s171ms - ExecTreeOpenTime: 853.294ms - PrepareTime: 38.268ms - ExecTreePrepareTime: 1.731ms DataStreamSender (dst_id=8):(Total: 29.905us, non-child: 29.905us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 14.22 KB (14560) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 347.573ms, non-child: 347.573ms, % non-child: 100.00%) - CodegenTime: 2.793ms - CompileTime: 101.089ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 72 (72) - NumInstructions: 3.26K (3262) - OptimizationTime: 216.086ms - PeakMemoryUsage: 1.59 MB (1670144) - PrepareTime: 29.603ms AGGREGATION_NODE (id=4):(Total: 855.023ms, non-child: 2.686ms, % non-child: 0.31%) - BuildTime: 7.238us - GetNewBlockTime: 247.345us - GetResultsTime: 0.000ns - HTResizeTime: 4.539us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.923us HASH_JOIN_NODE (id=3):(Total: 852.337ms, non-child: 1.684ms, % non-child: 0.20%) - BuildRows: 0 (0) - BuildTime: 4.019ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.04 MB (1091840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.388us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=3): - BuildRowsPartitionTime: 2.470us - BuildRowsPartitioned: 0 (0) - GetNewBlockTime: 19.723us - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.01 MB (1062016) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns AGGREGATION_NODE (id=6):(Total: 830.638ms, non-child: 2.327ms, % non-child: 0.28%) - BuildTime: 9.734us - GetNewBlockTime: 244.089us - GetResultsTime: 0.000ns - HTResizeTime: 4.944us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.350us EXCHANGE_NODE (id=5):(Total: 828.311ms, non-child: 828.311ms, % non-child: 100.00%) - BytesReceived: 0 - ConvertRowBatchTime: 1.049us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 828.301ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 849.850ms, non-child: 849.850ms, % non-child: 100.00%) - BytesReceived: 0 - ConvertRowBatchTime: 2.031us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 849.837ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 80 (80) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 768.00 KB (786432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns Fragment F02: Instance ce441eb8218e9dbf:9de609a100000029 (host=vb0208.halxg.cloudera.com:22000):(Total: 1s213ms, non-child: 8.492ms, % non-child: 0.70%) MemoryUsage(500.000ms): 4.59 MB, 4.60 MB ThreadUsage(500.000ms): 1, 2 - AverageThreadTokens: 1.50 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 6.18 MB (6481632) - PerHostPeakMemUsage: 110.86 MB (116242397) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s686ms - TotalNetworkSendTime: 545.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 2s015ms - TotalThreadsSysTime: 6.999ms - TotalThreadsUserTime: 319.951ms - TotalThreadsVoluntaryContextSwitches: 10 (10) Fragment Instance Lifecycle Timings: - ExecTime: 1.084ms - ExecTreeExecTime: 4.925us - OpenTime: 1s176ms - ExecTreeOpenTime: 858.744ms - PrepareTime: 35.517ms - ExecTreePrepareTime: 1.615ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 80 (80) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 768.00 KB (786432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=8):(Total: 30.951us, non-child: 30.951us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 14.22 KB (14560) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 344.445ms, non-child: 344.445ms, % non-child: 100.00%) - CodegenTime: 2.908ms - CompileTime: 100.855ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 72 (72) - NumInstructions: 3.26K (3262) - OptimizationTime: 215.616ms - PeakMemoryUsage: 1.59 MB (1670144) - PrepareTime: 27.351ms AGGREGATION_NODE (id=4):(Total: 860.357ms, non-child: 4.041ms, % non-child: 0.47%) ExecOption: Codegen Enabled - BuildTime: 6.901us - GetNewBlockTime: 189.121us - GetResultsTime: 0.000ns - HTResizeTime: 3.675us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.092us HASH_JOIN_NODE (id=3):(Total: 856.315ms, non-child: 1.792ms, % non-child: 0.21%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 3.453ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.04 MB (1091840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.370us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1.795us - BuildRowsPartitioned: 0 (0) - GetNewBlockTime: 24.016us - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.01 MB (1062016) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns AGGREGATION_NODE (id=6):(Total: 835.341ms, non-child: 2.796ms, % non-child: 0.33%) ExecOption: Codegen Enabled - BuildTime: 8.518us - GetNewBlockTime: 213.216us - GetResultsTime: 0.000ns - HTResizeTime: 4.696us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.332us EXCHANGE_NODE (id=5):(Total: 832.544ms, non-child: 8.209us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 946.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 832.535ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 853.778ms, non-child: 8.086us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.831us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 853.769ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ce441eb8218e9dbf:9de609a10000001d (host=vb0230.halxg.cloudera.com:22000):(Total: 1s213ms, non-child: 7.438ms, % non-child: 0.61%) MemoryUsage(500.000ms): 6.18 MB, 4.60 MB, 4.60 MB ThreadUsage(500.000ms): 1, 2, 2 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 6.18 MB (6481632) - PerHostPeakMemUsage: 110.77 MB (116152788) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s677ms - TotalNetworkSendTime: 438.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 2s005ms - TotalThreadsSysTime: 7.998ms - TotalThreadsUserTime: 319.950ms - TotalThreadsVoluntaryContextSwitches: 12 (12) Fragment Instance Lifecycle Timings: - ExecTime: 260.803us - ExecTreeExecTime: 4.154us - OpenTime: 1s172ms - ExecTreeOpenTime: 854.463ms - PrepareTime: 39.912ms - ExecTreePrepareTime: 1.653ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 80 (80) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 768.00 KB (786432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=8):(Total: 34.842us, non-child: 34.842us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 14.22 KB (14560) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 349.684ms, non-child: 349.684ms, % non-child: 100.00%) - CodegenTime: 3.537ms - CompileTime: 101.308ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 72 (72) - NumInstructions: 3.26K (3262) - OptimizationTime: 216.089ms - PeakMemoryUsage: 1.59 MB (1670144) - PrepareTime: 31.642ms AGGREGATION_NODE (id=4):(Total: 856.114ms, non-child: 3.815ms, % non-child: 0.45%) ExecOption: Codegen Enabled - BuildTime: 7.883us - GetNewBlockTime: 199.619us - GetResultsTime: 0.000ns - HTResizeTime: 5.030us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.340us HASH_JOIN_NODE (id=3):(Total: 852.299ms, non-child: 1.813ms, % non-child: 0.21%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 3.607ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.04 MB (1091840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.414us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1.958us - BuildRowsPartitioned: 0 (0) - GetNewBlockTime: 21.814us - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.01 MB (1062016) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns AGGREGATION_NODE (id=6):(Total: 829.610ms, non-child: 1.829ms, % non-child: 0.22%) ExecOption: Codegen Enabled - BuildTime: 8.314us - GetNewBlockTime: 257.218us - GetResultsTime: 0.000ns - HTResizeTime: 4.705us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.823us EXCHANGE_NODE (id=5):(Total: 827.781ms, non-child: 9.700us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.259us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 827.770ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 849.675ms, non-child: 8.672us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.858us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 849.665ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ce441eb8218e9dbf:9de609a100000021 (host=vb0224.halxg.cloudera.com:22000):(Total: 1s212ms, non-child: 8.321ms, % non-child: 0.69%) MemoryUsage(500.000ms): 6.18 MB, 4.60 MB, 4.35 MB ThreadUsage(500.000ms): 1, 2, 2 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 6.18 MB (6481632) - PerHostPeakMemUsage: 134.77 MB (141318612) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s693ms - TotalNetworkSendTime: 332.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 2s019ms - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 318.951ms - TotalThreadsVoluntaryContextSwitches: 15 (15) Fragment Instance Lifecycle Timings: - ExecTime: 450.750us - ExecTreeExecTime: 4.169us - OpenTime: 1s178ms - ExecTreeOpenTime: 860.241ms - PrepareTime: 33.431ms - ExecTreePrepareTime: 1.851ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 80 (80) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 768.00 KB (786432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=8):(Total: 29.339us, non-child: 29.339us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 14.22 KB (14560) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 341.976ms, non-child: 341.976ms, % non-child: 100.00%) - CodegenTime: 2.886ms - CompileTime: 101.387ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 72 (72) - NumInstructions: 3.26K (3262) - OptimizationTime: 215.601ms - PeakMemoryUsage: 1.59 MB (1670144) - PrepareTime: 24.289ms AGGREGATION_NODE (id=4):(Total: 862.090ms, non-child: 1.999ms, % non-child: 0.23%) ExecOption: Codegen Enabled - BuildTime: 5.867us - GetNewBlockTime: 475.193us - GetResultsTime: 0.000ns - HTResizeTime: 3.733us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.241us HASH_JOIN_NODE (id=3):(Total: 860.090ms, non-child: 1.736ms, % non-child: 0.20%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 3.293ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.04 MB (1091840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.262us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 8.812us - BuildRowsPartitioned: 0 (0) - GetNewBlockTime: 21.455us - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.01 MB (1062016) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns AGGREGATION_NODE (id=6):(Total: 838.586ms, non-child: 2.666ms, % non-child: 0.32%) ExecOption: Codegen Enabled - BuildTime: 9.984us - GetNewBlockTime: 235.401us - GetResultsTime: 0.000ns - HTResizeTime: 4.983us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.964us EXCHANGE_NODE (id=5):(Total: 835.919ms, non-child: 8.409us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.093us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 835.910ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 857.542ms, non-child: 9.116us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.989us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 857.532ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ce441eb8218e9dbf:9de609a10000002a (host=vb0206.halxg.cloudera.com:22000):(Total: 1s212ms, non-child: 8.384ms, % non-child: 0.69%) MemoryUsage(500.000ms): 6.18 MB, 4.60 MB ThreadUsage(500.000ms): 1, 2 - AverageThreadTokens: 1.50 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 6.18 MB (6481632) - PerHostPeakMemUsage: 110.68 MB (116051624) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s680ms - TotalNetworkSendTime: 665.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 2s008ms - TotalThreadsSysTime: 8.998ms - TotalThreadsUserTime: 316.952ms - TotalThreadsVoluntaryContextSwitches: 33 (33) Fragment Instance Lifecycle Timings: - ExecTime: 406.179us - ExecTreeExecTime: 6.242us - OpenTime: 1s172ms - ExecTreeOpenTime: 855.773ms - PrepareTime: 39.141ms - ExecTreePrepareTime: 1.730ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 80 (80) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 768.00 KB (786432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=8):(Total: 36.903us, non-child: 36.903us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 14.22 KB (14560) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 346.318ms, non-child: 346.318ms, % non-child: 100.00%) - CodegenTime: 2.654ms - CompileTime: 100.077ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 72 (72) - NumInstructions: 3.26K (3262) - OptimizationTime: 215.286ms - PeakMemoryUsage: 1.59 MB (1670144) - PrepareTime: 30.071ms AGGREGATION_NODE (id=4):(Total: 857.502ms, non-child: 3.907ms, % non-child: 0.46%) ExecOption: Codegen Enabled - BuildTime: 8.975us - GetNewBlockTime: 188.784us - GetResultsTime: 0.000ns - HTResizeTime: 5.870us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.892us HASH_JOIN_NODE (id=3):(Total: 853.595ms, non-child: 1.665ms, % non-child: 0.20%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 3.996ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.04 MB (1091840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.664us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2.256us - BuildRowsPartitioned: 0 (0) - GetNewBlockTime: 20.540us - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.01 MB (1062016) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns AGGREGATION_NODE (id=6):(Total: 832.620ms, non-child: 2.771ms, % non-child: 0.33%) ExecOption: Codegen Enabled - BuildTime: 8.397us - GetNewBlockTime: 264.204us - GetResultsTime: 0.000ns - HTResizeTime: 4.553us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.177us EXCHANGE_NODE (id=5):(Total: 829.849ms, non-child: 8.996us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.290us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 829.838ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 851.102ms, non-child: 9.783us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 2.037us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 851.091ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ce441eb8218e9dbf:9de609a100000028 (host=vb0228.halxg.cloudera.com:22000):(Total: 1s211ms, non-child: 7.581ms, % non-child: 0.63%) MemoryUsage(500.000ms): 4.60 MB, 4.60 MB ThreadUsage(500.000ms): 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 6.18 MB (6481632) - PerHostPeakMemUsage: 102.93 MB (107930616) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s686ms - TotalNetworkSendTime: 96.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 2s011ms - TotalThreadsSysTime: 5.998ms - TotalThreadsUserTime: 316.951ms - TotalThreadsVoluntaryContextSwitches: 8 (8) Fragment Instance Lifecycle Timings: - ExecTime: 499.101us - ExecTreeExecTime: 3.497us - OpenTime: 1s173ms - ExecTreeOpenTime: 856.063ms - PrepareTime: 37.727ms - ExecTreePrepareTime: 1.643ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 80 (80) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 768.00 KB (786432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=8):(Total: 26.700us, non-child: 26.700us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 14.22 KB (14560) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 346.556ms, non-child: 346.556ms, % non-child: 100.00%) - CodegenTime: 2.788ms - CompileTime: 100.918ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 72 (72) - NumInstructions: 3.26K (3262) - OptimizationTime: 215.082ms - PeakMemoryUsage: 1.59 MB (1670144) - PrepareTime: 29.350ms AGGREGATION_NODE (id=4):(Total: 857.704ms, non-child: 1.380ms, % non-child: 0.16%) ExecOption: Codegen Enabled - BuildTime: 6.001us - GetNewBlockTime: 179.932us - GetResultsTime: 0.000ns - HTResizeTime: 4.177us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.956us HASH_JOIN_NODE (id=3):(Total: 856.323ms, non-child: 1.619ms, % non-child: 0.19%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 3.349ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.04 MB (1091840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.028us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2.289us - BuildRowsPartitioned: 0 (0) - GetNewBlockTime: 22.285us - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.01 MB (1062016) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns AGGREGATION_NODE (id=6):(Total: 834.845ms, non-child: 2.206ms, % non-child: 0.26%) ExecOption: Codegen Enabled - BuildTime: 9.737us - GetNewBlockTime: 264.796us - GetResultsTime: 0.000ns - HTResizeTime: 5.705us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.212us EXCHANGE_NODE (id=5):(Total: 832.639ms, non-child: 8.474us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.280us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 832.630ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 853.900ms, non-child: 21.439us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 2.017us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 853.877ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ce441eb8218e9dbf:9de609a100000022 (host=vb0218.halxg.cloudera.com:22000):(Total: 1s211ms, non-child: 7.666ms, % non-child: 0.63%) MemoryUsage(500.000ms): 4.60 MB, 4.60 MB ThreadUsage(500.000ms): 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 6.18 MB (6481632) - PerHostPeakMemUsage: 118.98 MB (124758015) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s689ms - TotalNetworkSendTime: 314.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 2s018ms - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 320.950ms - TotalThreadsVoluntaryContextSwitches: 9 (9) Fragment Instance Lifecycle Timings: - ExecTime: 517.693us - ExecTreeExecTime: 4.103us - OpenTime: 1s177ms - ExecTreeOpenTime: 858.767ms - PrepareTime: 33.123ms - ExecTreePrepareTime: 957.615us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 80 (80) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 768.00 KB (786432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=8):(Total: 15.223us, non-child: 15.223us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 14.22 KB (14560) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 344.202ms, non-child: 344.202ms, % non-child: 100.00%) - CodegenTime: 2.662ms - CompileTime: 100.752ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 72 (72) - NumInstructions: 3.26K (3262) - OptimizationTime: 216.368ms - PeakMemoryUsage: 1.59 MB (1670144) - PrepareTime: 26.502ms AGGREGATION_NODE (id=4):(Total: 859.723ms, non-child: 2.251ms, % non-child: 0.26%) ExecOption: Codegen Enabled - BuildTime: 4.061us - GetNewBlockTime: 112.236us - GetResultsTime: 0.000ns - HTResizeTime: 2.534us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.311us HASH_JOIN_NODE (id=3):(Total: 857.472ms, non-child: 1.213ms, % non-child: 0.14%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 3.504ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.04 MB (1091840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 857.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1.875us - BuildRowsPartitioned: 0 (0) - GetNewBlockTime: 22.709us - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.01 MB (1062016) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns AGGREGATION_NODE (id=6):(Total: 837.073ms, non-child: 3.041ms, % non-child: 0.36%) ExecOption: Codegen Enabled - BuildTime: 8.250us - GetNewBlockTime: 128.776us - GetResultsTime: 0.000ns - HTResizeTime: 4.324us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.392us EXCHANGE_NODE (id=5):(Total: 834.032ms, non-child: 8.057us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.016us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 834.023ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 855.796ms, non-child: 5.792us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.196us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 855.790ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ce441eb8218e9dbf:9de609a100000024 (host=vb0234.halxg.cloudera.com:22000):(Total: 1s211ms, non-child: 7.688ms, % non-child: 0.63%) MemoryUsage(500.000ms): 4.60 MB, 4.60 MB ThreadUsage(500.000ms): 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 6.18 MB (6481632) - PerHostPeakMemUsage: 110.84 MB (116223516) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s669ms - TotalNetworkSendTime: 288.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 1s998ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 321.950ms - TotalThreadsVoluntaryContextSwitches: 11 (11) Fragment Instance Lifecycle Timings: - ExecTime: 298.997us - ExecTreeExecTime: 4.474us - OpenTime: 1s169ms - ExecTreeOpenTime: 848.862ms - PrepareTime: 41.468ms - ExecTreePrepareTime: 1.642ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 80 (80) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 768.00 KB (786432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=8):(Total: 27.389us, non-child: 27.389us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 14.22 KB (14560) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 353.376ms, non-child: 353.376ms, % non-child: 100.00%) - CodegenTime: 2.706ms - CompileTime: 102.059ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 72 (72) - NumInstructions: 3.26K (3262) - OptimizationTime: 217.594ms - PeakMemoryUsage: 1.59 MB (1670144) - PrepareTime: 33.100ms AGGREGATION_NODE (id=4):(Total: 850.502ms, non-child: 2.890ms, % non-child: 0.34%) ExecOption: Codegen Enabled - BuildTime: 8.450us - GetNewBlockTime: 209.687us - GetResultsTime: 0.000ns - HTResizeTime: 5.567us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.941us HASH_JOIN_NODE (id=3):(Total: 847.611ms, non-child: 1.472ms, % non-child: 0.17%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 3.707ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.04 MB (1091840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.581us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1.938us - BuildRowsPartitioned: 0 (0) - GetNewBlockTime: 18.903us - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.01 MB (1062016) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns AGGREGATION_NODE (id=6):(Total: 825.458ms, non-child: 1.615ms, % non-child: 0.20%) ExecOption: Codegen Enabled - BuildTime: 10.014us - GetNewBlockTime: 252.003us - GetResultsTime: 0.000ns - HTResizeTime: 6.026us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.376us EXCHANGE_NODE (id=5):(Total: 823.843ms, non-child: 7.318us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.203us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 823.834ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 845.336ms, non-child: 9.725us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 2.008us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 845.325ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ce441eb8218e9dbf:9de609a10000001f (host=vb0232.halxg.cloudera.com:22000):(Total: 1s210ms, non-child: 8.508ms, % non-child: 0.70%) MemoryUsage(500.000ms): 6.18 MB, 4.60 MB, 4.60 MB ThreadUsage(500.000ms): 1, 2, 2 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 6.18 MB (6481632) - PerHostPeakMemUsage: 118.66 MB (124426213) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s688ms - TotalNetworkSendTime: 307.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 33 (33) - TotalThreadsTotalWallClockTime: 2s012ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 318.950ms - TotalThreadsVoluntaryContextSwitches: 11 (11) Fragment Instance Lifecycle Timings: - ExecTime: 504.666us - ExecTreeExecTime: 4.340us - OpenTime: 1s175ms - ExecTreeOpenTime: 858.027ms - PrepareTime: 34.109ms - ExecTreePrepareTime: 1.901ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 80 (80) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 768.00 KB (786432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=8):(Total: 21.945us, non-child: 21.945us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 14.22 KB (14560) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 341.661ms, non-child: 341.661ms, % non-child: 100.00%) - CodegenTime: 2.637ms - CompileTime: 100.216ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 72 (72) - NumInstructions: 3.26K (3262) - OptimizationTime: 215.826ms - PeakMemoryUsage: 1.59 MB (1670144) - PrepareTime: 25.039ms AGGREGATION_NODE (id=4):(Total: 859.926ms, non-child: 2.494ms, % non-child: 0.29%) ExecOption: Codegen Enabled - BuildTime: 8.083us - GetNewBlockTime: 532.628us - GetResultsTime: 0.000ns - HTResizeTime: 5.068us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.273us HASH_JOIN_NODE (id=3):(Total: 857.432ms, non-child: 1.522ms, % non-child: 0.18%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 3.122ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.04 MB (1091840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.621us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2.189us - BuildRowsPartitioned: 0 (0) - GetNewBlockTime: 19.365us - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.01 MB (1062016) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns AGGREGATION_NODE (id=6):(Total: 834.502ms, non-child: 1.497ms, % non-child: 0.18%) ExecOption: Codegen Enabled - BuildTime: 8.992us - GetNewBlockTime: 264.410us - GetResultsTime: 0.000ns - HTResizeTime: 5.209us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.229us EXCHANGE_NODE (id=5):(Total: 833.005ms, non-child: 8.772us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.072us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 832.995ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 855.065ms, non-child: 8.839us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.982us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 855.055ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ce441eb8218e9dbf:9de609a100000023 (host=vb0204.halxg.cloudera.com:22000):(Total: 1s210ms, non-child: 7.806ms, % non-child: 0.65%) MemoryUsage(500.000ms): 6.18 MB, 4.60 MB ThreadUsage(500.000ms): 1, 2 - AverageThreadTokens: 1.50 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 6.18 MB (6481632) - PerHostPeakMemUsage: 102.58 MB (107561819) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s666ms - TotalNetworkSendTime: 458.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 2s000ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 322.951ms - TotalThreadsVoluntaryContextSwitches: 15 (15) Fragment Instance Lifecycle Timings: - ExecTime: 252.490us - ExecTreeExecTime: 5.507us - OpenTime: 1s165ms - ExecTreeOpenTime: 846.846ms - PrepareTime: 44.140ms - ExecTreePrepareTime: 3.066ms DataStreamSender (dst_id=8):(Total: 35.349us, non-child: 35.349us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 14.22 KB (14560) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 352.339ms, non-child: 352.339ms, % non-child: 100.00%) - CodegenTime: 2.790ms - CompileTime: 100.778ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 72 (72) - NumInstructions: 3.26K (3262) - OptimizationTime: 216.386ms - PeakMemoryUsage: 1.59 MB (1670144) - PrepareTime: 33.242ms AGGREGATION_NODE (id=4):(Total: 849.911ms, non-child: 2.116ms, % non-child: 0.25%) ExecOption: Codegen Enabled - BuildTime: 7.638us - GetNewBlockTime: 426.133us - GetResultsTime: 0.000ns - HTResizeTime: 4.565us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.718us HASH_JOIN_NODE (id=3):(Total: 847.795ms, non-child: 2.646ms, % non-child: 0.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 11.830ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.04 MB (1091840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.674us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2.336us - BuildRowsPartitioned: 0 (0) - GetNewBlockTime: 15.579us - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.01 MB (1062016) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns AGGREGATION_NODE (id=6):(Total: 824.525ms, non-child: 1.988ms, % non-child: 0.24%) ExecOption: Codegen Enabled - BuildTime: 10.749us - GetNewBlockTime: 363.049us - GetResultsTime: 0.000ns - HTResizeTime: 6.391us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.910us EXCHANGE_NODE (id=5):(Total: 822.536ms, non-child: 10.148us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 989.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 822.525ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 843.966ms, non-child: 11.203us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 3.041us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 843.954ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ce441eb8218e9dbf:9de609a100000026 (host=vb0222.halxg.cloudera.com:22000):(Total: 1s210ms, non-child: 8.590ms, % non-child: 0.71%) MemoryUsage(500.000ms): 4.60 MB, 4.60 MB ThreadUsage(500.000ms): 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 6.18 MB (6481632) - PerHostPeakMemUsage: 118.92 MB (124699607) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s668ms - TotalNetworkSendTime: 224.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 1s995ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 320.950ms - TotalThreadsVoluntaryContextSwitches: 8 (8) Fragment Instance Lifecycle Timings: - ExecTime: 1.014ms - ExecTreeExecTime: 4.003us - OpenTime: 1s166ms - ExecTreeOpenTime: 847.578ms - PrepareTime: 42.051ms - ExecTreePrepareTime: 1.616ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 80 (80) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 768.00 KB (786432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=8):(Total: 35.585us, non-child: 35.585us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 14.22 KB (14560) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 352.243ms, non-child: 352.243ms, % non-child: 100.00%) - CodegenTime: 2.667ms - CompileTime: 101.421ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 72 (72) - NumInstructions: 3.26K (3262) - OptimizationTime: 216.691ms - PeakMemoryUsage: 1.59 MB (1670144) - PrepareTime: 33.250ms AGGREGATION_NODE (id=4):(Total: 849.187ms, non-child: 1.622ms, % non-child: 0.19%) ExecOption: Codegen Enabled - BuildTime: 6.214us - GetNewBlockTime: 202.941us - GetResultsTime: 0.000ns - HTResizeTime: 4.057us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.290us HASH_JOIN_NODE (id=3):(Total: 847.564ms, non-child: 1.787ms, % non-child: 0.21%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 3.509ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.04 MB (1091840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.080us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1.811us - BuildRowsPartitioned: 0 (0) - GetNewBlockTime: 17.265us - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.01 MB (1062016) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns AGGREGATION_NODE (id=6):(Total: 825.392ms, non-child: 1.760ms, % non-child: 0.21%) ExecOption: Codegen Enabled - BuildTime: 8.578us - GetNewBlockTime: 243.309us - GetResultsTime: 0.000ns - HTResizeTime: 4.320us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.749us EXCHANGE_NODE (id=5):(Total: 823.631ms, non-child: 6.952us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.043us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 823.622ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 844.949ms, non-child: 22.245us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.871us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 844.925ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ce441eb8218e9dbf:9de609a100000020 (host=vb0214.halxg.cloudera.com:22000):(Total: 1s209ms, non-child: 7.873ms, % non-child: 0.65%) MemoryUsage(500.000ms): 6.18 MB, 4.60 MB, 2.50 MB ThreadUsage(500.000ms): 1, 2, 2 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 6.18 MB (6481632) - PerHostPeakMemUsage: 118.72 MB (124488749) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s676ms - TotalNetworkSendTime: 681.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 36 (36) - TotalThreadsTotalWallClockTime: 2s007ms - TotalThreadsSysTime: 11.998ms - TotalThreadsUserTime: 317.951ms - TotalThreadsVoluntaryContextSwitches: 10 (10) Fragment Instance Lifecycle Timings: - ExecTime: 286.409us - ExecTreeExecTime: 6.266us - OpenTime: 1s173ms - ExecTreeOpenTime: 853.854ms - PrepareTime: 36.418ms - ExecTreePrepareTime: 1.655ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 80 (80) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 768.00 KB (786432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=8):(Total: 30.747us, non-child: 30.747us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 14.22 KB (14560) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 346.571ms, non-child: 346.571ms, % non-child: 100.00%) - CodegenTime: 2.735ms - CompileTime: 100.815ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 72 (72) - NumInstructions: 3.26K (3262) - OptimizationTime: 216.772ms - PeakMemoryUsage: 1.59 MB (1670144) - PrepareTime: 28.358ms AGGREGATION_NODE (id=4):(Total: 855.509ms, non-child: 3.892ms, % non-child: 0.46%) ExecOption: Codegen Enabled - BuildTime: 8.886us - GetNewBlockTime: 172.824us - GetResultsTime: 0.000ns - HTResizeTime: 5.636us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.874us HASH_JOIN_NODE (id=3):(Total: 851.616ms, non-child: 1.582ms, % non-child: 0.19%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 3.401ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.04 MB (1091840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.778us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1.748us - BuildRowsPartitioned: 0 (0) - GetNewBlockTime: 20.149us - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.01 MB (1062016) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns AGGREGATION_NODE (id=6):(Total: 831.031ms, non-child: 3.491ms, % non-child: 0.42%) ExecOption: Codegen Enabled - BuildTime: 8.308us - GetNewBlockTime: 234.358us - GetResultsTime: 0.000ns - HTResizeTime: 4.574us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.230us EXCHANGE_NODE (id=5):(Total: 827.539ms, non-child: 8.161us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 816.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 827.530ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 849.238ms, non-child: 10.712us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 2.282us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 849.226ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ce441eb8218e9dbf:9de609a100000025 (host=vb0212.halxg.cloudera.com:22000):(Total: 1s209ms, non-child: 8.241ms, % non-child: 0.68%) MemoryUsage(500.000ms): 4.60 MB, 4.60 MB ThreadUsage(500.000ms): 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 6.18 MB (6481632) - PerHostPeakMemUsage: 86.81 MB (91030825) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s676ms - TotalNetworkSendTime: 555.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 32 (32) - TotalThreadsTotalWallClockTime: 2s001ms - TotalThreadsSysTime: 6.998ms - TotalThreadsUserTime: 316.951ms - TotalThreadsVoluntaryContextSwitches: 12 (12) Fragment Instance Lifecycle Timings: - ExecTime: 261.016us - ExecTreeExecTime: 5.998us - OpenTime: 1s170ms - ExecTreeOpenTime: 852.230ms - PrepareTime: 37.984ms - ExecTreePrepareTime: 1.689ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 80 (80) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 768.00 KB (786432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=8):(Total: 36.237us, non-child: 36.237us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 14.22 KB (14560) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 346.934ms, non-child: 346.934ms, % non-child: 100.00%) - CodegenTime: 2.725ms - CompileTime: 101.249ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 72 (72) - NumInstructions: 3.26K (3262) - OptimizationTime: 215.952ms - PeakMemoryUsage: 1.59 MB (1670144) - PrepareTime: 29.094ms AGGREGATION_NODE (id=4):(Total: 853.918ms, non-child: 2.773ms, % non-child: 0.32%) ExecOption: Codegen Enabled - BuildTime: 8.648us - GetNewBlockTime: 194.676us - GetResultsTime: 0.000ns - HTResizeTime: 4.953us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.118us HASH_JOIN_NODE (id=3):(Total: 851.144ms, non-child: 1.568ms, % non-child: 0.18%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 2.811ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.04 MB (1091840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.504us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1.207us - BuildRowsPartitioned: 0 (0) - GetNewBlockTime: 14.961us - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.01 MB (1062016) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns AGGREGATION_NODE (id=6):(Total: 828.907ms, non-child: 1.519ms, % non-child: 0.18%) ExecOption: Codegen Enabled - BuildTime: 6.864us - GetNewBlockTime: 262.091us - GetResultsTime: 0.000ns - HTResizeTime: 4.418us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.770us EXCHANGE_NODE (id=5):(Total: 827.388ms, non-child: 5.692us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 499.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 827.382ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 848.750ms, non-child: 10.077us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 2.500us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 848.739ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ce441eb8218e9dbf:9de609a10000001e (host=vb0216.halxg.cloudera.com:22000):(Total: 1s208ms, non-child: 8.196ms, % non-child: 0.68%) MemoryUsage(500.000ms): 4.59 MB, 4.60 MB ThreadUsage(500.000ms): 1, 2 - AverageThreadTokens: 1.50 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 6.18 MB (6481632) - PerHostPeakMemUsage: 94.81 MB (99411241) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s671ms - TotalNetworkSendTime: 805.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s998ms - TotalThreadsSysTime: 5.998ms - TotalThreadsUserTime: 318.951ms - TotalThreadsVoluntaryContextSwitches: 8 (8) Fragment Instance Lifecycle Timings: - ExecTime: 992.734us - ExecTreeExecTime: 5.968us - OpenTime: 1s167ms - ExecTreeOpenTime: 850.647ms - PrepareTime: 39.799ms - ExecTreePrepareTime: 1.566ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 80 (80) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 768.00 KB (786432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=8):(Total: 27.406us, non-child: 27.406us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 14.22 KB (14560) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 347.670ms, non-child: 347.670ms, % non-child: 100.00%) - CodegenTime: 2.692ms - CompileTime: 100.045ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 72 (72) - NumInstructions: 3.26K (3262) - OptimizationTime: 215.579ms - PeakMemoryUsage: 1.59 MB (1670144) - PrepareTime: 31.442ms AGGREGATION_NODE (id=4):(Total: 852.212ms, non-child: 3.119ms, % non-child: 0.37%) ExecOption: Codegen Enabled - BuildTime: 7.445us - GetNewBlockTime: 180.213us - GetResultsTime: 0.000ns - HTResizeTime: 4.422us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.976us HASH_JOIN_NODE (id=3):(Total: 849.092ms, non-child: 1.553ms, % non-child: 0.18%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 3.360ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.04 MB (1091840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.441us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2.302us - BuildRowsPartitioned: 0 (0) - GetNewBlockTime: 14.733us - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.01 MB (1062016) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns AGGREGATION_NODE (id=6):(Total: 827.432ms, non-child: 2.493ms, % non-child: 0.30%) ExecOption: Codegen Enabled - BuildTime: 20.979us - GetNewBlockTime: 228.461us - GetResultsTime: 0.000ns - HTResizeTime: 4.906us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.381us EXCHANGE_NODE (id=5):(Total: 824.939ms, non-child: 8.573us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.250us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 824.929ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 846.800ms, non-child: 9.142us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 2.065us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 846.790ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance ce441eb8218e9dbf:9de609a100000027 (host=vb0220.halxg.cloudera.com:22000):(Total: 1s206ms, non-child: 8.737ms, % non-child: 0.72%) MemoryUsage(500.000ms): 4.59 MB, 4.60 MB ThreadUsage(500.000ms): 1, 2 - AverageThreadTokens: 1.50 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 6.18 MB (6481632) - PerHostPeakMemUsage: 126.75 MB (132910257) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1s662ms - TotalNetworkSendTime: 292.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1s991ms - TotalThreadsSysTime: 7.998ms - TotalThreadsUserTime: 319.950ms - TotalThreadsVoluntaryContextSwitches: 9 (9) Fragment Instance Lifecycle Timings: - ExecTime: 617.886us - ExecTreeExecTime: 4.368us - OpenTime: 1s164ms - ExecTreeOpenTime: 844.018ms - PrepareTime: 40.928ms - ExecTreePrepareTime: 1.655ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 80 (80) - BlocksRecycled: 16 (16) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 768.00 KB (786432) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=8):(Total: 30.062us, non-child: 30.062us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 14.22 KB (14560) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 352.051ms, non-child: 352.051ms, % non-child: 100.00%) - CodegenTime: 2.712ms - CompileTime: 103.369ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 72 (72) - NumInstructions: 3.26K (3262) - OptimizationTime: 216.361ms - PeakMemoryUsage: 1.59 MB (1670144) - PrepareTime: 31.710ms AGGREGATION_NODE (id=4):(Total: 845.671ms, non-child: 1.299ms, % non-child: 0.15%) ExecOption: Codegen Enabled - BuildTime: 6.286us - GetNewBlockTime: 198.847us - GetResultsTime: 0.000ns - HTResizeTime: 4.268us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 1.907us HASH_JOIN_NODE (id=3):(Total: 844.371ms, non-child: 1.605ms, % non-child: 0.19%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 3.320ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.04 MB (1091840) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.163us - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2.069us - BuildRowsPartitioned: 0 (0) - GetNewBlockTime: 22.355us - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.01 MB (1062016) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns AGGREGATION_NODE (id=6):(Total: 823.614ms, non-child: 2.907ms, % non-child: 0.35%) ExecOption: Codegen Enabled - BuildTime: 8.594us - GetNewBlockTime: 205.952us - GetResultsTime: 0.000ns - HTResizeTime: 4.410us - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.27 MB (2380928) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) - UnpinTime: 2.358us EXCHANGE_NODE (id=5):(Total: 820.706ms, non-child: 7.536us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 933.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 820.698ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=7):(Total: 841.998ms, non-child: 21.288us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.759us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 841.975ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F01:(Total: 1s136ms, non-child: 50.069ms, % non-child: 4.40%) split sizes: min: 4.45 GB, max: 4.70 GB, avg: 4.60 GB, stddev: 108.75 MB completion times: min:1s125ms max:1s172ms mean: 1s139ms stddev:17.527ms execution rates: min:3.80 GB/sec max:4.18 GB/sec mean:4.04 GB/sec stddev:131.84 MB/sec num instances: 14 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 94.55 MB (99140500) - PerHostPeakMemUsage: 111.93 MB (117371877) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6.404us - TotalStorageWaitTime: 666.488ms - TotalThreadsInvoluntaryContextSwitches: 102 (102) - TotalThreadsTotalWallClockTime: 2s018ms - TotalThreadsSysTime: 9.353ms - TotalThreadsUserTime: 1s000ms - TotalThreadsVoluntaryContextSwitches: 341 (341) Fragment Instance Lifecycle Timings: - ExecTime: 125.408ms - ExecTreeExecTime: 100.118ms - OpenTime: 962.008ms - ExecTreeOpenTime: 211.427us - PrepareTime: 49.469ms - ExecTreePrepareTime: 969.067us DataStreamSender (dst_id=5):(Total: 130.281us, non-child: 130.281us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 199.06 KB (203840) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 985.442ms, non-child: 985.442ms, % non-child: 100.00%) - CodegenTime: 18.714ms - CompileTime: 120.345ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 435 (435) - NumInstructions: 8.00K (8003) - OptimizationTime: 839.941ms - PeakMemoryUsage: 3.91 MB (4097536) - PrepareTime: 24.450ms AGGREGATION_NODE (id=2):(Total: 101.289ms, non-child: 5.138ms, % non-child: 5.07%) - GetNewBlockTime: 153.942us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.30 MB (1367716) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 349.745us - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=1):(Total: 96.151ms, non-child: 96.151ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 252.73 MB (265002671) - BytesReadDataNodeCache: 0 - BytesReadLocal: 252.73 MB (265002671) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 252.73 MB (265002671) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 18 (18) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 18 (18) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 93.07 MB (97587410) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 87.714ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 931.619ms - MaterializeTupleTime(*): 3.033us - ScannerThreadsSysTime: 3.853ms - ScannerThreadsUserTime: 38.196ms - ScannerThreadsVoluntaryContextSwitches: 252 (252) - TotalRawHdfsReadTime(*): 213.226ms - TotalReadThroughput: 0.00 /sec Fragment F01: Instance ce441eb8218e9dbf:9de609a10000000e (host=vb0206.halxg.cloudera.com:22000):(Total: 1s170ms, non-child: 26.494ms, % non-child: 2.26%) Hdfs split stats (:<# splits>/): 6:1/253.40 MB 9:3/760.17 MB 2:1/253.39 MB 8:1/253.40 MB 3:1/253.39 MB 7:1/253.39 MB 4:2/506.77 MB 1:2/506.77 MB 0:6/1.48 GB MemoryUsage(500.000ms): 5.37 MB, 5.37 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 105.92 MB (111065494) - PerHostPeakMemUsage: 110.68 MB (116051624) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 25.556us - TotalStorageWaitTime: 689.061ms - TotalThreadsInvoluntaryContextSwitches: 101 (101) - TotalThreadsTotalWallClockTime: 2s063ms - TotalThreadsSysTime: 13.994ms - TotalThreadsUserTime: 1s005ms - TotalThreadsVoluntaryContextSwitches: 321 (321) Fragment Instance Lifecycle Timings: - ExecTime: 155.437ms - ExecTreeExecTime: 151.737ms - OpenTime: 968.230ms - ExecTreeOpenTime: 196.696us - PrepareTime: 46.394ms - ExecTreePrepareTime: 629.325us DataStreamSender (dst_id=5):(Total: 261.707us, non-child: 261.707us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 199.06 KB (203840) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 990.786ms, non-child: 990.786ms, % non-child: 100.00%) - CodegenTime: 18.538ms - CompileTime: 123.099ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 435 (435) - NumInstructions: 8.00K (8003) - OptimizationTime: 843.685ms - PeakMemoryUsage: 3.91 MB (4097536) - PrepareTime: 23.095ms AGGREGATION_NODE (id=2):(Total: 152.551ms, non-child: 8.719ms, % non-child: 5.72%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 60.147us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.30 MB (1367716) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 438.562us - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=1):(Total: 143.831ms, non-child: 143.831ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/253.40 MB 9:3/760.17 MB 2:1/253.39 MB 8:1/253.40 MB 3:1/253.39 MB 7:1/253.39 MB 4:2/506.77 MB 1:2/506.77 MB 0:6/1.48 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 13.395ms ; Min: 2.685ms ; Max: 49.374ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 233.76 MB (245112832) - BytesReadDataNodeCache: 0 - BytesReadLocal: 233.76 MB (245112832) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 233.76 MB (245112832) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 18 (18) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 18 (18) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 104.44 MB (109512404) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 136.342ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 939.462ms - MaterializeTupleTime(*): 3.082us - ScannerThreadsSysTime: 5.995ms - ScannerThreadsUserTime: 38.983ms - ScannerThreadsVoluntaryContextSwitches: 239 (239) - TotalRawHdfsReadTime(*): 191.050ms - TotalReadThroughput: 0.00 /sec Instance ce441eb8218e9dbf:9de609a100000007 (host=vb0204.halxg.cloudera.com:22000):(Total: 1s168ms, non-child: 28.326ms, % non-child: 2.42%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 6:1/253.41 MB 5:3/760.17 MB 3:5/1.24 GB 0:1/253.39 MB 7:2/506.81 MB 4:2/506.83 MB 1:4/1013.57 MB MemoryUsage(500.000ms): 5.37 MB, 5.37 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 49.92 MB (52347908) - PerHostPeakMemUsage: 102.58 MB (107561819) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6.381us - TotalStorageWaitTime: 650.466ms - TotalThreadsInvoluntaryContextSwitches: 106 (106) - TotalThreadsTotalWallClockTime: 2s170ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 1s022ms - TotalThreadsVoluntaryContextSwitches: 270 (270) Fragment Instance Lifecycle Timings: - ExecTime: 127.865ms - ExecTreeExecTime: 124.828ms - OpenTime: 988.321ms - ExecTreeOpenTime: 306.981us - PrepareTime: 52.185ms - ExecTreePrepareTime: 2.185ms DataStreamSender (dst_id=5):(Total: 74.325us, non-child: 74.325us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 199.06 KB (203840) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s012ms, non-child: 1s012ms, % non-child: 100.00%) - CodegenTime: 18.394ms - CompileTime: 132.959ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 435 (435) - NumInstructions: 8.00K (8003) - OptimizationTime: 853.305ms - PeakMemoryUsage: 3.91 MB (4097536) - PrepareTime: 25.783ms AGGREGATION_NODE (id=2):(Total: 127.309ms, non-child: 3.028ms, % non-child: 2.38%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 827.851us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.30 MB (1367716) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 184.548us - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=1):(Total: 124.280ms, non-child: 124.280ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 6:1/253.41 MB 5:3/760.17 MB 3:5/1.24 GB 0:1/253.39 MB 7:2/506.81 MB 4:2/506.83 MB 1:4/1013.57 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 10.771ms ; Min: 336.283us ; Max: 37.942ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 265.86 MB (278769664) - BytesReadDataNodeCache: 0 - BytesReadLocal: 265.86 MB (278769664) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 265.86 MB (278769664) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 17 (17) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 48.44 MB (50794818) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 109.077ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 1s053ms - MaterializeTupleTime(*): 1.744us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 36.984ms - ScannerThreadsVoluntaryContextSwitches: 172 (172) - TotalRawHdfsReadTime(*): 177.459ms - TotalReadThroughput: 0.00 /sec Instance ce441eb8218e9dbf:9de609a100000009 (host=vb0212.halxg.cloudera.com:22000):(Total: 1s166ms, non-child: 26.230ms, % non-child: 2.25%) Hdfs split stats (:<# splits>/): 9:1/253.39 MB 5:1/253.40 MB 6:2/506.81 MB 4:2/506.79 MB 7:3/760.20 MB 0:2/506.80 MB 2:3/760.20 MB 1:4/1013.53 MB MemoryUsage(500.000ms): 5.37 MB, 1.47 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 81.92 MB (85897173) - PerHostPeakMemUsage: 86.81 MB (91030825) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5.142us - TotalStorageWaitTime: 1s403ms - TotalThreadsInvoluntaryContextSwitches: 104 (104) - TotalThreadsTotalWallClockTime: 2s751ms - TotalThreadsSysTime: 5.996ms - TotalThreadsUserTime: 1s010ms - TotalThreadsVoluntaryContextSwitches: 346 (346) Fragment Instance Lifecycle Timings: - ExecTime: 145.315ms - ExecTreeExecTime: 142.225ms - OpenTime: 973.985ms - ExecTreeOpenTime: 191.220us - PrepareTime: 47.154ms - ExecTreePrepareTime: 956.994us DataStreamSender (dst_id=5):(Total: 62.634us, non-child: 62.634us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 199.06 KB (203840) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 996.849ms, non-child: 996.849ms, % non-child: 100.00%) - CodegenTime: 18.431ms - CompileTime: 121.661ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 435 (435) - NumInstructions: 8.00K (8003) - OptimizationTime: 850.765ms - PeakMemoryUsage: 3.91 MB (4097536) - PrepareTime: 23.474ms AGGREGATION_NODE (id=2):(Total: 143.365ms, non-child: 4.954ms, % non-child: 3.46%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 106.834us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.30 MB (1367716) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 101.909us - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=1):(Total: 138.410ms, non-child: 138.410ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.39 MB 5:1/253.40 MB 6:2/506.81 MB 4:2/506.79 MB 7:3/760.20 MB 0:2/506.80 MB 2:3/760.20 MB 1:4/1013.53 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 10.313ms ; Min: 2.255ms ; Max: 66.543ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 201.76 MB (211558400) - BytesReadDataNodeCache: 0 - BytesReadLocal: 201.76 MB (211558400) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 201.76 MB (211558400) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 18 (18) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 18 (18) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 80.44 MB (84344083) - PerReadThreadRawHdfsThroughput: 393.34 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 130.626ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 1s632ms - MaterializeTupleTime(*): 3.110us - ScannerThreadsSysTime: 3.996ms - ScannerThreadsUserTime: 34.983ms - ScannerThreadsVoluntaryContextSwitches: 264 (264) - TotalRawHdfsReadTime(*): 512.938ms - TotalReadThroughput: 0.00 /sec Instance ce441eb8218e9dbf:9de609a100000002 (host=vb0216.halxg.cloudera.com:22000):(Total: 1s147ms, non-child: 49.026ms, % non-child: 4.27%) Hdfs split stats (:<# splits>/): 8:1/253.39 MB 3:1/253.39 MB 9:3/760.19 MB 10:2/506.80 MB 7:4/1013.58 MB 6:1/253.41 MB 5:1/253.41 MB 1:3/760.19 MB 0:2/506.82 MB MemoryUsage(500.000ms): 5.37 MB, 5.37 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 57.96 MB (60777740) - PerHostPeakMemUsage: 94.81 MB (99411241) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.016us - TotalStorageWaitTime: 603.047ms - TotalThreadsInvoluntaryContextSwitches: 103 (103) - TotalThreadsTotalWallClockTime: 1s963ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 1s003ms - TotalThreadsVoluntaryContextSwitches: 232 (232) Fragment Instance Lifecycle Timings: - ExecTime: 98.866ms - ExecTreeExecTime: 96.199ms - OpenTime: 977.870ms - ExecTreeOpenTime: 195.432us - PrepareTime: 70.600ms - ExecTreePrepareTime: 691.139us DataStreamSender (dst_id=5):(Total: 309.029us, non-child: 309.029us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 199.06 KB (203840) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s000ms, non-child: 1s000ms, % non-child: 100.00%) - CodegenTime: 19.661ms - CompileTime: 125.108ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 435 (435) - NumInstructions: 8.00K (8003) - OptimizationTime: 850.621ms - PeakMemoryUsage: 3.91 MB (4097536) - PrepareTime: 24.483ms AGGREGATION_NODE (id=2):(Total: 97.076ms, non-child: 1.979ms, % non-child: 2.04%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 55.827us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.30 MB (1367716) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 465.142us - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=1):(Total: 95.097ms, non-child: 95.097ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.39 MB 3:1/253.39 MB 9:3/760.19 MB 10:2/506.80 MB 7:4/1013.58 MB 6:1/253.41 MB 5:1/253.41 MB 1:3/760.19 MB 0:2/506.82 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 10.435ms ; Min: 820.854us ; Max: 37.977ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 257.76 MB (270278656) - BytesReadDataNodeCache: 0 - BytesReadLocal: 257.76 MB (270278656) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 257.76 MB (270278656) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 18 (18) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 18 (18) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 56.48 MB (59224650) - PerReadThreadRawHdfsThroughput: 1.66 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 87.240ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 886.908ms - MaterializeTupleTime(*): 2.949us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 23.982ms - ScannerThreadsVoluntaryContextSwitches: 143 (143) - TotalRawHdfsReadTime(*): 151.401ms - TotalReadThroughput: 0.00 /sec Instance ce441eb8218e9dbf:9de609a100000006 (host=vb0218.halxg.cloudera.com:22000):(Total: 1s137ms, non-child: 23.108ms, % non-child: 2.03%) Hdfs split stats (:<# splits>/): 2:3/760.17 MB 4:1/253.40 MB 9:1/253.38 MB 5:2/506.79 MB 1:4/1013.59 MB 10:1/253.39 MB 8:2/506.77 MB 7:1/253.38 MB 6:1/253.40 MB 3:1/253.39 MB 0:2/506.78 MB MemoryUsage(500.000ms): 5.37 MB, 1.47 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 81.93 MB (85905365) - PerHostPeakMemUsage: 118.98 MB (124758015) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.788us - TotalStorageWaitTime: 718.493ms - TotalThreadsInvoluntaryContextSwitches: 110 (110) - TotalThreadsTotalWallClockTime: 2s052ms - TotalThreadsSysTime: 8.996ms - TotalThreadsUserTime: 1s003ms - TotalThreadsVoluntaryContextSwitches: 326 (326) Fragment Instance Lifecycle Timings: - ExecTime: 121.559ms - ExecTreeExecTime: 119.709ms - OpenTime: 970.851ms - ExecTreeOpenTime: 184.763us - PrepareTime: 44.857ms - ExecTreePrepareTime: 603.534us DataStreamSender (dst_id=5):(Total: 70.322us, non-child: 70.322us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 199.06 KB (203840) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 993.629ms, non-child: 993.629ms, % non-child: 100.00%) - CodegenTime: 17.974ms - CompileTime: 123.378ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 435 (435) - NumInstructions: 8.00K (8003) - OptimizationTime: 845.525ms - PeakMemoryUsage: 3.91 MB (4097536) - PrepareTime: 23.817ms AGGREGATION_NODE (id=2):(Total: 120.490ms, non-child: 2.882ms, % non-child: 2.39%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 55.926us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.30 MB (1367716) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 567.536us - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=1):(Total: 117.607ms, non-child: 117.607ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:3/760.17 MB 4:1/253.40 MB 9:1/253.38 MB 5:2/506.79 MB 1:4/1013.59 MB 10:1/253.39 MB 8:2/506.77 MB 7:1/253.38 MB 6:1/253.40 MB 3:1/253.39 MB 0:2/506.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 10.120ms ; Min: 69.639us ; Max: 51.974ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 265.86 MB (278769664) - BytesReadDataNodeCache: 0 - BytesReadLocal: 265.86 MB (278769664) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 265.86 MB (278769664) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 11 (11) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 80.44 MB (84352275) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 109.672ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 960.203ms - MaterializeTupleTime(*): 2.494us - ScannerThreadsSysTime: 2.997ms - ScannerThreadsUserTime: 32.982ms - ScannerThreadsVoluntaryContextSwitches: 234 (234) - TotalRawHdfsReadTime(*): 202.548ms - TotalReadThroughput: 0.00 /sec Instance ce441eb8218e9dbf:9de609a10000000d (host=vb0208.halxg.cloudera.com:22000):(Total: 1s129ms, non-child: 25.547ms, % non-child: 2.26%) Hdfs split stats (:<# splits>/): 4:1/253.40 MB 1:2/506.79 MB 7:1/234.34 MB 10:1/253.38 MB 8:1/253.38 MB 9:2/440.61 MB 6:1/253.38 MB 5:4/1013.56 MB 3:4/1013.64 MB 2:2/506.77 MB MemoryUsage(500.000ms): 5.37 MB, 5.37 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 106.09 MB (111248042) - PerHostPeakMemUsage: 110.86 MB (116242397) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5.625us - TotalStorageWaitTime: 664.510ms - TotalThreadsInvoluntaryContextSwitches: 101 (101) - TotalThreadsTotalWallClockTime: 1s979ms - TotalThreadsSysTime: 10.996ms - TotalThreadsUserTime: 1s010ms - TotalThreadsVoluntaryContextSwitches: 349 (349) Fragment Instance Lifecycle Timings: - ExecTime: 112.938ms - ExecTreeExecTime: 109.393ms - OpenTime: 971.242ms - ExecTreeOpenTime: 214.298us - PrepareTime: 45.444ms - ExecTreePrepareTime: 621.088us DataStreamSender (dst_id=5):(Total: 79.420us, non-child: 79.420us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 199.06 KB (203840) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 993.807ms, non-child: 993.807ms, % non-child: 100.00%) - CodegenTime: 18.969ms - CompileTime: 123.054ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 435 (435) - NumInstructions: 8.00K (8003) - OptimizationTime: 846.619ms - PeakMemoryUsage: 3.91 MB (4097536) - PrepareTime: 23.505ms AGGREGATION_NODE (id=2):(Total: 110.220ms, non-child: 8.563ms, % non-child: 7.77%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 59.234us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.30 MB (1367716) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 327.149us - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=1):(Total: 101.656ms, non-child: 101.656ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.40 MB 1:2/506.79 MB 7:1/234.34 MB 10:1/253.38 MB 8:1/253.38 MB 9:2/440.61 MB 6:1/253.38 MB 5:4/1013.56 MB 3:4/1013.64 MB 2:2/506.77 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 9.343ms ; Min: 1.687ms ; Max: 30.270ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 240.98 MB (252685415) - BytesReadDataNodeCache: 0 - BytesReadLocal: 240.98 MB (252685415) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 240.98 MB (252685415) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 104.61 MB (109694952) - PerReadThreadRawHdfsThroughput: 1.01 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 93.644ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 895.858ms - MaterializeTupleTime(*): 3.968us - ScannerThreadsSysTime: 4.997ms - ScannerThreadsUserTime: 37.981ms - ScannerThreadsVoluntaryContextSwitches: 253 (253) - TotalRawHdfsReadTime(*): 231.875ms - TotalReadThroughput: 0.00 /sec Instance ce441eb8218e9dbf:9de609a100000004 (host=vb0214.halxg.cloudera.com:22000):(Total: 1s127ms, non-child: 130.495ms, % non-child: 11.58%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 8:1/253.39 MB 5:1/253.38 MB 10:1/253.37 MB 6:2/506.79 MB 9:2/506.80 MB 1:1/253.40 MB 4:2/506.81 MB 2:4/959.91 MB 0:4/1013.58 MB MemoryUsage(500.000ms): 5.37 MB, 5.37 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.04 MB (119576644) - PerHostPeakMemUsage: 118.72 MB (124488749) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7.039us - TotalStorageWaitTime: 546.311ms - TotalThreadsInvoluntaryContextSwitches: 92 (92) - TotalThreadsTotalWallClockTime: 1s855ms - TotalThreadsSysTime: 8.995ms - TotalThreadsUserTime: 932.845ms - TotalThreadsVoluntaryContextSwitches: 391 (391) Fragment Instance Lifecycle Timings: - ExecTime: 184.619ms - ExecTreeExecTime: 76.664ms - OpenTime: 896.285ms - ExecTreeOpenTime: 173.694us - PrepareTime: 46.238ms - ExecTreePrepareTime: 839.932us DataStreamSender (dst_id=5):(Total: 56.299us, non-child: 56.299us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 199.06 KB (203840) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 918.971ms, non-child: 918.971ms, % non-child: 100.00%) - CodegenTime: 18.681ms - CompileTime: 105.662ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 435 (435) - NumInstructions: 8.00K (8003) - OptimizationTime: 788.582ms - PeakMemoryUsage: 3.91 MB (4097536) - PrepareTime: 24.115ms AGGREGATION_NODE (id=2):(Total: 77.670ms, non-child: 2.921ms, % non-child: 3.76%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 65.468us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.30 MB (1367716) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 90.094us - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=1):(Total: 74.749ms, non-child: 74.749ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 8:1/253.39 MB 5:1/253.38 MB 10:1/253.37 MB 6:2/506.79 MB 9:2/506.80 MB 1:1/253.40 MB 4:2/506.81 MB 2:4/959.91 MB 0:4/1013.58 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 8.510ms ; Min: 3.289ms ; Max: 21.361ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 305.68 MB (320529659) - BytesReadDataNodeCache: 0 - BytesReadLocal: 305.68 MB (320529659) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 305.68 MB (320529659) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 112.56 MB (118023554) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 69.063ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 774.822ms - MaterializeTupleTime(*): 3.164us - ScannerThreadsSysTime: 5.995ms - ScannerThreadsUserTime: 34.981ms - ScannerThreadsVoluntaryContextSwitches: 308 (308) - TotalRawHdfsReadTime(*): 230.636ms - TotalReadThroughput: 0.00 /sec Instance ce441eb8218e9dbf:9de609a100000003 (host=vb0232.halxg.cloudera.com:22000):(Total: 1s126ms, non-child: 42.444ms, % non-child: 3.77%) Hdfs split stats (:<# splits>/): 8:2/506.78 MB 6:1/253.39 MB 9:3/760.16 MB 7:2/506.80 MB 5:2/506.79 MB 4:1/253.40 MB 2:2/506.80 MB 1:6/1.48 GB MemoryUsage(500.000ms): 5.37 MB, 5.37 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 113.98 MB (119514108) - PerHostPeakMemUsage: 118.66 MB (124426213) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.308us - TotalStorageWaitTime: 612.028ms - TotalThreadsInvoluntaryContextSwitches: 104 (104) - TotalThreadsTotalWallClockTime: 1s986ms - TotalThreadsSysTime: 10.992ms - TotalThreadsUserTime: 1s004ms - TotalThreadsVoluntaryContextSwitches: 368 (368) Fragment Instance Lifecycle Timings: - ExecTime: 139.119ms - ExecTreeExecTime: 119.645ms - OpenTime: 940.876ms - ExecTreeOpenTime: 216.228us - PrepareTime: 46.829ms - ExecTreePrepareTime: 653.651us DataStreamSender (dst_id=5):(Total: 68.096us, non-child: 68.096us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 199.06 KB (203840) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 963.843ms, non-child: 963.843ms, % non-child: 100.00%) - CodegenTime: 18.791ms - CompileTime: 108.870ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 435 (435) - NumInstructions: 8.00K (8003) - OptimizationTime: 830.458ms - PeakMemoryUsage: 3.91 MB (4097536) - PrepareTime: 23.874ms AGGREGATION_NODE (id=2):(Total: 120.505ms, non-child: 5.828ms, % non-child: 4.84%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 68.049us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.30 MB (1367716) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 381.847us - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=1):(Total: 114.676ms, non-child: 114.676ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:2/506.78 MB 6:1/253.39 MB 9:3/760.16 MB 7:2/506.80 MB 5:2/506.79 MB 4:1/253.40 MB 2:2/506.80 MB 1:6/1.48 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 10.920ms ; Min: 1.991ms ; Max: 47.165ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 273.86 MB (287158272) - BytesReadDataNodeCache: 0 - BytesReadLocal: 273.86 MB (287158272) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 273.86 MB (287158272) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 112.50 MB (117961018) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 108.144ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 906.305ms - MaterializeTupleTime(*): 3.330us - ScannerThreadsSysTime: 7.993ms - ScannerThreadsUserTime: 59.981ms - ScannerThreadsVoluntaryContextSwitches: 290 (290) - TotalRawHdfsReadTime(*): 192.100ms - TotalReadThroughput: 0.00 /sec Instance ce441eb8218e9dbf:9de609a100000001 (host=vb0230.halxg.cloudera.com:22000):(Total: 1s126ms, non-child: 38.935ms, % non-child: 3.46%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 8:2/506.79 MB 10:1/7.47 MB 5:1/253.40 MB 9:1/253.39 MB 6:1/253.38 MB 7:3/514.15 MB 4:1/253.40 MB 3:2/506.83 MB 1:3/760.18 MB 0:4/1013.58 MB MemoryUsage(500.000ms): 5.37 MB, 5.37 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 89.82 MB (94182186) - PerHostPeakMemUsage: 110.77 MB (116152788) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.952us - TotalStorageWaitTime: 704.765ms - TotalThreadsInvoluntaryContextSwitches: 103 (103) - TotalThreadsTotalWallClockTime: 2s130ms - TotalThreadsSysTime: 10.995ms - TotalThreadsUserTime: 1s003ms - TotalThreadsVoluntaryContextSwitches: 348 (348) Fragment Instance Lifecycle Timings: - ExecTime: 109.869ms - ExecTreeExecTime: 93.000ms - OpenTime: 969.564ms - ExecTreeOpenTime: 225.916us - PrepareTime: 46.904ms - ExecTreePrepareTime: 1.526ms DataStreamSender (dst_id=5):(Total: 77.507us, non-child: 77.507us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 199.06 KB (203840) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 992.635ms, non-child: 992.635ms, % non-child: 100.00%) - CodegenTime: 18.630ms - CompileTime: 123.873ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 435 (435) - NumInstructions: 8.00K (8003) - OptimizationTime: 844.010ms - PeakMemoryUsage: 3.91 MB (4097536) - PrepareTime: 24.064ms AGGREGATION_NODE (id=2):(Total: 94.745ms, non-child: 1.275ms, % non-child: 1.35%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 441.017us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.30 MB (1367716) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 347.865us - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=1):(Total: 93.470ms, non-child: 93.470ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 8:2/506.79 MB 10:1/7.47 MB 5:1/253.40 MB 9:1/253.39 MB 6:1/253.38 MB 7:3/514.15 MB 4:1/253.40 MB 3:2/506.83 MB 1:3/760.18 MB 0:4/1013.58 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 20 out of 20 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:40 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 13.006ms ; Min: 2.747ms ; Max: 35.505ms ; Number of samples: 20) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 243.35 MB (255171690) - BytesReadDataNodeCache: 0 - BytesReadLocal: 243.35 MB (255171690) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 243.35 MB (255171690) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 20 (20) - NumDisksAccessed: 11 (11) - NumRowGroups: 20 (20) - NumScannerThreadsStarted: 20 (20) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 88.34 MB (92629096) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 78.987ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 1s051ms - MaterializeTupleTime(*): 3.545us - ScannerThreadsSysTime: 3.996ms - ScannerThreadsUserTime: 34.980ms - ScannerThreadsVoluntaryContextSwitches: 249 (249) - TotalRawHdfsReadTime(*): 177.946ms - TotalReadThroughput: 0.00 /sec Instance ce441eb8218e9dbf:9de609a100000005 (host=vb0224.halxg.cloudera.com:22000):(Total: 1s124ms, non-child: 70.893ms, % non-child: 6.31%) Hdfs split stats (:<# splits>/): 2:1/253.40 MB 1:1/253.41 MB 10:1/253.38 MB 5:2/506.78 MB 0:2/506.77 MB 4:3/760.16 MB 9:2/506.80 MB 8:2/506.78 MB 7:2/506.79 MB 6:1/227.66 MB 3:2/506.80 MB MemoryUsage(500.000ms): 5.37 MB, 5.37 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 130.00 MB (136316032) - PerHostPeakMemUsage: 134.77 MB (141318612) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5.094us - TotalStorageWaitTime: 439.454ms - TotalThreadsInvoluntaryContextSwitches: 98 (98) - TotalThreadsTotalWallClockTime: 1s738ms - TotalThreadsSysTime: 8.996ms - TotalThreadsUserTime: 1s017ms - TotalThreadsVoluntaryContextSwitches: 371 (371) Fragment Instance Lifecycle Timings: - ExecTime: 113.249ms - ExecTreeExecTime: 65.211ms - OpenTime: 964.893ms - ExecTreeOpenTime: 245.659us - PrepareTime: 46.107ms - ExecTreePrepareTime: 669.665us DataStreamSender (dst_id=5):(Total: 71.820us, non-child: 71.820us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 199.06 KB (203840) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 987.197ms, non-child: 987.197ms, % non-child: 100.00%) - CodegenTime: 19.160ms - CompileTime: 123.222ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 435 (435) - NumInstructions: 8.00K (8003) - OptimizationTime: 839.873ms - PeakMemoryUsage: 3.91 MB (4097536) - PrepareTime: 23.502ms AGGREGATION_NODE (id=2):(Total: 66.116ms, non-child: 8.074ms, % non-child: 12.21%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 68.618us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.30 MB (1367716) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 599.609us - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=1):(Total: 58.042ms, non-child: 58.042ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/253.40 MB 1:1/253.41 MB 10:1/253.38 MB 5:2/506.78 MB 0:2/506.77 MB 4:3/760.16 MB 9:2/506.80 MB 8:2/506.78 MB 7:2/506.79 MB 6:1/227.66 MB 3:2/506.80 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 5.707ms ; Min: 1.776ms ; Max: 7.900ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 249.86 MB (261992448) - BytesReadDataNodeCache: 0 - BytesReadLocal: 249.86 MB (261992448) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 249.86 MB (261992448) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 11 (11) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 128.52 MB (134762942) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 49.576ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 660.575ms - MaterializeTupleTime(*): 3.268us - ScannerThreadsSysTime: 2.997ms - ScannerThreadsUserTime: 49.981ms - ScannerThreadsVoluntaryContextSwitches: 288 (288) - TotalRawHdfsReadTime(*): 217.388ms - TotalReadThroughput: 0.00 /sec Instance ce441eb8218e9dbf:9de609a10000000b (host=vb0220.halxg.cloudera.com:22000):(Total: 1s123ms, non-child: 85.681ms, % non-child: 7.63%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 2:2/479.23 MB 6:1/253.41 MB 9:3/760.16 MB 8:2/506.78 MB 7:1/253.41 MB 5:3/760.20 MB 3:3/760.20 MB 0:2/506.78 MB 1:1/253.41 MB MemoryUsage(500.000ms): 5.37 MB, 5.37 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 122.07 MB (127998152) - PerHostPeakMemUsage: 126.75 MB (132910257) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.644us - TotalStorageWaitTime: 437.108ms - TotalThreadsInvoluntaryContextSwitches: 102 (102) - TotalThreadsTotalWallClockTime: 1s730ms - TotalThreadsSysTime: 7.996ms - TotalThreadsUserTime: 990.838ms - TotalThreadsVoluntaryContextSwitches: 475 (475) Fragment Instance Lifecycle Timings: - ExecTime: 126.647ms - ExecTreeExecTime: 65.790ms - OpenTime: 946.512ms - ExecTreeOpenTime: 196.599us - PrepareTime: 50.316ms - ExecTreePrepareTime: 1.083ms DataStreamSender (dst_id=5):(Total: 436.859us, non-child: 436.859us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 199.06 KB (203840) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 970.352ms, non-child: 970.352ms, % non-child: 100.00%) - CodegenTime: 18.399ms - CompileTime: 105.725ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 435 (435) - NumInstructions: 8.00K (8003) - OptimizationTime: 839.153ms - PeakMemoryUsage: 3.91 MB (4097536) - PrepareTime: 24.874ms AGGREGATION_NODE (id=2):(Total: 67.060ms, non-child: 11.280ms, % non-child: 16.82%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 101.992us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.30 MB (1367716) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 128.089us - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=1):(Total: 55.779ms, non-child: 55.779ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 2:2/479.23 MB 6:1/253.41 MB 9:3/760.16 MB 8:2/506.78 MB 7:1/253.41 MB 5:3/760.20 MB 3:3/760.20 MB 0:2/506.78 MB 1:1/253.41 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 5.942ms ; Min: 2.112ms ; Max: 8.153ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 281.86 MB (295546880) - BytesReadDataNodeCache: 0 - BytesReadLocal: 281.86 MB (295546880) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 281.86 MB (295546880) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 120.59 MB (126445062) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 48.540ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 656.973ms - MaterializeTupleTime(*): 2.785us - ScannerThreadsSysTime: 4.997ms - ScannerThreadsUserTime: 40.982ms - ScannerThreadsVoluntaryContextSwitches: 392 (392) - TotalRawHdfsReadTime(*): 202.077ms - TotalReadThroughput: 0.00 /sec Instance ce441eb8218e9dbf:9de609a100000008 (host=vb0234.halxg.cloudera.com:22000):(Total: 1s123ms, non-child: 53.730ms, % non-child: 4.78%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 5:2/506.79 MB 9:3/760.17 MB 1:2/506.79 MB 7:2/506.79 MB 6:3/760.18 MB 3:2/506.77 MB 2:3/512.05 MB 0:1/253.40 MB MemoryUsage(500.000ms): 5.37 MB, 1.47 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 73.88 MB (77473201) - PerHostPeakMemUsage: 110.84 MB (116223516) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.626us - TotalStorageWaitTime: 654.272ms - TotalThreadsInvoluntaryContextSwitches: 104 (104) - TotalThreadsTotalWallClockTime: 1s958ms - TotalThreadsSysTime: 11.994ms - TotalThreadsUserTime: 998.836ms - TotalThreadsVoluntaryContextSwitches: 323 (323) Fragment Instance Lifecycle Timings: - ExecTime: 112.083ms - ExecTreeExecTime: 80.945ms - OpenTime: 963.466ms - ExecTreeOpenTime: 190.944us - PrepareTime: 47.709ms - ExecTreePrepareTime: 1.478ms DataStreamSender (dst_id=5):(Total: 84.904us, non-child: 84.904us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 199.06 KB (203840) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 986.886ms, non-child: 986.886ms, % non-child: 100.00%) - CodegenTime: 18.446ms - CompileTime: 121.894ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 435 (435) - NumInstructions: 8.00K (8003) - OptimizationTime: 840.152ms - PeakMemoryUsage: 3.91 MB (4097536) - PrepareTime: 24.235ms AGGREGATION_NODE (id=2):(Total: 82.605ms, non-child: 3.445ms, % non-child: 4.17%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 70.378us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.30 MB (1367716) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 689.786us - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=1):(Total: 79.159ms, non-child: 79.159ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 5:2/506.79 MB 9:3/760.17 MB 1:2/506.79 MB 7:2/506.79 MB 6:3/760.18 MB 3:2/506.77 MB 2:3/512.05 MB 0:1/253.40 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 11.348ms ; Min: 4.010ms ; Max: 34.114ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 234.39 MB (245772081) - BytesReadDataNodeCache: 0 - BytesReadLocal: 234.39 MB (245772081) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 234.39 MB (245772081) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 72.40 MB (75920111) - PerReadThreadRawHdfsThroughput: 1.56 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 71.728ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 883.180ms - MaterializeTupleTime(*): 3.123us - ScannerThreadsSysTime: 4.995ms - ScannerThreadsUserTime: 34.982ms - ScannerThreadsVoluntaryContextSwitches: 216 (216) - TotalRawHdfsReadTime(*): 146.607ms - TotalReadThroughput: 0.00 /sec Instance ce441eb8218e9dbf:9de609a10000000a (host=vb0222.halxg.cloudera.com:22000):(Total: 1s123ms, non-child: 38.595ms, % non-child: 3.44%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 0:1/253.38 MB 6:1/253.38 MB 3:1/253.38 MB 4:2/506.83 MB 9:3/760.15 MB 7:2/506.79 MB 8:3/760.18 MB 5:2/506.79 MB 1:3/760.22 MB MemoryUsage(500.000ms): 5.37 MB, 1.47 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 98.11 MB (102876222) - PerHostPeakMemUsage: 118.92 MB (124699607) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5.983us - TotalStorageWaitTime: 672.558ms - TotalThreadsInvoluntaryContextSwitches: 106 (106) - TotalThreadsTotalWallClockTime: 2s092ms - TotalThreadsSysTime: 12.995ms - TotalThreadsUserTime: 1s001ms - TotalThreadsVoluntaryContextSwitches: 285 (285) Fragment Instance Lifecycle Timings: - ExecTime: 98.637ms - ExecTreeExecTime: 84.916ms - OpenTime: 970.260ms - ExecTreeOpenTime: 222.419us - PrepareTime: 54.232ms - ExecTreePrepareTime: 1.035ms DataStreamSender (dst_id=5):(Total: 100.400us, non-child: 100.400us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 199.06 KB (203840) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 998.331ms, non-child: 998.331ms, % non-child: 100.00%) - CodegenTime: 19.301ms - CompileTime: 123.152ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 435 (435) - NumInstructions: 8.00K (8003) - OptimizationTime: 845.311ms - PeakMemoryUsage: 3.91 MB (4097536) - PrepareTime: 29.197ms AGGREGATION_NODE (id=2):(Total: 86.164ms, non-child: 2.816ms, % non-child: 3.27%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 111.422us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.30 MB (1367716) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 389.349us - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=1):(Total: 83.348ms, non-child: 83.348ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 0:1/253.38 MB 6:1/253.38 MB 3:1/253.38 MB 4:2/506.83 MB 9:3/760.15 MB 7:2/506.79 MB 8:3/760.18 MB 5:2/506.79 MB 1:3/760.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 8.667ms ; Min: 672.452us ; Max: 24.916ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 265.86 MB (278769664) - BytesReadDataNodeCache: 0 - BytesReadLocal: 265.86 MB (278769664) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 265.86 MB (278769664) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 96.63 MB (101323132) - PerReadThreadRawHdfsThroughput: 1.50 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 76.087ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 1s024ms - MaterializeTupleTime(*): 3.609us - ScannerThreadsSysTime: 3.996ms - ScannerThreadsUserTime: 34.981ms - ScannerThreadsVoluntaryContextSwitches: 186 (186) - TotalRawHdfsReadTime(*): 173.371ms - TotalReadThroughput: 0.00 /sec Instance ce441eb8218e9dbf:9de609a10000000c (host=vb0228.halxg.cloudera.com:22000):(Total: 1s122ms, non-child: 61.466ms, % non-child: 5.47%) Hdfs split stats (:<# splits>/): 6:1/253.41 MB 0:2/506.78 MB 10:3/698.42 MB 7:2/506.80 MB 3:1/253.41 MB 8:3/760.19 MB 4:1/253.39 MB 5:3/760.17 MB 1:3/760.20 MB MemoryUsage(500.000ms): 5.37 MB, 5.37 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 98.03 MB (102788739) - PerHostPeakMemUsage: 102.93 MB (107930616) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.510us - TotalStorageWaitTime: 535.566ms - TotalThreadsInvoluntaryContextSwitches: 98 (98) - TotalThreadsTotalWallClockTime: 1s791ms - TotalThreadsSysTime: 9.998ms - TotalThreadsUserTime: 1s000ms - TotalThreadsVoluntaryContextSwitches: 377 (377) Fragment Instance Lifecycle Timings: - ExecTime: 109.505ms - ExecTreeExecTime: 71.394ms - OpenTime: 965.762ms - ExecTreeOpenTime: 199.139us - PrepareTime: 47.596ms - ExecTreePrepareTime: 592.485us DataStreamSender (dst_id=5):(Total: 70.612us, non-child: 70.612us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 199.06 KB (203840) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 989.186ms, non-child: 989.186ms, % non-child: 100.00%) - CodegenTime: 18.617ms - CompileTime: 123.175ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 435 (435) - NumInstructions: 8.00K (8003) - OptimizationTime: 841.120ms - PeakMemoryUsage: 3.91 MB (4097536) - PrepareTime: 24.283ms AGGREGATION_NODE (id=2):(Total: 72.176ms, non-child: 6.167ms, % non-child: 8.54%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 62.427us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.30 MB (1367716) - PinTime: 0.000ns - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 184.949us - UnpinTime: 0.000ns HDFS_SCAN_NODE (id=1):(Total: 66.009ms, non-child: 66.009ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/253.41 MB 0:2/506.78 MB 10:3/698.42 MB 7:2/506.80 MB 3:1/253.41 MB 8:3/760.19 MB 4:1/253.39 MB 5:3/760.17 MB 1:3/760.20 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 7.617ms ; Min: 2.134ms ; Max: 16.828ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 217.36 MB (227922077) - BytesReadDataNodeCache: 0 - BytesReadLocal: 217.36 MB (227922077) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 217.36 MB (227922077) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 96.55 MB (101235649) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 59.267ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 716.717ms - MaterializeTupleTime(*): 2.303us - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 37.981ms - ScannerThreadsVoluntaryContextSwitches: 295 (295) - TotalRawHdfsReadTime(*): 177.770ms - TotalReadThroughput: 0.00 /sec Averaged Fragment F00:(Total: 1s128ms, non-child: 39.785ms, % non-child: 3.53%) split sizes: min: 4.45 GB, max: 4.70 GB, avg: 4.60 GB, stddev: 108.75 MB completion times: min:1s103ms max:1s186ms mean: 1s130ms stddev:22.826ms execution rates: min:3.75 GB/sec max:4.21 GB/sec mean:4.07 GB/sec stddev:144.26 MB/sec num instances: 14 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 85.09 MB (89224016) - PerHostPeakMemUsage: 111.93 MB (117371877) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5.245us - TotalStorageWaitTime: 615.296ms - TotalThreadsInvoluntaryContextSwitches: 83 (83) - TotalThreadsTotalWallClockTime: 2s015ms - TotalThreadsSysTime: 9.138ms - TotalThreadsUserTime: 792.937ms - TotalThreadsVoluntaryContextSwitches: 335 (335) Fragment Instance Lifecycle Timings: - ExecTime: 319.667ms - ExecTreeExecTime: 299.239ms - OpenTime: 763.215ms - ExecTreeOpenTime: 154.583us - PrepareTime: 45.438ms - ExecTreePrepareTime: 362.955us DataStreamSender (dst_id=7):(Total: 58.663us, non-child: 58.663us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 54.25 KB (55552) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 788.351ms, non-child: 788.351ms, % non-child: 100.00%) - CodegenTime: 14.934ms - CompileTime: 97.831ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 368 (368) - NumInstructions: 6.61K (6613) - OptimizationTime: 663.638ms - PeakMemoryUsage: 3.23 MB (3385856) - PrepareTime: 26.262ms HDFS_SCAN_NODE (id=0):(Total: 300.175ms, non-child: 300.175ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 262.96 MB (275730222) - BytesReadDataNodeCache: 0 - BytesReadLocal: 262.96 MB (275730222) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 262.96 MB (275730222) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 18 (18) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 18 (18) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 85.02 MB (89153422) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 88.669ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 932.617ms - MaterializeTupleTime(*): 2.860us - ScannerThreadsSysTime: 4.210ms - ScannerThreadsUserTime: 28.910ms - ScannerThreadsVoluntaryContextSwitches: 239 (239) - TotalRawHdfsReadTime(*): 183.198ms - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Fragment F00: Instance ce441eb8218e9dbf:9de609a10000001c (host=vb0206.halxg.cloudera.com:22000):(Total: 1s185ms, non-child: 23.313ms, % non-child: 1.97%) Hdfs split stats (:<# splits>/): 6:1/253.40 MB 9:3/760.17 MB 2:1/253.39 MB 8:1/253.40 MB 3:1/253.39 MB 7:1/253.39 MB 4:2/506.77 MB 1:2/506.77 MB 0:6/1.48 GB MemoryUsage(500.000ms): 3.29 MB, 3.29 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 80.50 MB (84408916) - PerHostPeakMemUsage: 110.68 MB (116051624) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6.581us - TotalStorageWaitTime: 763.500ms - TotalThreadsInvoluntaryContextSwitches: 87 (87) - TotalThreadsTotalWallClockTime: 2s267ms - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 803.864ms - TotalThreadsVoluntaryContextSwitches: 276 (276) Fragment Instance Lifecycle Timings: - ExecTime: 366.547ms - ExecTreeExecTime: 362.400ms - OpenTime: 769.677ms - ExecTreeOpenTime: 150.564us - PrepareTime: 49.245ms - ExecTreePrepareTime: 464.564us DataStreamSender (dst_id=7):(Total: 44.150us, non-child: 44.150us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 54.25 KB (55552) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 798.593ms, non-child: 798.593ms, % non-child: 100.00%) - CodegenTime: 14.847ms - CompileTime: 99.032ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 368 (368) - NumInstructions: 6.61K (6613) - OptimizationTime: 669.150ms - PeakMemoryUsage: 3.23 MB (3385856) - PrepareTime: 29.766ms HDFS_SCAN_NODE (id=0):(Total: 363.582ms, non-child: 363.582ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/253.40 MB 9:3/760.17 MB 2:1/253.39 MB 8:1/253.40 MB 3:1/253.39 MB 7:1/253.39 MB 4:2/506.77 MB 1:2/506.77 MB 0:6/1.48 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 200ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 18.770ms ; Min: 2.808ms ; Max: 48.371ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 273.76 MB (287055872) - BytesReadDataNodeCache: 0 - BytesReadLocal: 273.76 MB (287055872) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 273.76 MB (287055872) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 18 (18) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 18 (18) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 80.43 MB (84338322) - PerReadThreadRawHdfsThroughput: 1.50 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 153.576ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 1s131ms - MaterializeTupleTime(*): 3.024us - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 32.982ms - ScannerThreadsVoluntaryContextSwitches: 185 (185) - TotalRawHdfsReadTime(*): 177.988ms - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance ce441eb8218e9dbf:9de609a100000017 (host=vb0212.halxg.cloudera.com:22000):(Total: 1s172ms, non-child: 22.392ms, % non-child: 1.91%) Hdfs split stats (:<# splits>/): 9:1/253.39 MB 5:1/253.40 MB 6:2/506.81 MB 4:2/506.79 MB 7:3/760.20 MB 0:2/506.80 MB 2:3/760.20 MB 1:4/1013.53 MB MemoryUsage(500.000ms): 3.29 MB, 88.94 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.36 MB (67486947) - PerHostPeakMemUsage: 86.81 MB (91030825) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5.037us - TotalStorageWaitTime: 1s104ms - TotalThreadsInvoluntaryContextSwitches: 81 (81) - TotalThreadsTotalWallClockTime: 3s101ms - TotalThreadsSysTime: 7.996ms - TotalThreadsUserTime: 793.866ms - TotalThreadsVoluntaryContextSwitches: 263 (263) Fragment Instance Lifecycle Timings: - ExecTime: 356.572ms - ExecTreeExecTime: 353.298ms - OpenTime: 765.791ms - ExecTreeOpenTime: 142.189us - PrepareTime: 50.401ms - ExecTreePrepareTime: 448.091us DataStreamSender (dst_id=7):(Total: 47.883us, non-child: 47.883us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 54.25 KB (55552) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 795.938ms, non-child: 795.938ms, % non-child: 100.00%) - CodegenTime: 14.626ms - CompileTime: 98.667ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 368 (368) - NumInstructions: 6.61K (6613) - OptimizationTime: 665.630ms - PeakMemoryUsage: 3.23 MB (3385856) - PrepareTime: 31.011ms HDFS_SCAN_NODE (id=0):(Total: 354.447ms, non-child: 354.447ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.39 MB 5:1/253.40 MB 6:2/506.81 MB 4:2/506.79 MB 7:3/760.20 MB 0:2/506.80 MB 2:3/760.20 MB 1:4/1013.53 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 201ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 28.757ms ; Min: 1.183ms ; Max: 74.003ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 273.76 MB (287055872) - BytesReadDataNodeCache: 0 - BytesReadLocal: 273.76 MB (287055872) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 273.76 MB (287055872) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 18 (18) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 18 (18) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 64.29 MB (67416353) - PerReadThreadRawHdfsThroughput: 1.58 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 145.811ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 1s979ms - MaterializeTupleTime(*): 2.402us - ScannerThreadsSysTime: 4.996ms - ScannerThreadsUserTime: 24.983ms - ScannerThreadsVoluntaryContextSwitches: 164 (164) - TotalRawHdfsReadTime(*): 169.500ms - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance ce441eb8218e9dbf:9de609a100000015 (host=vb0204.halxg.cloudera.com:22000):(Total: 1s147ms, non-child: 23.312ms, % non-child: 2.03%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 6:1/253.41 MB 5:3/760.17 MB 3:5/1.24 GB 0:1/253.39 MB 7:2/506.81 MB 4:2/506.83 MB 1:4/1013.57 MB MemoryUsage(500.000ms): 3.29 MB, 62.25 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 96.47 MB (101159026) - PerHostPeakMemUsage: 102.58 MB (107561819) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6.959us - TotalStorageWaitTime: 741.505ms - TotalThreadsInvoluntaryContextSwitches: 83 (83) - TotalThreadsTotalWallClockTime: 2s076ms - TotalThreadsSysTime: 4.998ms - TotalThreadsUserTime: 803.866ms - TotalThreadsVoluntaryContextSwitches: 376 (376) Fragment Instance Lifecycle Timings: - ExecTime: 341.574ms - ExecTreeExecTime: 337.783ms - OpenTime: 762.368ms - ExecTreeOpenTime: 190.859us - PrepareTime: 43.287ms - ExecTreePrepareTime: 291.528us DataStreamSender (dst_id=7):(Total: 303.695us, non-child: 303.695us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 54.25 KB (55552) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 785.090ms, non-child: 785.090ms, % non-child: 100.00%) - CodegenTime: 14.391ms - CompileTime: 97.691ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 368 (368) - NumInstructions: 6.61K (6613) - OptimizationTime: 662.567ms - PeakMemoryUsage: 3.23 MB (3385856) - PrepareTime: 24.269ms HDFS_SCAN_NODE (id=0):(Total: 338.557ms, non-child: 338.557ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.40 MB 6:1/253.41 MB 5:3/760.17 MB 3:5/1.24 GB 0:1/253.39 MB 7:2/506.81 MB 4:2/506.83 MB 1:4/1013.57 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Runtime filters: Only following filters arrived: , waited 201ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 15.213ms ; Min: 2.109ms ; Max: 39.795ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 257.86 MB (270381056) - BytesReadDataNodeCache: 0 - BytesReadLocal: 257.86 MB (270381056) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 257.86 MB (270381056) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 17 (17) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 96.41 MB (101088432) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 127.414ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 973.360ms - MaterializeTupleTime(*): 2.161us - ScannerThreadsSysTime: 1.998ms - ScannerThreadsUserTime: 38.983ms - ScannerThreadsVoluntaryContextSwitches: 292 (292) - TotalRawHdfsReadTime(*): 204.482ms - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance ce441eb8218e9dbf:9de609a10000001b (host=vb0208.halxg.cloudera.com:22000):(Total: 1s133ms, non-child: 22.749ms, % non-child: 2.01%) Hdfs split stats (:<# splits>/): 4:1/253.40 MB 1:2/506.79 MB 7:1/234.34 MB 10:1/253.38 MB 8:1/253.38 MB 9:2/440.61 MB 6:1/253.38 MB 5:4/1013.56 MB 3:4/1013.64 MB 2:2/506.77 MB MemoryUsage(500.000ms): 3.29 MB, 62.25 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 80.48 MB (84390035) - PerHostPeakMemUsage: 110.86 MB (116242397) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6.748us - TotalStorageWaitTime: 675.845ms - TotalThreadsInvoluntaryContextSwitches: 85 (85) - TotalThreadsTotalWallClockTime: 2s220ms - TotalThreadsSysTime: 8.996ms - TotalThreadsUserTime: 807.863ms - TotalThreadsVoluntaryContextSwitches: 315 (315) Fragment Instance Lifecycle Timings: - ExecTime: 317.164ms - ExecTreeExecTime: 313.756ms - OpenTime: 774.666ms - ExecTreeOpenTime: 151.455us - PrepareTime: 41.681ms - ExecTreePrepareTime: 261.741us DataStreamSender (dst_id=7):(Total: 27.279us, non-child: 27.279us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 54.25 KB (55552) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 796.324ms, non-child: 796.324ms, % non-child: 100.00%) - CodegenTime: 15.934ms - CompileTime: 97.649ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 368 (368) - NumInstructions: 6.61K (6613) - OptimizationTime: 675.354ms - PeakMemoryUsage: 3.23 MB (3385856) - PrepareTime: 22.680ms HDFS_SCAN_NODE (id=0):(Total: 314.451ms, non-child: 314.451ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.40 MB 1:2/506.79 MB 7:1/234.34 MB 10:1/253.38 MB 8:1/253.38 MB 9:2/440.61 MB 6:1/253.38 MB 5:4/1013.56 MB 3:4/1013.64 MB 2:2/506.77 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Runtime filters: Only following filters arrived: , waited 201ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 16.399ms ; Min: 3.042ms ; Max: 31.128ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 304.98 MB (319794279) - BytesReadDataNodeCache: 0 - BytesReadLocal: 304.98 MB (319794279) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 304.98 MB (319794279) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 80.41 MB (84319441) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 98.827ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 1s128ms - MaterializeTupleTime(*): 3.789us - ScannerThreadsSysTime: 1.998ms - ScannerThreadsUserTime: 30.982ms - ScannerThreadsVoluntaryContextSwitches: 206 (206) - TotalRawHdfsReadTime(*): 202.419ms - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance ce441eb8218e9dbf:9de609a100000011 (host=vb0232.halxg.cloudera.com:22000):(Total: 1s127ms, non-child: 23.441ms, % non-child: 2.08%) Hdfs split stats (:<# splits>/): 8:2/506.78 MB 6:1/253.39 MB 9:3/760.16 MB 7:2/506.80 MB 5:2/506.79 MB 4:1/253.40 MB 2:2/506.80 MB 1:6/1.48 GB MemoryUsage(500.000ms): 3.29 MB, 3.29 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 56.51 MB (59256583) - PerHostPeakMemUsage: 118.66 MB (124426213) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.443us - TotalStorageWaitTime: 459.332ms - TotalThreadsInvoluntaryContextSwitches: 82 (82) - TotalThreadsTotalWallClockTime: 1s992ms - TotalThreadsSysTime: 7.997ms - TotalThreadsUserTime: 783.865ms - TotalThreadsVoluntaryContextSwitches: 278 (278) Fragment Instance Lifecycle Timings: - ExecTime: 313.450ms - ExecTreeExecTime: 309.676ms - OpenTime: 762.114ms - ExecTreeOpenTime: 141.994us - PrepareTime: 51.736ms - ExecTreePrepareTime: 525.141us DataStreamSender (dst_id=7):(Total: 46.736us, non-child: 46.736us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 54.25 KB (55552) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 792.919ms, non-child: 792.919ms, % non-child: 100.00%) - CodegenTime: 14.739ms - CompileTime: 97.883ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 368 (368) - NumInstructions: 6.61K (6613) - OptimizationTime: 662.857ms - PeakMemoryUsage: 3.23 MB (3385856) - PrepareTime: 31.536ms HDFS_SCAN_NODE (id=0):(Total: 310.974ms, non-child: 310.974ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:2/506.78 MB 6:1/253.39 MB 9:3/760.16 MB 7:2/506.80 MB 5:2/506.79 MB 4:1/253.40 MB 2:2/506.80 MB 1:6/1.48 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Runtime filters: Only following filters arrived: , waited 201ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 5.934ms ; Min: 791.955us ; Max: 19.247ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 297.86 MB (312324096) - BytesReadDataNodeCache: 0 - BytesReadLocal: 297.86 MB (312324096) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 297.86 MB (312324096) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 8 (8) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 56.44 MB (59185989) - PerReadThreadRawHdfsThroughput: 1.75 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 103.004ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 916.856ms - MaterializeTupleTime(*): 2.095us - ScannerThreadsSysTime: 2.997ms - ScannerThreadsUserTime: 21.981ms - ScannerThreadsVoluntaryContextSwitches: 185 (185) - TotalRawHdfsReadTime(*): 166.234ms - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance ce441eb8218e9dbf:9de609a10000000f (host=vb0230.halxg.cloudera.com:22000):(Total: 1s120ms, non-child: 45.292ms, % non-child: 4.04%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 8:2/506.79 MB 10:1/7.47 MB 5:1/253.40 MB 9:1/253.39 MB 6:1/253.38 MB 7:3/514.15 MB 4:1/253.40 MB 3:2/506.83 MB 1:3/760.18 MB 0:4/1013.58 MB MemoryUsage(500.000ms): 3.29 MB, 3.29 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 96.49 MB (101172979) - PerHostPeakMemUsage: 110.77 MB (116152788) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.729us - TotalStorageWaitTime: 592.861ms - TotalThreadsInvoluntaryContextSwitches: 82 (82) - TotalThreadsTotalWallClockTime: 1s905ms - TotalThreadsSysTime: 5.996ms - TotalThreadsUserTime: 797.864ms - TotalThreadsVoluntaryContextSwitches: 358 (358) Fragment Instance Lifecycle Timings: - ExecTime: 310.004ms - ExecTreeExecTime: 281.998ms - OpenTime: 771.006ms - ExecTreeOpenTime: 157.061us - PrepareTime: 39.715ms - ExecTreePrepareTime: 270.059us DataStreamSender (dst_id=7):(Total: 31.062us, non-child: 31.062us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 54.25 KB (55552) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 792.734ms, non-child: 792.734ms, % non-child: 100.00%) - CodegenTime: 14.462ms - CompileTime: 100.903ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 368 (368) - NumInstructions: 6.61K (6613) - OptimizationTime: 668.542ms - PeakMemoryUsage: 3.23 MB (3385856) - PrepareTime: 22.660ms HDFS_SCAN_NODE (id=0):(Total: 282.698ms, non-child: 282.698ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 8:2/506.79 MB 10:1/7.47 MB 5:1/253.40 MB 9:1/253.39 MB 6:1/253.38 MB 7:3/514.15 MB 4:1/253.40 MB 3:2/506.83 MB 1:3/760.18 MB 0:4/1013.58 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 20 out of 20 Runtime filters: Only following filters arrived: , waited 200ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:20 PARQUET/SNAPPY:40 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 9.674ms ; Min: 2.785ms ; Max: 39.301ms ; Number of samples: 20) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 218.94 MB (229573832) - BytesReadDataNodeCache: 0 - BytesReadLocal: 218.94 MB (229573832) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 218.94 MB (229573832) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 20 (20) - NumDisksAccessed: 11 (11) - NumRowGroups: 20 (20) - NumScannerThreadsStarted: 20 (20) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 96.42 MB (101102385) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 71.516ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 20 (20) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 824.720ms - MaterializeTupleTime(*): 3.752us - ScannerThreadsSysTime: 2.997ms - ScannerThreadsUserTime: 26.981ms - ScannerThreadsVoluntaryContextSwitches: 253 (253) - TotalRawHdfsReadTime(*): 153.061ms - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance ce441eb8218e9dbf:9de609a100000014 (host=vb0218.halxg.cloudera.com:22000):(Total: 1s118ms, non-child: 24.404ms, % non-child: 2.18%) Hdfs split stats (:<# splits>/): 2:3/760.17 MB 4:1/253.40 MB 9:1/253.38 MB 5:2/506.79 MB 1:4/1013.59 MB 10:1/253.39 MB 8:2/506.77 MB 7:1/253.38 MB 6:1/253.40 MB 3:1/253.39 MB 0:2/506.78 MB MemoryUsage(500.000ms): 3.29 MB, 88.94 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 104.51 MB (109588759) - PerHostPeakMemUsage: 118.98 MB (124758015) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5.352us - TotalStorageWaitTime: 595.555ms - TotalThreadsInvoluntaryContextSwitches: 84 (84) - TotalThreadsTotalWallClockTime: 1s885ms - TotalThreadsSysTime: 13.991ms - TotalThreadsUserTime: 787.867ms - TotalThreadsVoluntaryContextSwitches: 384 (384) Fragment Instance Lifecycle Timings: - ExecTime: 318.636ms - ExecTreeExecTime: 313.184ms - OpenTime: 760.902ms - ExecTreeOpenTime: 156.926us - PrepareTime: 39.067ms - ExecTreePrepareTime: 245.743us DataStreamSender (dst_id=7):(Total: 27.781us, non-child: 27.781us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 54.25 KB (55552) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 780.388ms, non-child: 780.388ms, % non-child: 100.00%) - CodegenTime: 14.511ms - CompileTime: 96.543ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 368 (368) - NumInstructions: 6.61K (6613) - OptimizationTime: 661.172ms - PeakMemoryUsage: 3.23 MB (3385856) - PrepareTime: 22.085ms HDFS_SCAN_NODE (id=0):(Total: 313.812ms, non-child: 313.812ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:3/760.17 MB 4:1/253.40 MB 9:1/253.38 MB 5:2/506.79 MB 1:4/1013.59 MB 10:1/253.39 MB 8:2/506.77 MB 7:1/253.38 MB 6:1/253.40 MB 3:1/253.39 MB 0:2/506.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Runtime filters: Only following filters arrived: , waited 201ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 8.551ms ; Min: 4.675ms ; Max: 59.243ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 241.86 MB (253603840) - BytesReadDataNodeCache: 0 - BytesReadLocal: 241.86 MB (253603840) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 241.86 MB (253603840) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 11 (11) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 104.44 MB (109518165) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 104.686ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 805.614ms - MaterializeTupleTime(*): 3.354us - ScannerThreadsSysTime: 8.992ms - ScannerThreadsUserTime: 27.983ms - ScannerThreadsVoluntaryContextSwitches: 293 (293) - TotalRawHdfsReadTime(*): 203.891ms - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance ce441eb8218e9dbf:9de609a100000012 (host=vb0214.halxg.cloudera.com:22000):(Total: 1s118ms, non-child: 77.243ms, % non-child: 6.91%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 8:1/253.39 MB 5:1/253.38 MB 10:1/253.37 MB 6:2/506.79 MB 9:2/506.80 MB 1:1/253.40 MB 4:2/506.81 MB 2:4/959.91 MB 0:4/1013.58 MB MemoryUsage(500.000ms): 3.29 MB, 62.25 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 112.65 MB (118118790) - PerHostPeakMemUsage: 118.72 MB (124488749) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5.692us - TotalStorageWaitTime: 400.327ms - TotalThreadsInvoluntaryContextSwitches: 78 (78) - TotalThreadsTotalWallClockTime: 1s700ms - TotalThreadsSysTime: 11.995ms - TotalThreadsUserTime: 751.873ms - TotalThreadsVoluntaryContextSwitches: 435 (435) Fragment Instance Lifecycle Timings: - ExecTime: 357.766ms - ExecTreeExecTime: 298.519ms - OpenTime: 720.361ms - ExecTreeOpenTime: 160.015us - PrepareTime: 39.914ms - ExecTreePrepareTime: 264.761us DataStreamSender (dst_id=7):(Total: 30.016us, non-child: 30.016us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 54.25 KB (55552) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 741.591ms, non-child: 741.591ms, % non-child: 100.00%) - CodegenTime: 14.620ms - CompileTime: 90.716ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 368 (368) - NumInstructions: 6.61K (6613) - OptimizationTime: 627.437ms - PeakMemoryUsage: 3.23 MB (3385856) - PrepareTime: 22.844ms HDFS_SCAN_NODE (id=0):(Total: 299.203ms, non-child: 299.203ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.40 MB 8:1/253.39 MB 5:1/253.38 MB 10:1/253.37 MB 6:2/506.79 MB 9:2/506.80 MB 1:1/253.40 MB 4:2/506.81 MB 2:4/959.91 MB 0:4/1013.58 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Runtime filters: Only following filters arrived: , waited 241ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 3.697ms ; Min: 409.895us ; Max: 17.437ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 305.68 MB (320529659) - BytesReadDataNodeCache: 0 - BytesReadLocal: 305.68 MB (320529659) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 305.68 MB (320529659) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 112.58 MB (118048196) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 50.337ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 621.989ms - MaterializeTupleTime(*): 3.290us - ScannerThreadsSysTime: 4.997ms - ScannerThreadsUserTime: 30.983ms - ScannerThreadsVoluntaryContextSwitches: 344 (344) - TotalRawHdfsReadTime(*): 218.927ms - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance ce441eb8218e9dbf:9de609a100000016 (host=vb0234.halxg.cloudera.com:22000):(Total: 1s115ms, non-child: 63.714ms, % non-child: 5.71%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 5:2/506.79 MB 9:3/760.17 MB 1:2/506.79 MB 7:2/506.79 MB 6:3/760.18 MB 3:2/506.77 MB 2:3/512.05 MB 0:1/253.40 MB MemoryUsage(500.000ms): 3.29 MB, 88.94 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 88.55 MB (92855132) - PerHostPeakMemUsage: 110.84 MB (116223516) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.059us - TotalStorageWaitTime: 583.574ms - TotalThreadsInvoluntaryContextSwitches: 82 (82) - TotalThreadsTotalWallClockTime: 1s809ms - TotalThreadsSysTime: 6.996ms - TotalThreadsUserTime: 798.865ms - TotalThreadsVoluntaryContextSwitches: 368 (368) Fragment Instance Lifecycle Timings: - ExecTime: 295.887ms - ExecTreeExecTime: 252.524ms - OpenTime: 767.769ms - ExecTreeOpenTime: 143.225us - PrepareTime: 51.851ms - ExecTreePrepareTime: 467.028us DataStreamSender (dst_id=7):(Total: 46.137us, non-child: 46.137us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 54.25 KB (55552) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 798.120ms, non-child: 798.120ms, % non-child: 100.00%) - CodegenTime: 14.930ms - CompileTime: 99.400ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 368 (368) - NumInstructions: 6.61K (6613) - OptimizationTime: 666.701ms - PeakMemoryUsage: 3.23 MB (3385856) - PrepareTime: 31.386ms HDFS_SCAN_NODE (id=0):(Total: 253.695ms, non-child: 253.695ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.41 MB 5:2/506.79 MB 9:3/760.17 MB 1:2/506.79 MB 7:2/506.79 MB 6:3/760.18 MB 3:2/506.77 MB 2:3/512.05 MB 0:1/253.40 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Runtime filters: Only following filters arrived: , waited 181ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 7.291ms ; Min: 4.424ms ; Max: 9.174ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 218.05 MB (228646219) - BytesReadDataNodeCache: 0 - BytesReadLocal: 218.05 MB (228646219) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 218.05 MB (228646219) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 88.49 MB (92784538) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 66.346ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 745.968ms - MaterializeTupleTime(*): 2.460us - ScannerThreadsSysTime: 4.996ms - ScannerThreadsUserTime: 28.982ms - ScannerThreadsVoluntaryContextSwitches: 264 (264) - TotalRawHdfsReadTime(*): 157.881ms - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance ce441eb8218e9dbf:9de609a100000013 (host=vb0224.halxg.cloudera.com:22000):(Total: 1s115ms, non-child: 49.596ms, % non-child: 4.45%) Hdfs split stats (:<# splits>/): 2:1/253.40 MB 1:1/253.41 MB 10:1/253.38 MB 5:2/506.78 MB 0:2/506.77 MB 4:3/760.16 MB 9:2/506.80 MB 8:2/506.78 MB 7:2/506.79 MB 6:1/227.66 MB 3:2/506.80 MB MemoryUsage(500.000ms): 3.29 MB, 3.29 MB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 72.45 MB (75970958) - PerHostPeakMemUsage: 134.77 MB (141318612) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6.761us - TotalStorageWaitTime: 655.704ms - TotalThreadsInvoluntaryContextSwitches: 88 (88) - TotalThreadsTotalWallClockTime: 2s044ms - TotalThreadsSysTime: 15.993ms - TotalThreadsUserTime: 786.867ms - TotalThreadsVoluntaryContextSwitches: 306 (306) Fragment Instance Lifecycle Timings: - ExecTime: 305.636ms - ExecTreeExecTime: 275.324ms - OpenTime: 761.324ms - ExecTreeOpenTime: 141.266us - PrepareTime: 48.472ms - ExecTreePrepareTime: 427.205us DataStreamSender (dst_id=7):(Total: 46.486us, non-child: 46.486us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 54.25 KB (55552) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 789.438ms, non-child: 789.438ms, % non-child: 100.00%) - CodegenTime: 15.016ms - CompileTime: 97.535ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 368 (368) - NumInstructions: 6.61K (6613) - OptimizationTime: 662.317ms - PeakMemoryUsage: 3.23 MB (3385856) - PrepareTime: 28.944ms HDFS_SCAN_NODE (id=0):(Total: 276.415ms, non-child: 276.415ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/253.40 MB 1:1/253.41 MB 10:1/253.38 MB 5:2/506.78 MB 0:2/506.77 MB 4:3/760.16 MB 9:2/506.80 MB 8:2/506.78 MB 7:2/506.79 MB 6:1/227.66 MB 3:2/506.80 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Runtime filters: Only following filters arrived: , waited 201ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 14.696ms ; Min: 3.018ms ; Max: 24.842ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 289.86 MB (303935488) - BytesReadDataNodeCache: 0 - BytesReadLocal: 289.86 MB (303935488) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 289.86 MB (303935488) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 11 (11) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 72.38 MB (75900364) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 68.051ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 977.651ms - MaterializeTupleTime(*): 2.793us - ScannerThreadsSysTime: 6.994ms - ScannerThreadsUserTime: 27.983ms - ScannerThreadsVoluntaryContextSwitches: 206 (206) - TotalRawHdfsReadTime(*): 209.723ms - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance ce441eb8218e9dbf:9de609a100000018 (host=vb0222.halxg.cloudera.com:22000):(Total: 1s113ms, non-child: 58.872ms, % non-child: 5.29%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 0:1/253.38 MB 6:1/253.38 MB 3:1/253.38 MB 4:2/506.83 MB 9:3/760.15 MB 7:2/506.79 MB 8:3/760.18 MB 5:2/506.79 MB 1:3/760.22 MB MemoryUsage(500.000ms): 3.29 MB, 88.94 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 104.52 MB (109596984) - PerHostPeakMemUsage: 118.92 MB (124699607) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5.187us - TotalStorageWaitTime: 559.113ms - TotalThreadsInvoluntaryContextSwitches: 84 (84) - TotalThreadsTotalWallClockTime: 1s823ms - TotalThreadsSysTime: 12.995ms - TotalThreadsUserTime: 799.865ms - TotalThreadsVoluntaryContextSwitches: 366 (366) Fragment Instance Lifecycle Timings: - ExecTime: 304.782ms - ExecTreeExecTime: 266.145ms - OpenTime: 766.849ms - ExecTreeOpenTime: 157.987us - PrepareTime: 42.221ms - ExecTreePrepareTime: 296.998us DataStreamSender (dst_id=7):(Total: 34.319us, non-child: 34.319us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 54.25 KB (55552) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 788.045ms, non-child: 788.045ms, % non-child: 100.00%) - CodegenTime: 14.999ms - CompileTime: 99.139ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 368 (368) - NumInstructions: 6.61K (6613) - OptimizationTime: 666.180ms - PeakMemoryUsage: 3.23 MB (3385856) - PrepareTime: 22.139ms HDFS_SCAN_NODE (id=0):(Total: 266.940ms, non-child: 266.940ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/253.39 MB 0:1/253.38 MB 6:1/253.38 MB 3:1/253.38 MB 4:2/506.83 MB 9:3/760.15 MB 7:2/506.79 MB 8:3/760.18 MB 5:2/506.79 MB 1:3/760.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Runtime filters: Only following filters arrived: , waited 201ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 7.186ms ; Min: 2.651ms ; Max: 9.125ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 233.86 MB (245215232) - BytesReadDataNodeCache: 0 - BytesReadLocal: 233.86 MB (245215232) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 233.86 MB (245215232) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 104.45 MB (109526390) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 56.908ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 751.973ms - MaterializeTupleTime(*): 3.188us - ScannerThreadsSysTime: 6.995ms - ScannerThreadsUserTime: 34.981ms - ScannerThreadsVoluntaryContextSwitches: 272 (272) - TotalRawHdfsReadTime(*): 194.914ms - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance ce441eb8218e9dbf:9de609a100000019 (host=vb0220.halxg.cloudera.com:22000):(Total: 1s113ms, non-child: 57.127ms, % non-child: 5.13%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 2:2/479.23 MB 6:1/253.41 MB 9:3/760.16 MB 8:2/506.78 MB 7:1/253.41 MB 5:3/760.20 MB 3:3/760.20 MB 0:2/506.78 MB 1:1/253.41 MB MemoryUsage(500.000ms): 3.29 MB, 88.94 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 72.71 MB (76238896) - PerHostPeakMemUsage: 126.75 MB (132910257) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5.400us - TotalStorageWaitTime: 342.792ms - TotalThreadsInvoluntaryContextSwitches: 83 (83) - TotalThreadsTotalWallClockTime: 1s700ms - TotalThreadsSysTime: 11.996ms - TotalThreadsUserTime: 792.867ms - TotalThreadsVoluntaryContextSwitches: 358 (358) Fragment Instance Lifecycle Timings: - ExecTime: 302.027ms - ExecTreeExecTime: 266.382ms - OpenTime: 762.425ms - ExecTreeOpenTime: 140.966us - PrepareTime: 48.924ms - ExecTreePrepareTime: 451.481us DataStreamSender (dst_id=7):(Total: 45.166us, non-child: 45.166us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 54.25 KB (55552) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 788.758ms, non-child: 788.758ms, % non-child: 100.00%) - CodegenTime: 15.123ms - CompileTime: 96.969ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 368 (368) - NumInstructions: 6.61K (6613) - OptimizationTime: 663.927ms - PeakMemoryUsage: 3.23 MB (3385856) - PrepareTime: 27.229ms HDFS_SCAN_NODE (id=0):(Total: 267.518ms, non-child: 267.518ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 2:2/479.23 MB 6:1/253.41 MB 9:3/760.16 MB 8:2/506.78 MB 7:1/253.41 MB 5:3/760.20 MB 3:3/760.20 MB 0:2/506.78 MB 1:1/253.41 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Runtime filters: Only following filters arrived: , waited 201ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 3.427ms ; Min: 1.387ms ; Max: 14.021ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 297.86 MB (312324096) - BytesReadDataNodeCache: 0 - BytesReadLocal: 297.86 MB (312324096) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 297.86 MB (312324096) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 10 (10) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 72.64 MB (76168302) - PerReadThreadRawHdfsThroughput: 1.62 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 50.328ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 636.262ms - MaterializeTupleTime(*): 2.078us - ScannerThreadsSysTime: 3.997ms - ScannerThreadsUserTime: 29.983ms - ScannerThreadsVoluntaryContextSwitches: 255 (255) - TotalRawHdfsReadTime(*): 179.333ms - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance ce441eb8218e9dbf:9de609a10000001a (host=vb0228.halxg.cloudera.com:22000):(Total: 1s113ms, non-child: 41.507ms, % non-child: 3.73%) Hdfs split stats (:<# splits>/): 6:1/253.41 MB 0:2/506.78 MB 10:3/698.42 MB 7:2/506.80 MB 3:1/253.41 MB 8:3/760.19 MB 4:1/253.39 MB 5:3/760.17 MB 1:3/760.20 MB MemoryUsage(500.000ms): 3.29 MB, 88.94 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 72.61 MB (76132499) - PerHostPeakMemUsage: 102.93 MB (107930616) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.219us - TotalStorageWaitTime: 661.926ms - TotalThreadsInvoluntaryContextSwitches: 84 (84) - TotalThreadsTotalWallClockTime: 2s030ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 797.864ms - TotalThreadsVoluntaryContextSwitches: 276 (276) Fragment Instance Lifecycle Timings: - ExecTime: 302.027ms - ExecTreeExecTime: 279.405ms - OpenTime: 764.290ms - ExecTreeOpenTime: 149.806us - PrepareTime: 46.831ms - ExecTreePrepareTime: 401.864us DataStreamSender (dst_id=7):(Total: 60.091us, non-child: 60.091us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 54.25 KB (55552) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 791.205ms, non-child: 791.205ms, % non-child: 100.00%) - CodegenTime: 15.080ms - CompileTime: 98.876ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 368 (368) - NumInstructions: 6.61K (6613) - OptimizationTime: 663.914ms - PeakMemoryUsage: 3.23 MB (3385856) - PrepareTime: 27.808ms HDFS_SCAN_NODE (id=0):(Total: 280.435ms, non-child: 280.435ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/253.41 MB 0:2/506.78 MB 10:3/698.42 MB 7:2/506.80 MB 3:1/253.41 MB 8:3/760.19 MB 4:1/253.39 MB 5:3/760.17 MB 1:3/760.20 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 19 out of 19 Runtime filters: Only following filters arrived: , waited 201ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:19 PARQUET/SNAPPY:38 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 12.632ms ; Min: 2.449ms ; Max: 26.871ms ; Number of samples: 19) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 281.34 MB (295002394) - BytesReadDataNodeCache: 0 - BytesReadLocal: 281.34 MB (295002394) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 281.34 MB (295002394) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 19 (19) - NumDisksAccessed: 9 (9) - NumRowGroups: 19 (19) - NumScannerThreadsStarted: 19 (19) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 72.54 MB (76061905) - PerReadThreadRawHdfsThroughput: 1.58 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 71.718ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 19 (19) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 964.126ms - MaterializeTupleTime(*): 3.366us - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 29.981ms - ScannerThreadsVoluntaryContextSwitches: 176 (176) - TotalRawHdfsReadTime(*): 173.828ms - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Instance ce441eb8218e9dbf:9de609a100000010 (host=vb0216.halxg.cloudera.com:22000):(Total: 1s101ms, non-child: 24.033ms, % non-child: 2.18%) Hdfs split stats (:<# splits>/): 8:1/253.39 MB 3:1/253.39 MB 9:3/760.19 MB 10:2/506.80 MB 7:4/1013.58 MB 6:1/253.41 MB 5:1/253.41 MB 1:3/760.19 MB 0:2/506.82 MB MemoryUsage(500.000ms): 3.29 MB, 62.25 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 88.46 MB (92759729) - PerHostPeakMemUsage: 94.81 MB (99411241) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.267us - TotalStorageWaitTime: 477.471ms - TotalThreadsInvoluntaryContextSwitches: 82 (82) - TotalThreadsTotalWallClockTime: 1s656ms - TotalThreadsSysTime: 8.995ms - TotalThreadsUserTime: 793.867ms - TotalThreadsVoluntaryContextSwitches: 341 (341) Fragment Instance Lifecycle Timings: - ExecTime: 283.263ms - ExecTreeExecTime: 278.954ms - OpenTime: 775.466ms - ExecTreeOpenTime: 179.854us - PrepareTime: 42.792ms - ExecTreePrepareTime: 265.173us DataStreamSender (dst_id=7):(Total: 30.484us, non-child: 30.484us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 54.25 KB (55552) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 797.766ms, non-child: 797.766ms, % non-child: 100.00%) - CodegenTime: 15.800ms - CompileTime: 98.635ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2074504) - NumFunctions: 368 (368) - NumInstructions: 6.61K (6613) - OptimizationTime: 675.189ms - PeakMemoryUsage: 3.23 MB (3385856) - PrepareTime: 23.312ms HDFS_SCAN_NODE (id=0):(Total: 279.728ms, non-child: 279.728ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.39 MB 3:1/253.39 MB 9:3/760.19 MB 10:2/506.80 MB 7:4/1013.58 MB 6:1/253.41 MB 5:1/253.41 MB 1:3/760.19 MB 0:2/506.82 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Runtime filters: Only following filters arrived: , waited 201ms Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/NONE:18 PARQUET/SNAPPY:36 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 6.426ms ; Min: 1.746ms ; Max: 18.359ms ; Number of samples: 18) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 185.76 MB (194781184) - BytesReadDataNodeCache: 0 - BytesReadLocal: 185.76 MB (194781184) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 185.76 MB (194781184) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 18 (18) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 18 (18) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 88.40 MB (92689135) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 72.842ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 598.436ms - MaterializeTupleTime(*): 2.289us - ScannerThreadsSysTime: 4.995ms - ScannerThreadsUserTime: 16.985ms - ScannerThreadsVoluntaryContextSwitches: 258 (258) - TotalRawHdfsReadTime(*): 152.595ms - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0)