Log file created at: 2016/12/12 10:53:42 Running on machine: mj-desktop.ca.cloudera.com Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg I1212 10:53:42.366956 2419 logging.cc:120] stdout will be logged to this file. E1212 10:53:42.367080 2419 logging.cc:121] stderr will be logged to this file. I1212 10:53:42.367272 2419 minidump.cc:229] Setting minidump size limit to 20971520. I1212 10:53:42.367312 2419 atomicops-internals-x86.cc:93] vendor GenuineIntel family 6 model 12 sse2 1 cmpxchg16b 1 I1212 10:53:42.385746 2419 authentication.cc:1057] Internal communication is not authenticated I1212 10:53:42.385758 2419 authentication.cc:1078] External communication is not authenticated I1212 10:53:42.385880 2419 thread.cc:288] Started thread 2429 - common:maintenance-thread I1212 10:53:42.385960 2419 thread.cc:288] Started thread 2430 - common:pause-monitor I1212 10:53:42.385972 2419 init.cc:206] impalad version 2.8.0-SNAPSHOT DEBUG (build a415be54d179c1a9a00aede2dcfcf1bb65c31f59) Built on Sun Dec 11 08:37:37 PST 2016 I1212 10:53:42.385974 2419 init.cc:207] Using hostname: mj-desktop.ca.cloudera.com I1212 10:53:42.386613 2419 logging.cc:156] Flags (see also /varz are on debug webserver): --catalog_service_port=26000 --initial_hms_cnxn_timeout_s=120 --load_catalog_in_background=false --num_metadata_loading_threads=16 --sentry_config= --asm_module_dir= --disable_optimization_passes=false --dump_ir=false --opt_module_dir= --perf_map=false --print_llvm_ir_instruction_count=false --unopt_module_dir= --abort_on_config_error=true --be_port=22000 --be_principal= --compact_catalog_topic=false --disable_kudu=false --disable_mem_pools=false --enable_accept_queue_server=true --enable_process_lifetime_heap_profiling=false --fault_injection_rpc_delay_ms=0 --fault_injection_rpc_type=0 --heap_profile_dir= --hostname=mj-desktop.ca.cloudera.com --inc_stats_size_limit_bytes=209715200 --keytab_file= --krb5_conf= --krb5_debug_file= --kudu_operation_timeout_ms=180000 --load_auth_to_local_rules=false --max_minidumps=9 --mem_limit=8970861499 --minidump_path=/home/mj/dev/Impala/logs/cluster/minidumps/impalad --minidump_size_limit_hint_kb=20480 --principal= --redaction_rules_file= --skip_file_runtime_filtering=false --stress_datastream_recvr_delay_ms=0 --stress_free_pool_alloc=0 --max_log_files=10 --pause_monitor_sleep_time_ms=500 --pause_monitor_warn_threshold_ms=10000 --log_filename=impalad --redirect_stdout_stderr=true --data_source_batch_size=1024 --exchg_node_buffer_size_bytes=10485760 --enable_partitioned_aggregation=true --enable_partitioned_hash_join=true --enable_probe_side_filtering=true --enable_quadratic_probing=true --skip_lzo_version_check=false --parquet_min_filter_reject_ratio=0.10000000000000001 --runtime_filter_wait_time_ms=1000 --suppress_unknown_disk_id_warnings=false --max_row_batches=0 --kudu_max_row_batches=0 --kudu_scanner_keep_alive_period_us=15000000 --kudu_read_mode=READ_LATEST --kudu_scanner_keep_alive_period_sec=15 --pick_only_leaders_for_tests=false --kudu_mutation_buffer_size=10485760 --kudu_sink_mem_required=20971520 --kudu_vlog=0 --convert_legacy_hive_parquet_utc_timestamps=false --max_page_header_size=8388608 --enable_phj_probe_side_filtering=true --accepted_cnxn_queue_depth=10000 --enable_ldap_auth=false --internal_principals_whitelist=hdfs --kerberos_reinit_interval=60 --ldap_allow_anonymous_binds=false --ldap_baseDN= --ldap_bind_pattern= --ldap_ca_certificate= --ldap_domain= --ldap_manual_config=false --ldap_passwords_in_clear_ok=false --ldap_tls=false --ldap_uri= --sasl_path= --rpc_cnxn_attempts=10 --rpc_cnxn_retry_interval_ms=2000 --disk_spill_encryption=false --insert_inherit_permissions=false --datastream_sender_timeout_ms=120000 --max_cached_file_handles=0 --max_free_io_buffers=128 --min_buffer_size=1024 --num_disks=0 --num_remote_hdfs_io_threads=8 --num_s3_io_threads=16 --num_threads_per_disk=0 --read_size=8388608 --backend_client_connection_num_retries=3 --backend_client_rpc_timeout_ms=300000 --catalog_client_connection_num_retries=3 --catalog_client_rpc_timeout_ms=0 --catalog_service_host=localhost --cgroup_hierarchy_path= --coordinator_rpc_threads=12 --enable_rm=false --enable_webserver=true --llama_addresses= --llama_callback_port=28000 --llama_host= --llama_max_request_attempts=5 --llama_port=15000 --llama_registration_timeout_secs=30 --llama_registration_wait_secs=3 --num_hdfs_worker_threads=16 --resource_broker_cnxn_attempts=1 --resource_broker_cnxn_retry_interval_ms=3000 --resource_broker_recv_timeout=0 --resource_broker_send_timeout=0 --staging_cgroup=impala_staging --state_store_host=localhost --state_store_subscriber_port=23000 --use_statestore=true --s3a_access_key_cmd= --s3a_secret_key_cmd= --local_library_dir=/tmp --serialize_batch=false --status_report_interval=5 --log_mem_usage_interval=0 --max_filter_error_rate=0.75 --num_threads_per_core=3 --use_local_tz_for_unix_timestamp_conversions=false --scratch_dirs=/tmp --queue_wait_timeout_ms=60000 --rm_always_use_defaults=false --rm_default_cpu_vcores=2 --rm_default_memory=4G --default_pool_max_queued=200 --default_pool_max_requests=-1 --default_pool_mem_limit= --disable_pool_max_requests=false --disable_pool_mem_limits=false --fair_scheduler_allocation_path= --llama_site_path= --require_username=false --disable_admission_control=false --authorization_policy_file= --authorization_policy_provider_class=org.apache.sentry.provider.common.HadoopGroupResourceAuthorizationProvider --authorized_proxy_user_config= --authorized_proxy_user_config_delimiter=, --kudu_master_hosts=127.0.0.1 --server_name= --abort_on_failed_audit_event=true --abort_on_failed_lineage_event=true --audit_event_log_dir= --be_service_threads=64 --beeswax_port=21000 --cancellation_thread_pool_size=5 --default_query_options= --fe_service_threads=64 --hs2_port=21050 --idle_query_timeout=0 --idle_session_timeout=0 --lineage_event_log_dir= --local_nodemanager_url= --log_query_to_file=true --max_audit_event_log_file_size=5000 --max_lineage_log_file_size=5000 --max_profile_log_file_size=5000 --max_profile_log_files=10 --max_result_cache_size=100000 --profile_log_dir= --query_log_size=25 --ssl_client_ca_certificate= --ssl_private_key= --ssl_private_key_password_cmd= --ssl_server_certificate= --statestore_subscriber_cnxn_attempts=10 --statestore_subscriber_cnxn_retry_interval_ms=3000 --statestore_subscriber_timeout_seconds=30 --state_store_port=24000 --statestore_heartbeat_frequency_ms=1000 --statestore_heartbeat_tcp_timeout_seconds=3 --statestore_max_missed_heartbeats=10 --statestore_num_heartbeat_threads=10 --statestore_num_update_threads=10 --statestore_update_frequency_ms=2000 --statestore_update_tcp_timeout_seconds=300 --force_lowercase_usernames=false --num_cores=0 --web_log_bytes=1048576 --non_impala_java_vlog=0 --periodic_counter_update_period_ms=500 --enable_webserver_doc_root=true --webserver_authentication_domain= --webserver_certificate_file= --webserver_doc_root=/home/mj/dev/Impala --webserver_interface= --webserver_password_file= --webserver_port=25000 --webserver_private_key_file= --webserver_private_key_password_cmd= --webserver_x_frame_options=DENY --flagfile= --fromenv= --tryfromenv= --undefok= --tab_completion_columns=80 --tab_completion_word= --help=false --helpfull=false --helpmatch= --helpon= --helppackage=false --helpshort=false --helpxml=false --version=false --alsologtoemail= --alsologtostderr=false --drop_log_memory=true --log_backtrace_at= --log_dir=/home/mj/dev/Impala/logs/cluster --log_link= --log_prefix=true --logbuflevel=0 --logbufsecs=5 --logemaillevel=999 --logmailer=/bin/mail --logtostderr=false --max_log_size=1800 --minloglevel=0 --stderrthreshold=4 --stop_logging_if_full_disk=false --symbolize_stacktrace=true --v=2 --vmodule=kudu-scanner=3,kudu-scan-node=3 I1212 10:53:42.386700 2419 init.cc:212] Cpu Info: Model: Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz Cores: 8 L1 Cache: 32.00 KB (Line: 64.00 B) L2 Cache: 256.00 KB (Line: 64.00 B) L3 Cache: 8.00 MB (Line: 64.00 B) Hardware Supports: ssse3 sse4_1 sse4_2 popcnt avx avx2 I1212 10:53:42.386708 2419 init.cc:213] Disk Info: Num disks 2: sda (rotational=true) sdb (rotational=false) I1212 10:53:42.386713 2419 init.cc:214] Physical Memory: 31.33 GB I1212 10:53:42.386718 2419 init.cc:215] OS version: Linux version 3.13.0-101-generic (buildd@lgw01-40) (gcc version 4.8.4 (Ubuntu 4.8.4-2Listening for transport dt_socket at address: 30000 ubuntu1~14.04.3) ) #148-Ubuntu SMP Thu Oct 20 22:08:32 UTC 2016 Clock: clocksource: 'tsc', clockid_t: CLOCK_MONOTONIC I1212 10:53:42.386730 2419 init.cc:216] Process ID: 2419 I1212 10:53:43.215270 2419 llvm-codegen.cc:194] CPU class for runtime code generation: haswell I1212 10:53:43.215330 2419 llvm-codegen.cc:196] CPU flags for runtime code generation: -sse4a,-avx512bw,+cx16,-tbm,+xsave,-fma4,-avx512vl,-prfchw,+bmi2,-adx,-xsavec,+fsgsbase,+avx,-avx512cd,-avx512pf,+rtm,+popcnt,+fma,+bmi,+aes,+rdrnd,-xsaves,+sse4.1,+sse4.2,+avx2,-avx512er,+sse,+lzcnt,+pclmul,-avx512f,+f16c,+ssse3,+mmx,-pku,+cmov,-xop,-rdseed,+movbe,+hle,+xsaveopt,-sha,+sse2,+sse3,-avx512dq I1212 10:53:43.696456 2419 hbase-table-scanner.cc:166] Detected HBase version >= 0.95.2 ... I1212 11:08:59.837719 12765 parquet-column-readers.cc:959] Decompressed 27581 to 65526 I1212 11:08:59.877774 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 39344.9us I1212 11:08:59.946501 12765 parquet-column-readers.cc:959] Decompressed 27565 to 65537 I1212 11:09:00.008548 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 47437.5us I1212 11:09:00.053666 12765 parquet-column-readers.cc:959] Decompressed 27495 to 65527 I1212 11:09:00.114403 12765 parquet-column-readers.cc:959] Decompressed 12730 to 65544 I1212 11:09:00.114784 12765 parquet-column-readers.cc:959] Decompressed 38473 to 65544 I1212 11:09:00.168607 12765 parquet-column-readers.cc:959] Decompressed 27648 to 65533 I1212 11:09:00.205585 12765 parquet-column-readers.cc:959] Decompressed 56979 to 65540 I1212 11:09:00.242138 12765 parquet-column-readers.cc:959] Decompressed 27528 to 65530 I1212 11:09:00.312319 12765 parquet-column-readers.cc:959] Decompressed 27553 to 65505 I1212 11:09:00.381057 12765 parquet-column-readers.cc:959] Decompressed 27775 to 65522 I1212 11:09:00.417774 12765 parquet-column-readers.cc:959] Decompressed 12834 to 65544 I1212 11:09:00.417999 12765 parquet-column-readers.cc:959] Decompressed 38534 to 65544 I1212 11:09:00.454042 12765 parquet-column-readers.cc:959] Decompressed 27624 to 65513 I1212 11:09:00.554611 12765 parquet-column-readers.cc:959] Decompressed 57038 to 65540 I1212 11:09:00.555727 12765 parquet-column-readers.cc:959] Decompressed 27567 to 65529 I1212 11:09:00.622445 12765 parquet-column-readers.cc:959] Decompressed 27467 to 65522 I1212 11:09:00.689105 12765 parquet-column-readers.cc:959] Decompressed 12882 to 65544 I1212 11:09:00.689323 12765 parquet-column-readers.cc:959] Decompressed 38474 to 65544 I1212 11:09:00.690958 12765 parquet-column-readers.cc:959] Decompressed 27465 to 65532 I1212 11:09:00.758092 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:00.759480 12765 parquet-column-readers.cc:959] Decompressed 27679 to 65519 I1212 11:09:00.842727 12765 parquet-column-readers.cc:959] Decompressed 27715 to 65523 I1212 11:09:00.924494 12765 parquet-column-readers.cc:959] Decompressed 27563 to 65525 I1212 11:09:00.960821 12765 parquet-column-readers.cc:959] Decompressed 57051 to 65540 I1212 11:09:01.027607 12765 parquet-column-readers.cc:959] Decompressed 12922 to 65544 I1212 11:09:01.027988 12765 parquet-column-readers.cc:959] Decompressed 38507 to 65544 I1212 11:09:01.030896 12765 parquet-column-readers.cc:959] Decompressed 27602 to 65519 I1212 11:09:01.067862 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 41423.2us I1212 11:09:01.114436 12765 parquet-column-readers.cc:959] Decompressed 27502 to 65527 I1212 11:09:01.149340 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 30302.6us I1212 11:09:01.185340 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 35764us I1212 11:09:01.217399 12765 parquet-column-readers.cc:959] Decompressed 27565 to 65522 I1212 11:09:01.304004 12765 parquet-column-readers.cc:959] Decompressed 27729 to 65526 I1212 11:09:01.304286 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000001 I1212 11:09:01.304296 3769 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000001 done=false I1212 11:09:01.304304 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000001 status=0 done=false I1212 11:09:01.304688 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 403.349ms 439.112ms 884.74K 6.00M 94.53 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:01.305127 3769 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000001 Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(500.000ms): 47.95 MB, 112.52 MB, 113.27 MB, 113.83 MB, 113.91 MB, 114.03 MB, 114.10 MB, 113.97 MB, 113.78 MB, 114.07 MB, 114.07 MB, 114.26 MB, 114.26 MB, 114.45 MB, 114.35 MB, 114.22 MB, 114.22 MB, 114.16 MB, 114.59 MB, 114.47 MB, 114.53 MB, 113.91 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.41 MB, 114.35 MB, 114.41 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.66 MB (120226209) - PerHostPeakMemUsage: 114.66 MB (120226209) - RowsProduced: 346.11K (346112) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.732ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 403.726ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 13s521ms, non-child: 13s521ms, % non-child: 100.00%) - KuduApplyTimer: 11s355ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.52 K/sec - TotalNumRows: 345.09K (345088) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 404.667ms, non-child: 404.667ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 17.04 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 38.071ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.53 MB (99122698) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 388.10K (388096) - RowsReturned: 346.11K (346112) - RowsReturnedRate: 855.30 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 4.92 MB/sec I1212 11:09:01.306717 3769 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.74 MB (116123758) - PerHostPeakMemUsage: 110.74 MB (116123758) - RowsProduced: 294.91K (294912) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.354ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 402.338ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 11s528ms, non-child: 11s528ms, % non-child: 100.00%) - KuduApplyTimer: 9s745ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.49 K/sec - TotalNumRows: 293.89K (293888) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 403.349ms, non-child: 403.349ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 27.821ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.60 MB (94998376) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 336.90K (336896) - RowsReturned: 294.91K (294912) - RowsReturnedRate: 738.50 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 5.49 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(500.000ms): 51.01 MB, 112.78 MB, 113.40 MB, 113.77 MB, 113.98 MB, 113.98 MB, 114.04 MB, 114.04 MB, 114.08 MB, 114.14 MB, 114.08 MB, 114.27 MB, 114.33 MB, 114.45 MB, 114.35 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.54 MB, 114.47 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.66 MB (120232026) - PerHostPeakMemUsage: 114.66 MB (120232026) - RowsProduced: 243.71K (243712) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.241ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 437.841ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 9s497ms, non-child: 9s497ms, % non-child: 100.00%) - KuduApplyTimer: 8s055ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.55 K/sec - TotalNumRows: 242.69K (242688) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 439.112ms, non-child: 439.112ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 25.07 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 20.864ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.47 MB (99062920) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 285.70K (285696) - RowsReturned: 243.71K (243712) - RowsReturnedRate: 555.01 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 6.92 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(500.000ms): 98.86 MB, 101.15 MB, 101.84 MB, 102.03 MB, 102.23 MB, 102.29 MB, 102.23 MB, 102.29 MB, 102.33 MB, 102.33 MB, 102.33 MB, 102.52 MB, 102.58 MB, 102.73 MB, 102.42 MB, 102.54 MB, 102.42 MB, 102.42 MB, 102.73 MB, 102.73 MB, 102.73 MB, 102.42 MB, 102.42 MB, 102.42 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 102.91 MB (107913039) - PerHostPeakMemUsage: 102.91 MB (107913039) - RowsProduced: 294.91K (294912) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.089ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 365.445ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 11s566ms, non-child: 11s566ms, % non-child: 100.00%) - KuduApplyTimer: 9s826ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.41 K/sec - TotalNumRows: 293.89K (293888) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 366.267ms, non-child: 366.267ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 24.529ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 82.79 MB (86809510) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 336.90K (336896) - RowsReturned: 294.91K (294912) - RowsReturnedRate: 805.18 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 4.65 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(500.000ms): 47.95 MB, 112.52 MB, 113.27 MB, 113.83 MB, 113.91 MB, 114.03 MB, 114.10 MB, 113.97 MB, 113.78 MB, 114.07 MB, 114.07 MB, 114.26 MB, 114.26 MB, 114.45 MB, 114.35 MB, 114.22 MB, 114.22 MB, 114.16 MB, 114.59 MB, 114.47 MB, 114.53 MB, 113.91 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.41 MB, 114.35 MB, 114.41 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.66 MB (120226209) - PerHostPeakMemUsage: 114.66 MB (120226209) - RowsProduced: 346.11K (346112) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.732ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 403.726ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 13s521ms, non-child: 13s521ms, % non-child: 100.00%) - KuduApplyTimer: 11s355ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.52 K/sec - TotalNumRows: 345.09K (345088) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 404.667ms, non-child: 404.667ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 17.04 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 38.071ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.53 MB (99122698) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 388.10K (388096) - RowsReturned: 346.11K (346112) - RowsReturnedRate: 855.30 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 4.92 MB/sec I1212 11:09:01.392837 12765 parquet-column-readers.cc:959] Decompressed 12730 to 65544 I1212 11:09:01.393247 12765 parquet-column-readers.cc:959] Decompressed 38558 to 65544 I1212 11:09:01.432373 12765 parquet-column-readers.cc:959] Decompressed 27424 to 65505 I1212 11:09:01.466895 12765 parquet-column-readers.cc:959] Decompressed 57030 to 65540 I1212 11:09:01.467059 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:01.467334 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:01.505018 12765 parquet-column-readers.cc:959] Decompressed 27589 to 65522 I1212 11:09:01.539908 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:01.540199 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:01.540472 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:01.578074 12765 parquet-column-readers.cc:959] Decompressed 27591 to 65529 I1212 11:09:01.646556 12765 parquet-column-readers.cc:959] Decompressed 27557 to 65540 I1212 11:09:01.677834 12765 parquet-column-readers.cc:959] Decompressed 12937 to 65544 I1212 11:09:01.678210 12765 parquet-column-readers.cc:959] Decompressed 38530 to 65544 I1212 11:09:01.715075 12765 parquet-column-readers.cc:959] Decompressed 27546 to 65543 I1212 11:09:01.783148 12765 parquet-column-readers.cc:959] Decompressed 27559 to 65531 I1212 11:09:01.815711 12765 parquet-column-readers.cc:959] Decompressed 57043 to 65540 I1212 11:09:01.851822 12765 parquet-column-readers.cc:959] Decompressed 27664 to 65527 I1212 11:09:01.920701 12765 parquet-column-readers.cc:959] Decompressed 27604 to 65535 I1212 11:09:01.952198 12765 parquet-column-readers.cc:959] Decompressed 12883 to 65544 I1212 11:09:01.952652 12765 parquet-column-readers.cc:959] Decompressed 38451 to 65544 I1212 11:09:01.991403 12765 parquet-column-readers.cc:959] Decompressed 27555 to 65543 I1212 11:09:02.084524 12765 parquet-column-readers.cc:959] Decompressed 27666 to 65518 I1212 11:09:02.171435 12765 parquet-column-readers.cc:959] Decompressed 27487 to 65517 I1212 11:09:02.221163 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:02.245862 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 44495.5us I1212 11:09:02.271064 12765 parquet-column-readers.cc:959] Decompressed 56983 to 65540 I1212 11:09:02.306622 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:09:02.306648 3766 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000000 done=false I1212 11:09:02.306668 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000000 status=0 done=false I1212 11:09:02.307262 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 420.871ms 491.678ms 1.01M 6.00M 94.54 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:02.307729 3766 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000000 Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(500.000ms): 51.01 MB, 112.78 MB, 113.40 MB, 113.77 MB, 113.98 MB, 113.98 MB, 114.04 MB, 114.04 MB, 114.08 MB, 114.14 MB, 114.08 MB, 114.27 MB, 114.33 MB, 114.45 MB, 114.35 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.54 MB, 114.47 MB, 114.54 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.35 MB, 114.29 MB, 114.41 MB, 114.10 MB, 114.41 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.66 MB (120232026) - PerHostPeakMemUsage: 114.66 MB (120232026) - RowsProduced: 368.64K (368640) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.241ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 490.796ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 14s409ms, non-child: 14s409ms, % non-child: 100.00%) - KuduApplyTimer: 12s237ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.51 K/sec - TotalNumRows: 367.62K (367616) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 491.678ms, non-child: 491.678ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 25.07 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 30.366ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99128495) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 410.62K (410624) - RowsReturned: 368.64K (368640) - RowsReturnedRate: 749.76 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 4.61 MB/sec I1212 11:09:02.309309 3766 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.74 MB (116123758) - PerHostPeakMemUsage: 110.74 MB (116123758) - RowsProduced: 336.55K (336554) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.354ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 419.989ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 13s165ms, non-child: 13s165ms, % non-child: 100.00%) - KuduApplyTimer: 11s139ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.48 K/sec - TotalNumRows: 335.53K (335530) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 420.871ms, non-child: 420.871ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 30.989ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.62 MB (95020234) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 378.54K (378538) - RowsReturned: 336.55K (336554) - RowsReturnedRate: 803.41 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 4.73 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(500.000ms): 51.01 MB, 112.78 MB, 113.40 MB, 113.77 MB, 113.98 MB, 113.98 MB, 114.04 MB, 114.04 MB, 114.08 MB, 114.14 MB, 114.08 MB, 114.27 MB, 114.33 MB, 114.45 MB, 114.35 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.54 MB, 114.47 MB, 114.54 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.35 MB, 114.29 MB, 114.41 MB, 114.10 MB, 114.41 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.66 MB (120232026) - PerHostPeakMemUsage: 114.66 MB (120232026) - RowsProduced: 368.64K (368640) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.241ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 490.796ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 14s409ms, non-child: 14s409ms, % non-child: 100.00%) - KuduApplyTimer: 12s237ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.51 K/sec - TotalNumRows: 367.62K (367616) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 491.678ms, non-child: 491.678ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 25.07 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 30.366ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99128495) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 410.62K (410624) - RowsReturned: 368.64K (368640) - RowsReturnedRate: 749.76 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 4.61 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(500.000ms): 98.86 MB, 101.15 MB, 101.84 MB, 102.03 MB, 102.23 MB, 102.29 MB, 102.23 MB, 102.29 MB, 102.33 MB, 102.33 MB, 102.33 MB, 102.52 MB, 102.58 MB, 102.73 MB, 102.42 MB, 102.54 MB, 102.42 MB, 102.42 MB, 102.73 MB, 102.73 MB, 102.73 MB, 102.42 MB, 102.42 MB, 102.42 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 102.91 MB (107913039) - PerHostPeakMemUsage: 102.91 MB (107913039) - RowsProduced: 294.91K (294912) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.089ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 365.445ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 11s566ms, non-child: 11s566ms, % non-child: 100.00%) - KuduApplyTimer: 9s826ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.41 K/sec - TotalNumRows: 293.89K (293888) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 366.267ms, non-child: 366.267ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 24.529ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 82.79 MB (86809510) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 336.90K (336896) - RowsReturned: 294.91K (294912) - RowsReturnedRate: 805.18 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 4.65 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(500.000ms): 47.95 MB, 112.52 MB, 113.27 MB, 113.83 MB, 113.91 MB, 114.03 MB, 114.10 MB, 113.97 MB, 113.78 MB, 114.07 MB, 114.07 MB, 114.26 MB, 114.26 MB, 114.45 MB, 114.35 MB, 114.22 MB, 114.22 MB, 114.16 MB, 114.59 MB, 114.47 MB, 114.53 MB, 113.91 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.41 MB, 114.35 MB, 114.41 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.66 MB (120226209) - PerHostPeakMemUsage: 114.66 MB (120226209) - RowsProduced: 346.11K (346112) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.732ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 403.726ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 13s521ms, non-child: 13s521ms, % non-child: 100.00%) - KuduApplyTimer: 11s355ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.52 K/sec - TotalNumRows: 345.09K (345088) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 404.667ms, non-child: 404.667ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 17.04 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 38.071ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.53 MB (99122698) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 388.10K (388096) - RowsReturned: 346.11K (346112) - RowsReturnedRate: 855.30 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 4.92 MB/sec I1212 11:09:02.324733 12765 parquet-column-readers.cc:959] Decompressed 12684 to 65544 I1212 11:09:02.325117 12765 parquet-column-readers.cc:959] Decompressed 38603 to 65544 I1212 11:09:02.327929 12765 parquet-column-readers.cc:959] Decompressed 27698 to 65526 I1212 11:09:02.343003 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 48604.8us I1212 11:09:02.429630 12765 parquet-column-readers.cc:959] Decompressed 27544 to 65532 I1212 11:09:02.545400 12765 parquet-column-readers.cc:959] Decompressed 27572 to 65538 I1212 11:09:02.617864 12765 parquet-column-readers.cc:959] Decompressed 27605 to 65531 I1212 11:09:02.684572 12765 parquet-column-readers.cc:959] Decompressed 12717 to 65544 I1212 11:09:02.684818 12765 parquet-column-readers.cc:959] Decompressed 38493 to 65544 I1212 11:09:02.686210 12765 parquet-column-readers.cc:959] Decompressed 27374 to 65519 I1212 11:09:02.753481 12765 parquet-column-readers.cc:959] Decompressed 57000 to 65540 I1212 11:09:02.754616 12765 parquet-column-readers.cc:959] Decompressed 27473 to 65525 I1212 11:09:02.820407 12765 parquet-column-readers.cc:959] Decompressed 27579 to 65515 I1212 11:09:02.886909 12765 parquet-column-readers.cc:959] Decompressed 27577 to 65531 I1212 11:09:02.949770 12765 parquet-column-readers.cc:959] Decompressed 12786 to 65544 I1212 11:09:02.950143 12765 parquet-column-readers.cc:959] Decompressed 38470 to 65544 I1212 11:09:02.952957 12765 parquet-column-readers.cc:959] Decompressed 27592 to 65526 I1212 11:09:03.019780 12765 parquet-column-readers.cc:959] Decompressed 27588 to 65507 I1212 11:09:03.083623 12765 parquet-column-readers.cc:959] Decompressed 56995 to 65540 I1212 11:09:03.118357 12765 parquet-column-readers.cc:959] Decompressed 27497 to 65518 I1212 11:09:03.148905 12765 parquet-column-readers.cc:959] Decompressed 65516 to 65510 I1212 11:09:03.150254 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:03.150553 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:03.150867 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:03.190354 12765 parquet-column-readers.cc:959] Decompressed 27687 to 65518 I1212 11:09:03.225512 12765 parquet-column-readers.cc:959] Decompressed 12704 to 65544 I1212 11:09:03.225885 12765 parquet-column-readers.cc:959] Decompressed 38546 to 65544 I1212 11:09:03.272312 12765 parquet-column-readers.cc:959] Decompressed 27272 to 65540 I1212 11:09:03.362179 12765 parquet-column-readers.cc:959] Decompressed 27567 to 65527 I1212 11:09:03.425305 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 33354.4us I1212 11:09:03.477613 12765 parquet-column-readers.cc:959] Decompressed 27473 to 65542 I1212 11:09:03.490437 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 31719.7us I1212 11:09:03.574815 12765 parquet-column-readers.cc:959] Decompressed 57072 to 65540 I1212 11:09:03.575906 12765 parquet-column-readers.cc:959] Decompressed 27667 to 65542 I1212 11:09:03.583194 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 39580.8us I1212 11:09:03.611685 12765 parquet-column-readers.cc:959] Decompressed 12807 to 65544 I1212 11:09:03.612040 12765 parquet-column-readers.cc:959] Decompressed 38512 to 65544 I1212 11:09:03.662421 12765 parquet-column-readers.cc:959] Decompressed 27641 to 65530 I1212 11:09:03.775044 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:03.777786 12765 parquet-column-readers.cc:959] Decompressed 27498 to 65534 I1212 11:09:03.860450 12765 parquet-column-readers.cc:959] Decompressed 27527 to 65530 I1212 11:09:03.932183 12765 parquet-column-readers.cc:959] Decompressed 27722 to 65536 I1212 11:09:03.967929 12765 parquet-column-readers.cc:959] Decompressed 12824 to 65544 I1212 11:09:03.968140 12765 parquet-column-readers.cc:959] Decompressed 38537 to 65544 I1212 11:09:04.004534 12765 parquet-column-readers.cc:959] Decompressed 27804 to 65536 I1212 11:09:04.038293 12765 parquet-column-readers.cc:959] Decompressed 57035 to 65540 I1212 11:09:04.108155 12765 parquet-column-readers.cc:959] Decompressed 27794 to 65516 I1212 11:09:04.178198 12765 parquet-column-readers.cc:959] Decompressed 27377 to 65511 I1212 11:09:04.246671 12765 parquet-column-readers.cc:959] Decompressed 12895 to 65544 I1212 11:09:04.246883 12765 parquet-column-readers.cc:959] Decompressed 38517 to 65544 I1212 11:09:04.248239 12765 parquet-column-readers.cc:959] Decompressed 27568 to 65529 I1212 11:09:04.304589 12731 plan-fragment-executor.cc:408] Reporting profile for instance 25407d49fc4cde6f:d575dd6200000002 I1212 11:09:04.304913 12731 plan-fragment-executor.cc:412] Fragment 25407d49fc4cde6f:d575dd6200000002:(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(500.000ms): 98.86 MB, 101.15 MB, 101.84 MB, 102.03 MB, 102.23 MB, 102.29 MB, 102.23 MB, 102.29 MB, 102.33 MB, 102.33 MB, 102.33 MB, 102.52 MB, 102.58 MB, 102.73 MB, 102.42 MB, 102.54 MB, 102.42 MB, 102.42 MB, 102.73 MB, 102.73 MB, 102.73 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.67 MB, 102.60 MB, 102.73 MB, 102.60 MB, 102.54 MB, 102.54 MB, 102.54 MB, 102.60 MB, 102.48 MB, 102.60 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 102.91 MB (107913039) - PerHostPeakMemUsage: 102.91 MB (107913039) - RowsProduced: 421.89K (421888) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.089ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 375.364ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 16s546ms, non-child: 0.000ns, % non-child: 0.00%) - KuduApplyTimer: 14s042ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.43 K/sec - TotalNumRows: 420.86K (420864) CodeGen:(Total: 85.001ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 375.801ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 34.289ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 82.79 MB (86809510) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 463.87K (463872) - RowsReturned: 421.89K (421888) - RowsReturnedRate: 1.12 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 3.28 MB/sec I1212 11:09:04.360857 12731 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:09:04.360882 12731 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:09:04.361451 3396 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000002 I1212 11:09:04.361462 3396 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000002 done=false I1212 11:09:04.361469 3396 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000002 status=0 done=false I1212 11:09:04.318193 12765 parquet-column-readers.cc:959] Decompressed 27700 to 65529 I1212 11:09:04.361899 3396 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 424.057ms 491.678ms 1.14M 6.00M 94.54 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:04.362409 3396 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000002 Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(500.000ms): 98.86 MB, 101.15 MB, 101.84 MB, 102.03 MB, 102.23 MB, 102.29 MB, 102.23 MB, 102.29 MB, 102.33 MB, 102.33 MB, 102.33 MB, 102.52 MB, 102.58 MB, 102.73 MB, 102.42 MB, 102.54 MB, 102.42 MB, 102.42 MB, 102.73 MB, 102.73 MB, 102.73 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.67 MB, 102.60 MB, 102.73 MB, 102.60 MB, 102.54 MB, 102.54 MB, 102.54 MB, 102.60 MB, 102.48 MB, 102.60 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 102.91 MB (107913039) - PerHostPeakMemUsage: 102.91 MB (107913039) - RowsProduced: 423.94K (423936) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.089ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 375.395ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 16s617ms, non-child: 16s617ms, % non-child: 100.00%) - KuduApplyTimer: 14s104ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.45 K/sec - TotalNumRows: 422.91K (422912) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 375.826ms, non-child: 375.826ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 34.289ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 82.79 MB (86809510) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 463.87K (463872) - RowsReturned: 423.94K (423936) - RowsReturnedRate: 1.13 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 3.28 MB/sec I1212 11:09:04.364086 3396 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.74 MB (116123758) - PerHostPeakMemUsage: 110.74 MB (116123758) - RowsProduced: 379.56K (379562) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.354ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 423.306ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 14s849ms, non-child: 14s849ms, % non-child: 100.00%) - KuduApplyTimer: 12s565ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.49 K/sec - TotalNumRows: 378.54K (378538) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 424.057ms, non-child: 424.057ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 34.242ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.62 MB (95020234) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 420.86K (420864) - RowsReturned: 379.56K (379562) - RowsReturnedRate: 911.02 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 4.27 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(500.000ms): 51.01 MB, 112.78 MB, 113.40 MB, 113.77 MB, 113.98 MB, 113.98 MB, 114.04 MB, 114.04 MB, 114.08 MB, 114.14 MB, 114.08 MB, 114.27 MB, 114.33 MB, 114.45 MB, 114.35 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.54 MB, 114.47 MB, 114.54 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.35 MB, 114.29 MB, 114.41 MB, 114.10 MB, 114.41 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.66 MB (120232026) - PerHostPeakMemUsage: 114.66 MB (120232026) - RowsProduced: 368.64K (368640) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.241ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 490.796ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 14s409ms, non-child: 14s409ms, % non-child: 100.00%) - KuduApplyTimer: 12s237ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.51 K/sec - TotalNumRows: 367.62K (367616) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 491.678ms, non-child: 491.678ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 25.07 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 30.366ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99128495) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 410.62K (410624) - RowsReturned: 368.64K (368640) - RowsReturnedRate: 749.76 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 4.61 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(500.000ms): 98.86 MB, 101.15 MB, 101.84 MB, 102.03 MB, 102.23 MB, 102.29 MB, 102.23 MB, 102.29 MB, 102.33 MB, 102.33 MB, 102.33 MB, 102.52 MB, 102.58 MB, 102.73 MB, 102.42 MB, 102.54 MB, 102.42 MB, 102.42 MB, 102.73 MB, 102.73 MB, 102.73 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.67 MB, 102.60 MB, 102.73 MB, 102.60 MB, 102.54 MB, 102.54 MB, 102.54 MB, 102.60 MB, 102.48 MB, 102.60 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 102.91 MB (107913039) - PerHostPeakMemUsage: 102.91 MB (107913039) - RowsProduced: 423.94K (423936) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.089ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 375.395ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 16s617ms, non-child: 16s617ms, % non-child: 100.00%) - KuduApplyTimer: 14s104ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.45 K/sec - TotalNumRows: 422.91K (422912) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 375.826ms, non-child: 375.826ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 34.289ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 82.79 MB (86809510) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 463.87K (463872) - RowsReturned: 423.94K (423936) - RowsReturnedRate: 1.13 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 3.28 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(500.000ms): 47.95 MB, 112.52 MB, 113.27 MB, 113.83 MB, 113.91 MB, 114.03 MB, 114.10 MB, 113.97 MB, 113.78 MB, 114.07 MB, 114.07 MB, 114.26 MB, 114.26 MB, 114.45 MB, 114.35 MB, 114.22 MB, 114.22 MB, 114.16 MB, 114.59 MB, 114.47 MB, 114.53 MB, 113.91 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.41 MB, 114.35 MB, 114.41 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.66 MB (120226209) - PerHostPeakMemUsage: 114.66 MB (120226209) - RowsProduced: 346.11K (346112) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.732ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 403.726ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 13s521ms, non-child: 13s521ms, % non-child: 100.00%) - KuduApplyTimer: 11s355ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.52 K/sec - TotalNumRows: 345.09K (345088) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 404.667ms, non-child: 404.667ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 17.04 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 38.071ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.53 MB (99122698) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 388.10K (388096) - RowsReturned: 346.11K (346112) - RowsReturnedRate: 855.30 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 4.92 MB/sec I1212 11:09:04.364341 12731 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:09:04.398382 12765 parquet-column-readers.cc:959] Decompressed 57010 to 65540 I1212 11:09:04.400475 12765 parquet-column-readers.cc:959] Decompressed 27484 to 65508 I1212 11:09:04.475858 12765 parquet-column-readers.cc:959] Decompressed 27590 to 65535 I1212 11:09:04.548599 12765 parquet-column-readers.cc:959] Decompressed 12718 to 65544 I1212 11:09:04.549008 12765 parquet-column-readers.cc:959] Decompressed 38469 to 65544 I1212 11:09:04.551995 12765 parquet-column-readers.cc:959] Decompressed 27492 to 65516 I1212 11:09:04.655110 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 40304.2us I1212 11:09:04.664736 12765 parquet-column-readers.cc:959] Decompressed 27629 to 65536 I1212 11:09:04.763484 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 37989.2us I1212 11:09:04.793423 12765 parquet-column-readers.cc:959] Decompressed 27532 to 65535 I1212 11:09:04.802945 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 39135.2us I1212 11:09:04.907979 12765 parquet-column-readers.cc:959] Decompressed 27357 to 65538 I1212 11:09:04.964102 12765 parquet-column-readers.cc:959] Decompressed 57010 to 65540 I1212 11:09:05.021085 12765 parquet-column-readers.cc:959] Decompressed 12817 to 65544 I1212 11:09:05.021323 12765 parquet-column-readers.cc:959] Decompressed 38508 to 65544 I1212 11:09:05.078210 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:05.078366 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:05.078510 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:05.078881 12765 parquet-column-readers.cc:959] Decompressed 27560 to 65505 I1212 11:09:05.160815 12765 parquet-column-readers.cc:959] Decompressed 27479 to 65517 I1212 11:09:05.229419 12765 parquet-column-readers.cc:959] Decompressed 27678 to 65534 I1212 11:09:05.296409 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:05.297684 12765 parquet-column-readers.cc:959] Decompressed 27646 to 65534 I1212 11:09:05.329119 12765 parquet-column-readers.cc:959] Decompressed 12903 to 65544 I1212 11:09:05.329340 12765 parquet-column-readers.cc:959] Decompressed 38576 to 65544 I1212 11:09:05.363255 12765 parquet-column-readers.cc:959] Decompressed 27554 to 65530 I1212 11:09:05.396024 12765 parquet-column-readers.cc:959] Decompressed 57001 to 65540 I1212 11:09:05.430985 12765 parquet-column-readers.cc:959] Decompressed 27339 to 65531 I1212 11:09:05.499691 12765 parquet-column-readers.cc:959] Decompressed 27590 to 65509 I1212 11:09:05.585260 12765 parquet-column-readers.cc:959] Decompressed 27505 to 65542 I1212 11:09:05.625880 12765 parquet-column-readers.cc:959] Decompressed 13048 to 65544 I1212 11:09:05.626250 12765 parquet-column-readers.cc:959] Decompressed 38485 to 65544 I1212 11:09:05.684175 12765 parquet-column-readers.cc:959] Decompressed 27536 to 65525 I1212 11:09:05.788317 12765 parquet-column-readers.cc:959] Decompressed 27572 to 65536 I1212 11:09:05.833034 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 38092.9us I1212 11:09:05.840075 12765 parquet-column-readers.cc:959] Decompressed 57110 to 65540 I1212 11:09:05.900817 12765 parquet-column-readers.cc:959] Decompressed 27510 to 65530 I1212 11:09:05.920090 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 38973.3us I1212 11:09:06.033681 12765 parquet-column-readers.cc:959] Decompressed 12827 to 65544 I1212 11:09:06.034071 12765 parquet-column-readers.cc:959] Decompressed 38524 to 65544 I1212 11:09:06.036859 12765 parquet-column-readers.cc:959] Decompressed 27628 to 65540 I1212 11:09:06.136256 12765 parquet-column-readers.cc:959] Decompressed 27627 to 65523 I1212 11:09:06.206833 12765 parquet-column-readers.cc:959] Decompressed 27672 to 65542 I1212 11:09:06.277529 12765 parquet-column-readers.cc:959] Decompressed 27658 to 65523 I1212 11:09:06.307664 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000001 I1212 11:09:06.307673 3769 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000001 done=false I1212 11:09:06.307680 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000001 status=0 done=false I1212 11:09:06.307991 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 429.046ms 491.678ms 1.26M 6.00M 94.54 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:06.308349 3769 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000001 Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(500.000ms): 47.95 MB, 112.52 MB, 113.27 MB, 113.83 MB, 113.91 MB, 114.03 MB, 114.10 MB, 113.97 MB, 113.78 MB, 114.07 MB, 114.07 MB, 114.26 MB, 114.26 MB, 114.45 MB, 114.35 MB, 114.22 MB, 114.22 MB, 114.16 MB, 114.59 MB, 114.47 MB, 114.53 MB, 113.91 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.41 MB, 114.35 MB, 114.41 MB, 114.28 MB, 114.28 MB, 114.28 MB, 114.35 MB, 114.22 MB, 114.28 MB, 114.17 MB, 114.03 MB, 114.16 MB, 114.16 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.66 MB (120226209) - PerHostPeakMemUsage: 114.66 MB (120226209) - RowsProduced: 471.04K (471040) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.732ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 419.107ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 18s497ms, non-child: 18s497ms, % non-child: 100.00%) - KuduApplyTimer: 15s569ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.41 K/sec - TotalNumRows: 470.02K (470016) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 419.633ms, non-child: 419.633ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 17.04 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 47.442ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.53 MB (99122698) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 513.02K (513024) - RowsReturned: 471.04K (471040) - RowsReturnedRate: 1.12 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 3.63 MB/sec I1212 11:09:06.309388 3769 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.74 MB (116123758) - PerHostPeakMemUsage: 110.74 MB (116123758) - RowsProduced: 421.20K (421205) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.354ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 428.433ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 16s508ms, non-child: 16s508ms, % non-child: 100.00%) - KuduApplyTimer: 13s970ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.46 K/sec - TotalNumRows: 420.18K (420181) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 429.046ms, non-child: 429.046ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 37.366ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.62 MB (95020234) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 462.51K (462506) - RowsReturned: 421.20K (421205) - RowsReturnedRate: 1.00 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 3.84 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(500.000ms): 51.01 MB, 112.78 MB, 113.40 MB, 113.77 MB, 113.98 MB, 113.98 MB, 114.04 MB, 114.04 MB, 114.08 MB, 114.14 MB, 114.08 MB, 114.27 MB, 114.33 MB, 114.45 MB, 114.35 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.54 MB, 114.47 MB, 114.54 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.35 MB, 114.29 MB, 114.41 MB, 114.10 MB, 114.41 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.66 MB (120232026) - PerHostPeakMemUsage: 114.66 MB (120232026) - RowsProduced: 368.64K (368640) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.241ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 490.796ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 14s409ms, non-child: 14s409ms, % non-child: 100.00%) - KuduApplyTimer: 12s237ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.51 K/sec - TotalNumRows: 367.62K (367616) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 491.678ms, non-child: 491.678ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 25.07 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 30.366ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99128495) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 410.62K (410624) - RowsReturned: 368.64K (368640) - RowsReturnedRate: 749.76 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 4.61 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(500.000ms): 98.86 MB, 101.15 MB, 101.84 MB, 102.03 MB, 102.23 MB, 102.29 MB, 102.23 MB, 102.29 MB, 102.33 MB, 102.33 MB, 102.33 MB, 102.52 MB, 102.58 MB, 102.73 MB, 102.42 MB, 102.54 MB, 102.42 MB, 102.42 MB, 102.73 MB, 102.73 MB, 102.73 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.67 MB, 102.60 MB, 102.73 MB, 102.60 MB, 102.54 MB, 102.54 MB, 102.54 MB, 102.60 MB, 102.48 MB, 102.60 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 102.91 MB (107913039) - PerHostPeakMemUsage: 102.91 MB (107913039) - RowsProduced: 423.94K (423936) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.089ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 375.395ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 16s617ms, non-child: 16s617ms, % non-child: 100.00%) - KuduApplyTimer: 14s104ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.45 K/sec - TotalNumRows: 422.91K (422912) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 375.826ms, non-child: 375.826ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 34.289ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 82.79 MB (86809510) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 463.87K (463872) - RowsReturned: 423.94K (423936) - RowsReturnedRate: 1.13 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 3.28 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(500.000ms): 47.95 MB, 112.52 MB, 113.27 MB, 113.83 MB, 113.91 MB, 114.03 MB, 114.10 MB, 113.97 MB, 113.78 MB, 114.07 MB, 114.07 MB, 114.26 MB, 114.26 MB, 114.45 MB, 114.35 MB, 114.22 MB, 114.22 MB, 114.16 MB, 114.59 MB, 114.47 MB, 114.53 MB, 113.91 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.41 MB, 114.35 MB, 114.41 MB, 114.28 MB, 114.28 MB, 114.28 MB, 114.35 MB, 114.22 MB, 114.28 MB, 114.17 MB, 114.03 MB, 114.16 MB, 114.16 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.66 MB (120226209) - PerHostPeakMemUsage: 114.66 MB (120226209) - RowsProduced: 471.04K (471040) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.732ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 419.107ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 18s497ms, non-child: 18s497ms, % non-child: 100.00%) - KuduApplyTimer: 15s569ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.41 K/sec - TotalNumRows: 470.02K (470016) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 419.633ms, non-child: 419.633ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 17.04 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 47.442ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.53 MB (99122698) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 513.02K (513024) - RowsReturned: 471.04K (471040) - RowsReturnedRate: 1.12 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 3.63 MB/sec I1212 11:09:06.311030 12765 parquet-column-readers.cc:959] Decompressed 57125 to 65540 I1212 11:09:06.345969 12765 parquet-column-readers.cc:959] Decompressed 12910 to 65544 I1212 11:09:06.346351 12765 parquet-column-readers.cc:959] Decompressed 38558 to 65544 I1212 11:09:06.349128 12765 parquet-column-readers.cc:959] Decompressed 27275 to 65534 I1212 11:09:06.418241 12765 parquet-column-readers.cc:959] Decompressed 27459 to 65533 I1212 11:09:06.488389 12765 parquet-column-readers.cc:959] Decompressed 27734 to 65536 I1212 11:09:06.522104 12765 parquet-column-readers.cc:959] Decompressed 75266 to 80902 I1212 11:09:06.558593 12765 parquet-column-readers.cc:959] Decompressed 27546 to 65532 I1212 11:09:06.625556 12765 parquet-column-readers.cc:959] Decompressed 12744 to 65544 I1212 11:09:06.625915 12765 parquet-column-readers.cc:959] Decompressed 38416 to 65544 I1212 11:09:06.628720 12765 parquet-column-readers.cc:959] Decompressed 27505 to 65532 I1212 11:09:06.660804 12765 parquet-column-readers.cc:959] Decompressed 41617 to 65454 I1212 11:09:06.661689 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:06.661938 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:06.662173 12765 parquet-column-readers.cc:959] Decompressed 62855 to 63455 I1212 11:09:06.663311 12765 parquet-column-readers.cc:959] Decompressed 65562 to 65555 I1212 11:09:06.663676 12765 parquet-column-readers.cc:959] Decompressed 65460 to 65454 I1212 11:09:06.695956 12765 parquet-column-readers.cc:959] Decompressed 57014 to 65540 I1212 11:09:06.699093 12765 parquet-column-readers.cc:959] Decompressed 27654 to 65528 I1212 11:09:06.737512 12765 parquet-column-readers.cc:959] Decompressed 65516 to 65510 I1212 11:09:06.738893 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:06.739184 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:06.739464 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:06.793123 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:06.795853 12765 parquet-column-readers.cc:959] Decompressed 27472 to 65506 I1212 11:09:06.930938 12765 parquet-column-readers.cc:959] Decompressed 27628 to 65540 I1212 11:09:06.980281 12765 parquet-column-readers.cc:959] Decompressed 12896 to 65544 I1212 11:09:06.980650 12765 parquet-column-readers.cc:959] Decompressed 38528 to 65544 I1212 11:09:07.040293 12765 parquet-column-readers.cc:959] Decompressed 27612 to 65506 I1212 11:09:07.077692 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 42347.7us I1212 11:09:07.157121 12765 parquet-column-readers.cc:959] Decompressed 27645 to 65533 I1212 11:09:07.190691 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 43159.9us I1212 11:09:07.200727 12765 parquet-column-readers.cc:959] Decompressed 57088 to 65540 I1212 11:09:07.248648 12765 parquet-column-readers.cc:959] Decompressed 27296 to 65528 I1212 11:09:07.311213 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:09:07.311224 3766 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000000 done=false I1212 11:09:07.311233 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000000 status=0 done=false I1212 11:09:07.311640 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 438.844ms 521.071ms 1.38M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:07.312144 3766 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000000 Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(500.000ms): 51.01 MB, 112.78 MB, 113.40 MB, 113.77 MB, 113.98 MB, 113.98 MB, 114.04 MB, 114.04 MB, 114.08 MB, 114.14 MB, 114.08 MB, 114.27 MB, 114.33 MB, 114.45 MB, 114.35 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.54 MB, 114.47 MB, 114.54 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.35 MB, 114.29 MB, 114.41 MB, 114.10 MB, 114.41 MB, 114.41 MB, 114.29 MB, 114.35 MB, 114.29 MB, 114.23 MB, 114.23 MB, 114.29 MB, 114.10 MB, 114.23 MB, 114.74 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 489.47K (489472) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.241ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 520.624ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 19s396ms, non-child: 19s396ms, % non-child: 100.00%) - KuduApplyTimer: 16s454ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.18 K/sec - TotalNumRows: 488.45K (488448) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 521.071ms, non-child: 521.071ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 25.07 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 41.707ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 531.46K (531456) - RowsReturned: 489.47K (489472) - RowsReturnedRate: 939.36 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 3.46 MB/sec I1212 11:09:07.313902 3766 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.79 MB (116175351) - PerHostPeakMemUsage: 110.79 MB (116175351) - RowsProduced: 461.48K (461482) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.354ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 438.375ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 18s170ms, non-child: 18s170ms, % non-child: 100.00%) - KuduApplyTimer: 15s376ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.35 K/sec - TotalNumRows: 460.46K (460458) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 438.844ms, non-child: 438.844ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 41.146ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.71 MB (95112798) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 502.78K (502784) - RowsReturned: 461.48K (461482) - RowsReturnedRate: 1.06 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 3.45 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(500.000ms): 51.01 MB, 112.78 MB, 113.40 MB, 113.77 MB, 113.98 MB, 113.98 MB, 114.04 MB, 114.04 MB, 114.08 MB, 114.14 MB, 114.08 MB, 114.27 MB, 114.33 MB, 114.45 MB, 114.35 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.54 MB, 114.47 MB, 114.54 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.35 MB, 114.29 MB, 114.41 MB, 114.10 MB, 114.41 MB, 114.41 MB, 114.29 MB, 114.35 MB, 114.29 MB, 114.23 MB, 114.23 MB, 114.29 MB, 114.10 MB, 114.23 MB, 114.74 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 489.47K (489472) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.241ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 520.624ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 19s396ms, non-child: 19s396ms, % non-child: 100.00%) - KuduApplyTimer: 16s454ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.18 K/sec - TotalNumRows: 488.45K (488448) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 521.071ms, non-child: 521.071ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 25.07 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 41.707ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 531.46K (531456) - RowsReturned: 489.47K (489472) - RowsReturnedRate: 939.36 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 3.46 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(500.000ms): 98.86 MB, 101.15 MB, 101.84 MB, 102.03 MB, 102.23 MB, 102.29 MB, 102.23 MB, 102.29 MB, 102.33 MB, 102.33 MB, 102.33 MB, 102.52 MB, 102.58 MB, 102.73 MB, 102.42 MB, 102.54 MB, 102.42 MB, 102.42 MB, 102.73 MB, 102.73 MB, 102.73 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.67 MB, 102.60 MB, 102.73 MB, 102.60 MB, 102.54 MB, 102.54 MB, 102.54 MB, 102.60 MB, 102.48 MB, 102.60 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 102.91 MB (107913039) - PerHostPeakMemUsage: 102.91 MB (107913039) - RowsProduced: 423.94K (423936) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.089ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 375.395ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 16s617ms, non-child: 16s617ms, % non-child: 100.00%) - KuduApplyTimer: 14s104ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.45 K/sec - TotalNumRows: 422.91K (422912) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 375.826ms, non-child: 375.826ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 34.289ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 82.79 MB (86809510) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 463.87K (463872) - RowsReturned: 423.94K (423936) - RowsReturnedRate: 1.13 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 3.28 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(500.000ms): 47.95 MB, 112.52 MB, 113.27 MB, 113.83 MB, 113.91 MB, 114.03 MB, 114.10 MB, 113.97 MB, 113.78 MB, 114.07 MB, 114.07 MB, 114.26 MB, 114.26 MB, 114.45 MB, 114.35 MB, 114.22 MB, 114.22 MB, 114.16 MB, 114.59 MB, 114.47 MB, 114.53 MB, 113.91 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.41 MB, 114.35 MB, 114.41 MB, 114.28 MB, 114.28 MB, 114.28 MB, 114.35 MB, 114.22 MB, 114.28 MB, 114.17 MB, 114.03 MB, 114.16 MB, 114.16 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.66 MB (120226209) - PerHostPeakMemUsage: 114.66 MB (120226209) - RowsProduced: 471.04K (471040) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.732ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 419.107ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 18s497ms, non-child: 18s497ms, % non-child: 100.00%) - KuduApplyTimer: 15s569ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.41 K/sec - TotalNumRows: 470.02K (470016) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 419.633ms, non-child: 419.633ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 17.04 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 47.442ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.53 MB (99122698) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 513.02K (513024) - RowsReturned: 471.04K (471040) - RowsReturnedRate: 1.12 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 3.63 MB/sec I1212 11:09:07.330353 12765 parquet-column-readers.cc:959] Decompressed 27523 to 65536 I1212 11:09:07.363090 12765 parquet-column-readers.cc:959] Decompressed 12711 to 65544 I1212 11:09:07.363479 12765 parquet-column-readers.cc:959] Decompressed 38580 to 65544 I1212 11:09:07.400589 12765 parquet-column-readers.cc:959] Decompressed 27628 to 65512 I1212 11:09:07.468804 12765 parquet-column-readers.cc:959] Decompressed 27658 to 65500 I1212 11:09:07.537134 12765 parquet-column-readers.cc:959] Decompressed 27665 to 65536 I1212 11:09:07.600929 12765 parquet-column-readers.cc:959] Decompressed 57043 to 65540 I1212 11:09:07.603117 12765 parquet-column-readers.cc:959] Decompressed 27617 to 65515 I1212 11:09:07.632966 12765 parquet-column-readers.cc:959] Decompressed 12670 to 65544 I1212 11:09:07.633333 12765 parquet-column-readers.cc:959] Decompressed 38503 to 65544 I1212 11:09:07.670547 12765 parquet-column-readers.cc:959] Decompressed 27509 to 65511 I1212 11:09:07.771553 12765 parquet-column-readers.cc:959] Decompressed 27712 to 65527 I1212 11:09:07.838419 12765 parquet-column-readers.cc:959] Decompressed 27511 to 65530 I1212 11:09:07.903853 12765 parquet-column-readers.cc:959] Decompressed 12796 to 65544 I1212 11:09:07.904235 12765 parquet-column-readers.cc:959] Decompressed 38462 to 65544 I1212 11:09:07.906985 12765 parquet-column-readers.cc:959] Decompressed 27437 to 65535 I1212 11:09:08.008342 12765 parquet-column-readers.cc:959] Decompressed 57089 to 65540 I1212 11:09:08.010618 12765 parquet-column-readers.cc:959] Decompressed 27562 to 65540 I1212 11:09:08.112445 12765 parquet-column-readers.cc:959] Decompressed 27608 to 65529 I1212 11:09:08.209177 12765 parquet-column-readers.cc:959] Decompressed 27589 to 65531 I1212 11:09:08.242386 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 53192.4us I1212 11:09:08.282511 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 32928.7us I1212 11:09:08.284121 12765 parquet-column-readers.cc:959] Decompressed 12804 to 65544 I1212 11:09:08.284503 12765 parquet-column-readers.cc:959] Decompressed 38515 to 65544 I1212 11:09:08.284817 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:08.287431 12765 parquet-column-readers.cc:959] Decompressed 27960 to 65525 I1212 11:09:08.374611 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 42898.1us I1212 11:09:08.381078 12765 parquet-column-readers.cc:959] Decompressed 27640 to 65505 I1212 11:09:08.465872 12765 parquet-column-readers.cc:959] Decompressed 56987 to 65540 I1212 11:09:08.468142 12765 parquet-column-readers.cc:959] Decompressed 27575 to 65513 I1212 11:09:08.568255 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:08.568413 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:08.568562 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:08.568935 12765 parquet-column-readers.cc:959] Decompressed 27443 to 65536 I1212 11:09:08.633813 12765 parquet-column-readers.cc:959] Decompressed 12876 to 65544 I1212 11:09:08.634030 12765 parquet-column-readers.cc:959] Decompressed 38505 to 65544 I1212 11:09:08.635434 12765 parquet-column-readers.cc:959] Decompressed 27463 to 65518 I1212 11:09:08.738107 12765 parquet-column-readers.cc:959] Decompressed 27503 to 65530 I1212 11:09:08.804877 12765 parquet-column-readers.cc:959] Decompressed 27527 to 65510 I1212 11:09:08.868976 12765 parquet-column-readers.cc:959] Decompressed 57045 to 65540 I1212 11:09:08.870185 12765 parquet-column-readers.cc:959] Decompressed 27603 to 65528 I1212 11:09:08.901589 12765 parquet-column-readers.cc:959] Decompressed 12737 to 65544 I1212 11:09:08.901805 12765 parquet-column-readers.cc:959] Decompressed 38600 to 65544 I1212 11:09:08.936522 12765 parquet-column-readers.cc:959] Decompressed 27707 to 65541 I1212 11:09:09.005357 12765 parquet-column-readers.cc:959] Decompressed 27545 to 65542 I1212 11:09:09.092234 12765 parquet-column-readers.cc:959] Decompressed 27395 to 65499 I1212 11:09:09.177304 12765 parquet-column-readers.cc:959] Decompressed 27524 to 65529 I1212 11:09:09.220255 12765 parquet-column-readers.cc:959] Decompressed 12981 to 65544 I1212 11:09:09.220482 12765 parquet-column-readers.cc:959] Decompressed 38509 to 65544 I1212 11:09:09.255646 12765 parquet-column-readers.cc:959] Decompressed 27700 to 65542 I1212 11:09:09.291610 12765 parquet-column-readers.cc:959] Decompressed 57019 to 65540 I1212 11:09:09.325685 12765 parquet-column-readers.cc:959] Decompressed 27665 to 65514 I1212 11:09:09.364580 12731 plan-fragment-executor.cc:408] Reporting profile for instance 25407d49fc4cde6f:d575dd6200000002 I1212 11:09:09.365166 12731 plan-fragment-executor.cc:412] Fragment 25407d49fc4cde6f:d575dd6200000002:(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(500.000ms): 98.86 MB, 101.15 MB, 101.84 MB, 102.03 MB, 102.23 MB, 102.29 MB, 102.23 MB, 102.29 MB, 102.33 MB, 102.33 MB, 102.33 MB, 102.52 MB, 102.58 MB, 102.73 MB, 102.42 MB, 102.54 MB, 102.42 MB, 102.42 MB, 102.73 MB, 102.73 MB, 102.73 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.67 MB, 102.60 MB, 102.73 MB, 102.60 MB, 102.54 MB, 102.54 MB, 102.54 MB, 102.60 MB, 102.48 MB, 102.60 MB, 102.48 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.93 MB, 102.93 MB, 102.93 MB, 102.85 MB, 102.42 MB, 102.48 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 102.91 MB (107913039) - RowsProduced: 547.84K (547840) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.089ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 416.101ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 21s582ms, non-child: 0.000ns, % non-child: 0.00%) - KuduApplyTimer: 18s329ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.34 K/sec - TotalNumRows: 546.82K (546816) CodeGen:(Total: 85.001ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 416.138ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 87.672ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 589.82K (589824) - RowsReturned: 547.84K (547840) - RowsReturnedRate: 1.32 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 2.53 MB/sec I1212 11:09:09.365206 12731 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:09:09.365213 12731 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:09:09.365687 5418 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000002 I1212 11:09:09.365696 5418 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000002 done=false I1212 11:09:09.365705 5418 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000002 status=0 done=false I1212 11:09:09.366138 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 452.281ms 521.071ms 1.51M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:09.366657 5418 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000002 Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(500.000ms): 98.86 MB, 101.15 MB, 101.84 MB, 102.03 MB, 102.23 MB, 102.29 MB, 102.23 MB, 102.29 MB, 102.33 MB, 102.33 MB, 102.33 MB, 102.52 MB, 102.58 MB, 102.73 MB, 102.42 MB, 102.54 MB, 102.42 MB, 102.42 MB, 102.73 MB, 102.73 MB, 102.73 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.67 MB, 102.60 MB, 102.73 MB, 102.60 MB, 102.54 MB, 102.54 MB, 102.54 MB, 102.60 MB, 102.48 MB, 102.60 MB, 102.48 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.93 MB, 102.93 MB, 102.93 MB, 102.85 MB, 102.42 MB, 102.48 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 547.84K (547840) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.089ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 416.101ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 21s582ms, non-child: 21s582ms, % non-child: 100.00%) - KuduApplyTimer: 18s329ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.34 K/sec - TotalNumRows: 546.82K (546816) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 416.138ms, non-child: 416.138ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 87.672ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 589.82K (589824) - RowsReturned: 547.84K (547840) - RowsReturnedRate: 1.32 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 2.53 MB/sec I1212 11:09:09.368405 5418 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.86 MB (116248721) - PerHostPeakMemUsage: 110.86 MB (116248721) - RowsProduced: 502.78K (502784) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.354ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 451.944ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 19s825ms, non-child: 19s825ms, % non-child: 100.00%) - KuduApplyTimer: 16s784ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.31 K/sec - TotalNumRows: 501.76K (501760) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 452.281ms, non-child: 452.281ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 58.940ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95227138) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 544.77K (544768) - RowsReturned: 502.78K (502784) - RowsReturnedRate: 1.13 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 3.21 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(500.000ms): 51.01 MB, 112.78 MB, 113.40 MB, 113.77 MB, 113.98 MB, 113.98 MB, 114.04 MB, 114.04 MB, 114.08 MB, 114.14 MB, 114.08 MB, 114.27 MB, 114.33 MB, 114.45 MB, 114.35 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.54 MB, 114.47 MB, 114.54 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.35 MB, 114.29 MB, 114.41 MB, 114.10 MB, 114.41 MB, 114.41 MB, 114.29 MB, 114.35 MB, 114.29 MB, 114.23 MB, 114.23 MB, 114.29 MB, 114.10 MB, 114.23 MB, 114.74 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 489.47K (489472) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.241ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 520.624ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 19s396ms, non-child: 19s396ms, % non-child: 100.00%) - KuduApplyTimer: 16s454ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.18 K/sec - TotalNumRows: 488.45K (488448) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 521.071ms, non-child: 521.071ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 25.07 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 41.707ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 531.46K (531456) - RowsReturned: 489.47K (489472) - RowsReturnedRate: 939.36 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 3.46 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(500.000ms): 98.86 MB, 101.15 MB, 101.84 MB, 102.03 MB, 102.23 MB, 102.29 MB, 102.23 MB, 102.29 MB, 102.33 MB, 102.33 MB, 102.33 MB, 102.52 MB, 102.58 MB, 102.73 MB, 102.42 MB, 102.54 MB, 102.42 MB, 102.42 MB, 102.73 MB, 102.73 MB, 102.73 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.67 MB, 102.60 MB, 102.73 MB, 102.60 MB, 102.54 MB, 102.54 MB, 102.54 MB, 102.60 MB, 102.48 MB, 102.60 MB, 102.48 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.93 MB, 102.93 MB, 102.93 MB, 102.85 MB, 102.42 MB, 102.48 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 547.84K (547840) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.089ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 416.101ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 21s582ms, non-child: 21s582ms, % non-child: 100.00%) - KuduApplyTimer: 18s329ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.34 K/sec - TotalNumRows: 546.82K (546816) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 416.138ms, non-child: 416.138ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 87.672ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 589.82K (589824) - RowsReturned: 547.84K (547840) - RowsReturnedRate: 1.32 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 2.53 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(500.000ms): 47.95 MB, 112.52 MB, 113.27 MB, 113.83 MB, 113.91 MB, 114.03 MB, 114.10 MB, 113.97 MB, 113.78 MB, 114.07 MB, 114.07 MB, 114.26 MB, 114.26 MB, 114.45 MB, 114.35 MB, 114.22 MB, 114.22 MB, 114.16 MB, 114.59 MB, 114.47 MB, 114.53 MB, 113.91 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.41 MB, 114.35 MB, 114.41 MB, 114.28 MB, 114.28 MB, 114.28 MB, 114.35 MB, 114.22 MB, 114.28 MB, 114.17 MB, 114.03 MB, 114.16 MB, 114.16 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.66 MB (120226209) - PerHostPeakMemUsage: 114.66 MB (120226209) - RowsProduced: 471.04K (471040) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.732ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 419.107ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 18s497ms, non-child: 18s497ms, % non-child: 100.00%) - KuduApplyTimer: 15s569ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.41 K/sec - TotalNumRows: 470.02K (470016) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 419.633ms, non-child: 419.633ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 17.04 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 47.442ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.53 MB (99122698) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 513.02K (513024) - RowsReturned: 471.04K (471040) - RowsReturnedRate: 1.12 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 3.63 MB/sec I1212 11:09:09.368546 12731 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:09:09.422488 12765 parquet-column-readers.cc:959] Decompressed 27538 to 65534 I1212 11:09:09.426543 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 39993us I1212 11:09:09.515360 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 44284.3us I1212 11:09:09.564613 12765 parquet-column-readers.cc:959] Decompressed 12916 to 65544 I1212 11:09:09.564981 12765 parquet-column-readers.cc:959] Decompressed 38522 to 65544 I1212 11:09:09.567628 12765 parquet-column-readers.cc:959] Decompressed 27404 to 65539 I1212 11:09:09.637897 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 43474.7us I1212 11:09:09.657181 12765 parquet-column-readers.cc:959] Decompressed 27715 to 65505 I1212 11:09:09.750941 12765 parquet-column-readers.cc:959] Decompressed 57061 to 65540 I1212 11:09:09.752985 12765 parquet-column-readers.cc:959] Decompressed 27578 to 65522 I1212 11:09:09.786164 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:09.824656 12765 parquet-column-readers.cc:959] Decompressed 27562 to 65522 I1212 11:09:09.893972 12765 parquet-column-readers.cc:959] Decompressed 12702 to 65544 I1212 11:09:09.894343 12765 parquet-column-readers.cc:959] Decompressed 38572 to 65544 I1212 11:09:09.897183 12765 parquet-column-readers.cc:959] Decompressed 27447 to 65518 I1212 11:09:09.970558 12765 parquet-column-readers.cc:959] Decompressed 27515 to 65519 I1212 11:09:10.039654 12765 parquet-column-readers.cc:959] Decompressed 27487 to 65527 I1212 11:09:10.107329 12765 parquet-column-readers.cc:959] Decompressed 27539 to 65523 I1212 11:09:10.139284 12765 parquet-column-readers.cc:959] Decompressed 57026 to 65540 I1212 11:09:10.173148 12765 parquet-column-readers.cc:959] Decompressed 12953 to 65544 I1212 11:09:10.173511 12765 parquet-column-readers.cc:959] Decompressed 38471 to 65544 I1212 11:09:10.174026 12765 parquet-column-readers.cc:959] Decompressed 65516 to 65510 I1212 11:09:10.176419 12765 parquet-column-readers.cc:959] Decompressed 27636 to 65540 I1212 11:09:10.217974 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:10.218250 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:10.218529 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:10.257637 12765 parquet-column-readers.cc:959] Decompressed 27624 to 65508 I1212 11:09:10.341398 12765 parquet-column-readers.cc:959] Decompressed 27813 to 65517 I1212 11:09:10.451912 12765 parquet-column-readers.cc:959] Decompressed 27346 to 65543 I1212 11:09:10.487663 12765 parquet-column-readers.cc:959] Decompressed 12621 to 65544 I1212 11:09:10.488044 12765 parquet-column-readers.cc:959] Decompressed 38419 to 65544 I1212 11:09:10.526037 12765 parquet-column-readers.cc:959] Decompressed 27598 to 65524 I1212 11:09:10.574944 12765 parquet-column-readers.cc:959] Decompressed 57022 to 65540 I1212 11:09:10.611924 12765 parquet-column-readers.cc:959] Decompressed 27659 to 65524 I1212 11:09:10.671052 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 35811.9us I1212 11:09:10.701169 12765 parquet-column-readers.cc:959] Decompressed 27623 to 65542 I1212 11:09:10.784793 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 52453.3us I1212 11:09:10.813304 12765 parquet-column-readers.cc:959] Decompressed 27653 to 65529 I1212 11:09:10.860419 12765 parquet-column-readers.cc:959] Decompressed 12945 to 65544 I1212 11:09:10.860795 12765 parquet-column-readers.cc:959] Decompressed 38502 to 65544 I1212 11:09:10.922593 12765 parquet-column-readers.cc:959] Decompressed 27453 to 65526 I1212 11:09:11.038645 12765 parquet-column-readers.cc:959] Decompressed 27632 to 65535 I1212 11:09:11.094255 12765 parquet-column-readers.cc:959] Decompressed 56945 to 65540 I1212 11:09:11.147106 12765 parquet-column-readers.cc:959] Decompressed 27550 to 65539 I1212 11:09:11.217813 12765 parquet-column-readers.cc:959] Decompressed 27658 to 65542 I1212 11:09:11.252172 12765 parquet-column-readers.cc:959] Decompressed 13103 to 65544 I1212 11:09:11.252516 12765 parquet-column-readers.cc:959] Decompressed 38548 to 65544 I1212 11:09:11.288813 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:11.290185 12765 parquet-column-readers.cc:959] Decompressed 27426 to 65522 I1212 11:09:11.310798 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000001 I1212 11:09:11.310817 3769 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000001 done=false I1212 11:09:11.310832 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000001 status=0 done=false I1212 11:09:11.311512 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 456.706ms 521.071ms 1.63M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:11.312052 3769 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000001 Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(500.000ms): 47.95 MB, 112.52 MB, 113.27 MB, 113.83 MB, 113.91 MB, 114.03 MB, 114.10 MB, 113.97 MB, 113.78 MB, 114.07 MB, 114.07 MB, 114.26 MB, 114.26 MB, 114.45 MB, 114.35 MB, 114.22 MB, 114.22 MB, 114.16 MB, 114.59 MB, 114.47 MB, 114.53 MB, 113.91 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.41 MB, 114.35 MB, 114.41 MB, 114.28 MB, 114.28 MB, 114.28 MB, 114.35 MB, 114.22 MB, 114.28 MB, 114.17 MB, 114.03 MB, 114.16 MB, 114.16 MB, 114.67 MB, 114.67 MB, 114.80 MB, 114.61 MB, 114.16 MB, 114.16 MB, 114.28 MB, 114.10 MB, 114.28 MB, 114.16 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 592.90K (592896) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.732ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 432.770ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 23s475ms, non-child: 23s475ms, % non-child: 100.00%) - KuduApplyTimer: 19s795ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.21 K/sec - TotalNumRows: 591.87K (591872) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 432.908ms, non-child: 432.908ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 17.04 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 56.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 634.88K (634880) - RowsReturned: 592.90K (592896) - RowsReturnedRate: 1.37 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 2.87 MB/sec I1212 11:09:11.313530 3769 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 543.40K (543402) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.354ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 456.498ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 21s484ms, non-child: 21s484ms, % non-child: 100.00%) - KuduApplyTimer: 18s193ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.24 K/sec - TotalNumRows: 542.38K (542378) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 456.706ms, non-child: 456.706ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 62.126ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 585.39K (585386) - RowsReturned: 543.40K (543402) - RowsReturnedRate: 1.21 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 2.95 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(500.000ms): 51.01 MB, 112.78 MB, 113.40 MB, 113.77 MB, 113.98 MB, 113.98 MB, 114.04 MB, 114.04 MB, 114.08 MB, 114.14 MB, 114.08 MB, 114.27 MB, 114.33 MB, 114.45 MB, 114.35 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.54 MB, 114.47 MB, 114.54 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.35 MB, 114.29 MB, 114.41 MB, 114.10 MB, 114.41 MB, 114.41 MB, 114.29 MB, 114.35 MB, 114.29 MB, 114.23 MB, 114.23 MB, 114.29 MB, 114.10 MB, 114.23 MB, 114.74 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 489.47K (489472) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.241ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 520.624ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 19s396ms, non-child: 19s396ms, % non-child: 100.00%) - KuduApplyTimer: 16s454ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.18 K/sec - TotalNumRows: 488.45K (488448) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 521.071ms, non-child: 521.071ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 25.07 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 41.707ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 531.46K (531456) - RowsReturned: 489.47K (489472) - RowsReturnedRate: 939.36 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 3.46 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(500.000ms): 98.86 MB, 101.15 MB, 101.84 MB, 102.03 MB, 102.23 MB, 102.29 MB, 102.23 MB, 102.29 MB, 102.33 MB, 102.33 MB, 102.33 MB, 102.52 MB, 102.58 MB, 102.73 MB, 102.42 MB, 102.54 MB, 102.42 MB, 102.42 MB, 102.73 MB, 102.73 MB, 102.73 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.67 MB, 102.60 MB, 102.73 MB, 102.60 MB, 102.54 MB, 102.54 MB, 102.54 MB, 102.60 MB, 102.48 MB, 102.60 MB, 102.48 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.93 MB, 102.93 MB, 102.93 MB, 102.85 MB, 102.42 MB, 102.48 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 547.84K (547840) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.089ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 416.101ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 21s582ms, non-child: 21s582ms, % non-child: 100.00%) - KuduApplyTimer: 18s329ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.34 K/sec - TotalNumRows: 546.82K (546816) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 416.138ms, non-child: 416.138ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 87.672ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 589.82K (589824) - RowsReturned: 547.84K (547840) - RowsReturnedRate: 1.32 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 2.53 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(500.000ms): 47.95 MB, 112.52 MB, 113.27 MB, 113.83 MB, 113.91 MB, 114.03 MB, 114.10 MB, 113.97 MB, 113.78 MB, 114.07 MB, 114.07 MB, 114.26 MB, 114.26 MB, 114.45 MB, 114.35 MB, 114.22 MB, 114.22 MB, 114.16 MB, 114.59 MB, 114.47 MB, 114.53 MB, 113.91 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.41 MB, 114.35 MB, 114.41 MB, 114.28 MB, 114.28 MB, 114.28 MB, 114.35 MB, 114.22 MB, 114.28 MB, 114.17 MB, 114.03 MB, 114.16 MB, 114.16 MB, 114.67 MB, 114.67 MB, 114.80 MB, 114.61 MB, 114.16 MB, 114.16 MB, 114.28 MB, 114.10 MB, 114.28 MB, 114.16 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 592.90K (592896) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.732ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 432.770ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 23s475ms, non-child: 23s475ms, % non-child: 100.00%) - KuduApplyTimer: 19s795ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.21 K/sec - TotalNumRows: 591.87K (591872) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 432.908ms, non-child: 432.908ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 17.04 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 56.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 634.88K (634880) - RowsReturned: 592.90K (592896) - RowsReturnedRate: 1.37 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 2.87 MB/sec I1212 11:09:11.410147 12765 parquet-column-readers.cc:959] Decompressed 27448 to 65537 I1212 11:09:11.507984 12765 parquet-column-readers.cc:959] Decompressed 27554 to 65532 I1212 11:09:11.541352 12765 parquet-column-readers.cc:959] Decompressed 57018 to 65540 I1212 11:09:11.573994 12765 parquet-column-readers.cc:959] Decompressed 12847 to 65544 I1212 11:09:11.574442 12765 parquet-column-readers.cc:959] Decompressed 38448 to 65544 I1212 11:09:11.577096 12765 parquet-column-readers.cc:959] Decompressed 27640 to 65506 I1212 11:09:11.641927 12765 parquet-column-readers.cc:959] Decompressed 27512 to 65538 I1212 11:09:11.713359 12765 parquet-column-readers.cc:959] Decompressed 27528 to 65513 I1212 11:09:11.804288 12765 parquet-column-readers.cc:959] Decompressed 27460 to 65542 I1212 11:09:11.828394 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 32123.9us I1212 11:09:11.890791 12765 parquet-column-readers.cc:959] Decompressed 12927 to 65544 I1212 11:09:11.891201 12765 parquet-column-readers.cc:959] Decompressed 38546 to 65544 I1212 11:09:11.891952 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:11.892208 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:11.894053 12765 parquet-column-readers.cc:959] Decompressed 27673 to 65524 I1212 11:09:11.940560 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 63796.3us I1212 11:09:11.989926 12765 parquet-column-readers.cc:959] Decompressed 57028 to 65540 I1212 11:09:11.992130 12765 parquet-column-readers.cc:959] Decompressed 27613 to 65528 I1212 11:09:12.033393 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:12.033700 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:12.033993 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:12.072520 12765 parquet-column-readers.cc:959] Decompressed 27646 to 65506 I1212 11:09:12.150389 12765 parquet-column-readers.cc:959] Decompressed 27705 to 65542 I1212 11:09:12.217911 12765 parquet-column-readers.cc:959] Decompressed 12779 to 65544 I1212 11:09:12.218266 12765 parquet-column-readers.cc:959] Decompressed 38545 to 65544 I1212 11:09:12.255947 12765 parquet-column-readers.cc:959] Decompressed 27550 to 65543 I1212 11:09:12.314909 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:09:12.314920 3766 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000000 done=false I1212 11:09:12.314926 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000000 status=0 done=false I1212 11:09:12.315210 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 465.480ms 547.394ms 1.76M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:12.315516 3766 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000000 Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(500.000ms): 51.01 MB, 112.78 MB, 113.40 MB, 113.77 MB, 113.98 MB, 113.98 MB, 114.04 MB, 114.04 MB, 114.08 MB, 114.14 MB, 114.08 MB, 114.27 MB, 114.33 MB, 114.45 MB, 114.35 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.54 MB, 114.47 MB, 114.54 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.35 MB, 114.29 MB, 114.41 MB, 114.10 MB, 114.41 MB, 114.41 MB, 114.29 MB, 114.35 MB, 114.29 MB, 114.23 MB, 114.23 MB, 114.29 MB, 114.10 MB, 114.23 MB, 114.74 MB, 114.68 MB, 114.74 MB, 114.29 MB, 114.29 MB, 114.17 MB, 114.17 MB, 114.23 MB, 114.29 MB, 114.29 MB, 106.32 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 618.50K (618496) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 547.341ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 24s392ms, non-child: 24s392ms, % non-child: 100.00%) - KuduApplyTimer: 20s695ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.31 K/sec - TotalNumRows: 617.47K (617472) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 547.394ms, non-child: 547.394ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 25.07 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 51.453ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 660.48K (660480) - RowsReturned: 618.50K (618496) - RowsReturnedRate: 1.13 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 2.77 MB/sec I1212 11:09:12.316639 3766 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 586.41K (586410) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.356ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 465.404ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 23s150ms, non-child: 23s150ms, % non-child: 100.00%) - KuduApplyTimer: 19s606ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.29 K/sec - TotalNumRows: 585.39K (585386) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 465.480ms, non-child: 465.480ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 65.375ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 628.39K (628394) - RowsReturned: 586.41K (586410) - RowsReturnedRate: 1.27 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 2.72 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(500.000ms): 51.01 MB, 112.78 MB, 113.40 MB, 113.77 MB, 113.98 MB, 113.98 MB, 114.04 MB, 114.04 MB, 114.08 MB, 114.14 MB, 114.08 MB, 114.27 MB, 114.33 MB, 114.45 MB, 114.35 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.54 MB, 114.47 MB, 114.54 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.35 MB, 114.29 MB, 114.41 MB, 114.10 MB, 114.41 MB, 114.41 MB, 114.29 MB, 114.35 MB, 114.29 MB, 114.23 MB, 114.23 MB, 114.29 MB, 114.10 MB, 114.23 MB, 114.74 MB, 114.68 MB, 114.74 MB, 114.29 MB, 114.29 MB, 114.17 MB, 114.17 MB, 114.23 MB, 114.29 MB, 114.29 MB, 106.32 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 618.50K (618496) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 547.341ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 24s392ms, non-child: 24s392ms, % non-child: 100.00%) - KuduApplyTimer: 20s695ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.31 K/sec - TotalNumRows: 617.47K (617472) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 547.394ms, non-child: 547.394ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 25.07 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 51.453ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 660.48K (660480) - RowsReturned: 618.50K (618496) - RowsReturnedRate: 1.13 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 2.77 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(500.000ms): 98.86 MB, 101.15 MB, 101.84 MB, 102.03 MB, 102.23 MB, 102.29 MB, 102.23 MB, 102.29 MB, 102.33 MB, 102.33 MB, 102.33 MB, 102.52 MB, 102.58 MB, 102.73 MB, 102.42 MB, 102.54 MB, 102.42 MB, 102.42 MB, 102.73 MB, 102.73 MB, 102.73 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.67 MB, 102.60 MB, 102.73 MB, 102.60 MB, 102.54 MB, 102.54 MB, 102.54 MB, 102.60 MB, 102.48 MB, 102.60 MB, 102.48 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.93 MB, 102.93 MB, 102.93 MB, 102.85 MB, 102.42 MB, 102.48 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 547.84K (547840) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.089ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 416.101ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 21s582ms, non-child: 21s582ms, % non-child: 100.00%) - KuduApplyTimer: 18s329ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.34 K/sec - TotalNumRows: 546.82K (546816) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 416.138ms, non-child: 416.138ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 87.672ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 589.82K (589824) - RowsReturned: 547.84K (547840) - RowsReturnedRate: 1.32 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 2.53 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(500.000ms): 47.95 MB, 112.52 MB, 113.27 MB, 113.83 MB, 113.91 MB, 114.03 MB, 114.10 MB, 113.97 MB, 113.78 MB, 114.07 MB, 114.07 MB, 114.26 MB, 114.26 MB, 114.45 MB, 114.35 MB, 114.22 MB, 114.22 MB, 114.16 MB, 114.59 MB, 114.47 MB, 114.53 MB, 113.91 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.41 MB, 114.35 MB, 114.41 MB, 114.28 MB, 114.28 MB, 114.28 MB, 114.35 MB, 114.22 MB, 114.28 MB, 114.17 MB, 114.03 MB, 114.16 MB, 114.16 MB, 114.67 MB, 114.67 MB, 114.80 MB, 114.61 MB, 114.16 MB, 114.16 MB, 114.28 MB, 114.10 MB, 114.28 MB, 114.16 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 592.90K (592896) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.732ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 432.770ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 23s475ms, non-child: 23s475ms, % non-child: 100.00%) - KuduApplyTimer: 19s795ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.21 K/sec - TotalNumRows: 591.87K (591872) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 432.908ms, non-child: 432.908ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 17.04 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 56.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 634.88K (634880) - RowsReturned: 592.90K (592896) - RowsReturnedRate: 1.37 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 2.87 MB/sec I1212 11:09:12.326793 12765 parquet-column-readers.cc:959] Decompressed 27468 to 65516 I1212 11:09:12.358410 12765 parquet-column-readers.cc:959] Decompressed 57062 to 65540 I1212 11:09:12.394423 12765 parquet-column-readers.cc:959] Decompressed 27617 to 65539 I1212 11:09:12.462818 12765 parquet-column-readers.cc:959] Decompressed 27457 to 65540 I1212 11:09:12.493772 12765 parquet-column-readers.cc:959] Decompressed 12707 to 65544 I1212 11:09:12.494141 12765 parquet-column-readers.cc:959] Decompressed 38525 to 65544 I1212 11:09:12.549506 12765 parquet-column-readers.cc:959] Decompressed 27494 to 65541 I1212 11:09:12.628844 12765 parquet-column-readers.cc:959] Decompressed 27719 to 65510 I1212 11:09:12.708076 12765 parquet-column-readers.cc:959] Decompressed 27959 to 65530 I1212 11:09:12.741168 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:12.775816 12765 parquet-column-readers.cc:959] Decompressed 57004 to 65540 I1212 11:09:12.778038 12765 parquet-column-readers.cc:959] Decompressed 27672 to 65515 I1212 11:09:12.809164 12765 parquet-column-readers.cc:959] Decompressed 12793 to 65544 I1212 11:09:12.809543 12765 parquet-column-readers.cc:959] Decompressed 38536 to 65544 I1212 11:09:12.848956 12765 parquet-column-readers.cc:959] Decompressed 27605 to 65515 I1212 11:09:12.916837 12765 parquet-column-readers.cc:959] Decompressed 27436 to 65531 I1212 11:09:13.003510 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 30762us I1212 11:09:13.066469 12765 parquet-column-readers.cc:959] Decompressed 27642 to 65515 I1212 11:09:13.108894 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 32460.5us I1212 11:09:13.154757 12765 parquet-column-readers.cc:959] Decompressed 12639 to 65544 I1212 11:09:13.155138 12765 parquet-column-readers.cc:959] Decompressed 38543 to 65544 I1212 11:09:13.157922 12765 parquet-column-readers.cc:959] Decompressed 27433 to 65498 I1212 11:09:13.235152 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 51937.6us I1212 11:09:13.255362 12765 parquet-column-readers.cc:959] Decompressed 57042 to 65540 I1212 11:09:13.257581 12765 parquet-column-readers.cc:959] Decompressed 27464 to 65535 I1212 11:09:13.343039 12765 parquet-column-readers.cc:959] Decompressed 27346 to 65535 I1212 11:09:13.412670 12765 parquet-column-readers.cc:959] Decompressed 27752 to 65526 I1212 11:09:13.480809 12765 parquet-column-readers.cc:959] Decompressed 12708 to 65544 I1212 11:09:13.481169 12765 parquet-column-readers.cc:959] Decompressed 38540 to 65544 I1212 11:09:13.484030 12765 parquet-column-readers.cc:959] Decompressed 27687 to 65515 I1212 11:09:13.552984 12765 parquet-column-readers.cc:959] Decompressed 27347 to 65519 I1212 11:09:13.584110 12765 parquet-column-readers.cc:959] Decompressed 41690 to 65454 I1212 11:09:13.586896 12765 parquet-column-readers.cc:959] Decompressed 65460 to 65454 I1212 11:09:13.618741 12765 parquet-column-readers.cc:959] Decompressed 57043 to 65540 I1212 11:09:13.620851 12765 parquet-column-readers.cc:959] Decompressed 27395 to 65531 I1212 11:09:13.653726 12765 parquet-column-readers.cc:959] Decompressed 65516 to 65510 I1212 11:09:13.708122 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:13.708398 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:13.708662 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:13.709352 12765 parquet-column-readers.cc:959] Decompressed 27453 to 65543 I1212 11:09:13.786695 12765 parquet-column-readers.cc:959] Decompressed 12976 to 65544 I1212 11:09:13.787071 12765 parquet-column-readers.cc:959] Decompressed 38568 to 65544 I1212 11:09:13.789813 12765 parquet-column-readers.cc:959] Decompressed 27535 to 65536 I1212 11:09:13.873826 12765 parquet-column-readers.cc:959] Decompressed 27675 to 65537 I1212 11:09:13.980325 12765 parquet-column-readers.cc:959] Decompressed 27350 to 65506 I1212 11:09:14.050735 12765 parquet-column-readers.cc:959] Decompressed 56999 to 65540 I1212 11:09:14.052804 12765 parquet-column-readers.cc:959] Decompressed 27544 to 65543 I1212 11:09:14.083864 12765 parquet-column-readers.cc:959] Decompressed 12798 to 65544 I1212 11:09:14.084233 12765 parquet-column-readers.cc:959] Decompressed 38558 to 65544 I1212 11:09:14.120695 12765 parquet-column-readers.cc:959] Decompressed 27379 to 65537 I1212 11:09:14.159165 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:14.208284 12765 parquet-column-readers.cc:959] Decompressed 27746 to 65536 I1212 11:09:14.218003 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 31622.9us I1212 11:09:14.325218 12765 parquet-column-readers.cc:959] Decompressed 27673 to 65538 I1212 11:09:14.368635 12731 plan-fragment-executor.cc:408] Reporting profile for instance 25407d49fc4cde6f:d575dd6200000002 I1212 11:09:14.369278 12731 plan-fragment-executor.cc:412] Fragment 25407d49fc4cde6f:d575dd6200000002:(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(500.000ms): 98.86 MB, 101.15 MB, 101.84 MB, 102.03 MB, 102.23 MB, 102.29 MB, 102.23 MB, 102.29 MB, 102.33 MB, 102.33 MB, 102.33 MB, 102.52 MB, 102.58 MB, 102.73 MB, 102.42 MB, 102.54 MB, 102.42 MB, 102.42 MB, 102.73 MB, 102.73 MB, 102.73 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.67 MB, 102.60 MB, 102.73 MB, 102.60 MB, 102.54 MB, 102.54 MB, 102.54 MB, 102.60 MB, 102.48 MB, 102.60 MB, 102.48 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.93 MB, 102.93 MB, 102.93 MB, 102.85 MB, 102.42 MB, 102.48 MB, 102.42 MB, 102.42 MB, 102.29 MB, 102.60 MB, 94.51 MB, 94.69 MB, 94.57 MB, 94.50 MB, 94.63 MB, 94.69 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 671.74K (671744) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 438.407ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 26s525ms, non-child: 0.000ns, % non-child: 0.00%) - KuduApplyTimer: 22s476ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.29 K/sec - TotalNumRows: 670.72K (670720) CodeGen:(Total: 85.001ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 438.052ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 97.983ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 713.73K (713728) - RowsReturned: 671.74K (671744) - RowsReturnedRate: 1.53 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 2.07 MB/sec I1212 11:09:14.369323 12731 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:09:14.369333 12731 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:09:14.369828 3396 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000002 I1212 11:09:14.369843 3396 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000002 done=false I1212 11:09:14.369856 3396 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000002 status=0 done=false I1212 11:09:14.370363 3396 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 472.785ms 547.394ms 1.88M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:14.370995 3396 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000002 Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(500.000ms): 98.86 MB, 101.15 MB, 101.84 MB, 102.03 MB, 102.23 MB, 102.29 MB, 102.23 MB, 102.29 MB, 102.33 MB, 102.33 MB, 102.33 MB, 102.52 MB, 102.58 MB, 102.73 MB, 102.42 MB, 102.54 MB, 102.42 MB, 102.42 MB, 102.73 MB, 102.73 MB, 102.73 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.67 MB, 102.60 MB, 102.73 MB, 102.60 MB, 102.54 MB, 102.54 MB, 102.54 MB, 102.60 MB, 102.48 MB, 102.60 MB, 102.48 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.93 MB, 102.93 MB, 102.93 MB, 102.85 MB, 102.42 MB, 102.48 MB, 102.42 MB, 102.42 MB, 102.29 MB, 102.60 MB, 94.51 MB, 94.69 MB, 94.57 MB, 94.50 MB, 94.63 MB, 94.69 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 671.74K (671744) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 438.407ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 26s525ms, non-child: 26s525ms, % non-child: 100.00%) - KuduApplyTimer: 22s476ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.29 K/sec - TotalNumRows: 670.72K (670720) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 438.052ms, non-child: 438.052ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 97.983ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 713.73K (713728) - RowsReturned: 671.74K (671744) - RowsReturnedRate: 1.53 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 2.07 MB/sec I1212 11:09:14.373033 3396 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 627.71K (627712) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.358ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 472.839ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 24s797ms, non-child: 24s797ms, % non-child: 100.00%) - KuduApplyTimer: 20s989ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.27 K/sec - TotalNumRows: 626.69K (626688) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 472.785ms, non-child: 472.785ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 68.812ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 669.70K (669696) - RowsReturned: 627.71K (627712) - RowsReturnedRate: 1.34 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 2.57 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(500.000ms): 51.01 MB, 112.78 MB, 113.40 MB, 113.77 MB, 113.98 MB, 113.98 MB, 114.04 MB, 114.04 MB, 114.08 MB, 114.14 MB, 114.08 MB, 114.27 MB, 114.33 MB, 114.45 MB, 114.35 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.54 MB, 114.47 MB, 114.54 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.35 MB, 114.29 MB, 114.41 MB, 114.10 MB, 114.41 MB, 114.41 MB, 114.29 MB, 114.35 MB, 114.29 MB, 114.23 MB, 114.23 MB, 114.29 MB, 114.10 MB, 114.23 MB, 114.74 MB, 114.68 MB, 114.74 MB, 114.29 MB, 114.29 MB, 114.17 MB, 114.17 MB, 114.23 MB, 114.29 MB, 114.29 MB, 106.32 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 618.50K (618496) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 547.341ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 24s392ms, non-child: 24s392ms, % non-child: 100.00%) - KuduApplyTimer: 20s695ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.31 K/sec - TotalNumRows: 617.47K (617472) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 547.394ms, non-child: 547.394ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 25.07 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 51.453ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 660.48K (660480) - RowsReturned: 618.50K (618496) - RowsReturnedRate: 1.13 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 2.77 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(500.000ms): 98.86 MB, 101.15 MB, 101.84 MB, 102.03 MB, 102.23 MB, 102.29 MB, 102.23 MB, 102.29 MB, 102.33 MB, 102.33 MB, 102.33 MB, 102.52 MB, 102.58 MB, 102.73 MB, 102.42 MB, 102.54 MB, 102.42 MB, 102.42 MB, 102.73 MB, 102.73 MB, 102.73 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.67 MB, 102.60 MB, 102.73 MB, 102.60 MB, 102.54 MB, 102.54 MB, 102.54 MB, 102.60 MB, 102.48 MB, 102.60 MB, 102.48 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.93 MB, 102.93 MB, 102.93 MB, 102.85 MB, 102.42 MB, 102.48 MB, 102.42 MB, 102.42 MB, 102.29 MB, 102.60 MB, 94.51 MB, 94.69 MB, 94.57 MB, 94.50 MB, 94.63 MB, 94.69 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 671.74K (671744) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 438.407ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 26s525ms, non-child: 26s525ms, % non-child: 100.00%) - KuduApplyTimer: 22s476ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.29 K/sec - TotalNumRows: 670.72K (670720) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 438.052ms, non-child: 438.052ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 97.983ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 713.73K (713728) - RowsReturned: 671.74K (671744) - RowsReturnedRate: 1.53 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 2.07 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(500.000ms): 47.95 MB, 112.52 MB, 113.27 MB, 113.83 MB, 113.91 MB, 114.03 MB, 114.10 MB, 113.97 MB, 113.78 MB, 114.07 MB, 114.07 MB, 114.26 MB, 114.26 MB, 114.45 MB, 114.35 MB, 114.22 MB, 114.22 MB, 114.16 MB, 114.59 MB, 114.47 MB, 114.53 MB, 113.91 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.41 MB, 114.35 MB, 114.41 MB, 114.28 MB, 114.28 MB, 114.28 MB, 114.35 MB, 114.22 MB, 114.28 MB, 114.17 MB, 114.03 MB, 114.16 MB, 114.16 MB, 114.67 MB, 114.67 MB, 114.80 MB, 114.61 MB, 114.16 MB, 114.16 MB, 114.28 MB, 114.10 MB, 114.28 MB, 114.16 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 592.90K (592896) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.732ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 432.770ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 23s475ms, non-child: 23s475ms, % non-child: 100.00%) - KuduApplyTimer: 19s795ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.21 K/sec - TotalNumRows: 591.87K (591872) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 432.908ms, non-child: 432.908ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 17.04 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 56.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 634.88K (634880) - RowsReturned: 592.90K (592896) - RowsReturnedRate: 1.37 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 2.87 MB/sec I1212 11:09:14.373188 12731 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:09:14.406069 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 55766.3us I1212 11:09:14.455755 12765 parquet-column-readers.cc:959] Decompressed 27469 to 65537 I1212 11:09:14.527395 12765 parquet-column-readers.cc:959] Decompressed 12718 to 65544 I1212 11:09:14.527637 12765 parquet-column-readers.cc:959] Decompressed 38464 to 65544 I1212 11:09:14.587517 12765 parquet-column-readers.cc:959] Decompressed 27527 to 65514 I1212 11:09:14.643898 12765 parquet-column-readers.cc:959] Decompressed 57013 to 65540 I1212 11:09:14.692847 12765 parquet-column-readers.cc:959] Decompressed 27740 to 65530 I1212 11:09:14.762600 12765 parquet-column-readers.cc:959] Decompressed 27502 to 65517 I1212 11:09:14.828362 12765 parquet-column-readers.cc:959] Decompressed 27598 to 65529 I1212 11:09:14.859997 12765 parquet-column-readers.cc:959] Decompressed 12761 to 65544 I1212 11:09:14.860378 12765 parquet-column-readers.cc:959] Decompressed 38521 to 65544 I1212 11:09:14.903435 12765 parquet-column-readers.cc:959] Decompressed 27675 to 65524 I1212 11:09:15.035233 12765 parquet-column-readers.cc:959] Decompressed 56981 to 65540 I1212 11:09:15.037292 12765 parquet-column-readers.cc:959] Decompressed 27526 to 65527 I1212 11:09:15.106063 12765 parquet-column-readers.cc:959] Decompressed 27539 to 65537 I1212 11:09:15.172579 12765 parquet-column-readers.cc:959] Decompressed 12768 to 65544 I1212 11:09:15.172942 12765 parquet-column-readers.cc:959] Decompressed 38556 to 65544 I1212 11:09:15.175731 12765 parquet-column-readers.cc:959] Decompressed 27466 to 65538 I1212 11:09:15.245890 12765 parquet-column-readers.cc:959] Decompressed 27827 to 65532 I1212 11:09:15.314929 12765 parquet-column-readers.cc:959] Decompressed 27615 to 65537 I1212 11:09:15.396953 12765 parquet-column-readers.cc:959] Decompressed 27379 to 65503 I1212 11:09:15.421010 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 38184.4us I1212 11:09:15.432564 12765 parquet-column-readers.cc:959] Decompressed 57023 to 65540 I1212 11:09:15.477509 12765 parquet-column-readers.cc:959] Decompressed 12987 to 65544 I1212 11:09:15.477879 12765 parquet-column-readers.cc:959] Decompressed 38557 to 65544 I1212 11:09:15.479553 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:15.479833 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:15.480108 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:15.480700 12765 parquet-column-readers.cc:959] Decompressed 27282 to 65511 I1212 11:09:15.563814 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 37493.3us I1212 11:09:15.570961 12765 parquet-column-readers.cc:959] Decompressed 27634 to 65528 I1212 11:09:15.665598 12765 parquet-column-readers.cc:959] Decompressed 27697 to 65530 I1212 11:09:15.754778 12765 parquet-column-readers.cc:959] Decompressed 27584 to 65542 I1212 11:09:15.790554 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:15.824774 12765 parquet-column-readers.cc:959] Decompressed 12721 to 65544 I1212 11:09:15.824991 12765 parquet-column-readers.cc:959] Decompressed 38575 to 65544 I1212 11:09:15.860581 12765 parquet-column-readers.cc:959] Decompressed 27546 to 65508 I1212 11:09:15.893679 12765 parquet-column-readers.cc:959] Decompressed 56989 to 65540 I1212 11:09:15.930784 12765 parquet-column-readers.cc:959] Decompressed 27735 to 65541 I1212 11:09:16.013859 12765 parquet-column-readers.cc:959] Decompressed 27599 to 65536 I1212 11:09:16.124792 12765 parquet-column-readers.cc:959] Decompressed 27560 to 65505 I1212 11:09:16.174525 12765 parquet-column-readers.cc:959] Decompressed 12898 to 65544 I1212 11:09:16.174893 12765 parquet-column-readers.cc:959] Decompressed 38516 to 65544 I1212 11:09:16.229549 12765 parquet-column-readers.cc:959] Decompressed 27600 to 65535 I1212 11:09:16.314484 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000001 I1212 11:09:16.314491 3769 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000001 done=false I1212 11:09:16.314510 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000001 status=0 done=false I1212 11:09:16.314801 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 480.113ms 547.394ms 2.01M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:16.315150 3769 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000001 Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(500.000ms): 47.95 MB, 112.52 MB, 113.27 MB, 113.83 MB, 113.91 MB, 114.03 MB, 114.10 MB, 113.97 MB, 113.78 MB, 114.07 MB, 114.07 MB, 114.26 MB, 114.26 MB, 114.45 MB, 114.35 MB, 114.22 MB, 114.22 MB, 114.16 MB, 114.59 MB, 114.47 MB, 114.53 MB, 113.91 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.41 MB, 114.35 MB, 114.41 MB, 114.28 MB, 114.28 MB, 114.28 MB, 114.35 MB, 114.22 MB, 114.28 MB, 114.17 MB, 114.03 MB, 114.16 MB, 114.16 MB, 114.67 MB, 114.67 MB, 114.80 MB, 114.61 MB, 114.16 MB, 114.16 MB, 114.28 MB, 114.10 MB, 114.28 MB, 114.16 MB, 114.22 MB, 106.37 MB, 106.37 MB, 106.31 MB, 106.25 MB, 106.37 MB, 106.44 MB, 106.37 MB, 106.19 MB, 106.31 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 720.90K (720896) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 455.159ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 28s434ms, non-child: 28s434ms, % non-child: 100.00%) - KuduApplyTimer: 23s973ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.32 K/sec - TotalNumRows: 719.87K (719872) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 454.892ms, non-child: 454.892ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 17.04 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 67.077ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 762.88K (762880) - RowsReturned: 720.90K (720896) - RowsReturnedRate: 1.58 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 2.38 MB/sec I1212 11:09:16.316254 3769 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 670.38K (670378) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.359ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 480.302ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 26s450ms, non-child: 26s450ms, % non-child: 100.00%) - KuduApplyTimer: 22s382ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.30 K/sec - TotalNumRows: 669.35K (669354) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 480.113ms, non-child: 480.113ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 72.171ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 712.36K (712362) - RowsReturned: 670.38K (670378) - RowsReturnedRate: 1.42 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 2.40 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(500.000ms): 51.01 MB, 112.78 MB, 113.40 MB, 113.77 MB, 113.98 MB, 113.98 MB, 114.04 MB, 114.04 MB, 114.08 MB, 114.14 MB, 114.08 MB, 114.27 MB, 114.33 MB, 114.45 MB, 114.35 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.54 MB, 114.47 MB, 114.54 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.35 MB, 114.29 MB, 114.41 MB, 114.10 MB, 114.41 MB, 114.41 MB, 114.29 MB, 114.35 MB, 114.29 MB, 114.23 MB, 114.23 MB, 114.29 MB, 114.10 MB, 114.23 MB, 114.74 MB, 114.68 MB, 114.74 MB, 114.29 MB, 114.29 MB, 114.17 MB, 114.17 MB, 114.23 MB, 114.29 MB, 114.29 MB, 106.32 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 618.50K (618496) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 547.341ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 24s392ms, non-child: 24s392ms, % non-child: 100.00%) - KuduApplyTimer: 20s695ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.31 K/sec - TotalNumRows: 617.47K (617472) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 547.394ms, non-child: 547.394ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 25.07 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 51.453ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 660.48K (660480) - RowsReturned: 618.50K (618496) - RowsReturnedRate: 1.13 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 2.77 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(500.000ms): 98.86 MB, 101.15 MB, 101.84 MB, 102.03 MB, 102.23 MB, 102.29 MB, 102.23 MB, 102.29 MB, 102.33 MB, 102.33 MB, 102.33 MB, 102.52 MB, 102.58 MB, 102.73 MB, 102.42 MB, 102.54 MB, 102.42 MB, 102.42 MB, 102.73 MB, 102.73 MB, 102.73 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.67 MB, 102.60 MB, 102.73 MB, 102.60 MB, 102.54 MB, 102.54 MB, 102.54 MB, 102.60 MB, 102.48 MB, 102.60 MB, 102.48 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.93 MB, 102.93 MB, 102.93 MB, 102.85 MB, 102.42 MB, 102.48 MB, 102.42 MB, 102.42 MB, 102.29 MB, 102.60 MB, 94.51 MB, 94.69 MB, 94.57 MB, 94.50 MB, 94.63 MB, 94.69 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 671.74K (671744) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 438.407ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 26s525ms, non-child: 26s525ms, % non-child: 100.00%) - KuduApplyTimer: 22s476ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.29 K/sec - TotalNumRows: 670.72K (670720) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 438.052ms, non-child: 438.052ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 97.983ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 713.73K (713728) - RowsReturned: 671.74K (671744) - RowsReturnedRate: 1.53 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 2.07 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(500.000ms): 47.95 MB, 112.52 MB, 113.27 MB, 113.83 MB, 113.91 MB, 114.03 MB, 114.10 MB, 113.97 MB, 113.78 MB, 114.07 MB, 114.07 MB, 114.26 MB, 114.26 MB, 114.45 MB, 114.35 MB, 114.22 MB, 114.22 MB, 114.16 MB, 114.59 MB, 114.47 MB, 114.53 MB, 113.91 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.41 MB, 114.35 MB, 114.41 MB, 114.28 MB, 114.28 MB, 114.28 MB, 114.35 MB, 114.22 MB, 114.28 MB, 114.17 MB, 114.03 MB, 114.16 MB, 114.16 MB, 114.67 MB, 114.67 MB, 114.80 MB, 114.61 MB, 114.16 MB, 114.16 MB, 114.28 MB, 114.10 MB, 114.28 MB, 114.16 MB, 114.22 MB, 106.37 MB, 106.37 MB, 106.31 MB, 106.25 MB, 106.37 MB, 106.44 MB, 106.37 MB, 106.19 MB, 106.31 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 720.90K (720896) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 455.159ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 28s434ms, non-child: 28s434ms, % non-child: 100.00%) - KuduApplyTimer: 23s973ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.32 K/sec - TotalNumRows: 719.87K (719872) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 454.892ms, non-child: 454.892ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 17.04 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 67.077ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 762.88K (762880) - RowsReturned: 720.90K (720896) - RowsReturnedRate: 1.58 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 2.38 MB/sec I1212 11:09:16.327564 12765 parquet-column-readers.cc:959] Decompressed 27409 to 65532 I1212 11:09:16.383395 12765 parquet-column-readers.cc:959] Decompressed 57014 to 65540 I1212 11:09:16.423939 12765 parquet-column-readers.cc:959] Decompressed 27370 to 65513 I1212 11:09:16.494468 12765 parquet-column-readers.cc:959] Decompressed 27587 to 65532 I1212 11:09:16.527480 12765 parquet-column-readers.cc:959] Decompressed 12825 to 65544 I1212 11:09:16.527873 12765 parquet-column-readers.cc:959] Decompressed 38538 to 65544 I1212 11:09:16.571826 12765 parquet-column-readers.cc:959] Decompressed 27386 to 65528 I1212 11:09:16.591177 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 34202us I1212 11:09:16.647510 12765 parquet-column-readers.cc:959] Decompressed 27619 to 65527 I1212 11:09:16.674844 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 40494.6us I1212 11:09:16.745910 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 37189.3us I1212 11:09:16.768056 12765 parquet-column-readers.cc:959] Decompressed 27671 to 65541 I1212 11:09:16.815439 12765 parquet-column-readers.cc:959] Decompressed 57089 to 65540 I1212 11:09:16.871059 12765 parquet-column-readers.cc:959] Decompressed 12814 to 65544 I1212 11:09:16.871460 12765 parquet-column-readers.cc:959] Decompressed 38480 to 65544 I1212 11:09:16.874375 12765 parquet-column-readers.cc:959] Decompressed 27572 to 65518 I1212 11:09:16.982719 12765 parquet-column-readers.cc:959] Decompressed 27648 to 65524 I1212 11:09:17.056859 12765 parquet-column-readers.cc:959] Decompressed 27490 to 65507 I1212 11:09:17.130206 12765 parquet-column-readers.cc:959] Decompressed 27764 to 65524 I1212 11:09:17.165091 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:17.165336 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:17.165585 12765 parquet-column-readers.cc:959] Decompressed 62866 to 63650 I1212 11:09:17.166779 12765 parquet-column-readers.cc:959] Decompressed 65560 to 65553 I1212 11:09:17.201293 12765 parquet-column-readers.cc:959] Decompressed 12865 to 65544 I1212 11:09:17.201704 12765 parquet-column-readers.cc:959] Decompressed 38534 to 65544 I1212 11:09:17.204681 12765 parquet-column-readers.cc:959] Decompressed 27659 to 65539 I1212 11:09:17.279238 12765 parquet-column-readers.cc:959] Decompressed 65516 to 65510 I1212 11:09:17.279579 12765 parquet-column-readers.cc:959] Decompressed 57007 to 65540 I1212 11:09:17.283646 12765 parquet-column-readers.cc:959] Decompressed 27803 to 65541 I1212 11:09:17.317975 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:09:17.317986 3766 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000000 done=false I1212 11:09:17.317994 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000000 status=0 done=false I1212 11:09:17.318378 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 482.604ms 554.869ms 2.14M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:17.318964 3766 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000000 Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(500.000ms): 51.01 MB, 112.78 MB, 113.40 MB, 113.77 MB, 113.98 MB, 113.98 MB, 114.04 MB, 114.04 MB, 114.08 MB, 114.14 MB, 114.08 MB, 114.27 MB, 114.33 MB, 114.45 MB, 114.35 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.54 MB, 114.47 MB, 114.54 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.35 MB, 114.29 MB, 114.41 MB, 114.10 MB, 114.41 MB, 114.41 MB, 114.29 MB, 114.35 MB, 114.29 MB, 114.23 MB, 114.23 MB, 114.29 MB, 114.10 MB, 114.23 MB, 114.74 MB, 114.68 MB, 114.74 MB, 114.29 MB, 114.29 MB, 114.17 MB, 114.17 MB, 114.23 MB, 114.29 MB, 114.29 MB, 106.32 MB, 106.44 MB, 106.32 MB, 106.38 MB, 106.32 MB, 106.44 MB, 106.38 MB, 106.25 MB, 106.25 MB, 106.13 MB, 106.38 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 748.54K (748544) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 555.239ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 29s350ms, non-child: 29s350ms, % non-child: 100.00%) - KuduApplyTimer: 24s877ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.47 K/sec - TotalNumRows: 747.52K (747520) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 554.869ms, non-child: 554.869ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 25.07 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 61.904ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 790.53K (790528) - RowsReturned: 748.54K (748544) - RowsReturnedRate: 1.35 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 2.31 MB/sec I1212 11:09:17.320807 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:17.321033 3766 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 713.73K (713728) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.359ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 482.935ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 28s103ms, non-child: 28s103ms, % non-child: 100.00%) - KuduApplyTimer: 23s775ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.36 K/sec - TotalNumRows: 712.70K (712704) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 482.604ms, non-child: 482.604ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 75.655ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 755.71K (755712) - RowsReturned: 713.73K (713728) - RowsReturnedRate: 1.49 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 2.25 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(500.000ms): 51.01 MB, 112.78 MB, 113.40 MB, 113.77 MB, 113.98 MB, 113.98 MB, 114.04 MB, 114.04 MB, 114.08 MB, 114.14 MB, 114.08 MB, 114.27 MB, 114.33 MB, 114.45 MB, 114.35 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.54 MB, 114.47 MB, 114.54 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.35 MB, 114.29 MB, 114.41 MB, 114.10 MB, 114.41 MB, 114.41 MB, 114.29 MB, 114.35 MB, 114.29 MB, 114.23 MB, 114.23 MB, 114.29 MB, 114.10 MB, 114.23 MB, 114.74 MB, 114.68 MB, 114.74 MB, 114.29 MB, 114.29 MB, 114.17 MB, 114.17 MB, 114.23 MB, 114.29 MB, 114.29 MB, 106.32 MB, 106.44 MB, 106.32 MB, 106.38 MB, 106.32 MB, 106.44 MB, 106.38 MB, 106.25 MB, 106.25 MB, 106.13 MB, 106.38 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 748.54K (748544) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 555.239ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 29s350ms, non-child: 29s350ms, % non-child: 100.00%) - KuduApplyTimer: 24s877ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.47 K/sec - TotalNumRows: 747.52K (747520) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 554.869ms, non-child: 554.869ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 25.07 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 61.904ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 790.53K (790528) - RowsReturned: 748.54K (748544) - RowsReturnedRate: 1.35 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 2.31 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(500.000ms): 98.86 MB, 101.15 MB, 101.84 MB, 102.03 MB, 102.23 MB, 102.29 MB, 102.23 MB, 102.29 MB, 102.33 MB, 102.33 MB, 102.33 MB, 102.52 MB, 102.58 MB, 102.73 MB, 102.42 MB, 102.54 MB, 102.42 MB, 102.42 MB, 102.73 MB, 102.73 MB, 102.73 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.67 MB, 102.60 MB, 102.73 MB, 102.60 MB, 102.54 MB, 102.54 MB, 102.54 MB, 102.60 MB, 102.48 MB, 102.60 MB, 102.48 MB, 102.42 MB, 102.42 MB, 102.42 MB, 102.93 MB, 102.93 MB, 102.93 MB, 102.85 MB, 102.42 MB, 102.48 MB, 102.42 MB, 102.42 MB, 102.29 MB, 102.60 MB, 94.51 MB, 94.69 MB, 94.57 MB, 94.50 MB, 94.63 MB, 94.69 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 671.74K (671744) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 438.407ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 26s525ms, non-child: 26s525ms, % non-child: 100.00%) - KuduApplyTimer: 22s476ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.29 K/sec - TotalNumRows: 670.72K (670720) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 438.052ms, non-child: 438.052ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 97.983ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 713.73K (713728) - RowsReturned: 671.74K (671744) - RowsReturnedRate: 1.53 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 2.07 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(500.000ms): 47.95 MB, 112.52 MB, 113.27 MB, 113.83 MB, 113.91 MB, 114.03 MB, 114.10 MB, 113.97 MB, 113.78 MB, 114.07 MB, 114.07 MB, 114.26 MB, 114.26 MB, 114.45 MB, 114.35 MB, 114.22 MB, 114.22 MB, 114.16 MB, 114.59 MB, 114.47 MB, 114.53 MB, 113.91 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.41 MB, 114.35 MB, 114.41 MB, 114.28 MB, 114.28 MB, 114.28 MB, 114.35 MB, 114.22 MB, 114.28 MB, 114.17 MB, 114.03 MB, 114.16 MB, 114.16 MB, 114.67 MB, 114.67 MB, 114.80 MB, 114.61 MB, 114.16 MB, 114.16 MB, 114.28 MB, 114.10 MB, 114.28 MB, 114.16 MB, 114.22 MB, 106.37 MB, 106.37 MB, 106.31 MB, 106.25 MB, 106.37 MB, 106.44 MB, 106.37 MB, 106.19 MB, 106.31 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 720.90K (720896) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 455.159ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 28s434ms, non-child: 28s434ms, % non-child: 100.00%) - KuduApplyTimer: 23s973ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.32 K/sec - TotalNumRows: 719.87K (719872) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 454.892ms, non-child: 454.892ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 17.04 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 67.077ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 762.88K (762880) - RowsReturned: 720.90K (720896) - RowsReturnedRate: 1.58 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 2.38 MB/sec I1212 11:09:17.322197 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:17.322511 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:17.322860 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:17.365880 12765 parquet-column-readers.cc:959] Decompressed 27517 to 65514 I1212 11:09:17.476197 12765 parquet-column-readers.cc:959] Decompressed 27552 to 65510 I1212 11:09:17.561769 12765 parquet-column-readers.cc:959] Decompressed 12829 to 65544 I1212 11:09:17.561990 12765 parquet-column-readers.cc:959] Decompressed 38526 to 65544 I1212 11:09:17.563413 12765 parquet-column-readers.cc:959] Decompressed 27452 to 65525 I1212 11:09:17.664675 12765 parquet-column-readers.cc:959] Decompressed 27390 to 65529 I1212 11:09:17.697505 12765 parquet-column-readers.cc:959] Decompressed 56975 to 65540 I1212 11:09:17.744712 12765 parquet-column-readers.cc:959] Decompressed 27556 to 65525 I1212 11:09:17.831504 12765 parquet-column-readers.cc:959] Decompressed 27455 to 65500 I1212 11:09:17.853060 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 29977.5us I1212 11:09:17.864547 12765 parquet-column-readers.cc:959] Decompressed 12872 to 65544 I1212 11:09:17.864943 12765 parquet-column-readers.cc:959] Decompressed 38547 to 65544 I1212 11:09:17.914021 12765 parquet-column-readers.cc:959] Decompressed 27451 to 65514 I1212 11:09:18.024480 12765 parquet-column-readers.cc:959] Decompressed 27598 to 65500 I1212 11:09:18.105248 12765 parquet-column-readers.cc:959] Decompressed 27715 to 65523 I1212 11:09:18.203860 12765 parquet-column-readers.cc:959] Decompressed 57007 to 65540 I1212 11:09:18.206064 12765 parquet-column-readers.cc:959] Decompressed 27549 to 65538 I1212 11:09:18.237781 12765 parquet-column-readers.cc:959] Decompressed 12981 to 65544 I1212 11:09:18.237989 12765 parquet-column-readers.cc:959] Decompressed 38609 to 65544 I1212 11:09:18.274145 12765 parquet-column-readers.cc:959] Decompressed 27425 to 65515 I1212 11:09:18.341244 12765 parquet-column-readers.cc:959] Decompressed 27667 to 65520 I1212 11:09:18.409006 12765 parquet-column-readers.cc:959] Decompressed 27545 to 65520 I1212 11:09:18.522505 12765 parquet-column-readers.cc:959] Decompressed 12872 to 65544 I1212 11:09:18.522848 12765 parquet-column-readers.cc:959] Decompressed 38454 to 65544 I1212 11:09:18.525166 12765 parquet-column-readers.cc:959] Decompressed 27537 to 65507 I1212 11:09:18.622505 12765 parquet-column-readers.cc:959] Decompressed 57058 to 65540 I1212 11:09:18.624423 12765 parquet-column-readers.cc:959] Decompressed 27700 to 65541 I1212 11:09:18.761564 12765 parquet-column-readers.cc:959] Decompressed 27443 to 65541 I1212 11:09:18.867671 12765 parquet-column-readers.cc:959] Decompressed 27728 to 65525 I1212 11:09:18.952273 12765 parquet-column-readers.cc:959] Decompressed 12706 to 65544 I1212 11:09:18.952662 12765 parquet-column-readers.cc:959] Decompressed 38487 to 65544 I1212 11:09:18.952885 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:18.955507 12765 parquet-column-readers.cc:959] Decompressed 27519 to 65507 I1212 11:09:19.007192 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 30136.3us I1212 11:09:19.036490 12765 parquet-column-readers.cc:959] Decompressed 27432 to 65520 I1212 11:09:19.082350 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 36959.9us I1212 11:09:19.114547 12765 parquet-column-readers.cc:959] Decompressed 57042 to 65540 I1212 11:09:19.116657 12765 parquet-column-readers.cc:959] Decompressed 27484 to 65529 I1212 11:09:19.150849 12765 parquet-column-readers.cc:959] Decompressed 65504 to 65496 I1212 11:09:19.151144 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:19.151427 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:19.163754 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 39324.6us I1212 11:09:19.187786 12765 parquet-column-readers.cc:959] Decompressed 27597 to 65538 I1212 11:09:19.290495 12765 parquet-column-readers.cc:959] Decompressed 12688 to 65544 I1212 11:09:19.290864 12765 parquet-column-readers.cc:959] Decompressed 38617 to 65544 I1212 11:09:19.293519 12765 parquet-column-readers.cc:959] Decompressed 27692 to 65530 I1212 11:09:19.373301 12731 plan-fragment-executor.cc:408] Reporting profile for instance 25407d49fc4cde6f:d575dd6200000002 I1212 11:09:19.373651 12731 plan-fragment-executor.cc:412] Fragment 25407d49fc4cde6f:d575dd6200000002:(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 790.53K (790528) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 472.892ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 31s511ms, non-child: 0.000ns, % non-child: 0.00%) - KuduApplyTimer: 26s697ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.05 K/sec - TotalNumRows: 789.50K (789504) CodeGen:(Total: 85.001ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 472.141ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 107.261ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 832.51K (832512) - RowsReturned: 790.53K (790528) - RowsReturnedRate: 1.67 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.74 MB/sec I1212 11:09:19.373664 12731 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:09:19.373670 12731 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:09:19.374027 5418 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000002 I1212 11:09:19.374037 5418 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000002 done=false I1212 11:09:19.374044 5418 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000002 status=0 done=false I1212 11:09:19.374348 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 493.967ms 554.869ms 2.26M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:19.374642 5418 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000002 Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 790.53K (790528) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 472.892ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 31s511ms, non-child: 31s511ms, % non-child: 100.00%) - KuduApplyTimer: 26s697ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.05 K/sec - TotalNumRows: 789.50K (789504) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 472.141ms, non-child: 472.141ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 107.261ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 832.51K (832512) - RowsReturned: 790.53K (790528) - RowsReturnedRate: 1.67 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.74 MB/sec I1212 11:09:19.375754 5418 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 753.32K (753322) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.359ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 494.430ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 29s765ms, non-child: 29s765ms, % non-child: 100.00%) - KuduApplyTimer: 25s182ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.28 K/sec - TotalNumRows: 752.30K (752298) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 493.967ms, non-child: 493.967ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 78.747ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 795.31K (795306) - RowsReturned: 753.32K (753322) - RowsReturnedRate: 1.54 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 2.14 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(500.000ms): 51.01 MB, 112.78 MB, 113.40 MB, 113.77 MB, 113.98 MB, 113.98 MB, 114.04 MB, 114.04 MB, 114.08 MB, 114.14 MB, 114.08 MB, 114.27 MB, 114.33 MB, 114.45 MB, 114.35 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.54 MB, 114.47 MB, 114.54 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.35 MB, 114.29 MB, 114.41 MB, 114.10 MB, 114.41 MB, 114.41 MB, 114.29 MB, 114.35 MB, 114.29 MB, 114.23 MB, 114.23 MB, 114.29 MB, 114.10 MB, 114.23 MB, 114.74 MB, 114.68 MB, 114.74 MB, 114.29 MB, 114.29 MB, 114.17 MB, 114.17 MB, 114.23 MB, 114.29 MB, 114.29 MB, 106.32 MB, 106.44 MB, 106.32 MB, 106.38 MB, 106.32 MB, 106.44 MB, 106.38 MB, 106.25 MB, 106.25 MB, 106.13 MB, 106.38 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 748.54K (748544) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 555.239ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 29s350ms, non-child: 29s350ms, % non-child: 100.00%) - KuduApplyTimer: 24s877ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.47 K/sec - TotalNumRows: 747.52K (747520) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 554.869ms, non-child: 554.869ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 25.07 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 61.904ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 790.53K (790528) - RowsReturned: 748.54K (748544) - RowsReturnedRate: 1.35 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 2.31 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 790.53K (790528) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 472.892ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 31s511ms, non-child: 31s511ms, % non-child: 100.00%) - KuduApplyTimer: 26s697ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.05 K/sec - TotalNumRows: 789.50K (789504) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 472.141ms, non-child: 472.141ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 107.261ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 832.51K (832512) - RowsReturned: 790.53K (790528) - RowsReturnedRate: 1.67 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.74 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(500.000ms): 47.95 MB, 112.52 MB, 113.27 MB, 113.83 MB, 113.91 MB, 114.03 MB, 114.10 MB, 113.97 MB, 113.78 MB, 114.07 MB, 114.07 MB, 114.26 MB, 114.26 MB, 114.45 MB, 114.35 MB, 114.22 MB, 114.22 MB, 114.16 MB, 114.59 MB, 114.47 MB, 114.53 MB, 113.91 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.41 MB, 114.35 MB, 114.41 MB, 114.28 MB, 114.28 MB, 114.28 MB, 114.35 MB, 114.22 MB, 114.28 MB, 114.17 MB, 114.03 MB, 114.16 MB, 114.16 MB, 114.67 MB, 114.67 MB, 114.80 MB, 114.61 MB, 114.16 MB, 114.16 MB, 114.28 MB, 114.10 MB, 114.28 MB, 114.16 MB, 114.22 MB, 106.37 MB, 106.37 MB, 106.31 MB, 106.25 MB, 106.37 MB, 106.44 MB, 106.37 MB, 106.19 MB, 106.31 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 720.90K (720896) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 455.159ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 28s434ms, non-child: 28s434ms, % non-child: 100.00%) - KuduApplyTimer: 23s973ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.32 K/sec - TotalNumRows: 719.87K (719872) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 454.892ms, non-child: 454.892ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 17.04 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 67.077ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 762.88K (762880) - RowsReturned: 720.90K (720896) - RowsReturnedRate: 1.58 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 2.38 MB/sec I1212 11:09:19.375831 12731 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:09:19.382437 12765 parquet-column-readers.cc:959] Decompressed 27709 to 65536 I1212 11:09:19.449911 12765 parquet-column-readers.cc:959] Decompressed 27414 to 65524 I1212 11:09:19.519124 12765 parquet-column-readers.cc:959] Decompressed 27626 to 65536 I1212 11:09:19.550892 12765 parquet-column-readers.cc:959] Decompressed 56983 to 65540 I1212 11:09:19.583601 12765 parquet-column-readers.cc:959] Decompressed 12902 to 65544 I1212 11:09:19.583818 12765 parquet-column-readers.cc:959] Decompressed 38469 to 65544 I1212 11:09:19.619251 12765 parquet-column-readers.cc:959] Decompressed 27800 to 65516 I1212 11:09:19.704123 12765 parquet-column-readers.cc:959] Decompressed 27585 to 65506 I1212 11:09:19.798245 12765 parquet-column-readers.cc:959] Decompressed 27775 to 65520 I1212 11:09:19.867286 12765 parquet-column-readers.cc:959] Decompressed 27779 to 65540 I1212 11:09:19.898495 12765 parquet-column-readers.cc:959] Decompressed 12807 to 65544 I1212 11:09:19.898862 12765 parquet-column-readers.cc:959] Decompressed 38528 to 65544 I1212 11:09:19.935760 12765 parquet-column-readers.cc:959] Decompressed 27389 to 65542 I1212 11:09:19.968400 12765 parquet-column-readers.cc:959] Decompressed 57027 to 65540 I1212 11:09:20.004990 12765 parquet-column-readers.cc:959] Decompressed 27595 to 65528 I1212 11:09:20.075201 12765 parquet-column-readers.cc:959] Decompressed 27870 to 65508 I1212 11:09:20.158427 12765 parquet-column-readers.cc:959] Decompressed 27694 to 65519 I1212 11:09:20.197033 12765 parquet-column-readers.cc:959] Decompressed 12970 to 65544 I1212 11:09:20.197405 12765 parquet-column-readers.cc:959] Decompressed 38529 to 65544 I1212 11:09:20.207999 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 40992.2us I1212 11:09:20.237761 12765 parquet-column-readers.cc:959] Decompressed 27301 to 65510 I1212 11:09:20.309031 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 41135.5us I1212 11:09:20.339787 12765 parquet-column-readers.cc:959] Decompressed 27482 to 65525 I1212 11:09:20.349170 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 39828.9us I1212 11:09:20.393043 12765 parquet-column-readers.cc:959] Decompressed 56961 to 65540 I1212 11:09:20.449084 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:20.451856 12765 parquet-column-readers.cc:959] Decompressed 27505 to 65512 I1212 11:09:20.577466 12765 parquet-column-readers.cc:959] Decompressed 13031 to 65544 I1212 11:09:20.577862 12765 parquet-column-readers.cc:959] Decompressed 38520 to 65544 I1212 11:09:20.580651 12765 parquet-column-readers.cc:959] Decompressed 27694 to 65540 I1212 11:09:20.645820 12765 parquet-column-readers.cc:959] Decompressed 27640 to 65527 I1212 11:09:20.712952 12765 parquet-column-readers.cc:959] Decompressed 41562 to 65454 I1212 11:09:20.715880 12765 parquet-column-readers.cc:959] Decompressed 65460 to 65454 I1212 11:09:20.716017 12765 parquet-column-readers.cc:959] Decompressed 27479 to 65539 I1212 11:09:20.782354 12765 parquet-column-readers.cc:959] Decompressed 27553 to 65520 I1212 11:09:20.819103 12765 parquet-column-readers.cc:959] Decompressed 65516 to 65510 I1212 11:09:20.819411 12765 parquet-column-readers.cc:959] Decompressed 57014 to 65540 I1212 11:09:20.877162 12765 parquet-column-readers.cc:959] Decompressed 12619 to 65544 I1212 11:09:20.877385 12765 parquet-column-readers.cc:959] Decompressed 38515 to 65544 I1212 11:09:20.878237 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:20.878409 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:20.878561 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:20.878906 12765 parquet-column-readers.cc:959] Decompressed 27647 to 65528 I1212 11:09:20.997373 12765 parquet-column-readers.cc:959] Decompressed 27835 to 65521 I1212 11:09:21.112300 12765 parquet-column-readers.cc:959] Decompressed 27664 to 65514 I1212 11:09:21.183223 12765 parquet-column-readers.cc:959] Decompressed 27539 to 65538 I1212 11:09:21.247938 12765 parquet-column-readers.cc:959] Decompressed 12841 to 65544 I1212 11:09:21.248162 12765 parquet-column-readers.cc:959] Decompressed 38534 to 65544 I1212 11:09:21.249583 12765 parquet-column-readers.cc:959] Decompressed 27521 to 65506 I1212 11:09:21.318693 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000001 I1212 11:09:21.318706 3769 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000001 done=false I1212 11:09:21.318716 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000001 status=0 done=false I1212 11:09:21.319165 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 504.837ms 554.869ms 2.38M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:21.319654 3769 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000001 Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 841.73K (841728) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 488.163ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 33s428ms, non-child: 33s428ms, % non-child: 100.00%) - KuduApplyTimer: 28s219ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.15 K/sec - TotalNumRows: 840.70K (840704) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 487.500ms, non-child: 487.500ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 76.608ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 883.71K (883712) - RowsReturned: 841.73K (841728) - RowsReturnedRate: 1.73 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 2.03 MB/sec I1212 11:09:21.321491 3769 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 793.60K (793600) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.359ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 505.431ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 31s430ms, non-child: 31s430ms, % non-child: 100.00%) - KuduApplyTimer: 26s598ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.22 K/sec - TotalNumRows: 792.58K (792576) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 504.837ms, non-child: 504.837ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 81.924ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 835.58K (835584) - RowsReturned: 793.60K (793600) - RowsReturnedRate: 1.58 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 2.03 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(500.000ms): 51.01 MB, 112.78 MB, 113.40 MB, 113.77 MB, 113.98 MB, 113.98 MB, 114.04 MB, 114.04 MB, 114.08 MB, 114.14 MB, 114.08 MB, 114.27 MB, 114.33 MB, 114.45 MB, 114.35 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.54 MB, 114.47 MB, 114.54 MB, 114.29 MB, 114.16 MB, 114.16 MB, 114.16 MB, 114.35 MB, 114.29 MB, 114.41 MB, 114.10 MB, 114.41 MB, 114.41 MB, 114.29 MB, 114.35 MB, 114.29 MB, 114.23 MB, 114.23 MB, 114.29 MB, 114.10 MB, 114.23 MB, 114.74 MB, 114.68 MB, 114.74 MB, 114.29 MB, 114.29 MB, 114.17 MB, 114.17 MB, 114.23 MB, 114.29 MB, 114.29 MB, 106.32 MB, 106.44 MB, 106.32 MB, 106.38 MB, 106.32 MB, 106.44 MB, 106.38 MB, 106.25 MB, 106.25 MB, 106.13 MB, 106.38 MB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 748.54K (748544) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 555.239ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 29s350ms, non-child: 29s350ms, % non-child: 100.00%) - KuduApplyTimer: 24s877ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.47 K/sec - TotalNumRows: 747.52K (747520) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 554.869ms, non-child: 554.869ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(500.000ms): 25.07 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 61.904ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 790.53K (790528) - RowsReturned: 748.54K (748544) - RowsReturnedRate: 1.35 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 2.31 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 790.53K (790528) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 472.892ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 31s511ms, non-child: 31s511ms, % non-child: 100.00%) - KuduApplyTimer: 26s697ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.05 K/sec - TotalNumRows: 789.50K (789504) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 472.141ms, non-child: 472.141ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 107.261ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 832.51K (832512) - RowsReturned: 790.53K (790528) - RowsReturnedRate: 1.67 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.74 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 841.73K (841728) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 488.163ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 33s428ms, non-child: 33s428ms, % non-child: 100.00%) - KuduApplyTimer: 28s219ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.15 K/sec - TotalNumRows: 840.70K (840704) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 487.500ms, non-child: 487.500ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 76.608ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 883.71K (883712) - RowsReturned: 841.73K (841728) - RowsReturnedRate: 1.73 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 2.03 MB/sec I1212 11:09:21.333212 12765 parquet-column-readers.cc:959] Decompressed 56990 to 65540 I1212 11:09:21.335674 12765 parquet-column-readers.cc:959] Decompressed 27780 to 65540 I1212 11:09:21.344104 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 29491.8us I1212 11:09:21.417222 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 32793.6us I1212 11:09:21.477644 12765 parquet-column-readers.cc:959] Decompressed 27764 to 65525 I1212 11:09:21.546974 12765 parquet-column-readers.cc:959] Decompressed 27637 to 65522 I1212 11:09:21.586606 12765 parquet-column-readers.cc:959] Decompressed 12725 to 65544 I1212 11:09:21.586989 12765 parquet-column-readers.cc:959] Decompressed 38539 to 65544 I1212 11:09:21.638649 12765 parquet-column-readers.cc:959] Decompressed 27537 to 65534 I1212 11:09:21.735280 12765 parquet-column-readers.cc:959] Decompressed 27608 to 65528 I1212 11:09:21.788264 12765 parquet-column-readers.cc:959] Decompressed 57050 to 65540 I1212 11:09:21.822311 12765 parquet-column-readers.cc:959] Decompressed 27431 to 65533 I1212 11:09:21.888599 12765 parquet-column-readers.cc:959] Decompressed 27594 to 65537 I1212 11:09:21.920192 12765 parquet-column-readers.cc:959] Decompressed 12698 to 65544 I1212 11:09:21.920425 12765 parquet-column-readers.cc:959] Decompressed 38525 to 65544 I1212 11:09:21.953690 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:21.956311 12765 parquet-column-readers.cc:959] Decompressed 27474 to 65531 I1212 11:09:22.025380 12765 parquet-column-readers.cc:959] Decompressed 27670 to 65532 I1212 11:09:22.109488 12765 parquet-column-readers.cc:959] Decompressed 27784 to 65510 I1212 11:09:22.188757 12765 parquet-column-readers.cc:959] Decompressed 57024 to 65540 I1212 11:09:22.190971 12765 parquet-column-readers.cc:959] Decompressed 27696 to 65534 I1212 11:09:22.222826 12765 parquet-column-readers.cc:959] Decompressed 12801 to 65544 I1212 11:09:22.223198 12765 parquet-column-readers.cc:959] Decompressed 38520 to 65544 I1212 11:09:22.293956 12765 parquet-column-readers.cc:959] Decompressed 27501 to 65508 I1212 11:09:22.322029 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:09:22.322039 3766 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000000 done=false I1212 11:09:22.322047 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000000 status=0 done=false I1212 11:09:22.322438 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 512.062ms 576.547ms 2.51M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:22.322928 3766 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000000 Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 877.57K (877568) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 577.338ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 34s377ms, non-child: 34s377ms, % non-child: 100.00%) - KuduApplyTimer: 29s112ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.50 K/sec - TotalNumRows: 876.54K (876544) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 576.547ms, non-child: 576.547ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 73.631ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 919.55K (919552) - RowsReturned: 877.57K (877568) - RowsReturnedRate: 1.52 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.98 MB/sec I1212 11:09:22.324607 3766 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 836.61K (836608) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.359ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 512.798ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 33s105ms, non-child: 33s105ms, % non-child: 100.00%) - KuduApplyTimer: 28s010ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.23 K/sec - TotalNumRows: 835.58K (835584) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 512.062ms, non-child: 512.062ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 85.833ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 878.59K (878592) - RowsReturned: 836.61K (836608) - RowsReturnedRate: 1.64 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.92 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 877.57K (877568) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 577.338ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 34s377ms, non-child: 34s377ms, % non-child: 100.00%) - KuduApplyTimer: 29s112ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.50 K/sec - TotalNumRows: 876.54K (876544) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 576.547ms, non-child: 576.547ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 73.631ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 919.55K (919552) - RowsReturned: 877.57K (877568) - RowsReturnedRate: 1.52 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.98 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 790.53K (790528) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 472.892ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 31s511ms, non-child: 31s511ms, % non-child: 100.00%) - KuduApplyTimer: 26s697ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.05 K/sec - TotalNumRows: 789.50K (789504) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 472.141ms, non-child: 472.141ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 107.261ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 832.51K (832512) - RowsReturned: 790.53K (790528) - RowsReturnedRate: 1.67 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.74 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 841.73K (841728) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 488.163ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 33s428ms, non-child: 33s428ms, % non-child: 100.00%) - KuduApplyTimer: 28s219ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.15 K/sec - TotalNumRows: 840.70K (840704) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 487.500ms, non-child: 487.500ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 76.608ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 883.71K (883712) - RowsReturned: 841.73K (841728) - RowsReturnedRate: 1.73 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 2.03 MB/sec I1212 11:09:22.361676 12765 parquet-column-readers.cc:959] Decompressed 27588 to 65499 I1212 11:09:22.428272 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:22.428539 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:22.430337 12765 parquet-column-readers.cc:959] Decompressed 27698 to 65539 I1212 11:09:22.503276 12765 parquet-column-readers.cc:959] Decompressed 13059 to 65544 I1212 11:09:22.503660 12765 parquet-column-readers.cc:959] Decompressed 38476 to 65544 I1212 11:09:22.506458 12765 parquet-column-readers.cc:959] Decompressed 27555 to 65538 I1212 11:09:22.556355 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 39761.8us I1212 11:09:22.617722 12765 parquet-column-readers.cc:959] Decompressed 57059 to 65540 I1212 11:09:22.619845 12765 parquet-column-readers.cc:959] Decompressed 27592 to 65516 I1212 11:09:22.652230 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 51116us I1212 11:09:22.666870 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:22.667155 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:22.667438 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:22.692464 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 39954.4us I1212 11:09:22.702374 12765 parquet-column-readers.cc:959] Decompressed 27566 to 65504 I1212 11:09:22.775630 12765 parquet-column-readers.cc:959] Decompressed 27585 to 65506 I1212 11:09:22.862901 12765 parquet-column-readers.cc:959] Decompressed 12926 to 65544 I1212 11:09:22.863287 12765 parquet-column-readers.cc:959] Decompressed 38564 to 65544 I1212 11:09:22.866096 12765 parquet-column-readers.cc:959] Decompressed 27658 to 65536 I1212 11:09:22.944636 12765 parquet-column-readers.cc:959] Decompressed 27485 to 65513 I1212 11:09:23.018954 12765 parquet-column-readers.cc:959] Decompressed 57033 to 65540 I1212 11:09:23.021147 12765 parquet-column-readers.cc:959] Decompressed 27559 to 65517 I1212 11:09:23.138228 12765 parquet-column-readers.cc:959] Decompressed 27482 to 65524 I1212 11:09:23.169381 12765 parquet-column-readers.cc:959] Decompressed 12932 to 65544 I1212 11:09:23.169759 12765 parquet-column-readers.cc:959] Decompressed 38494 to 65544 I1212 11:09:23.221300 12765 parquet-column-readers.cc:959] Decompressed 27623 to 65533 I1212 11:09:23.320318 12765 parquet-column-readers.cc:959] Decompressed 27509 to 65533 I1212 11:09:23.412442 12765 parquet-column-readers.cc:959] Decompressed 27438 to 65539 I1212 11:09:23.444725 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:23.478974 12765 parquet-column-readers.cc:959] Decompressed 57041 to 65540 I1212 11:09:23.480051 12765 parquet-column-readers.cc:959] Decompressed 27768 to 65525 I1212 11:09:23.512154 12765 parquet-column-readers.cc:959] Decompressed 12911 to 65544 I1212 11:09:23.512452 12765 parquet-column-readers.cc:959] Decompressed 38592 to 65544 I1212 11:09:23.546952 12765 parquet-column-readers.cc:959] Decompressed 27608 to 65520 I1212 11:09:23.614079 12765 parquet-column-readers.cc:959] Decompressed 27815 to 65535 I1212 11:09:23.701126 12765 parquet-column-readers.cc:959] Decompressed 27535 to 65527 I1212 11:09:23.783514 12765 parquet-column-readers.cc:959] Decompressed 27736 to 65524 I1212 11:09:23.823144 12765 parquet-column-readers.cc:959] Decompressed 12734 to 65544 I1212 11:09:23.823369 12765 parquet-column-readers.cc:959] Decompressed 38536 to 65544 I1212 11:09:23.859138 12765 parquet-column-readers.cc:959] Decompressed 27684 to 65502 I1212 11:09:23.892019 12765 parquet-column-readers.cc:959] Decompressed 57011 to 65540 I1212 11:09:23.927162 12765 parquet-column-readers.cc:959] Decompressed 27552 to 65543 I1212 11:09:24.068135 12765 parquet-column-readers.cc:959] Decompressed 27553 to 65516 I1212 11:09:24.149639 12765 parquet-column-readers.cc:959] Decompressed 12762 to 65544 I1212 11:09:24.150051 12765 parquet-column-readers.cc:959] Decompressed 38542 to 65544 I1212 11:09:24.152850 12765 parquet-column-readers.cc:959] Decompressed 27764 to 65505 I1212 11:09:24.222602 12765 parquet-column-readers.cc:959] Decompressed 27594 to 65525 I1212 11:09:24.287209 12765 parquet-column-readers.cc:959] Decompressed 65516 to 65510 I1212 11:09:24.287586 12765 parquet-column-readers.cc:959] Decompressed 57052 to 65540 I1212 11:09:24.289750 12765 parquet-column-readers.cc:959] Decompressed 27719 to 65539 I1212 11:09:24.321849 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:24.322124 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:24.322420 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:24.375929 12731 plan-fragment-executor.cc:408] Reporting profile for instance 25407d49fc4cde6f:d575dd6200000002 I1212 11:09:24.376322 12731 plan-fragment-executor.cc:412] Fragment 25407d49fc4cde6f:d575dd6200000002:(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 918.53K (918528) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 495.277ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 36s513ms, non-child: 0.000ns, % non-child: 0.00%) - KuduApplyTimer: 30s919ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.13 K/sec - TotalNumRows: 917.50K (917504) CodeGen:(Total: 85.001ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 494.094ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 116.901ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 959.49K (959488) - RowsReturned: 918.53K (918528) - RowsReturnedRate: 1.86 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.51 MB/sec I1212 11:09:24.376355 12731 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:09:24.376366 12731 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:09:24.376688 3396 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000002 I1212 11:09:24.376694 3396 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000002 done=false I1212 11:09:24.376701 3396 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000002 status=0 done=false I1212 11:09:24.377024 3396 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 519.380ms 576.547ms 2.64M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:24.377308 3396 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000002 Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 918.53K (918528) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 495.277ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 36s513ms, non-child: 36s513ms, % non-child: 100.00%) - KuduApplyTimer: 30s919ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.13 K/sec - TotalNumRows: 917.50K (917504) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 494.094ms, non-child: 494.094ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 116.901ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 959.49K (959488) - RowsReturned: 918.53K (918528) - RowsReturnedRate: 1.86 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.51 MB/sec I1212 11:09:24.378316 3396 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 879.27K (879274) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.359ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 520.259ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 34s772ms, non-child: 34s772ms, % non-child: 100.00%) - KuduApplyTimer: 29s417ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.26 K/sec - TotalNumRows: 878.25K (878250) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 519.380ms, non-child: 519.380ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 89.047ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 920.92K (920917) - RowsReturned: 879.27K (879274) - RowsReturnedRate: 1.70 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.84 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 877.57K (877568) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 577.338ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 34s377ms, non-child: 34s377ms, % non-child: 100.00%) - KuduApplyTimer: 29s112ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.50 K/sec - TotalNumRows: 876.54K (876544) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 576.547ms, non-child: 576.547ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 73.631ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 919.55K (919552) - RowsReturned: 877.57K (877568) - RowsReturnedRate: 1.52 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.98 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 918.53K (918528) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 495.277ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 36s513ms, non-child: 36s513ms, % non-child: 100.00%) - KuduApplyTimer: 30s919ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.13 K/sec - TotalNumRows: 917.50K (917504) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 494.094ms, non-child: 494.094ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 116.901ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 959.49K (959488) - RowsReturned: 918.53K (918528) - RowsReturnedRate: 1.86 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.51 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 841.73K (841728) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 488.163ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 33s428ms, non-child: 33s428ms, % non-child: 100.00%) - KuduApplyTimer: 28s219ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.15 K/sec - TotalNumRows: 840.70K (840704) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 487.500ms, non-child: 487.500ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 76.608ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 883.71K (883712) - RowsReturned: 841.73K (841728) - RowsReturnedRate: 1.73 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 2.03 MB/sec I1212 11:09:24.378465 12731 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:09:24.379494 12765 parquet-column-readers.cc:959] Decompressed 27467 to 65523 I1212 11:09:24.473290 12765 parquet-column-readers.cc:959] Decompressed 12861 to 65544 I1212 11:09:24.473654 12765 parquet-column-readers.cc:959] Decompressed 38570 to 65544 I1212 11:09:24.476357 12765 parquet-column-readers.cc:959] Decompressed 27674 to 65537 I1212 11:09:24.575919 12765 parquet-column-readers.cc:959] Decompressed 27600 to 65534 I1212 11:09:24.647581 12765 parquet-column-readers.cc:959] Decompressed 27449 to 65528 I1212 11:09:24.715399 12765 parquet-column-readers.cc:959] Decompressed 27677 to 65531 I1212 11:09:24.748209 12765 parquet-column-readers.cc:959] Decompressed 57029 to 65540 I1212 11:09:24.779979 12765 parquet-column-readers.cc:959] Decompressed 12812 to 65544 I1212 11:09:24.780364 12765 parquet-column-readers.cc:959] Decompressed 38463 to 65544 I1212 11:09:24.816414 12765 parquet-column-readers.cc:959] Decompressed 27402 to 65525 I1212 11:09:24.861243 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:24.883430 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 38075.2us I1212 11:09:24.907157 12765 parquet-column-readers.cc:959] Decompressed 27545 to 65538 I1212 11:09:24.983968 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 39700.2us I1212 11:09:24.994410 12765 parquet-column-readers.cc:959] Decompressed 27686 to 65539 I1212 11:09:25.063045 12765 parquet-column-readers.cc:959] Decompressed 27381 to 65519 I1212 11:09:25.093837 12765 parquet-column-readers.cc:959] Decompressed 12770 to 65544 I1212 11:09:25.094202 12765 parquet-column-readers.cc:959] Decompressed 38534 to 65544 I1212 11:09:25.131804 12765 parquet-column-readers.cc:959] Decompressed 27419 to 65541 I1212 11:09:25.172977 12765 parquet-column-readers.cc:959] Decompressed 57019 to 65540 I1212 11:09:25.217164 12765 parquet-column-readers.cc:959] Decompressed 27490 to 65540 I1212 11:09:25.312539 12765 parquet-column-readers.cc:959] Decompressed 27654 to 65541 I1212 11:09:25.378048 12765 parquet-column-readers.cc:959] Decompressed 27481 to 65530 I1212 11:09:25.410629 12765 parquet-column-readers.cc:959] Decompressed 12837 to 65544 I1212 11:09:25.410850 12765 parquet-column-readers.cc:959] Decompressed 38527 to 65544 I1212 11:09:25.445302 12765 parquet-column-readers.cc:959] Decompressed 27510 to 65504 I1212 11:09:25.512519 12765 parquet-column-readers.cc:959] Decompressed 27622 to 65515 I1212 11:09:25.551213 12765 parquet-column-readers.cc:959] Decompressed 57057 to 65540 I1212 11:09:25.634701 12765 parquet-column-readers.cc:959] Decompressed 27458 to 65528 I1212 11:09:25.727996 12765 parquet-column-readers.cc:959] Decompressed 12743 to 65544 I1212 11:09:25.728380 12765 parquet-column-readers.cc:959] Decompressed 38572 to 65544 I1212 11:09:25.731181 12765 parquet-column-readers.cc:959] Decompressed 27532 to 65540 I1212 11:09:25.826372 12765 parquet-column-readers.cc:959] Decompressed 27661 to 65517 I1212 11:09:25.892382 12765 parquet-column-readers.cc:959] Decompressed 27437 to 65519 I1212 11:09:25.958693 12765 parquet-column-readers.cc:959] Decompressed 27475 to 65520 I1212 11:09:26.003279 12765 parquet-column-readers.cc:959] Decompressed 57006 to 65540 I1212 11:09:26.030239 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 32912.3us I1212 11:09:26.055408 12765 parquet-column-readers.cc:959] Decompressed 12852 to 65544 I1212 11:09:26.055806 12765 parquet-column-readers.cc:959] Decompressed 38462 to 65544 I1212 11:09:26.057420 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:26.057719 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:26.058156 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:26.058897 12765 parquet-column-readers.cc:959] Decompressed 27528 to 65536 I1212 11:09:26.172042 12765 parquet-column-readers.cc:959] Decompressed 27705 to 65527 I1212 11:09:26.278482 12765 parquet-column-readers.cc:959] Decompressed 27647 to 65535 I1212 11:09:26.322859 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000001 I1212 11:09:26.322867 3769 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000001 done=false I1212 11:09:26.322876 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000001 status=0 done=false I1212 11:09:26.323298 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 524.466ms 576.547ms 2.76M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:26.323766 3769 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000001 Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 964.61K (964608) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 503.813ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 38s413ms, non-child: 38s413ms, % non-child: 100.00%) - KuduApplyTimer: 32s423ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.08 K/sec - TotalNumRows: 963.58K (963584) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 502.758ms, non-child: 502.758ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 86.026ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.01M (1006592) - RowsReturned: 964.61K (964608) - RowsReturnedRate: 1.92 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.77 MB/sec I1212 11:09:26.325398 3769 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 920.23K (920234) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.359ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 525.476ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 36s434ms, non-child: 36s434ms, % non-child: 100.00%) - KuduApplyTimer: 30s818ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.24 K/sec - TotalNumRows: 919.21K (919210) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 524.466ms, non-child: 524.466ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 92.186ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 961.88K (961877) - RowsReturned: 920.23K (920234) - RowsReturnedRate: 1.77 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.75 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 877.57K (877568) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 577.338ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 34s377ms, non-child: 34s377ms, % non-child: 100.00%) - KuduApplyTimer: 29s112ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.50 K/sec - TotalNumRows: 876.54K (876544) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 576.547ms, non-child: 576.547ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 73.631ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 919.55K (919552) - RowsReturned: 877.57K (877568) - RowsReturnedRate: 1.52 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.98 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 918.53K (918528) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 495.277ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 36s513ms, non-child: 36s513ms, % non-child: 100.00%) - KuduApplyTimer: 30s919ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.13 K/sec - TotalNumRows: 917.50K (917504) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 494.094ms, non-child: 494.094ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 116.901ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 959.49K (959488) - RowsReturned: 918.53K (918528) - RowsReturnedRate: 1.86 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.51 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 964.61K (964608) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 503.813ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 38s413ms, non-child: 38s413ms, % non-child: 100.00%) - KuduApplyTimer: 32s423ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.08 K/sec - TotalNumRows: 963.58K (963584) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 502.758ms, non-child: 502.758ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 86.026ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.01M (1006592) - RowsReturned: 964.61K (964608) - RowsReturnedRate: 1.92 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.77 MB/sec I1212 11:09:26.390180 12765 parquet-column-readers.cc:959] Decompressed 27715 to 65511 I1212 11:09:26.448740 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:26.494715 12765 parquet-column-readers.cc:959] Decompressed 12932 to 65544 I1212 11:09:26.495076 12765 parquet-column-readers.cc:959] Decompressed 38433 to 65544 I1212 11:09:26.497839 12765 parquet-column-readers.cc:959] Decompressed 27492 to 65538 I1212 11:09:26.564589 12765 parquet-column-readers.cc:959] Decompressed 57077 to 65540 I1212 11:09:26.566849 12765 parquet-column-readers.cc:959] Decompressed 27672 to 65523 I1212 11:09:26.670374 12765 parquet-column-readers.cc:959] Decompressed 27532 to 65538 I1212 11:09:26.738934 12765 parquet-column-readers.cc:959] Decompressed 27559 to 65529 I1212 11:09:26.770748 12765 parquet-column-readers.cc:959] Decompressed 12821 to 65544 I1212 11:09:26.771113 12765 parquet-column-readers.cc:959] Decompressed 38415 to 65544 I1212 11:09:26.815366 12765 parquet-column-readers.cc:959] Decompressed 27349 to 65540 I1212 11:09:26.901559 12765 parquet-column-readers.cc:959] Decompressed 27734 to 65525 I1212 11:09:26.940390 12765 parquet-column-readers.cc:959] Decompressed 57034 to 65540 I1212 11:09:26.988441 12765 parquet-column-readers.cc:959] Decompressed 27536 to 65540 I1212 11:09:27.069068 12765 parquet-column-readers.cc:959] Decompressed 27584 to 65543 I1212 11:09:27.103770 12765 parquet-column-readers.cc:959] Decompressed 12824 to 65544 I1212 11:09:27.103984 12765 parquet-column-readers.cc:959] Decompressed 38560 to 65544 I1212 11:09:27.141242 12765 parquet-column-readers.cc:959] Decompressed 27444 to 65512 I1212 11:09:27.252398 12765 parquet-column-readers.cc:959] Decompressed 27607 to 65523 I1212 11:09:27.325862 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:09:27.325872 3766 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000000 done=false I1212 11:09:27.325881 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000000 status=0 done=false I1212 11:09:27.326275 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 529.743ms 592.376ms 2.88M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:27.326702 3766 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000000 Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.00M (1001472) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 593.557ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 39s352ms, non-child: 39s352ms, % non-child: 100.00%) - KuduApplyTimer: 33s307ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.42 K/sec - TotalNumRows: 1.00M (1000448) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 592.376ms, non-child: 592.376ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 83.431ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.04M (1043456) - RowsReturned: 1.00M (1001472) - RowsReturnedRate: 1.69 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.73 MB/sec I1212 11:09:27.328207 3766 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 961.54K (961536) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.359ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 530.882ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 38s092ms, non-child: 38s092ms, % non-child: 100.00%) - KuduApplyTimer: 32s216ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.21 K/sec - TotalNumRows: 960.51K (960512) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 529.743ms, non-child: 529.743ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 95.453ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.00M (1003178) - RowsReturned: 961.54K (961536) - RowsReturnedRate: 1.82 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.67 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.00M (1001472) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 593.557ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 39s352ms, non-child: 39s352ms, % non-child: 100.00%) - KuduApplyTimer: 33s307ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.42 K/sec - TotalNumRows: 1.00M (1000448) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 592.376ms, non-child: 592.376ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 83.431ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.04M (1043456) - RowsReturned: 1.00M (1001472) - RowsReturnedRate: 1.69 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.73 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 918.53K (918528) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 495.277ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 36s513ms, non-child: 36s513ms, % non-child: 100.00%) - KuduApplyTimer: 30s919ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.13 K/sec - TotalNumRows: 917.50K (917504) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 494.094ms, non-child: 494.094ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 116.901ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 959.49K (959488) - RowsReturned: 918.53K (918528) - RowsReturnedRate: 1.86 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.51 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 964.61K (964608) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 503.813ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 38s413ms, non-child: 38s413ms, % non-child: 100.00%) - KuduApplyTimer: 32s423ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.08 K/sec - TotalNumRows: 963.58K (963584) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 502.758ms, non-child: 502.758ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 86.026ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.01M (1006592) - RowsReturned: 964.61K (964608) - RowsReturnedRate: 1.92 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.77 MB/sec I1212 11:09:27.334589 12765 parquet-column-readers.cc:959] Decompressed 75001 to 80789 I1212 11:09:27.336041 12765 parquet-column-readers.cc:959] Decompressed 27669 to 65539 I1212 11:09:27.403723 12765 parquet-column-readers.cc:959] Decompressed 57030 to 65540 I1212 11:09:27.405931 12765 parquet-column-readers.cc:959] Decompressed 27463 to 65536 I1212 11:09:27.438463 12765 parquet-column-readers.cc:959] Decompressed 12792 to 65544 I1212 11:09:27.438835 12765 parquet-column-readers.cc:959] Decompressed 38492 to 65544 I1212 11:09:27.481058 12765 parquet-column-readers.cc:959] Decompressed 27520 to 65511 I1212 11:09:27.560822 12765 parquet-column-readers.cc:959] Decompressed 27469 to 65519 I1212 11:09:27.655710 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:27.655844 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:27.655954 12765 parquet-column-readers.cc:959] Decompressed 62933 to 63467 I1212 11:09:27.656528 12765 parquet-column-readers.cc:959] Decompressed 65559 to 65552 I1212 11:09:27.688972 12765 parquet-column-readers.cc:959] Decompressed 41492 to 65454 I1212 11:09:27.690305 12765 parquet-column-readers.cc:959] Decompressed 65460 to 65454 I1212 11:09:27.690474 12765 parquet-column-readers.cc:959] Decompressed 27646 to 65527 I1212 11:09:27.757362 12765 parquet-column-readers.cc:959] Decompressed 12922 to 65544 I1212 11:09:27.757573 12765 parquet-column-readers.cc:959] Decompressed 38565 to 65544 I1212 11:09:27.758981 12765 parquet-column-readers.cc:959] Decompressed 27651 to 65527 I1212 11:09:27.791224 12765 parquet-column-readers.cc:959] Decompressed 65516 to 65510 I1212 11:09:27.824594 12765 parquet-column-readers.cc:959] Decompressed 56999 to 65540 I1212 11:09:27.825196 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:27.825364 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:27.825511 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:27.825819 12765 parquet-column-readers.cc:959] Decompressed 27481 to 65517 I1212 11:09:27.857751 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:27.891721 12765 parquet-column-readers.cc:959] Decompressed 27376 to 65520 I1212 11:09:27.990555 12765 parquet-column-readers.cc:959] Decompressed 27753 to 65539 I1212 11:09:28.095770 12765 parquet-column-readers.cc:959] Decompressed 12744 to 65544 I1212 11:09:28.096179 12765 parquet-column-readers.cc:959] Decompressed 38530 to 65544 I1212 11:09:28.099134 12765 parquet-column-readers.cc:959] Decompressed 27547 to 65537 I1212 11:09:28.183790 12765 parquet-column-readers.cc:959] Decompressed 27589 to 65533 I1212 11:09:28.254127 12765 parquet-column-readers.cc:959] Decompressed 57077 to 65540 I1212 11:09:28.256304 12765 parquet-column-readers.cc:959] Decompressed 27597 to 65528 I1212 11:09:28.327260 12765 parquet-column-readers.cc:959] Decompressed 27495 to 65499 I1212 11:09:28.401470 12765 parquet-column-readers.cc:959] Decompressed 12860 to 65544 I1212 11:09:28.401851 12765 parquet-column-readers.cc:959] Decompressed 38507 to 65544 I1212 11:09:28.404685 12765 parquet-column-readers.cc:959] Decompressed 27723 to 65535 I1212 11:09:28.430930 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 43001.2us I1212 11:09:28.527554 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 40820.6us I1212 11:09:28.533285 12765 parquet-column-readers.cc:959] Decompressed 27327 to 65537 I1212 11:09:28.609522 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 41001.8us I1212 11:09:28.619163 12765 parquet-column-readers.cc:959] Decompressed 27683 to 65538 I1212 11:09:28.708278 12765 parquet-column-readers.cc:959] Decompressed 57040 to 65540 I1212 11:09:28.710371 12765 parquet-column-readers.cc:959] Decompressed 27496 to 65508 I1212 11:09:28.755417 12765 parquet-column-readers.cc:959] Decompressed 12857 to 65544 I1212 11:09:28.755897 12765 parquet-column-readers.cc:959] Decompressed 38486 to 65544 I1212 11:09:28.813119 12765 parquet-column-readers.cc:959] Decompressed 27630 to 65525 I1212 11:09:28.895735 12765 parquet-column-readers.cc:959] Decompressed 27587 to 65543 I1212 11:09:28.967221 12765 parquet-column-readers.cc:959] Decompressed 27690 to 65508 I1212 11:09:29.035734 12765 parquet-column-readers.cc:959] Decompressed 27676 to 65520 I1212 11:09:29.068141 12765 parquet-column-readers.cc:959] Decompressed 12704 to 65544 I1212 11:09:29.068416 12765 parquet-column-readers.cc:959] Decompressed 38450 to 65544 I1212 11:09:29.103835 12765 parquet-column-readers.cc:959] Decompressed 27444 to 65525 I1212 11:09:29.136463 12765 parquet-column-readers.cc:959] Decompressed 57013 to 65540 I1212 11:09:29.172166 12765 parquet-column-readers.cc:959] Decompressed 27621 to 65536 I1212 11:09:29.261508 12765 parquet-column-readers.cc:959] Decompressed 27502 to 65529 I1212 11:09:29.375866 12765 parquet-column-readers.cc:959] Decompressed 12763 to 65544 I1212 11:09:29.376240 12765 parquet-column-readers.cc:959] Decompressed 38571 to 65544 I1212 11:09:29.376365 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:29.378548 12731 plan-fragment-executor.cc:408] Reporting profile for instance 25407d49fc4cde6f:d575dd6200000002 I1212 11:09:29.379024 12765 parquet-column-readers.cc:959] Decompressed 27423 to 65524 I1212 11:09:29.379137 12731 plan-fragment-executor.cc:412] Fragment 25407d49fc4cde6f:d575dd6200000002:(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.04M (1043456) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 526.109ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 41s483ms, non-child: 0.000ns, % non-child: 0.00%) - KuduApplyTimer: 35s111ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.13 K/sec - TotalNumRows: 1.04M (1042432) CodeGen:(Total: 85.001ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 524.527ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 127.067ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.08M (1084416) - RowsReturned: 1.04M (1043456) - RowsReturnedRate: 1.99 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.33 MB/sec I1212 11:09:29.379168 12731 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:09:29.379175 12731 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:09:29.379755 5418 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000002 I1212 11:09:29.379767 5418 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000002 done=false I1212 11:09:29.379782 5418 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000002 status=0 done=false I1212 11:09:29.380267 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 539.887ms 592.376ms 3.01M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:29.380810 5418 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000002 Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.04M (1043456) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 526.109ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 41s483ms, non-child: 41s483ms, % non-child: 100.00%) - KuduApplyTimer: 35s111ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.13 K/sec - TotalNumRows: 1.04M (1042432) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 524.527ms, non-child: 524.527ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 127.067ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.09M (1085440) - RowsReturned: 1.04M (1043456) - RowsReturnedRate: 1.99 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.33 MB/sec I1212 11:09:29.382654 5418 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.00M (1003178) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.359ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 541.160ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 39s749ms, non-child: 39s749ms, % non-child: 100.00%) - KuduApplyTimer: 33s614ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.21 K/sec - TotalNumRows: 1.00M (1002154) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 539.887ms, non-child: 539.887ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 98.841ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.05M (1045162) - RowsReturned: 1.00M (1003178) - RowsReturnedRate: 1.87 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.61 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.00M (1001472) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 593.557ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 39s352ms, non-child: 39s352ms, % non-child: 100.00%) - KuduApplyTimer: 33s307ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.42 K/sec - TotalNumRows: 1.00M (1000448) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 592.376ms, non-child: 592.376ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 83.431ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.04M (1043456) - RowsReturned: 1.00M (1001472) - RowsReturnedRate: 1.69 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.73 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.04M (1043456) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 526.109ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 41s483ms, non-child: 41s483ms, % non-child: 100.00%) - KuduApplyTimer: 35s111ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.13 K/sec - TotalNumRows: 1.04M (1042432) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 524.527ms, non-child: 524.527ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 127.067ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.09M (1085440) - RowsReturned: 1.04M (1043456) - RowsReturnedRate: 1.99 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.33 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 964.61K (964608) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 503.813ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 38s413ms, non-child: 38s413ms, % non-child: 100.00%) - KuduApplyTimer: 32s423ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.08 K/sec - TotalNumRows: 963.58K (963584) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 502.758ms, non-child: 502.758ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 86.026ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.01M (1006592) - RowsReturned: 964.61K (964608) - RowsReturnedRate: 1.92 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.77 MB/sec I1212 11:09:29.382832 12731 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:09:29.452042 12765 parquet-column-readers.cc:959] Decompressed 27659 to 65532 I1212 11:09:29.522593 12765 parquet-column-readers.cc:959] Decompressed 57143 to 65540 I1212 11:09:29.524745 12765 parquet-column-readers.cc:959] Decompressed 27649 to 65526 I1212 11:09:29.562630 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:29.562934 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:29.563221 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:29.612380 12765 parquet-column-readers.cc:959] Decompressed 27869 to 65534 I1212 11:09:29.627753 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 39526.3us I1212 11:09:29.690206 12765 parquet-column-readers.cc:959] Decompressed 12663 to 65544 I1212 11:09:29.690619 12765 parquet-column-readers.cc:959] Decompressed 38491 to 65544 I1212 11:09:29.693640 12765 parquet-column-readers.cc:959] Decompressed 27740 to 65540 I1212 11:09:29.774310 12765 parquet-column-readers.cc:959] Decompressed 27494 to 65511 I1212 11:09:29.774932 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 30550us I1212 11:09:29.843747 12765 parquet-column-readers.cc:959] Decompressed 27429 to 65505 I1212 11:09:29.926658 12765 parquet-column-readers.cc:959] Decompressed 27542 to 65508 I1212 11:09:29.971251 12765 parquet-column-readers.cc:959] Decompressed 56979 to 65540 I1212 11:09:30.021553 12765 parquet-column-readers.cc:959] Decompressed 12770 to 65544 I1212 11:09:30.021940 12765 parquet-column-readers.cc:959] Decompressed 38497 to 65544 I1212 11:09:30.024811 12765 parquet-column-readers.cc:959] Decompressed 27346 to 65507 I1212 11:09:30.141050 12765 parquet-column-readers.cc:959] Decompressed 27504 to 65514 I1212 11:09:30.257151 12765 parquet-column-readers.cc:959] Decompressed 27608 to 65524 I1212 11:09:30.369652 12765 parquet-column-readers.cc:959] Decompressed 27460 to 65523 I1212 11:09:30.400437 12765 parquet-column-readers.cc:959] Decompressed 12577 to 65544 I1212 11:09:30.400809 12765 parquet-column-readers.cc:959] Decompressed 38510 to 65544 I1212 11:09:30.444190 12765 parquet-column-readers.cc:959] Decompressed 27670 to 65527 I1212 11:09:30.495280 12765 parquet-column-readers.cc:959] Decompressed 57028 to 65540 I1212 11:09:30.544399 12765 parquet-column-readers.cc:959] Decompressed 27496 to 65526 I1212 11:09:30.661212 12765 parquet-column-readers.cc:959] Decompressed 27698 to 65528 I1212 11:09:30.777469 12765 parquet-column-readers.cc:959] Decompressed 27543 to 65519 I1212 11:09:30.796928 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 36284.5us I1212 11:09:30.832645 12765 parquet-column-readers.cc:959] Decompressed 12685 to 65544 I1212 11:09:30.833022 12765 parquet-column-readers.cc:959] Decompressed 38545 to 65544 I1212 11:09:30.883846 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 41477.8us I1212 11:09:30.901856 12765 parquet-column-readers.cc:959] Decompressed 27691 to 65506 I1212 11:09:30.977506 12765 parquet-column-readers.cc:959] Decompressed 27647 to 65510 I1212 11:09:31.011070 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:31.011636 12765 parquet-column-readers.cc:959] Decompressed 57043 to 65540 I1212 11:09:31.053324 12765 parquet-column-readers.cc:959] Decompressed 27448 to 65527 I1212 11:09:31.132560 12765 parquet-column-readers.cc:959] Decompressed 27432 to 65526 I1212 11:09:31.182706 12765 parquet-column-readers.cc:959] Decompressed 12958 to 65544 I1212 11:09:31.183094 12765 parquet-column-readers.cc:959] Decompressed 38547 to 65544 I1212 11:09:31.225939 12765 parquet-column-readers.cc:959] Decompressed 27658 to 65514 I1212 11:09:31.326606 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000001 I1212 11:09:31.326613 3769 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000001 done=false I1212 11:09:31.326622 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000001 status=0 done=false I1212 11:09:31.327033 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 541.821ms 592.376ms 3.13M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:31.327605 3769 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000001 Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB, 106.22 MB, 106.57 MB, 106.76 MB, 106.25 MB, 106.25 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.09M (1087488) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 510.009ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 43s437ms, non-child: 43s437ms, % non-child: 100.00%) - KuduApplyTimer: 36s654ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.01 K/sec - TotalNumRows: 1.09M (1086464) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 508.560ms, non-child: 508.560ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 95.673ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.13M (1129472) - RowsReturned: 1.09M (1087488) - RowsReturnedRate: 2.14 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.57 MB/sec I1212 11:09:31.328985 12765 parquet-column-readers.cc:959] Decompressed 27540 to 65519 I1212 11:09:31.329257 3769 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.04M (1044138) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.359ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 543.225ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 41s424ms, non-child: 41s424ms, % non-child: 100.00%) - KuduApplyTimer: 35s024ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.19 K/sec - TotalNumRows: 1.04M (1043114) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 541.821ms, non-child: 541.821ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 102.057ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.09M (1086122) - RowsReturned: 1.04M (1044138) - RowsReturnedRate: 1.94 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.54 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.00M (1001472) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 593.557ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 39s352ms, non-child: 39s352ms, % non-child: 100.00%) - KuduApplyTimer: 33s307ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.42 K/sec - TotalNumRows: 1.00M (1000448) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 592.376ms, non-child: 592.376ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 83.431ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.04M (1043456) - RowsReturned: 1.00M (1001472) - RowsReturnedRate: 1.69 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.73 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.04M (1043456) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 526.109ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 41s483ms, non-child: 41s483ms, % non-child: 100.00%) - KuduApplyTimer: 35s111ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.13 K/sec - TotalNumRows: 1.04M (1042432) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 524.527ms, non-child: 524.527ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 127.067ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.09M (1085440) - RowsReturned: 1.04M (1043456) - RowsReturnedRate: 1.99 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.33 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB, 106.22 MB, 106.57 MB, 106.76 MB, 106.25 MB, 106.25 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.09M (1087488) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 510.009ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 43s437ms, non-child: 43s437ms, % non-child: 100.00%) - KuduApplyTimer: 36s654ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.01 K/sec - TotalNumRows: 1.09M (1086464) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 508.560ms, non-child: 508.560ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 95.673ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.13M (1129472) - RowsReturned: 1.09M (1087488) - RowsReturnedRate: 2.14 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.57 MB/sec I1212 11:09:31.393152 12765 parquet-column-readers.cc:959] Decompressed 65516 to 65510 I1212 11:09:31.394436 12765 parquet-column-readers.cc:959] Decompressed 27563 to 65537 I1212 11:09:31.428184 12765 parquet-column-readers.cc:959] Decompressed 57067 to 65540 I1212 11:09:31.461211 12765 parquet-column-readers.cc:959] Decompressed 12990 to 65544 I1212 11:09:31.461575 12765 parquet-column-readers.cc:959] Decompressed 38526 to 65544 I1212 11:09:31.463181 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:31.463495 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:31.463831 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:31.464622 12765 parquet-column-readers.cc:959] Decompressed 27722 to 65527 I1212 11:09:31.532810 12765 parquet-column-readers.cc:959] Decompressed 27831 to 65519 I1212 11:09:31.609819 12765 parquet-column-readers.cc:959] Decompressed 27637 to 65524 I1212 11:09:31.697494 12765 parquet-column-readers.cc:959] Decompressed 27539 to 65532 I1212 11:09:31.777611 12765 parquet-column-readers.cc:959] Decompressed 12492 to 65544 I1212 11:09:31.777830 12765 parquet-column-readers.cc:959] Decompressed 38498 to 65544 I1212 11:09:31.779244 12765 parquet-column-readers.cc:959] Decompressed 27630 to 65529 I1212 11:09:31.848013 12765 parquet-column-readers.cc:959] Decompressed 57059 to 65540 I1212 11:09:31.850214 12765 parquet-column-readers.cc:959] Decompressed 27672 to 65530 I1212 11:09:31.930186 12765 parquet-column-readers.cc:959] Decompressed 27663 to 65517 I1212 11:09:32.016376 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 30030.1us I1212 11:09:32.073822 12765 parquet-column-readers.cc:959] Decompressed 27756 to 65543 I1212 11:09:32.127540 12765 parquet-column-readers.cc:959] Decompressed 12904 to 65544 I1212 11:09:32.127917 12765 parquet-column-readers.cc:959] Decompressed 38477 to 65544 I1212 11:09:32.189358 12765 parquet-column-readers.cc:959] Decompressed 27575 to 65541 I1212 11:09:32.290599 12765 parquet-column-readers.cc:959] Decompressed 27739 to 65518 I1212 11:09:32.329574 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:09:32.329583 3766 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000000 done=false I1212 11:09:32.329592 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000000 status=0 done=false I1212 11:09:32.329929 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 544.794ms 601.294ms 3.26M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:32.330250 3766 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000000 Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB, 106.70 MB, 106.41 MB, 106.19 MB, 106.25 MB, 106.25 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.13M (1133568) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 602.891ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 44s313ms, non-child: 44s313ms, % non-child: 100.00%) - KuduApplyTimer: 37s518ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.56 K/sec - TotalNumRows: 1.13M (1132544) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 601.294ms, non-child: 601.294ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 93.879ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.18M (1175552) - RowsReturned: 1.13M (1133568) - RowsReturnedRate: 1.89 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.54 MB/sec I1212 11:09:32.332159 3766 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.09M (1088170) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.359ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 546.336ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 43s078ms, non-child: 43s078ms, % non-child: 100.00%) - KuduApplyTimer: 36s428ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.23 K/sec - TotalNumRows: 1.09M (1087146) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 544.794ms, non-child: 544.794ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 105.540ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.13M (1130154) - RowsReturned: 1.09M (1088170) - RowsReturnedRate: 2.00 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.48 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB, 106.70 MB, 106.41 MB, 106.19 MB, 106.25 MB, 106.25 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.13M (1133568) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 602.891ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 44s313ms, non-child: 44s313ms, % non-child: 100.00%) - KuduApplyTimer: 37s518ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.56 K/sec - TotalNumRows: 1.13M (1132544) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 601.294ms, non-child: 601.294ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 93.879ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.18M (1175552) - RowsReturned: 1.13M (1133568) - RowsReturnedRate: 1.89 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.54 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.04M (1043456) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 526.109ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 41s483ms, non-child: 41s483ms, % non-child: 100.00%) - KuduApplyTimer: 35s111ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.13 K/sec - TotalNumRows: 1.04M (1042432) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 524.527ms, non-child: 524.527ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 127.067ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.09M (1085440) - RowsReturned: 1.04M (1043456) - RowsReturnedRate: 1.99 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.33 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB, 106.22 MB, 106.57 MB, 106.76 MB, 106.25 MB, 106.25 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.09M (1087488) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 510.009ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 43s437ms, non-child: 43s437ms, % non-child: 100.00%) - KuduApplyTimer: 36s654ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.01 K/sec - TotalNumRows: 1.09M (1086464) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 508.560ms, non-child: 508.560ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 95.673ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.13M (1129472) - RowsReturned: 1.09M (1087488) - RowsReturnedRate: 2.14 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.57 MB/sec I1212 11:09:32.355295 12765 parquet-column-readers.cc:959] Decompressed 56968 to 65540 I1212 11:09:32.411258 12765 parquet-column-readers.cc:959] Decompressed 27610 to 65528 I1212 11:09:32.479847 12765 parquet-column-readers.cc:959] Decompressed 27615 to 65542 I1212 11:09:32.510926 12765 parquet-column-readers.cc:959] Decompressed 12827 to 65544 I1212 11:09:32.511291 12765 parquet-column-readers.cc:959] Decompressed 38538 to 65544 I1212 11:09:32.547341 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:32.550091 12765 parquet-column-readers.cc:959] Decompressed 27558 to 65520 I1212 11:09:32.618671 12765 parquet-column-readers.cc:959] Decompressed 27583 to 65529 I1212 11:09:32.687851 12765 parquet-column-readers.cc:959] Decompressed 27531 to 65542 I1212 11:09:32.769606 12765 parquet-column-readers.cc:959] Decompressed 56970 to 65540 I1212 11:09:32.771733 12765 parquet-column-readers.cc:959] Decompressed 27615 to 65508 I1212 11:09:32.825801 12765 parquet-column-readers.cc:959] Decompressed 12792 to 65544 I1212 11:09:32.826186 12765 parquet-column-readers.cc:959] Decompressed 38518 to 65544 I1212 11:09:32.872653 12765 parquet-column-readers.cc:959] Decompressed 27566 to 65530 I1212 11:09:32.981564 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:32.981824 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:32.983633 12765 parquet-column-readers.cc:959] Decompressed 27643 to 65532 I1212 11:09:33.057418 12765 parquet-column-readers.cc:959] Decompressed 27599 to 65543 I1212 11:09:33.152899 12765 parquet-column-readers.cc:959] Decompressed 12689 to 65544 I1212 11:09:33.153297 12765 parquet-column-readers.cc:959] Decompressed 38574 to 65544 I1212 11:09:33.156059 12765 parquet-column-readers.cc:959] Decompressed 27599 to 65530 I1212 11:09:33.179867 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 33463.7us I1212 11:09:33.242456 12765 parquet-column-readers.cc:959] Decompressed 57028 to 65540 I1212 11:09:33.243566 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:33.243834 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:33.244103 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:33.244737 12765 parquet-column-readers.cc:959] Decompressed 27868 to 65533 I1212 11:09:33.311141 12765 parquet-column-readers.cc:959] Decompressed 27533 to 65543 I1212 11:09:33.380296 12765 parquet-column-readers.cc:959] Decompressed 27596 to 65527 I1212 11:09:33.464099 12765 parquet-column-readers.cc:959] Decompressed 12641 to 65544 I1212 11:09:33.464468 12765 parquet-column-readers.cc:959] Decompressed 38480 to 65544 I1212 11:09:33.467344 12765 parquet-column-readers.cc:959] Decompressed 27601 to 65514 I1212 11:09:33.555157 12765 parquet-column-readers.cc:959] Decompressed 27470 to 65527 I1212 11:09:33.627167 12765 parquet-column-readers.cc:959] Decompressed 56999 to 65540 I1212 11:09:33.628317 12765 parquet-column-readers.cc:959] Decompressed 27481 to 65507 I1212 11:09:33.695667 12765 parquet-column-readers.cc:959] Decompressed 27498 to 65540 I1212 11:09:33.761617 12765 parquet-column-readers.cc:959] Decompressed 12773 to 65544 I1212 11:09:33.761833 12765 parquet-column-readers.cc:959] Decompressed 38481 to 65544 I1212 11:09:33.796552 12765 parquet-column-readers.cc:959] Decompressed 27643 to 65519 I1212 11:09:33.864083 12765 parquet-column-readers.cc:959] Decompressed 27506 to 65530 I1212 11:09:33.935925 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:33.938570 12765 parquet-column-readers.cc:959] Decompressed 27582 to 65542 I1212 11:09:34.019176 12765 parquet-column-readers.cc:959] Decompressed 57056 to 65540 I1212 11:09:34.021325 12765 parquet-column-readers.cc:959] Decompressed 27686 to 65519 I1212 11:09:34.073400 12765 parquet-column-readers.cc:959] Decompressed 12785 to 65544 I1212 11:09:34.073799 12765 parquet-column-readers.cc:959] Decompressed 38570 to 65544 I1212 11:09:34.128039 12765 parquet-column-readers.cc:959] Decompressed 27693 to 65527 I1212 11:09:34.203382 12765 parquet-column-readers.cc:959] Decompressed 27583 to 65541 I1212 11:09:34.271605 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 40367.8us I1212 11:09:34.296427 12765 parquet-column-readers.cc:959] Decompressed 27470 to 65535 I1212 11:09:34.382920 12731 plan-fragment-executor.cc:408] Reporting profile for instance 25407d49fc4cde6f:d575dd6200000002 I1212 11:09:34.383540 12731 plan-fragment-executor.cc:412] Fragment 25407d49fc4cde6f:d575dd6200000002:(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.16M (1164288) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 541.530ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 46s432ms, non-child: 0.000ns, % non-child: 0.00%) - KuduApplyTimer: 39s291ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.05 K/sec - TotalNumRows: 1.16M (1163264) CodeGen:(Total: 85.001ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 539.550ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 136.542ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.21M (1206272) - RowsReturned: 1.16M (1164288) - RowsReturnedRate: 2.16 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.19 MB/sec I1212 11:09:34.383586 12731 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:09:34.383604 12731 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:09:34.384117 3396 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000002 I1212 11:09:34.384130 3396 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000002 done=false I1212 11:09:34.384138 3396 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000002 status=0 done=false I1212 11:09:34.384599 3396 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 549.802ms 601.294ms 3.39M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:34.385113 3396 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000002 Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.16M (1164288) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 541.530ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 46s432ms, non-child: 46s432ms, % non-child: 100.00%) - KuduApplyTimer: 39s291ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.05 K/sec - TotalNumRows: 1.16M (1163264) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 539.550ms, non-child: 539.550ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 136.542ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.21M (1206272) - RowsReturned: 1.16M (1164288) - RowsReturnedRate: 2.16 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.19 MB/sec I1212 11:09:34.386998 3396 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.13M (1128448) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.359ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 551.476ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 44s728ms, non-child: 44s728ms, % non-child: 100.00%) - KuduApplyTimer: 37s821ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.21 K/sec - TotalNumRows: 1.13M (1127424) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 549.802ms, non-child: 549.802ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 108.698ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.17M (1170432) - RowsReturned: 1.13M (1128448) - RowsReturnedRate: 2.06 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.43 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB, 106.70 MB, 106.41 MB, 106.19 MB, 106.25 MB, 106.25 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.13M (1133568) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 602.891ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 44s313ms, non-child: 44s313ms, % non-child: 100.00%) - KuduApplyTimer: 37s518ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.56 K/sec - TotalNumRows: 1.13M (1132544) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 601.294ms, non-child: 601.294ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 93.879ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.18M (1175552) - RowsReturned: 1.13M (1133568) - RowsReturnedRate: 1.89 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.54 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.16M (1164288) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 541.530ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 46s432ms, non-child: 46s432ms, % non-child: 100.00%) - KuduApplyTimer: 39s291ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.05 K/sec - TotalNumRows: 1.16M (1163264) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 539.550ms, non-child: 539.550ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 136.542ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.21M (1206272) - RowsReturned: 1.16M (1164288) - RowsReturnedRate: 2.16 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.19 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB, 106.22 MB, 106.57 MB, 106.76 MB, 106.25 MB, 106.25 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.09M (1087488) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 510.009ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 43s437ms, non-child: 43s437ms, % non-child: 100.00%) - KuduApplyTimer: 36s654ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.01 K/sec - TotalNumRows: 1.09M (1086464) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 508.560ms, non-child: 508.560ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 95.673ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.13M (1129472) - RowsReturned: 1.09M (1087488) - RowsReturnedRate: 2.14 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.57 MB/sec I1212 11:09:34.387197 12731 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:09:34.395731 12765 parquet-column-readers.cc:959] Decompressed 27665 to 65542 I1212 11:09:34.455947 12765 parquet-column-readers.cc:959] Decompressed 12749 to 65544 I1212 11:09:34.456303 12765 parquet-column-readers.cc:959] Decompressed 38578 to 65544 I1212 11:09:34.489212 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 81031.7us I1212 11:09:34.516208 12765 parquet-column-readers.cc:959] Decompressed 27632 to 65510 I1212 11:09:34.567554 12765 parquet-column-readers.cc:959] Decompressed 57098 to 65540 I1212 11:09:34.623010 12765 parquet-column-readers.cc:959] Decompressed 27550 to 65519 I1212 11:09:34.822921 12765 parquet-column-readers.cc:959] Decompressed 27615 to 65532 I1212 11:09:34.870615 12765 parquet-column-readers.cc:959] Decompressed 41425 to 65454 I1212 11:09:34.873482 12765 parquet-column-readers.cc:959] Decompressed 65460 to 65454 I1212 11:09:34.910419 12765 parquet-column-readers.cc:959] Decompressed 12829 to 65544 I1212 11:09:34.910775 12765 parquet-column-readers.cc:959] Decompressed 38536 to 65544 I1212 11:09:34.912292 12765 parquet-column-readers.cc:959] Decompressed 27402 to 65528 I1212 11:09:35.022935 12765 parquet-column-readers.cc:959] Decompressed 27575 to 65520 I1212 11:09:35.054956 12765 parquet-column-readers.cc:959] Decompressed 65516 to 65510 I1212 11:09:35.091819 12765 parquet-column-readers.cc:959] Decompressed 56948 to 65540 I1212 11:09:35.092972 12765 parquet-column-readers.cc:959] Decompressed 27535 to 65530 I1212 11:09:35.140935 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:35.141209 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:35.141464 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:35.183863 12765 parquet-column-readers.cc:959] Decompressed 27418 to 65542 I1212 11:09:35.257886 12765 parquet-column-readers.cc:959] Decompressed 12860 to 65544 I1212 11:09:35.258267 12765 parquet-column-readers.cc:959] Decompressed 38490 to 65544 I1212 11:09:35.261024 12765 parquet-column-readers.cc:959] Decompressed 27711 to 65539 I1212 11:09:35.330787 12765 parquet-column-readers.cc:959] Decompressed 27472 to 65538 I1212 11:09:35.406545 12765 parquet-column-readers.cc:959] Decompressed 27432 to 65542 I1212 11:09:35.430207 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 34467us I1212 11:09:35.485513 12765 parquet-column-readers.cc:959] Decompressed 27630 to 65502 I1212 11:09:35.524233 12765 parquet-column-readers.cc:959] Decompressed 56984 to 65540 I1212 11:09:35.558903 12765 parquet-column-readers.cc:959] Decompressed 12785 to 65544 I1212 11:09:35.559288 12765 parquet-column-readers.cc:959] Decompressed 38554 to 65544 I1212 11:09:35.562119 12765 parquet-column-readers.cc:959] Decompressed 27603 to 65534 I1212 11:09:35.566833 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 36477.3us I1212 11:09:35.628590 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:35.666309 12765 parquet-column-readers.cc:959] Decompressed 27421 to 65517 I1212 11:09:35.735996 12765 parquet-column-readers.cc:959] Decompressed 27666 to 65519 I1212 11:09:35.805868 12765 parquet-column-readers.cc:959] Decompressed 27614 to 65513 I1212 11:09:35.837435 12765 parquet-column-readers.cc:959] Decompressed 12957 to 65544 I1212 11:09:35.837793 12765 parquet-column-readers.cc:959] Decompressed 38578 to 65544 I1212 11:09:35.875587 12765 parquet-column-readers.cc:959] Decompressed 27452 to 65538 I1212 11:09:35.917402 12765 parquet-column-readers.cc:959] Decompressed 57032 to 65540 I1212 11:09:35.965440 12765 parquet-column-readers.cc:959] Decompressed 27725 to 65537 I1212 11:09:36.044447 12765 parquet-column-readers.cc:959] Decompressed 27399 to 65530 I1212 11:09:36.123219 12765 parquet-column-readers.cc:959] Decompressed 27586 to 65541 I1212 11:09:36.157130 12765 parquet-column-readers.cc:959] Decompressed 12814 to 65544 I1212 11:09:36.157343 12765 parquet-column-readers.cc:959] Decompressed 38513 to 65544 I1212 11:09:36.196069 12765 parquet-column-readers.cc:959] Decompressed 27694 to 65543 I1212 11:09:36.280269 12765 parquet-column-readers.cc:959] Decompressed 27481 to 65518 I1212 11:09:36.330524 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000001 I1212 11:09:36.330533 3769 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000001 done=false I1212 11:09:36.330543 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000001 status=0 done=false I1212 11:09:36.330934 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 566.443ms 601.294ms 3.51M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:36.331421 3769 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000001 Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB, 106.22 MB, 106.57 MB, 106.76 MB, 106.25 MB, 106.25 MB, 106.28 MB, 106.40 MB, 106.40 MB, 106.34 MB, 106.34 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.21M (1209344) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 560.332ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 48s362ms, non-child: 48s362ms, % non-child: 100.00%) - KuduApplyTimer: 40s819ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.98 K/sec - TotalNumRows: 1.21M (1208320) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 558.486ms, non-child: 558.486ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 105.452ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.25M (1251328) - RowsReturned: 1.21M (1209344) - RowsReturnedRate: 2.17 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.41 MB/sec I1212 11:09:36.333148 3769 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.17M (1169066) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.359ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 568.251ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 46s369ms, non-child: 46s369ms, % non-child: 100.00%) - KuduApplyTimer: 39s209ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.20 K/sec - TotalNumRows: 1.17M (1168042) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 566.443ms, non-child: 566.443ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 111.958ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.21M (1211050) - RowsReturned: 1.17M (1169066) - RowsReturnedRate: 2.07 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.38 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB, 106.70 MB, 106.41 MB, 106.19 MB, 106.25 MB, 106.25 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.13M (1133568) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 602.891ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 44s313ms, non-child: 44s313ms, % non-child: 100.00%) - KuduApplyTimer: 37s518ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.56 K/sec - TotalNumRows: 1.13M (1132544) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 601.294ms, non-child: 601.294ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 93.879ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.18M (1175552) - RowsReturned: 1.13M (1133568) - RowsReturnedRate: 1.89 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.54 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.16M (1164288) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 541.530ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 46s432ms, non-child: 46s432ms, % non-child: 100.00%) - KuduApplyTimer: 39s291ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.05 K/sec - TotalNumRows: 1.16M (1163264) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 539.550ms, non-child: 539.550ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 136.542ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.21M (1206272) - RowsReturned: 1.16M (1164288) - RowsReturnedRate: 2.16 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.19 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB, 106.22 MB, 106.57 MB, 106.76 MB, 106.25 MB, 106.25 MB, 106.28 MB, 106.40 MB, 106.40 MB, 106.34 MB, 106.34 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.21M (1209344) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 560.332ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 48s362ms, non-child: 48s362ms, % non-child: 100.00%) - KuduApplyTimer: 40s819ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.98 K/sec - TotalNumRows: 1.21M (1208320) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 558.486ms, non-child: 558.486ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 105.452ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.25M (1251328) - RowsReturned: 1.21M (1209344) - RowsReturnedRate: 2.17 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.41 MB/sec I1212 11:09:36.338294 12765 parquet-column-readers.cc:959] Decompressed 57046 to 65540 I1212 11:09:36.397758 12765 parquet-column-readers.cc:959] Decompressed 27477 to 65526 I1212 11:09:36.512584 12765 parquet-column-readers.cc:959] Decompressed 27487 to 65526 I1212 11:09:36.572537 12765 parquet-column-readers.cc:959] Decompressed 12872 to 65544 I1212 11:09:36.572896 12765 parquet-column-readers.cc:959] Decompressed 38518 to 65544 I1212 11:09:36.592416 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 30951.1us I1212 11:09:36.673069 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 36808us I1212 11:09:36.695031 12765 parquet-column-readers.cc:959] Decompressed 27485 to 65515 I1212 11:09:36.741091 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 29928us I1212 11:09:36.773954 12765 parquet-column-readers.cc:959] Decompressed 27519 to 65533 I1212 11:09:36.845044 12765 parquet-column-readers.cc:959] Decompressed 27620 to 65506 I1212 11:09:36.878666 12765 parquet-column-readers.cc:959] Decompressed 57002 to 65540 I1212 11:09:36.879202 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:36.879354 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:36.879503 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:36.913610 12765 parquet-column-readers.cc:959] Decompressed 12953 to 65544 I1212 11:09:36.913820 12765 parquet-column-readers.cc:959] Decompressed 38572 to 65544 I1212 11:09:36.916455 12765 parquet-column-readers.cc:959] Decompressed 27585 to 65529 I1212 11:09:36.984927 12765 parquet-column-readers.cc:959] Decompressed 27355 to 65514 I1212 11:09:37.055930 12765 parquet-column-readers.cc:959] Decompressed 27662 to 65524 I1212 11:09:37.140327 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:37.143173 12765 parquet-column-readers.cc:959] Decompressed 27675 to 65523 I1212 11:09:37.224336 12765 parquet-column-readers.cc:959] Decompressed 12744 to 65544 I1212 11:09:37.224719 12765 parquet-column-readers.cc:959] Decompressed 38553 to 65544 I1212 11:09:37.227557 12765 parquet-column-readers.cc:959] Decompressed 27528 to 65531 I1212 11:09:37.311750 12765 parquet-column-readers.cc:959] Decompressed 57008 to 65540 I1212 11:09:37.314025 12765 parquet-column-readers.cc:959] Decompressed 27453 to 65520 I1212 11:09:37.333252 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:09:37.333259 3766 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000000 done=false I1212 11:09:37.333266 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000000 status=0 done=false I1212 11:09:37.333544 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 575.722ms 629.132ms 3.63M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:37.333842 3766 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000000 Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB, 106.70 MB, 106.41 MB, 106.19 MB, 106.25 MB, 106.25 MB, 106.32 MB, 106.35 MB, 106.41 MB, 106.35 MB, 106.22 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.26M (1256448) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 631.108ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 49s318ms, non-child: 49s318ms, % non-child: 100.00%) - KuduApplyTimer: 41s737ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.45 K/sec - TotalNumRows: 1.26M (1255424) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 629.132ms, non-child: 629.132ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 105.256ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.30M (1298432) - RowsReturned: 1.26M (1256448) - RowsReturnedRate: 2.00 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.38 MB/sec I1212 11:09:37.334944 3766 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.21M (1210026) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.359ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 577.657ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 48s037ms, non-child: 48s037ms, % non-child: 100.00%) - KuduApplyTimer: 40s616ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.16 K/sec - TotalNumRows: 1.21M (1209002) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 575.722ms, non-child: 575.722ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 115.750ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.25M (1252010) - RowsReturned: 1.21M (1210026) - RowsReturnedRate: 2.11 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.33 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB, 106.70 MB, 106.41 MB, 106.19 MB, 106.25 MB, 106.25 MB, 106.32 MB, 106.35 MB, 106.41 MB, 106.35 MB, 106.22 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.26M (1256448) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 631.108ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 49s318ms, non-child: 49s318ms, % non-child: 100.00%) - KuduApplyTimer: 41s737ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.45 K/sec - TotalNumRows: 1.26M (1255424) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 629.132ms, non-child: 629.132ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 105.256ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.30M (1298432) - RowsReturned: 1.26M (1256448) - RowsReturnedRate: 2.00 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.38 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.16M (1164288) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.095ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 541.530ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 46s432ms, non-child: 46s432ms, % non-child: 100.00%) - KuduApplyTimer: 39s291ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.05 K/sec - TotalNumRows: 1.16M (1163264) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 539.550ms, non-child: 539.550ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 136.542ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.21M (1206272) - RowsReturned: 1.16M (1164288) - RowsReturnedRate: 2.16 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.19 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB, 106.22 MB, 106.57 MB, 106.76 MB, 106.25 MB, 106.25 MB, 106.28 MB, 106.40 MB, 106.40 MB, 106.34 MB, 106.34 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.21M (1209344) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 560.332ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 48s362ms, non-child: 48s362ms, % non-child: 100.00%) - KuduApplyTimer: 40s819ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.98 K/sec - TotalNumRows: 1.21M (1208320) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 558.486ms, non-child: 558.486ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 105.452ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.25M (1251328) - RowsReturned: 1.21M (1209344) - RowsReturnedRate: 2.17 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.41 MB/sec I1212 11:09:37.396895 12765 parquet-column-readers.cc:959] Decompressed 27463 to 65518 I1212 11:09:37.528775 12765 parquet-column-readers.cc:959] Decompressed 27393 to 65521 I1212 11:09:37.568003 12765 parquet-column-readers.cc:959] Decompressed 12826 to 65544 I1212 11:09:37.568380 12765 parquet-column-readers.cc:959] Decompressed 38518 to 65544 I1212 11:09:37.606478 12765 parquet-column-readers.cc:959] Decompressed 27730 to 65536 I1212 11:09:37.676489 12765 parquet-column-readers.cc:959] Decompressed 27552 to 65530 I1212 11:09:37.710414 12765 parquet-column-readers.cc:959] Decompressed 56954 to 65540 I1212 11:09:37.765301 12765 parquet-column-readers.cc:959] Decompressed 27432 to 65515 I1212 11:09:37.841244 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 38579us I1212 11:09:37.858587 12765 parquet-column-readers.cc:959] Decompressed 27694 to 65530 I1212 11:09:37.891086 12765 parquet-column-readers.cc:959] Decompressed 12832 to 65544 I1212 11:09:37.891304 12765 parquet-column-readers.cc:959] Decompressed 38502 to 65544 I1212 11:09:37.927625 12765 parquet-column-readers.cc:959] Decompressed 27302 to 65529 I1212 11:09:37.999424 12765 parquet-column-readers.cc:959] Decompressed 27592 to 65541 I1212 11:09:38.066582 12765 parquet-column-readers.cc:959] Decompressed 27462 to 65499 I1212 11:09:38.131487 12765 parquet-column-readers.cc:959] Decompressed 57030 to 65540 I1212 11:09:38.132565 12765 parquet-column-readers.cc:959] Decompressed 27751 to 65539 I1212 11:09:38.164796 12765 parquet-column-readers.cc:959] Decompressed 12914 to 65544 I1212 11:09:38.165026 12765 parquet-column-readers.cc:959] Decompressed 38546 to 65544 I1212 11:09:38.201305 12765 parquet-column-readers.cc:959] Decompressed 27593 to 65503 I1212 11:09:38.289475 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:38.289669 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:38.289773 12765 parquet-column-readers.cc:959] Decompressed 62777 to 63457 I1212 11:09:38.290338 12765 parquet-column-readers.cc:959] Decompressed 65559 to 65552 I1212 11:09:38.290665 12765 parquet-column-readers.cc:959] Decompressed 27529 to 65524 I1212 11:09:38.443955 12765 parquet-column-readers.cc:959] Decompressed 27729 to 65522 I1212 11:09:38.512660 12765 parquet-column-readers.cc:959] Decompressed 12802 to 65544 I1212 11:09:38.513018 12765 parquet-column-readers.cc:959] Decompressed 38546 to 65544 I1212 11:09:38.513545 12765 parquet-column-readers.cc:959] Decompressed 65516 to 65510 I1212 11:09:38.515761 12765 parquet-column-readers.cc:959] Decompressed 27593 to 65541 I1212 11:09:38.586541 12765 parquet-column-readers.cc:959] Decompressed 56986 to 65540 I1212 11:09:38.587571 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:38.587846 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:38.588124 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:38.588804 12765 parquet-column-readers.cc:959] Decompressed 27484 to 65542 I1212 11:09:38.622838 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:38.679134 12765 parquet-column-readers.cc:959] Decompressed 27698 to 65541 I1212 11:09:38.752467 12765 parquet-column-readers.cc:959] Decompressed 27492 to 65540 I1212 11:09:38.819810 12765 parquet-column-readers.cc:959] Decompressed 12764 to 65544 I1212 11:09:38.820026 12765 parquet-column-readers.cc:959] Decompressed 38509 to 65544 I1212 11:09:38.821414 12765 parquet-column-readers.cc:959] Decompressed 27761 to 65540 I1212 11:09:38.891285 12765 parquet-column-readers.cc:959] Decompressed 27541 to 65542 I1212 11:09:38.953168 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 31094.9us I1212 11:09:38.997714 12765 parquet-column-readers.cc:959] Decompressed 57059 to 65540 I1212 11:09:38.999155 12765 parquet-column-readers.cc:959] Decompressed 27563 to 65535 I1212 11:09:39.039299 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 34378.1us I1212 11:09:39.071669 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 29985.2us I1212 11:09:39.098378 12765 parquet-column-readers.cc:959] Decompressed 27673 to 65505 I1212 11:09:39.164465 12765 parquet-column-readers.cc:959] Decompressed 12895 to 65544 I1212 11:09:39.164683 12765 parquet-column-readers.cc:959] Decompressed 38483 to 65544 I1212 11:09:39.166149 12765 parquet-column-readers.cc:959] Decompressed 27638 to 65531 I1212 11:09:39.268831 12765 parquet-column-readers.cc:959] Decompressed 27482 to 65538 I1212 11:09:39.336913 12765 parquet-column-readers.cc:959] Decompressed 27639 to 65520 I1212 11:09:39.387287 12731 plan-fragment-executor.cc:408] Reporting profile for instance 25407d49fc4cde6f:d575dd6200000002 I1212 11:09:39.387928 12731 plan-fragment-executor.cc:412] Fragment 25407d49fc4cde6f:d575dd6200000002:(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB, 94.66 MB, 94.66 MB, 94.57 MB, 90.47 MB, 86.84 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.29M (1287168) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.098ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 575.718ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 51s425ms, non-child: 0.000ns, % non-child: 0.00%) - KuduApplyTimer: 43s508ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.01 K/sec - TotalNumRows: 1.29M (1286144) CodeGen:(Total: 85.001ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 573.326ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 146.030ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.33M (1329152) - RowsReturned: 1.29M (1287168) - RowsReturnedRate: 2.25 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.07 MB/sec I1212 11:09:39.387965 12731 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:09:39.387974 12731 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:09:39.388387 5418 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000002 I1212 11:09:39.388393 5418 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000002 done=false I1212 11:09:39.388401 5418 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000002 status=0 done=false I1212 11:09:39.388698 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 586.981ms 629.132ms 3.75M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:39.389027 5418 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000002 Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB, 94.66 MB, 94.66 MB, 94.57 MB, 90.47 MB, 86.84 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.29M (1287168) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.098ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 575.718ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 51s425ms, non-child: 51s425ms, % non-child: 100.00%) - KuduApplyTimer: 43s508ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.01 K/sec - TotalNumRows: 1.29M (1286144) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 573.326ms, non-child: 573.326ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 146.030ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.33M (1329152) - RowsReturned: 1.29M (1287168) - RowsReturnedRate: 2.25 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.07 MB/sec I1212 11:09:39.390103 5418 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.25M (1250986) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.360ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 589.053ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 49s702ms, non-child: 49s702ms, % non-child: 100.00%) - KuduApplyTimer: 42s021ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.15 K/sec - TotalNumRows: 1.25M (1249962) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 586.981ms, non-child: 586.981ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 118.913ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.29M (1292970) - RowsReturned: 1.25M (1250986) - RowsReturnedRate: 2.14 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.29 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB, 106.70 MB, 106.41 MB, 106.19 MB, 106.25 MB, 106.25 MB, 106.32 MB, 106.35 MB, 106.41 MB, 106.35 MB, 106.22 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.26M (1256448) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 631.108ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 49s318ms, non-child: 49s318ms, % non-child: 100.00%) - KuduApplyTimer: 41s737ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.45 K/sec - TotalNumRows: 1.26M (1255424) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 629.132ms, non-child: 629.132ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 105.256ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.30M (1298432) - RowsReturned: 1.26M (1256448) - RowsReturnedRate: 2.00 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.38 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB, 94.66 MB, 94.66 MB, 94.57 MB, 90.47 MB, 86.84 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.29M (1287168) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.098ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 575.718ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 51s425ms, non-child: 51s425ms, % non-child: 100.00%) - KuduApplyTimer: 43s508ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.01 K/sec - TotalNumRows: 1.29M (1286144) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 573.326ms, non-child: 573.326ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 146.030ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.33M (1329152) - RowsReturned: 1.29M (1287168) - RowsReturnedRate: 2.25 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.07 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB, 106.22 MB, 106.57 MB, 106.76 MB, 106.25 MB, 106.25 MB, 106.28 MB, 106.40 MB, 106.40 MB, 106.34 MB, 106.34 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.21M (1209344) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.735ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 560.332ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 48s362ms, non-child: 48s362ms, % non-child: 100.00%) - KuduApplyTimer: 40s819ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.98 K/sec - TotalNumRows: 1.21M (1208320) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 558.486ms, non-child: 558.486ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 105.452ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.25M (1251328) - RowsReturned: 1.21M (1209344) - RowsReturnedRate: 2.17 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.41 MB/sec I1212 11:09:39.390187 12731 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:09:39.404228 12765 parquet-column-readers.cc:959] Decompressed 56976 to 65540 I1212 11:09:39.405441 12765 parquet-column-readers.cc:959] Decompressed 27666 to 65536 I1212 11:09:39.437875 12765 parquet-column-readers.cc:959] Decompressed 12667 to 65544 I1212 11:09:39.438086 12765 parquet-column-readers.cc:959] Decompressed 38467 to 65544 I1212 11:09:39.473161 12765 parquet-column-readers.cc:959] Decompressed 27740 to 65529 I1212 11:09:39.559361 12765 parquet-column-readers.cc:959] Decompressed 27653 to 65535 I1212 11:09:39.662777 12765 parquet-column-readers.cc:959] Decompressed 27644 to 65527 I1212 11:09:39.755046 12765 parquet-column-readers.cc:959] Decompressed 27495 to 65536 I1212 11:09:39.795825 12765 parquet-column-readers.cc:959] Decompressed 12847 to 65544 I1212 11:09:39.796206 12765 parquet-column-readers.cc:959] Decompressed 38504 to 65544 I1212 11:09:39.853106 12765 parquet-column-readers.cc:959] Decompressed 27727 to 65537 I1212 11:09:39.889060 12765 parquet-column-readers.cc:959] Decompressed 57049 to 65540 I1212 11:09:39.924561 12765 parquet-column-readers.cc:959] Decompressed 27541 to 65524 I1212 11:09:39.991255 12765 parquet-column-readers.cc:959] Decompressed 27683 to 65528 I1212 11:09:40.057075 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:40.117008 12765 parquet-column-readers.cc:959] Decompressed 12612 to 65544 I1212 11:09:40.117475 12765 parquet-column-readers.cc:959] Decompressed 38528 to 65544 I1212 11:09:40.120434 12765 parquet-column-readers.cc:959] Decompressed 27648 to 65520 I1212 11:09:40.130141 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 29735.4us I1212 11:09:40.212745 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 40294.9us I1212 11:09:40.220616 12765 parquet-column-readers.cc:959] Decompressed 27662 to 65526 I1212 11:09:40.314999 12765 parquet-column-readers.cc:959] Decompressed 57059 to 65540 I1212 11:09:40.315518 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:40.315666 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:40.315814 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:40.316115 12765 parquet-column-readers.cc:959] Decompressed 27776 to 65536 I1212 11:09:40.422260 12765 parquet-column-readers.cc:959] Decompressed 27550 to 65536 I1212 11:09:40.487535 12765 parquet-column-readers.cc:959] Decompressed 12640 to 65544 I1212 11:09:40.487745 12765 parquet-column-readers.cc:959] Decompressed 38555 to 65544 I1212 11:09:40.489148 12765 parquet-column-readers.cc:959] Decompressed 27688 to 65524 I1212 11:09:40.555814 12765 parquet-column-readers.cc:959] Decompressed 27461 to 65510 I1212 11:09:40.624083 12765 parquet-column-readers.cc:959] Decompressed 27610 to 65539 I1212 11:09:40.692463 12765 parquet-column-readers.cc:959] Decompressed 27479 to 65522 I1212 11:09:40.728641 12765 parquet-column-readers.cc:959] Decompressed 57096 to 65540 I1212 11:09:40.774018 12765 parquet-column-readers.cc:959] Decompressed 13039 to 65544 I1212 11:09:40.774231 12765 parquet-column-readers.cc:959] Decompressed 38475 to 65544 I1212 11:09:40.775703 12765 parquet-column-readers.cc:959] Decompressed 27740 to 65516 I1212 11:09:40.865988 12765 parquet-column-readers.cc:959] Decompressed 27614 to 65525 I1212 11:09:41.000859 12765 parquet-column-readers.cc:959] Decompressed 27569 to 65533 I1212 11:09:41.093789 12765 parquet-column-readers.cc:959] Decompressed 27507 to 65540 I1212 11:09:41.126408 12765 parquet-column-readers.cc:959] Decompressed 12828 to 65544 I1212 11:09:41.126778 12765 parquet-column-readers.cc:959] Decompressed 38530 to 65544 I1212 11:09:41.165774 12765 parquet-column-readers.cc:959] Decompressed 27607 to 65543 I1212 11:09:41.199865 12765 parquet-column-readers.cc:959] Decompressed 56986 to 65540 I1212 11:09:41.238116 12765 parquet-column-readers.cc:959] Decompressed 27503 to 65503 I1212 11:09:41.318591 12765 parquet-column-readers.cc:959] Decompressed 27413 to 65521 I1212 11:09:41.334558 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000001 I1212 11:09:41.334568 3769 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000001 done=false I1212 11:09:41.334580 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000001 status=0 done=false I1212 11:09:41.335031 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 591.740ms 629.132ms 3.87M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:41.335590 3769 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000001 Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB, 106.22 MB, 106.57 MB, 106.76 MB, 106.25 MB, 106.25 MB, 106.28 MB, 106.40 MB, 106.40 MB, 106.34 MB, 106.34 MB, 106.28 MB, 106.22 MB, 98.55 MB, 98.58 MB, 98.33 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.33M (1328128) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.739ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 575.027ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 53s369ms, non-child: 53s369ms, % non-child: 100.00%) - KuduApplyTimer: 45s061ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.87 K/sec - TotalNumRows: 1.33M (1327104) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 572.762ms, non-child: 572.762ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 114.383ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.37M (1370112) - RowsReturned: 1.33M (1328128) - RowsReturnedRate: 2.32 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.28 MB/sec I1212 11:09:41.339026 3769 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.29M (1290581) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.361ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 593.951ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 51s371ms, non-child: 51s371ms, % non-child: 100.00%) - KuduApplyTimer: 43s435ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.11 K/sec - TotalNumRows: 1.29M (1289557) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 591.740ms, non-child: 591.740ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 121.890ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.33M (1332565) - RowsReturned: 1.29M (1290581) - RowsReturnedRate: 2.19 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.24 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB, 106.70 MB, 106.41 MB, 106.19 MB, 106.25 MB, 106.25 MB, 106.32 MB, 106.35 MB, 106.41 MB, 106.35 MB, 106.22 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.26M (1256448) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.248ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 631.108ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 49s318ms, non-child: 49s318ms, % non-child: 100.00%) - KuduApplyTimer: 41s737ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.45 K/sec - TotalNumRows: 1.26M (1255424) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 629.132ms, non-child: 629.132ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 105.256ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.30M (1298432) - RowsReturned: 1.26M (1256448) - RowsReturnedRate: 2.00 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.38 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB, 94.66 MB, 94.66 MB, 94.57 MB, 90.47 MB, 86.84 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.29M (1287168) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.098ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 575.718ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 51s425ms, non-child: 51s425ms, % non-child: 100.00%) - KuduApplyTimer: 43s508ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.01 K/sec - TotalNumRows: 1.29M (1286144) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 573.326ms, non-child: 573.326ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 146.030ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.33M (1329152) - RowsReturned: 1.29M (1287168) - RowsReturnedRate: 2.25 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.07 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB, 106.22 MB, 106.57 MB, 106.76 MB, 106.25 MB, 106.25 MB, 106.28 MB, 106.40 MB, 106.40 MB, 106.34 MB, 106.34 MB, 106.28 MB, 106.22 MB, 98.55 MB, 98.58 MB, 98.33 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.33M (1328128) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.739ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 575.027ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 53s369ms, non-child: 53s369ms, % non-child: 100.00%) - KuduApplyTimer: 45s061ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.87 K/sec - TotalNumRows: 1.33M (1327104) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 572.762ms, non-child: 572.762ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 114.383ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.37M (1370112) - RowsReturned: 1.33M (1328128) - RowsReturnedRate: 2.32 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.28 MB/sec I1212 11:09:41.399927 12765 parquet-column-readers.cc:959] Decompressed 27490 to 65527 I1212 11:09:41.405264 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 40210.6us I1212 11:09:41.444578 12765 parquet-column-readers.cc:959] Decompressed 12912 to 65544 I1212 11:09:41.444955 12765 parquet-column-readers.cc:959] Decompressed 38478 to 65544 I1212 11:09:41.483288 12765 parquet-column-readers.cc:959] Decompressed 27482 to 65534 I1212 11:09:41.487246 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 40261.4us I1212 11:09:41.555353 12765 parquet-column-readers.cc:959] Decompressed 27839 to 65530 I1212 11:09:41.587362 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:41.588024 12765 parquet-column-readers.cc:959] Decompressed 57056 to 65540 I1212 11:09:41.624466 12765 parquet-column-readers.cc:959] Decompressed 27610 to 65532 I1212 11:09:41.727756 12765 parquet-column-readers.cc:959] Decompressed 12885 to 65544 I1212 11:09:41.728106 12765 parquet-column-readers.cc:959] Decompressed 38533 to 65544 I1212 11:09:41.731108 12765 parquet-column-readers.cc:959] Decompressed 27507 to 65535 I1212 11:09:41.764711 12765 parquet-column-readers.cc:959] Decompressed 41341 to 65454 I1212 11:09:41.767515 12765 parquet-column-readers.cc:959] Decompressed 65460 to 65454 I1212 11:09:41.802314 12765 parquet-column-readers.cc:959] Decompressed 27394 to 65537 I1212 11:09:41.870785 12765 parquet-column-readers.cc:959] Decompressed 27586 to 65538 I1212 11:09:41.924640 12765 parquet-column-readers.cc:959] Decompressed 65516 to 65510 I1212 11:09:41.965343 12765 parquet-column-readers.cc:959] Decompressed 27690 to 65520 I1212 11:09:42.007519 12765 parquet-column-readers.cc:959] Decompressed 56998 to 65540 I1212 11:09:42.008538 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:42.008821 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:42.009124 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:42.041452 12765 parquet-column-readers.cc:959] Decompressed 12910 to 65544 I1212 11:09:42.041899 12765 parquet-column-readers.cc:959] Decompressed 38477 to 65544 I1212 11:09:42.045634 12765 parquet-column-readers.cc:959] Decompressed 27332 to 65542 I1212 11:09:42.125452 12765 parquet-column-readers.cc:959] Decompressed 27667 to 65518 I1212 11:09:42.235182 12765 parquet-column-readers.cc:959] Decompressed 27662 to 65509 I1212 11:09:42.310955 12765 parquet-column-readers.cc:959] Decompressed 27548 to 65526 I1212 11:09:42.335832 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:09:42.335839 3766 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000000 done=false I1212 11:09:42.335845 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000000 status=0 done=false I1212 11:09:42.336122 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 597.070ms 645.121ms 3.99M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:42.336431 3766 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000000 Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB, 106.70 MB, 106.41 MB, 106.19 MB, 106.25 MB, 106.25 MB, 106.32 MB, 106.35 MB, 106.41 MB, 106.35 MB, 106.22 MB, 98.55 MB, 98.58 MB, 98.27 MB, 98.27 MB, 98.49 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.38M (1377280) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.251ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 647.486ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 54s313ms, non-child: 54s313ms, % non-child: 100.00%) - KuduApplyTimer: 45s953ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.34 K/sec - TotalNumRows: 1.38M (1376256) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 645.121ms, non-child: 645.121ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 114.966ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.42M (1419264) - RowsReturned: 1.38M (1377280) - RowsReturnedRate: 2.13 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.26 MB/sec I1212 11:09:42.337528 3766 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.33M (1330858) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.363ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 599.411ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 53s036ms, non-child: 53s036ms, % non-child: 100.00%) - KuduApplyTimer: 44s841ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.07 K/sec - TotalNumRows: 1.33M (1329834) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 597.070ms, non-child: 597.070ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 125.126ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.37M (1372842) - RowsReturned: 1.33M (1330858) - RowsReturnedRate: 2.23 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.20 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB, 106.70 MB, 106.41 MB, 106.19 MB, 106.25 MB, 106.25 MB, 106.32 MB, 106.35 MB, 106.41 MB, 106.35 MB, 106.22 MB, 98.55 MB, 98.58 MB, 98.27 MB, 98.27 MB, 98.49 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.38M (1377280) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.251ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 647.486ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 54s313ms, non-child: 54s313ms, % non-child: 100.00%) - KuduApplyTimer: 45s953ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.34 K/sec - TotalNumRows: 1.38M (1376256) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 645.121ms, non-child: 645.121ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 114.966ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.42M (1419264) - RowsReturned: 1.38M (1377280) - RowsReturnedRate: 2.13 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.26 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB, 94.66 MB, 94.66 MB, 94.57 MB, 90.47 MB, 86.84 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.29M (1287168) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.098ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 575.718ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 51s425ms, non-child: 51s425ms, % non-child: 100.00%) - KuduApplyTimer: 43s508ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.01 K/sec - TotalNumRows: 1.29M (1286144) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 573.326ms, non-child: 573.326ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 146.030ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.33M (1329152) - RowsReturned: 1.29M (1287168) - RowsReturnedRate: 2.25 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1.07 MB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB, 106.22 MB, 106.57 MB, 106.76 MB, 106.25 MB, 106.25 MB, 106.28 MB, 106.40 MB, 106.40 MB, 106.34 MB, 106.34 MB, 106.28 MB, 106.22 MB, 98.55 MB, 98.58 MB, 98.33 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.33M (1328128) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.739ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 575.027ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 53s369ms, non-child: 53s369ms, % non-child: 100.00%) - KuduApplyTimer: 45s061ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.87 K/sec - TotalNumRows: 1.33M (1327104) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 572.762ms, non-child: 572.762ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 114.383ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.37M (1370112) - RowsReturned: 1.33M (1328128) - RowsReturnedRate: 2.32 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.28 MB/sec I1212 11:09:42.374893 12765 parquet-column-readers.cc:959] Decompressed 12790 to 65544 I1212 11:09:42.375259 12765 parquet-column-readers.cc:959] Decompressed 38556 to 65544 I1212 11:09:42.378031 12765 parquet-column-readers.cc:959] Decompressed 27689 to 65501 I1212 11:09:42.456516 12765 parquet-column-readers.cc:959] Decompressed 56977 to 65540 I1212 11:09:42.458778 12765 parquet-column-readers.cc:959] Decompressed 27442 to 65531 I1212 11:09:42.503820 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 41455.5us I1212 11:09:42.588920 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 42562.9us I1212 11:09:42.620110 12765 parquet-column-readers.cc:959] Decompressed 27644 to 65533 I1212 11:09:42.667284 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 36946.5us I1212 11:09:42.704592 12765 parquet-column-readers.cc:959] Decompressed 27660 to 65540 I1212 11:09:42.738241 12765 parquet-column-readers.cc:959] Decompressed 12786 to 65544 I1212 11:09:42.738620 12765 parquet-column-readers.cc:959] Decompressed 38492 to 65544 I1212 11:09:42.777657 12765 parquet-column-readers.cc:959] Decompressed 27519 to 65533 I1212 11:09:42.848992 12765 parquet-column-readers.cc:959] Decompressed 27653 to 65522 I1212 11:09:42.882951 12765 parquet-column-readers.cc:959] Decompressed 57010 to 65540 I1212 11:09:42.919627 12765 parquet-column-readers.cc:959] Decompressed 27593 to 65535 I1212 11:09:42.990532 12765 parquet-column-readers.cc:959] Decompressed 27650 to 65531 I1212 11:09:43.021646 12765 parquet-column-readers.cc:959] Decompressed 12671 to 65544 I1212 11:09:43.022016 12765 parquet-column-readers.cc:959] Decompressed 38588 to 65544 I1212 11:09:43.022328 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:43.064323 12765 parquet-column-readers.cc:959] Decompressed 27616 to 65511 I1212 11:09:43.145323 12765 parquet-column-readers.cc:959] Decompressed 27576 to 65517 I1212 11:09:43.252109 12765 parquet-column-readers.cc:959] Decompressed 27399 to 65538 I1212 11:09:43.345824 12765 parquet-column-readers.cc:959] Decompressed 57003 to 65540 I1212 11:09:43.347846 12765 parquet-column-readers.cc:959] Decompressed 27711 to 65526 I1212 11:09:43.385340 12765 parquet-column-readers.cc:959] Decompressed 12800 to 65544 I1212 11:09:43.385716 12765 parquet-column-readers.cc:959] Decompressed 38519 to 65544 I1212 11:09:43.468219 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:43.468533 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:43.470264 12765 parquet-column-readers.cc:959] Decompressed 27573 to 65512 I1212 11:09:43.554334 12765 parquet-column-readers.cc:959] Decompressed 27607 to 65536 I1212 11:09:43.627768 12765 parquet-column-readers.cc:959] Decompressed 27579 to 65514 I1212 11:09:43.751338 12765 parquet-column-readers.cc:959] Decompressed 12852 to 65544 I1212 11:09:43.751698 12765 parquet-column-readers.cc:959] Decompressed 38571 to 65544 I1212 11:09:43.754091 12765 parquet-column-readers.cc:959] Decompressed 27453 to 65508 I1212 11:09:43.820338 12765 parquet-column-readers.cc:959] Decompressed 56986 to 65540 I1212 11:09:43.820825 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:43.820978 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:43.821147 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:43.821554 12765 parquet-column-readers.cc:959] Decompressed 27405 to 65525 I1212 11:09:43.888573 12765 parquet-column-readers.cc:959] Decompressed 27632 to 65536 I1212 11:09:43.956290 12765 parquet-column-readers.cc:959] Decompressed 27628 to 65530 I1212 11:09:44.023757 12765 parquet-column-readers.cc:959] Decompressed 12677 to 65544 I1212 11:09:44.024143 12765 parquet-column-readers.cc:959] Decompressed 38563 to 65544 I1212 11:09:44.025600 12765 parquet-column-readers.cc:959] Decompressed 27509 to 65522 I1212 11:09:44.091876 12765 parquet-column-readers.cc:959] Decompressed 27444 to 65522 I1212 11:09:44.158985 12765 parquet-column-readers.cc:959] Decompressed 57028 to 65540 I1212 11:09:44.161320 12765 parquet-column-readers.cc:959] Decompressed 27533 to 65507 I1212 11:09:44.271621 12765 parquet-column-readers.cc:959] Decompressed 27635 to 65535 I1212 11:09:44.305089 12765 parquet-column-readers.cc:959] Decompressed 12799 to 65544 I1212 11:09:44.305461 12765 parquet-column-readers.cc:959] Decompressed 38536 to 65544 I1212 11:09:44.359995 12765 parquet-column-readers.cc:959] Decompressed 27688 to 65527 I1212 11:09:44.390272 12731 plan-fragment-executor.cc:408] Reporting profile for instance 25407d49fc4cde6f:d575dd6200000002 I1212 11:09:44.390676 12731 plan-fragment-executor.cc:412] Fragment 25407d49fc4cde6f:d575dd6200000002:(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB, 94.66 MB, 94.66 MB, 94.57 MB, 90.47 MB, 86.84 MB, 86.68 MB, 86.50 MB, 86.68 MB, 86.78 MB, 86.68 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.41M (1413120) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.098ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 597.008ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 56s392ms, non-child: 0.000ns, % non-child: 0.00%) - KuduApplyTimer: 47s689ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.04 K/sec - TotalNumRows: 1.41M (1412096) CodeGen:(Total: 85.001ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 594.206ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 155.928ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.46M (1455104) - RowsReturned: 1.41M (1413120) - RowsReturnedRate: 2.38 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1002.06 KB/sec I1212 11:09:44.390713 12731 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:09:44.390719 12731 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:09:44.391039 3396 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000002 I1212 11:09:44.391046 3396 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000002 done=false I1212 11:09:44.391052 3396 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000002 status=0 done=false I1212 11:09:44.391356 3396 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 604.030ms 645.121ms 4.12M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:44.391682 3396 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000002 Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB, 94.66 MB, 94.66 MB, 94.57 MB, 90.47 MB, 86.84 MB, 86.68 MB, 86.50 MB, 86.68 MB, 86.78 MB, 86.68 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.41M (1413120) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.098ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 597.008ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 56s392ms, non-child: 56s392ms, % non-child: 100.00%) - KuduApplyTimer: 47s689ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.04 K/sec - TotalNumRows: 1.41M (1412096) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 594.206ms, non-child: 594.206ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 155.928ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.46M (1455104) - RowsReturned: 1.41M (1413120) - RowsReturnedRate: 2.38 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1002.06 KB/sec I1212 11:09:44.392774 3396 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.37M (1372842) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.363ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 606.507ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 54s691ms, non-child: 54s691ms, % non-child: 100.00%) - KuduApplyTimer: 46s234ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.08 K/sec - TotalNumRows: 1.37M (1371818) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 604.030ms, non-child: 604.030ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 128.425ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.41M (1414826) - RowsReturned: 1.37M (1372842) - RowsReturnedRate: 2.28 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.17 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB, 106.70 MB, 106.41 MB, 106.19 MB, 106.25 MB, 106.25 MB, 106.32 MB, 106.35 MB, 106.41 MB, 106.35 MB, 106.22 MB, 98.55 MB, 98.58 MB, 98.27 MB, 98.27 MB, 98.49 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.38M (1377280) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.251ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 647.486ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 54s313ms, non-child: 54s313ms, % non-child: 100.00%) - KuduApplyTimer: 45s953ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.34 K/sec - TotalNumRows: 1.38M (1376256) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 645.121ms, non-child: 645.121ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 114.966ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.42M (1419264) - RowsReturned: 1.38M (1377280) - RowsReturnedRate: 2.13 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.26 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB, 94.66 MB, 94.66 MB, 94.57 MB, 90.47 MB, 86.84 MB, 86.68 MB, 86.50 MB, 86.68 MB, 86.78 MB, 86.68 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.41M (1413120) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.098ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 597.008ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 56s392ms, non-child: 56s392ms, % non-child: 100.00%) - KuduApplyTimer: 47s689ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.04 K/sec - TotalNumRows: 1.41M (1412096) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 594.206ms, non-child: 594.206ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 155.928ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.46M (1455104) - RowsReturned: 1.41M (1413120) - RowsReturnedRate: 2.38 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1002.06 KB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB, 106.22 MB, 106.57 MB, 106.76 MB, 106.25 MB, 106.25 MB, 106.28 MB, 106.40 MB, 106.40 MB, 106.34 MB, 106.34 MB, 106.28 MB, 106.22 MB, 98.55 MB, 98.58 MB, 98.33 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.33M (1328128) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.739ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 575.027ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 53s369ms, non-child: 53s369ms, % non-child: 100.00%) - KuduApplyTimer: 45s061ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.87 K/sec - TotalNumRows: 1.33M (1327104) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 572.762ms, non-child: 572.762ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 114.383ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.37M (1370112) - RowsReturned: 1.33M (1328128) - RowsReturnedRate: 2.32 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.28 MB/sec I1212 11:09:44.392844 12731 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:09:44.433275 12765 parquet-column-readers.cc:959] Decompressed 27408 to 65526 I1212 11:09:44.504627 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:44.507480 12765 parquet-column-readers.cc:959] Decompressed 27624 to 65524 I1212 11:09:44.584743 12765 parquet-column-readers.cc:959] Decompressed 56997 to 65540 I1212 11:09:44.587093 12765 parquet-column-readers.cc:959] Decompressed 27665 to 65513 I1212 11:09:44.634224 12765 parquet-column-readers.cc:959] Decompressed 12561 to 65544 I1212 11:09:44.634620 12765 parquet-column-readers.cc:959] Decompressed 38553 to 65544 I1212 11:09:44.692844 12765 parquet-column-readers.cc:959] Decompressed 27382 to 65536 I1212 11:09:44.806535 12765 parquet-column-readers.cc:959] Decompressed 27419 to 65507 I1212 11:09:44.886512 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 36847.5us I1212 11:09:44.915451 12765 parquet-column-readers.cc:959] Decompressed 27691 to 65512 I1212 11:09:44.966850 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 32170.2us I1212 11:09:45.011404 12765 parquet-column-readers.cc:959] Decompressed 27553 to 65506 I1212 11:09:45.032291 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 32215.9us I1212 11:09:45.053311 12765 parquet-column-readers.cc:959] Decompressed 12829 to 65544 I1212 11:09:45.053603 12765 parquet-column-readers.cc:959] Decompressed 38533 to 65544 I1212 11:09:45.107234 12765 parquet-column-readers.cc:959] Decompressed 27470 to 65538 I1212 11:09:45.139178 12765 parquet-column-readers.cc:959] Decompressed 57031 to 65540 I1212 11:09:45.174377 12765 parquet-column-readers.cc:959] Decompressed 27548 to 65527 I1212 11:09:45.276178 12765 parquet-column-readers.cc:959] Decompressed 27831 to 65541 I1212 11:09:45.341462 12765 parquet-column-readers.cc:959] Decompressed 12860 to 65544 I1212 11:09:45.341841 12765 parquet-column-readers.cc:959] Decompressed 38627 to 65544 I1212 11:09:45.344651 12765 parquet-column-readers.cc:959] Decompressed 27635 to 65528 I1212 11:09:45.439849 12765 parquet-column-readers.cc:959] Decompressed 65516 to 65510 I1212 11:09:45.441627 12765 parquet-column-readers.cc:959] Decompressed 27496 to 65540 I1212 11:09:45.541432 12765 parquet-column-readers.cc:959] Decompressed 57098 to 65540 I1212 11:09:45.541959 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:45.542145 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:45.542322 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:45.542656 12765 parquet-column-readers.cc:959] Decompressed 27348 to 65532 I1212 11:09:45.616878 12765 parquet-column-readers.cc:959] Decompressed 27491 to 65515 I1212 11:09:45.685881 12765 parquet-column-readers.cc:959] Decompressed 12838 to 65544 I1212 11:09:45.686244 12765 parquet-column-readers.cc:959] Decompressed 38502 to 65544 I1212 11:09:45.689136 12765 parquet-column-readers.cc:959] Decompressed 27572 to 65517 I1212 11:09:45.776710 12765 parquet-column-readers.cc:959] Decompressed 27445 to 65521 I1212 11:09:45.872026 12765 parquet-column-readers.cc:959] Decompressed 27619 to 65542 I1212 11:09:45.941331 12765 parquet-column-readers.cc:959] Decompressed 27550 to 65533 I1212 11:09:45.974206 12765 parquet-column-readers.cc:959] Decompressed 56985 to 65540 I1212 11:09:46.018502 12765 parquet-column-readers.cc:959] Decompressed 12883 to 65544 I1212 11:09:46.018877 12765 parquet-column-readers.cc:959] Decompressed 38559 to 65544 I1212 11:09:46.021741 12765 parquet-column-readers.cc:959] Decompressed 27677 to 65502 I1212 11:09:46.065740 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:46.066305 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 32758.6us I1212 11:09:46.143560 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 30359.7us I1212 11:09:46.173091 12765 parquet-column-readers.cc:959] Decompressed 27640 to 65514 I1212 11:09:46.245314 12765 parquet-column-readers.cc:959] Decompressed 27714 to 65542 I1212 11:09:46.313100 12765 parquet-column-readers.cc:959] Decompressed 27616 to 65506 I1212 11:09:46.340622 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000001 I1212 11:09:46.340631 3769 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000001 done=false I1212 11:09:46.340641 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000001 status=0 done=false I1212 11:09:46.341022 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 606.723ms 645.121ms 4.25M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:46.341583 3769 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000001 Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB, 106.22 MB, 106.57 MB, 106.76 MB, 106.25 MB, 106.25 MB, 106.28 MB, 106.40 MB, 106.40 MB, 106.34 MB, 106.34 MB, 106.28 MB, 106.22 MB, 98.55 MB, 98.58 MB, 98.33 MB, 98.33 MB, 98.43 MB, 98.39 MB, 98.42 MB, 98.30 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.46M (1459200) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.739ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 583.534ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 58s377ms, non-child: 58s377ms, % non-child: 100.00%) - KuduApplyTimer: 49s291ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.98 K/sec - TotalNumRows: 1.46M (1458176) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 580.842ms, non-child: 580.842ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 124.193ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.50M (1501184) - RowsReturned: 1.46M (1459200) - RowsReturnedRate: 2.51 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.17 MB/sec I1212 11:09:46.343580 3769 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.42M (1416533) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.363ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 609.343ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 56s361ms, non-child: 56s361ms, % non-child: 100.00%) - KuduApplyTimer: 47s645ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.12 K/sec - TotalNumRows: 1.42M (1415509) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 606.723ms, non-child: 606.723ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 131.696ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.46M (1458517) - RowsReturned: 1.42M (1416533) - RowsReturnedRate: 2.34 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.13 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB, 106.70 MB, 106.41 MB, 106.19 MB, 106.25 MB, 106.25 MB, 106.32 MB, 106.35 MB, 106.41 MB, 106.35 MB, 106.22 MB, 98.55 MB, 98.58 MB, 98.27 MB, 98.27 MB, 98.49 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.38M (1377280) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.251ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 647.486ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 54s313ms, non-child: 54s313ms, % non-child: 100.00%) - KuduApplyTimer: 45s953ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.34 K/sec - TotalNumRows: 1.38M (1376256) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 645.121ms, non-child: 645.121ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 114.966ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.42M (1419264) - RowsReturned: 1.38M (1377280) - RowsReturnedRate: 2.13 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.26 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB, 94.66 MB, 94.66 MB, 94.57 MB, 90.47 MB, 86.84 MB, 86.68 MB, 86.50 MB, 86.68 MB, 86.78 MB, 86.68 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.41M (1413120) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.098ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 597.008ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 56s392ms, non-child: 56s392ms, % non-child: 100.00%) - KuduApplyTimer: 47s689ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.04 K/sec - TotalNumRows: 1.41M (1412096) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 594.206ms, non-child: 594.206ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 155.928ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.46M (1455104) - RowsReturned: 1.41M (1413120) - RowsReturnedRate: 2.38 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1002.06 KB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB, 106.22 MB, 106.57 MB, 106.76 MB, 106.25 MB, 106.25 MB, 106.28 MB, 106.40 MB, 106.40 MB, 106.34 MB, 106.34 MB, 106.28 MB, 106.22 MB, 98.55 MB, 98.58 MB, 98.33 MB, 98.33 MB, 98.43 MB, 98.39 MB, 98.42 MB, 98.30 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.46M (1459200) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.739ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 583.534ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 58s377ms, non-child: 58s377ms, % non-child: 100.00%) - KuduApplyTimer: 49s291ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.98 K/sec - TotalNumRows: 1.46M (1458176) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 580.842ms, non-child: 580.842ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 124.193ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.50M (1501184) - RowsReturned: 1.46M (1459200) - RowsReturnedRate: 2.51 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.17 MB/sec I1212 11:09:46.344818 12765 parquet-column-readers.cc:959] Decompressed 12845 to 65544 I1212 11:09:46.345036 12765 parquet-column-readers.cc:959] Decompressed 38521 to 65544 I1212 11:09:46.379173 12765 parquet-column-readers.cc:959] Decompressed 27562 to 65543 I1212 11:09:46.411885 12765 parquet-column-readers.cc:959] Decompressed 56972 to 65540 I1212 11:09:46.447036 12765 parquet-column-readers.cc:959] Decompressed 27434 to 65513 I1212 11:09:46.557868 12765 parquet-column-readers.cc:959] Decompressed 27742 to 65515 I1212 11:09:46.671020 12765 parquet-column-readers.cc:959] Decompressed 27416 to 65537 I1212 11:09:46.716102 12765 parquet-column-readers.cc:959] Decompressed 12751 to 65544 I1212 11:09:46.716480 12765 parquet-column-readers.cc:959] Decompressed 38605 to 65544 I1212 11:09:46.753089 12765 parquet-column-readers.cc:959] Decompressed 27288 to 65506 I1212 11:09:46.819407 12765 parquet-column-readers.cc:959] Decompressed 27507 to 65526 I1212 11:09:46.851277 12765 parquet-column-readers.cc:959] Decompressed 57010 to 65540 I1212 11:09:46.902977 12765 parquet-column-readers.cc:959] Decompressed 27505 to 65542 I1212 11:09:47.019600 12765 parquet-column-readers.cc:959] Decompressed 12776 to 65544 I1212 11:09:47.019990 12765 parquet-column-readers.cc:959] Decompressed 38478 to 65544 I1212 11:09:47.022781 12765 parquet-column-readers.cc:959] Decompressed 27647 to 65543 I1212 11:09:47.100850 12765 parquet-column-readers.cc:959] Decompressed 27300 to 65516 I1212 11:09:47.168145 12765 parquet-column-readers.cc:959] Decompressed 27637 to 65538 I1212 11:09:47.221449 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 36227.2us I1212 11:09:47.264034 12765 parquet-column-readers.cc:959] Decompressed 27589 to 65521 I1212 11:09:47.298144 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 32630.5us I1212 11:09:47.302146 12765 parquet-column-readers.cc:959] Decompressed 56984 to 65540 I1212 11:09:47.303236 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:47.303562 12765 parquet-column-readers.cc:959] Decompressed 65504 to 65496 I1212 11:09:47.303843 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:47.339088 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:09:47.339097 3766 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000000 done=false I1212 11:09:47.339107 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000000 status=0 done=false I1212 11:09:47.339483 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 615.783ms 672.301ms 4.38M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:47.340055 3766 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000000 Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB, 106.70 MB, 106.41 MB, 106.19 MB, 106.25 MB, 106.25 MB, 106.32 MB, 106.35 MB, 106.41 MB, 106.35 MB, 106.22 MB, 98.55 MB, 98.58 MB, 98.27 MB, 98.27 MB, 98.49 MB, 98.43 MB, 98.37 MB, 98.37 MB, 98.31 MB, 98.27 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.51M (1505280) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.251ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 675.081ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 59s262ms, non-child: 59s262ms, % non-child: 100.00%) - KuduApplyTimer: 50s140ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.38 K/sec - TotalNumRows: 1.50M (1504256) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 672.301ms, non-child: 672.301ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 125.041ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.55M (1547264) - RowsReturned: 1.51M (1505280) - RowsReturnedRate: 2.24 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.15 MB/sec I1212 11:09:47.342080 3766 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.46M (1459200) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.363ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 618.541ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 58s010ms, non-child: 58s010ms, % non-child: 100.00%) - KuduApplyTimer: 49s040ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.13 K/sec - TotalNumRows: 1.46M (1458176) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 615.783ms, non-child: 615.783ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 135.054ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.50M (1501184) - RowsReturned: 1.46M (1459200) - RowsReturnedRate: 2.38 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.10 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB, 106.70 MB, 106.41 MB, 106.19 MB, 106.25 MB, 106.25 MB, 106.32 MB, 106.35 MB, 106.41 MB, 106.35 MB, 106.22 MB, 98.55 MB, 98.58 MB, 98.27 MB, 98.27 MB, 98.49 MB, 98.43 MB, 98.37 MB, 98.37 MB, 98.31 MB, 98.27 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.51M (1505280) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.251ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 675.081ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 59s262ms, non-child: 59s262ms, % non-child: 100.00%) - KuduApplyTimer: 50s140ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.38 K/sec - TotalNumRows: 1.50M (1504256) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 672.301ms, non-child: 672.301ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 125.041ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.55M (1547264) - RowsReturned: 1.51M (1505280) - RowsReturnedRate: 2.24 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.15 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB, 94.66 MB, 94.66 MB, 94.57 MB, 90.47 MB, 86.84 MB, 86.68 MB, 86.50 MB, 86.68 MB, 86.78 MB, 86.68 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.41M (1413120) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.098ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 597.008ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 56s392ms, non-child: 56s392ms, % non-child: 100.00%) - KuduApplyTimer: 47s689ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.04 K/sec - TotalNumRows: 1.41M (1412096) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 594.206ms, non-child: 594.206ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 155.928ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.46M (1455104) - RowsReturned: 1.41M (1413120) - RowsReturnedRate: 2.38 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 1002.06 KB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB, 106.22 MB, 106.57 MB, 106.76 MB, 106.25 MB, 106.25 MB, 106.28 MB, 106.40 MB, 106.40 MB, 106.34 MB, 106.34 MB, 106.28 MB, 106.22 MB, 98.55 MB, 98.58 MB, 98.33 MB, 98.33 MB, 98.43 MB, 98.39 MB, 98.42 MB, 98.30 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.46M (1459200) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.739ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 583.534ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 58s377ms, non-child: 58s377ms, % non-child: 100.00%) - KuduApplyTimer: 49s291ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.98 K/sec - TotalNumRows: 1.46M (1458176) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 580.842ms, non-child: 580.842ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 124.193ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.50M (1501184) - RowsReturned: 1.46M (1459200) - RowsReturnedRate: 2.51 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.17 MB/sec I1212 11:09:47.343452 12765 parquet-column-readers.cc:959] Decompressed 12735 to 65544 I1212 11:09:47.343809 12765 parquet-column-readers.cc:959] Decompressed 38446 to 65544 I1212 11:09:47.346719 12765 parquet-column-readers.cc:959] Decompressed 27526 to 65535 I1212 11:09:47.417453 12765 parquet-column-readers.cc:959] Decompressed 27576 to 65535 I1212 11:09:47.487352 12765 parquet-column-readers.cc:959] Decompressed 27479 to 65515 I1212 11:09:47.555676 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:47.556994 12765 parquet-column-readers.cc:959] Decompressed 27627 to 65531 I1212 11:09:47.624640 12765 parquet-column-readers.cc:959] Decompressed 12917 to 65544 I1212 11:09:47.624855 12765 parquet-column-readers.cc:959] Decompressed 38528 to 65544 I1212 11:09:47.626276 12765 parquet-column-readers.cc:959] Decompressed 27810 to 65520 I1212 11:09:47.695706 12765 parquet-column-readers.cc:959] Decompressed 57034 to 65540 I1212 11:09:47.697932 12765 parquet-column-readers.cc:959] Decompressed 27524 to 65513 I1212 11:09:47.843010 12765 parquet-column-readers.cc:959] Decompressed 27730 to 65524 I1212 11:09:47.928628 12765 parquet-column-readers.cc:959] Decompressed 27562 to 65532 I1212 11:09:47.963381 12765 parquet-column-readers.cc:959] Decompressed 12784 to 65544 I1212 11:09:47.963593 12765 parquet-column-readers.cc:959] Decompressed 38537 to 65544 I1212 11:09:48.001600 12765 parquet-column-readers.cc:959] Decompressed 27557 to 65538 I1212 11:09:48.118391 12765 parquet-column-readers.cc:959] Decompressed 27745 to 65528 I1212 11:09:48.176390 12765 parquet-column-readers.cc:959] Decompressed 57040 to 65540 I1212 11:09:48.232650 12765 parquet-column-readers.cc:959] Decompressed 25827 to 27694 I1212 11:09:48.233422 12765 parquet-column-readers.cc:959] Decompressed 27572 to 65531 I1212 11:09:48.348347 12765 parquet-column-readers.cc:959] Decompressed 27445 to 65532 I1212 11:09:48.404011 12765 parquet-column-readers.cc:959] Decompressed 12741 to 65544 I1212 11:09:48.404397 12765 parquet-column-readers.cc:959] Decompressed 38491 to 65544 I1212 11:09:48.464462 12765 parquet-column-readers.cc:959] Decompressed 27539 to 65538 I1212 11:09:48.510164 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 30461.8us I1212 11:09:48.595074 12765 parquet-column-readers.cc:959] Decompressed 27571 to 65542 I1212 11:09:48.709926 12765 parquet-column-readers.cc:959] Decompressed 27557 to 65543 I1212 11:09:48.826642 12765 parquet-column-readers.cc:959] Decompressed 57006 to 65540 I1212 11:09:48.827756 12765 parquet-column-readers.cc:959] Decompressed 27566 to 65511 I1212 11:09:48.883019 12765 parquet-column-readers.cc:959] Decompressed 12891 to 65544 I1212 11:09:48.883265 12765 parquet-column-readers.cc:959] Decompressed 38578 to 65544 I1212 11:09:48.946827 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:48.946969 12765 parquet-column-readers.cc:959] Decompressed 65326 to 65320 I1212 11:09:48.947060 12765 parquet-column-readers.cc:959] Decompressed 39712 to 40063 I1212 11:09:48.947705 12765 parquet-column-readers.cc:959] Decompressed 41366 to 41360 I1212 11:09:49.004478 12765 parquet-column-readers.cc:959] Decompressed 38774 to 61193 I1212 11:09:49.007242 12765 parquet-column-readers.cc:959] Decompressed 61199 to 61193 I1212 11:09:49.007392 12765 parquet-column-readers.cc:959] Decompressed 27536 to 65512 I1212 11:09:49.123224 12765 parquet-column-readers.cc:959] Decompressed 27650 to 65540 I1212 11:09:49.222455 12765 parquet-column-readers.cc:959] Decompressed 27728 to 65533 I1212 11:09:49.329694 12765 parquet-column-readers.cc:959] Decompressed 12781 to 65544 I1212 11:09:49.330086 12765 parquet-column-readers.cc:959] Decompressed 38563 to 65544 I1212 11:09:49.330564 12765 parquet-column-readers.cc:959] Decompressed 65516 to 65510 I1212 11:09:49.333024 12765 parquet-column-readers.cc:959] Decompressed 27592 to 65526 I1212 11:09:49.373050 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:49.373234 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:49.373399 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:49.394170 12731 plan-fragment-executor.cc:408] Reporting profile for instance 25407d49fc4cde6f:d575dd6200000002 I1212 11:09:49.394841 12731 plan-fragment-executor.cc:412] Fragment 25407d49fc4cde6f:d575dd6200000002:(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB, 94.66 MB, 94.66 MB, 94.57 MB, 90.47 MB, 86.84 MB, 86.68 MB, 86.50 MB, 86.68 MB, 86.78 MB, 86.68 MB, 86.56 MB, 86.65 MB, 86.46 MB, 86.51 MB, 86.68 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.53M (1527808) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.098ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 634.374ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m1s, non-child: 0.000ns, % non-child: 0.00%) - KuduApplyTimer: 51s933ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.88 K/sec - TotalNumRows: 1.53M (1526784) CodeGen:(Total: 85.001ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 631.188ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 164.735ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.57M (1569792) - RowsReturned: 1.53M (1527808) - RowsReturnedRate: 2.42 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 921.25 KB/sec I1212 11:09:49.394894 12731 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:09:49.394904 12731 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:09:49.395288 5418 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000002 I1212 11:09:49.395294 5418 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000002 done=false I1212 11:09:49.395303 5418 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000002 status=0 done=false I1212 11:09:49.395654 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 628.110ms 672.301ms 4.49M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:49.395999 5418 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000002 Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB, 94.66 MB, 94.66 MB, 94.57 MB, 90.47 MB, 86.84 MB, 86.68 MB, 86.50 MB, 86.68 MB, 86.78 MB, 86.68 MB, 86.56 MB, 86.65 MB, 86.46 MB, 86.51 MB, 86.68 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.53M (1527808) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.098ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 634.374ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m1s, non-child: 1m1s, % non-child: 100.00%) - KuduApplyTimer: 51s933ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.88 K/sec - TotalNumRows: 1.53M (1526784) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 631.188ms, non-child: 631.188ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 164.735ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.57M (1569792) - RowsReturned: 1.53M (1527808) - RowsReturnedRate: 2.42 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 921.25 KB/sec I1212 11:09:49.397169 5418 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.50M (1497429) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.363ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 630.996ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 59s669ms, non-child: 59s669ms, % non-child: 100.00%) - KuduApplyTimer: 50s455ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.08 K/sec - TotalNumRows: 1.50M (1496405) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 628.110ms, non-child: 628.110ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 137.990ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.54M (1539413) - RowsReturned: 1.50M (1497429) - RowsReturnedRate: 2.39 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.07 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB, 106.70 MB, 106.41 MB, 106.19 MB, 106.25 MB, 106.25 MB, 106.32 MB, 106.35 MB, 106.41 MB, 106.35 MB, 106.22 MB, 98.55 MB, 98.58 MB, 98.27 MB, 98.27 MB, 98.49 MB, 98.43 MB, 98.37 MB, 98.37 MB, 98.31 MB, 98.27 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.51M (1505280) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.251ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 675.081ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 59s262ms, non-child: 59s262ms, % non-child: 100.00%) - KuduApplyTimer: 50s140ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.38 K/sec - TotalNumRows: 1.50M (1504256) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 672.301ms, non-child: 672.301ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 125.041ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.55M (1547264) - RowsReturned: 1.51M (1505280) - RowsReturnedRate: 2.24 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.15 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB, 94.66 MB, 94.66 MB, 94.57 MB, 90.47 MB, 86.84 MB, 86.68 MB, 86.50 MB, 86.68 MB, 86.78 MB, 86.68 MB, 86.56 MB, 86.65 MB, 86.46 MB, 86.51 MB, 86.68 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.53M (1527808) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.098ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 634.374ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m1s, non-child: 1m1s, % non-child: 100.00%) - KuduApplyTimer: 51s933ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.88 K/sec - TotalNumRows: 1.53M (1526784) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 631.188ms, non-child: 631.188ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 164.735ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.57M (1569792) - RowsReturned: 1.53M (1527808) - RowsReturnedRate: 2.42 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 921.25 KB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(1s000ms): 80.24 MB, 113.55 MB, 113.97 MB, 114.03 MB, 113.92 MB, 114.17 MB, 114.35 MB, 114.28 MB, 114.19 MB, 114.53 MB, 114.22 MB, 114.16 MB, 114.28 MB, 114.38 MB, 114.28 MB, 114.31 MB, 114.25 MB, 114.10 MB, 114.16 MB, 114.67 MB, 114.70 MB, 114.16 MB, 114.19 MB, 114.22 MB, 110.30 MB, 106.34 MB, 106.31 MB, 106.40 MB, 106.25 MB, 106.19 MB, 106.50 MB, 106.43 MB, 106.19 MB, 106.37 MB, 106.37 MB, 106.22 MB, 106.31 MB, 106.28 MB, 106.09 MB, 106.22 MB, 106.57 MB, 106.76 MB, 106.25 MB, 106.25 MB, 106.28 MB, 106.40 MB, 106.40 MB, 106.34 MB, 106.34 MB, 106.28 MB, 106.22 MB, 98.55 MB, 98.58 MB, 98.33 MB, 98.33 MB, 98.43 MB, 98.39 MB, 98.42 MB, 98.30 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.46M (1459200) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.739ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 583.534ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 58s377ms, non-child: 58s377ms, % non-child: 100.00%) - KuduApplyTimer: 49s291ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.98 K/sec - TotalNumRows: 1.46M (1458176) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 580.842ms, non-child: 580.842ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 42.97 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 124.193ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.50M (1501184) - RowsReturned: 1.46M (1459200) - RowsReturnedRate: 2.51 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.17 MB/sec I1212 11:09:49.397267 12731 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:09:49.421016 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:49.421250 12765 parquet-column-readers.cc:959] Decompressed 56986 to 65540 I1212 11:09:49.422384 12765 parquet-column-readers.cc:959] Decompressed 27484 to 65529 I1212 11:09:49.537824 12765 parquet-column-readers.cc:959] Decompressed 27622 to 65523 I1212 11:09:49.647485 12765 parquet-column-readers.cc:959] Decompressed 27591 to 65528 I1212 11:09:49.728961 12765 parquet-column-readers.cc:959] Decompressed 12713 to 65544 I1212 11:09:49.729177 12765 parquet-column-readers.cc:959] Decompressed 38571 to 65544 I1212 11:09:49.730698 12765 parquet-column-readers.cc:959] Decompressed 27713 to 65539 I1212 11:09:49.799278 12765 parquet-column-readers.cc:959] Decompressed 27413 to 65531 I1212 11:09:49.865969 12765 parquet-column-readers.cc:959] Decompressed 57123 to 65540 I1212 11:09:49.867048 12765 parquet-column-readers.cc:959] Decompressed 27566 to 65508 I1212 11:09:49.934543 12765 parquet-column-readers.cc:959] Decompressed 27477 to 65513 I1212 11:09:50.002143 12765 parquet-column-readers.cc:959] Decompressed 12576 to 65544 I1212 11:09:50.002415 12765 parquet-column-readers.cc:959] Decompressed 38502 to 65544 I1212 11:09:50.044771 12765 parquet-column-readers.cc:959] Decompressed 27455 to 65531 I1212 11:09:50.160415 12765 parquet-column-readers.cc:959] Decompressed 27599 to 65519 I1212 11:09:50.275523 12765 parquet-column-readers.cc:959] Decompressed 27681 to 65528 I1212 11:09:50.339148 12765 parquet-column-readers.cc:959] Decompressed 57011 to 65540 I1212 11:09:50.340229 12765 parquet-column-readers.cc:959] Decompressed 27681 to 65509 I1212 11:09:50.371383 12765 parquet-column-readers.cc:959] Decompressed 12836 to 65544 I1212 11:09:50.371608 12765 parquet-column-readers.cc:959] Decompressed 38507 to 65544 I1212 11:09:50.405827 12765 parquet-column-readers.cc:959] Decompressed 27641 to 65530 I1212 11:09:50.492996 12765 parquet-column-readers.cc:959] Decompressed 27657 to 65536 I1212 11:09:50.581159 12765 parquet-column-readers.cc:959] Decompressed 27803 to 65538 I1212 11:09:50.650463 12765 parquet-column-readers.cc:959] Decompressed 27676 to 65502 I1212 11:09:50.689635 12765 parquet-column-readers.cc:959] Decompressed 12808 to 65544 I1212 11:09:50.690003 12765 parquet-column-readers.cc:959] Decompressed 38599 to 65544 I1212 11:09:50.743706 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 37279.4us I1212 11:09:50.743830 12765 parquet-column-readers.cc:959] Decompressed 27549 to 65529 I1212 11:09:50.797451 12765 parquet-column-readers.cc:959] Decompressed 56997 to 65540 I1212 11:09:50.822574 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 38345.3us I1212 11:09:50.841974 12765 parquet-column-readers.cc:959] Decompressed 27380 to 65533 I1212 11:09:50.897411 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 38140.8us I1212 11:09:50.946686 12765 parquet-column-readers.cc:959] Decompressed 27522 to 65543 I1212 11:09:50.979837 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:51.013701 12765 parquet-column-readers.cc:959] Decompressed 12794 to 65544 I1212 11:09:51.013918 12765 parquet-column-readers.cc:959] Decompressed 38573 to 65544 I1212 11:09:51.015303 12765 parquet-column-readers.cc:959] Decompressed 27497 to 65518 I1212 11:09:51.082245 12765 parquet-column-readers.cc:959] Decompressed 27529 to 65532 I1212 11:09:51.147862 12765 parquet-column-readers.cc:959] Decompressed 57080 to 65540 I1212 11:09:51.148334 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:51.148478 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:51.148620 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:51.148978 12765 parquet-column-readers.cc:959] Decompressed 27693 to 65535 I1212 11:09:51.218570 12765 parquet-column-readers.cc:959] Decompressed 27533 to 65524 I1212 11:09:51.285637 12765 parquet-column-readers.cc:959] Decompressed 12922 to 65544 I1212 11:09:51.285997 12765 parquet-column-readers.cc:959] Decompressed 38501 to 65544 I1212 11:09:51.288681 12765 parquet-column-readers.cc:959] Decompressed 27604 to 65536 I1212 11:09:51.344965 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000001 I1212 11:09:51.344977 3769 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000001 done=false I1212 11:09:51.344986 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000001 status=0 done=false I1212 11:09:51.345396 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 632.971ms 672.301ms 4.62M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:51.345849 3769 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000001 Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.58M (1582080) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.743ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 598.542ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m3s, non-child: 1m3s, % non-child: 100.00%) - KuduApplyTimer: 53s494ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.95 K/sec - TotalNumRows: 1.58M (1581056) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 595.424ms, non-child: 595.424ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 133.562ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.62M (1624064) - RowsReturned: 1.58M (1582080) - RowsReturnedRate: 2.66 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.08 MB/sec I1212 11:09:51.347753 3769 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.54M (1538389) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.364ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 635.999ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m1s, non-child: 1m1s, % non-child: 100.00%) - KuduApplyTimer: 51s856ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.07 K/sec - TotalNumRows: 1.54M (1537365) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 632.971ms, non-child: 632.971ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 141.113ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.58M (1580373) - RowsReturned: 1.54M (1538389) - RowsReturnedRate: 2.44 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.04 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(1s000ms): 81.90 MB, 113.59 MB, 113.98 MB, 114.04 MB, 114.11 MB, 114.17 MB, 114.39 MB, 114.32 MB, 114.16 MB, 114.51 MB, 114.41 MB, 114.16 MB, 114.26 MB, 114.35 MB, 114.26 MB, 114.35 MB, 114.32 MB, 114.23 MB, 114.20 MB, 114.48 MB, 114.71 MB, 114.29 MB, 114.17 MB, 114.26 MB, 110.30 MB, 106.38 MB, 106.35 MB, 106.41 MB, 106.25 MB, 106.25 MB, 106.47 MB, 106.44 MB, 106.19 MB, 106.41 MB, 106.44 MB, 106.38 MB, 106.28 MB, 106.35 MB, 106.25 MB, 106.29 MB, 106.70 MB, 106.41 MB, 106.19 MB, 106.25 MB, 106.25 MB, 106.32 MB, 106.35 MB, 106.41 MB, 106.35 MB, 106.22 MB, 98.55 MB, 98.58 MB, 98.27 MB, 98.27 MB, 98.49 MB, 98.43 MB, 98.37 MB, 98.37 MB, 98.31 MB, 98.27 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.51M (1505280) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.251ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 675.081ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 59s262ms, non-child: 59s262ms, % non-child: 100.00%) - KuduApplyTimer: 50s140ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.38 K/sec - TotalNumRows: 1.50M (1504256) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 672.301ms, non-child: 672.301ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 47.13 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 125.041ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.55M (1547264) - RowsReturned: 1.51M (1505280) - RowsReturnedRate: 2.24 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.15 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB, 94.66 MB, 94.66 MB, 94.57 MB, 90.47 MB, 86.84 MB, 86.68 MB, 86.50 MB, 86.68 MB, 86.78 MB, 86.68 MB, 86.56 MB, 86.65 MB, 86.46 MB, 86.51 MB, 86.68 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.53M (1527808) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.098ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 634.374ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m1s, non-child: 1m1s, % non-child: 100.00%) - KuduApplyTimer: 51s933ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.88 K/sec - TotalNumRows: 1.53M (1526784) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 631.188ms, non-child: 631.188ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 164.735ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.57M (1569792) - RowsReturned: 1.53M (1527808) - RowsReturnedRate: 2.42 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 921.25 KB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.58M (1582080) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.743ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 598.542ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m3s, non-child: 1m3s, % non-child: 100.00%) - KuduApplyTimer: 53s494ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.95 K/sec - TotalNumRows: 1.58M (1581056) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 595.424ms, non-child: 595.424ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 133.562ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.62M (1624064) - RowsReturned: 1.58M (1582080) - RowsReturnedRate: 2.66 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.08 MB/sec I1212 11:09:51.385120 12765 parquet-column-readers.cc:959] Decompressed 27462 to 65532 I1212 11:09:51.477160 12765 parquet-column-readers.cc:959] Decompressed 27531 to 65532 I1212 11:09:51.551542 12765 parquet-column-readers.cc:959] Decompressed 27585 to 65533 I1212 11:09:51.582726 12765 parquet-column-readers.cc:959] Decompressed 57026 to 65540 I1212 11:09:51.626816 12765 parquet-column-readers.cc:959] Decompressed 12805 to 65544 I1212 11:09:51.627197 12765 parquet-column-readers.cc:959] Decompressed 38442 to 65544 I1212 11:09:51.630013 12765 parquet-column-readers.cc:959] Decompressed 27412 to 65508 I1212 11:09:51.707883 12765 parquet-column-readers.cc:959] Decompressed 27588 to 65522 I1212 11:09:51.845504 12765 parquet-column-readers.cc:959] Decompressed 27552 to 65507 I1212 11:09:51.936431 12765 parquet-column-readers.cc:959] Decompressed 27580 to 65527 I1212 11:09:51.943491 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 41143.5us I1212 11:09:51.971367 12765 parquet-column-readers.cc:959] Decompressed 12657 to 65544 I1212 11:09:51.971740 12765 parquet-column-readers.cc:959] Decompressed 38509 to 65544 I1212 11:09:52.028298 12765 parquet-column-readers.cc:959] Decompressed 27670 to 65514 I1212 11:09:52.062340 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 43970.4us I1212 11:09:52.078502 12765 parquet-column-readers.cc:959] Decompressed 56998 to 65540 I1212 11:09:52.100657 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 38105.3us I1212 11:09:52.120736 12765 parquet-column-readers.cc:959] Decompressed 27668 to 65541 I1212 11:09:52.192085 12765 parquet-column-readers.cc:959] Decompressed 27594 to 65521 I1212 11:09:52.261893 12765 parquet-column-readers.cc:959] Decompressed 27475 to 65520 I1212 11:09:52.293728 12765 parquet-column-readers.cc:959] Decompressed 12803 to 65544 I1212 11:09:52.294100 12765 parquet-column-readers.cc:959] Decompressed 38502 to 65544 I1212 11:09:52.331013 12765 parquet-column-readers.cc:959] Decompressed 27572 to 65543 I1212 11:09:52.343652 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:09:52.343660 3766 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000000 done=false I1212 11:09:52.343667 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000000 status=0 done=false I1212 11:09:52.343945 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 634.506ms 676.905ms 4.74M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:52.344200 3766 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000000 Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(2s000ms): 97.74 MB, 114.01 MB, 114.14 MB, 114.36 MB, 114.34 MB, 114.29 MB, 114.31 MB, 114.31 MB, 114.27 MB, 114.34 MB, 114.50 MB, 114.21 MB, 108.34 MB, 106.38 MB, 106.25 MB, 106.46 MB, 106.30 MB, 106.41 MB, 106.32 MB, 106.27 MB, 106.56 MB, 106.22 MB, 106.28 MB, 106.38 MB, 106.28 MB, 98.57 MB, 98.27 MB, 98.46 MB, 98.37 MB, 98.29 MB, 94.70 MB, 90.39 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.63M (1631232) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.256ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 680.101ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m4s, non-child: 1m4s, % non-child: 100.00%) - KuduApplyTimer: 54s376ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.36 K/sec - TotalNumRows: 1.63M (1630208) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 676.905ms, non-child: 676.905ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 58.16 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 134.691ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.67M (1673216) - RowsReturned: 1.63M (1631232) - RowsReturnedRate: 2.41 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.06 MB/sec I1212 11:09:52.345252 3766 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.58M (1580373) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.366ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 637.672ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m2s, non-child: 1m2s, % non-child: 100.00%) - KuduApplyTimer: 53s268ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.07 K/sec - TotalNumRows: 1.58M (1579349) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 634.506ms, non-child: 634.506ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 144.329ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.62M (1622357) - RowsReturned: 1.58M (1580373) - RowsReturnedRate: 2.50 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1.01 MB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(2s000ms): 97.74 MB, 114.01 MB, 114.14 MB, 114.36 MB, 114.34 MB, 114.29 MB, 114.31 MB, 114.31 MB, 114.27 MB, 114.34 MB, 114.50 MB, 114.21 MB, 108.34 MB, 106.38 MB, 106.25 MB, 106.46 MB, 106.30 MB, 106.41 MB, 106.32 MB, 106.27 MB, 106.56 MB, 106.22 MB, 106.28 MB, 106.38 MB, 106.28 MB, 98.57 MB, 98.27 MB, 98.46 MB, 98.37 MB, 98.29 MB, 94.70 MB, 90.39 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.63M (1631232) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.256ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 680.101ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m4s, non-child: 1m4s, % non-child: 100.00%) - KuduApplyTimer: 54s376ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.36 K/sec - TotalNumRows: 1.63M (1630208) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 676.905ms, non-child: 676.905ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 58.16 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 134.691ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.67M (1673216) - RowsReturned: 1.63M (1631232) - RowsReturnedRate: 2.41 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.06 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(1s000ms): 100.01 MB, 101.93 MB, 102.26 MB, 102.26 MB, 102.33 MB, 102.42 MB, 102.65 MB, 102.48 MB, 102.42 MB, 102.73 MB, 102.57 MB, 102.42 MB, 102.63 MB, 102.67 MB, 102.54 MB, 102.57 MB, 102.54 MB, 102.45 MB, 102.42 MB, 102.93 MB, 102.89 MB, 102.45 MB, 102.42 MB, 102.44 MB, 94.60 MB, 94.54 MB, 94.66 MB, 94.63 MB, 94.54 MB, 94.60 MB, 94.82 MB, 94.57 MB, 94.54 MB, 94.66 MB, 94.69 MB, 94.63 MB, 94.51 MB, 94.51 MB, 94.54 MB, 94.44 MB, 94.99 MB, 94.98 MB, 94.54 MB, 94.44 MB, 94.50 MB, 94.50 MB, 94.63 MB, 94.66 MB, 94.66 MB, 94.57 MB, 90.47 MB, 86.84 MB, 86.68 MB, 86.50 MB, 86.68 MB, 86.78 MB, 86.68 MB, 86.56 MB, 86.65 MB, 86.46 MB, 86.51 MB, 86.68 MB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.53M (1527808) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.098ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 634.374ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m1s, non-child: 1m1s, % non-child: 100.00%) - KuduApplyTimer: 51s933ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.88 K/sec - TotalNumRows: 1.53M (1526784) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 631.188ms, non-child: 631.188ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(1s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 164.735ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.57M (1569792) - RowsReturned: 1.53M (1527808) - RowsReturnedRate: 2.42 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 921.25 KB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.58M (1582080) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.743ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 598.542ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m3s, non-child: 1m3s, % non-child: 100.00%) - KuduApplyTimer: 53s494ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.95 K/sec - TotalNumRows: 1.58M (1581056) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 595.424ms, non-child: 595.424ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 133.562ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.62M (1624064) - RowsReturned: 1.58M (1582080) - RowsReturnedRate: 2.66 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.08 MB/sec I1212 11:09:52.400503 12765 parquet-column-readers.cc:959] Decompressed 27598 to 65528 I1212 11:09:52.431875 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:52.432613 12765 parquet-column-readers.cc:959] Decompressed 57018 to 65540 I1212 11:09:52.469144 12765 parquet-column-readers.cc:959] Decompressed 27543 to 65536 I1212 11:09:52.581630 12765 parquet-column-readers.cc:959] Decompressed 27744 to 65505 I1212 11:09:52.637433 12765 parquet-column-readers.cc:959] Decompressed 12852 to 65544 I1212 11:09:52.637652 12765 parquet-column-readers.cc:959] Decompressed 38517 to 65544 I1212 11:09:52.738680 12765 parquet-column-readers.cc:959] Decompressed 27463 to 65530 I1212 11:09:52.825919 12765 parquet-column-readers.cc:959] Decompressed 27439 to 65533 I1212 11:09:52.862537 12765 parquet-column-readers.cc:959] Decompressed 52504 to 52498 I1212 11:09:52.923101 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:52.923383 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:52.923653 12765 parquet-column-readers.cc:959] Decompressed 65502 to 65496 I1212 11:09:52.924166 12765 parquet-column-readers.cc:959] Decompressed 27606 to 65523 I1212 11:09:52.980725 12765 parquet-column-readers.cc:959] Decompressed 57053 to 65540 I1212 11:09:53.038739 12765 parquet-column-readers.cc:959] Decompressed 12837 to 65544 I1212 11:09:53.038957 12765 parquet-column-readers.cc:959] Decompressed 38622 to 65544 I1212 11:09:53.040846 12765 parquet-column-readers.cc:959] Decompressed 27482 to 65519 I1212 11:09:53.157730 12765 parquet-column-readers.cc:959] Decompressed 27645 to 65521 I1212 11:09:53.190265 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 36586.5us I1212 11:09:53.244490 12765 parquet-column-readers.cc:959] Decompressed 27404 to 65510 I1212 11:09:53.346815 12765 parquet-column-readers.cc:959] Decompressed 27688 to 65537 I1212 11:09:53.410850 12765 parquet-column-readers.cc:959] Decompressed 12797 to 65544 I1212 11:09:53.411296 12765 parquet-column-readers.cc:959] Decompressed 38541 to 65544 I1212 11:09:53.414132 12765 parquet-column-readers.cc:959] Decompressed 27646 to 65542 I1212 11:09:53.480010 12765 parquet-column-readers.cc:959] Decompressed 57016 to 65540 I1212 11:09:53.482410 12765 parquet-column-readers.cc:959] Decompressed 27604 to 65524 I1212 11:09:53.550817 12765 parquet-column-readers.cc:959] Decompressed 27649 to 65541 I1212 11:09:53.664139 12765 parquet-column-readers.cc:959] Decompressed 27672 to 65520 I1212 11:09:53.696252 12765 parquet-column-readers.cc:959] Decompressed 12589 to 65544 I1212 11:09:53.696615 12765 parquet-column-readers.cc:959] Decompressed 38590 to 65544 I1212 11:09:53.742094 12765 parquet-column-readers.cc:959] Decompressed 27530 to 65540 I1212 11:09:53.825388 12765 parquet-column-readers.cc:959] Decompressed 27628 to 65507 I1212 11:09:53.856161 12765 parquet-column-readers.cc:959] Decompressed 57000 to 65540 I1212 11:09:53.889120 12765 parquet-column-readers.cc:959] Decompressed 27650 to 65543 I1212 11:09:53.958356 12765 parquet-column-readers.cc:959] Decompressed 27651 to 65532 I1212 11:09:54.000547 12765 parquet-column-readers.cc:959] Decompressed 12733 to 65544 I1212 11:09:54.000910 12765 parquet-column-readers.cc:959] Decompressed 38525 to 65544 I1212 11:09:54.001134 12765 parquet-column-readers.cc:959] Decompressed 65540 to 65534 I1212 11:09:54.039669 12765 parquet-column-readers.cc:959] Decompressed 27569 to 65530 I1212 11:09:54.123802 12765 parquet-column-readers.cc:959] Decompressed 27419 to 65541 I1212 11:09:54.200049 12765 parquet-column-readers.cc:959] Decompressed 27618 to 65529 I1212 11:09:54.278575 12765 parquet-column-readers.cc:959] Decompressed 57048 to 65540 I1212 11:09:54.280741 12765 parquet-column-readers.cc:959] Decompressed 27504 to 65526 I1212 11:09:54.311007 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 30092.6us I1212 11:09:54.315724 12765 parquet-column-readers.cc:959] Decompressed 12723 to 65544 I1212 11:09:54.316092 12765 parquet-column-readers.cc:959] Decompressed 38566 to 65544 I1212 11:09:54.316922 12765 parquet-column-readers.cc:959] Decompressed 16782 to 16776 I1212 11:09:54.317152 12765 parquet-column-readers.cc:959] Decompressed 16782 to 16776 I1212 11:09:54.371311 12765 parquet-column-readers.cc:959] Decompressed 27662 to 65541 I1212 11:09:54.398308 12731 plan-fragment-executor.cc:408] Reporting profile for instance 25407d49fc4cde6f:d575dd6200000002 I1212 11:09:54.398844 12731 plan-fragment-executor.cc:412] Fragment 25407d49fc4cde6f:d575dd6200000002:(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(2s000ms): 100.97 MB, 102.26 MB, 102.38 MB, 102.57 MB, 102.57 MB, 102.49 MB, 102.65 MB, 102.56 MB, 102.49 MB, 102.67 MB, 102.67 MB, 102.43 MB, 94.57 MB, 94.65 MB, 94.57 MB, 94.69 MB, 94.60 MB, 94.66 MB, 94.51 MB, 94.49 MB, 94.98 MB, 94.49 MB, 94.50 MB, 94.65 MB, 94.61 MB, 88.65 MB, 86.59 MB, 86.73 MB, 86.62 MB, 86.56 MB, 86.59 MB, 80.84 MB, 78.46 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.65M (1650688) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.102ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 649.723ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m6s, non-child: 0.000ns, % non-child: 0.00%) - KuduApplyTimer: 56s160ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.86 K/sec - TotalNumRows: 1.65M (1649664) CodeGen:(Total: 85.001ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 646.142ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 174.280ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.69M (1692672) - RowsReturned: 1.65M (1650688) - RowsReturnedRate: 2.55 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 852.52 KB/sec I1212 11:09:54.398882 12731 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:09:54.398897 12731 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:09:54.399356 3396 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000002 I1212 11:09:54.399365 3396 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000002 done=false I1212 11:09:54.399374 3396 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000002 status=0 done=false I1212 11:09:54.399808 3396 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 639.490ms 676.905ms 4.86M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:54.400308 3396 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000002 Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(2s000ms): 100.97 MB, 102.26 MB, 102.38 MB, 102.57 MB, 102.57 MB, 102.49 MB, 102.65 MB, 102.56 MB, 102.49 MB, 102.67 MB, 102.67 MB, 102.43 MB, 94.57 MB, 94.65 MB, 94.57 MB, 94.69 MB, 94.60 MB, 94.66 MB, 94.51 MB, 94.49 MB, 94.98 MB, 94.49 MB, 94.50 MB, 94.65 MB, 94.61 MB, 88.65 MB, 86.59 MB, 86.73 MB, 86.62 MB, 86.56 MB, 86.59 MB, 80.84 MB, 78.46 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.65M (1650688) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.102ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 649.723ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m6s, non-child: 1m6s, % non-child: 100.00%) - KuduApplyTimer: 56s160ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.86 K/sec - TotalNumRows: 1.65M (1649664) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 646.142ms, non-child: 646.142ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 174.280ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.69M (1692672) - RowsReturned: 1.65M (1650688) - RowsReturnedRate: 2.55 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 852.52 KB/sec I1212 11:09:54.401962 3396 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.62M (1621333) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.367ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 642.788ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m4s, non-child: 1m4s, % non-child: 100.00%) - KuduApplyTimer: 54s677ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.06 K/sec - TotalNumRows: 1.62M (1620309) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 639.490ms, non-child: 639.490ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 147.511ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.66M (1663317) - RowsReturned: 1.62M (1621333) - RowsReturnedRate: 2.54 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 1014.90 KB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(2s000ms): 97.74 MB, 114.01 MB, 114.14 MB, 114.36 MB, 114.34 MB, 114.29 MB, 114.31 MB, 114.31 MB, 114.27 MB, 114.34 MB, 114.50 MB, 114.21 MB, 108.34 MB, 106.38 MB, 106.25 MB, 106.46 MB, 106.30 MB, 106.41 MB, 106.32 MB, 106.27 MB, 106.56 MB, 106.22 MB, 106.28 MB, 106.38 MB, 106.28 MB, 98.57 MB, 98.27 MB, 98.46 MB, 98.37 MB, 98.29 MB, 94.70 MB, 90.39 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.63M (1631232) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.256ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 680.101ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m4s, non-child: 1m4s, % non-child: 100.00%) - KuduApplyTimer: 54s376ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.36 K/sec - TotalNumRows: 1.63M (1630208) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 676.905ms, non-child: 676.905ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 58.16 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 134.691ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.67M (1673216) - RowsReturned: 1.63M (1631232) - RowsReturnedRate: 2.41 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.06 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(2s000ms): 100.97 MB, 102.26 MB, 102.38 MB, 102.57 MB, 102.57 MB, 102.49 MB, 102.65 MB, 102.56 MB, 102.49 MB, 102.67 MB, 102.67 MB, 102.43 MB, 94.57 MB, 94.65 MB, 94.57 MB, 94.69 MB, 94.60 MB, 94.66 MB, 94.51 MB, 94.49 MB, 94.98 MB, 94.49 MB, 94.50 MB, 94.65 MB, 94.61 MB, 88.65 MB, 86.59 MB, 86.73 MB, 86.62 MB, 86.56 MB, 86.59 MB, 80.84 MB, 78.46 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.65M (1650688) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.102ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 649.723ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m6s, non-child: 1m6s, % non-child: 100.00%) - KuduApplyTimer: 56s160ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.86 K/sec - TotalNumRows: 1.65M (1649664) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 646.142ms, non-child: 646.142ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 174.280ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.69M (1692672) - RowsReturned: 1.65M (1650688) - RowsReturnedRate: 2.55 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 852.52 KB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.58M (1582080) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.743ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 598.542ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m3s, non-child: 1m3s, % non-child: 100.00%) - KuduApplyTimer: 53s494ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.95 K/sec - TotalNumRows: 1.58M (1581056) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 595.424ms, non-child: 595.424ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 133.562ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.62M (1624064) - RowsReturned: 1.58M (1582080) - RowsReturnedRate: 2.66 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1.08 MB/sec I1212 11:09:54.402132 12731 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:09:54.492084 12765 parquet-column-readers.cc:959] Decompressed 27688 to 65510 I1212 11:09:54.559273 12765 parquet-column-readers.cc:959] Decompressed 27414 to 65536 I1212 11:09:54.623809 12765 parquet-column-readers.cc:959] Decompressed 12630 to 65544 I1212 11:09:54.624017 12765 parquet-column-readers.cc:959] Decompressed 38516 to 65544 I1212 11:09:54.625485 12765 parquet-column-readers.cc:959] Decompressed 27712 to 65526 I1212 11:09:54.658499 12765 parquet-column-readers.cc:959] Decompressed 36508 to 36502 I1212 11:09:54.658682 12765 parquet-column-readers.cc:959] Decompressed 36508 to 36502 I1212 11:09:54.658833 12765 parquet-column-readers.cc:959] Decompressed 36508 to 36502 I1212 11:09:54.691390 12765 parquet-column-readers.cc:959] Decompressed 57075 to 65540 I1212 11:09:54.692559 12765 parquet-column-readers.cc:959] Decompressed 27264 to 65532 I1212 11:09:54.763327 12765 parquet-column-readers.cc:959] Decompressed 27644 to 65533 I1212 11:09:54.857062 12765 parquet-column-readers.cc:959] Decompressed 27550 to 65542 I1212 11:09:54.948207 12765 parquet-column-readers.cc:959] Decompressed 12718 to 65544 I1212 11:09:54.948578 12765 parquet-column-readers.cc:959] Decompressed 38536 to 65544 I1212 11:09:54.951372 12765 parquet-column-readers.cc:959] Decompressed 27681 to 65540 I1212 11:09:55.024494 12765 parquet-column-readers.cc:959] Decompressed 27548 to 65513 I1212 11:09:55.092061 12765 parquet-column-readers.cc:959] Decompressed 56922 to 65540 I1212 11:09:55.095544 12765 parquet-column-readers.cc:959] Decompressed 27710 to 65535 I1212 11:09:55.230989 12765 parquet-column-readers.cc:959] Decompressed 27511 to 65522 I1212 11:09:55.258813 12765 parquet-column-readers.cc:959] Decompressed 13006 to 65544 I1212 11:09:55.259181 12765 parquet-column-readers.cc:959] Decompressed 38510 to 65544 I1212 11:09:55.313874 12765 parquet-column-readers.cc:959] Decompressed 27767 to 65526 I1212 11:09:55.392534 12765 parquet-column-readers.cc:959] Decompressed 27446 to 65526 I1212 11:09:55.460088 12765 parquet-column-readers.cc:959] Decompressed 7540 to 7535 I1212 11:09:55.463114 12765 parquet-column-readers.cc:959] Decompressed 27820 to 65522 I1212 11:09:55.546985 12765 parquet-column-readers.cc:959] Decompressed 9066 to 10417 I1212 11:09:55.548480 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 39896.7us I1212 11:09:55.549191 12765 parquet-column-readers.cc:959] Decompressed 24341 to 57573 I1212 11:09:55.606899 12765 parquet-column-readers.cc:959] Decompressed 596 to 2919 I1212 11:09:55.607215 12765 parquet-column-readers.cc:959] Decompressed 3841 to 6407 I1212 11:09:55.721256 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31201, user_credentials={real_user=mj}} blocked reactor thread for 40363.6us I1212 11:09:55.769465 12765 progress-updater.cc:55] Splits complete (node=1) 100% Complete (1 out of 1) I1212 11:09:55.769762 2745 disk-io-mgr.cc:884] Disk (id=0) reading for DiskIoRequestContext: 0xa760b40 (state=Cancelled status_=Cancelled #ready_buffers=0 #used_buffers=0 #num_buffers_in_reader=0 #finished_scan_ranges=17 #disk_with_ranges=1 #disks=1 0: is_on_queue=0 done=0 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unstarted_scan_ranges=0 #unstarted_write_ranges=0 #reading_threads=1 1: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unstarted_scan_ranges=0 #unstarted_write_ranges=0 #reading_threads=0 2: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unstarted_scan_ranges=0 #unstarted_write_ranges=0 #reading_threads=0 3: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unstarted_scan_ranges=0 #unstarted_write_ranges=0 #reading_threads=0) I1212 11:09:56.348762 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000001 I1212 11:09:56.348769 3769 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000001 done=false I1212 11:09:56.348776 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000001 status=0 done=false I1212 11:09:56.349066 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 648.885ms 676.905ms 4.99M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:56.349326 3769 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000001 Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB, 90.35 MB, 90.50 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.70M (1704960) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.743ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 627.137ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m8s, non-child: 1m8s, % non-child: 100.00%) - KuduApplyTimer: 57s662ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.94 K/sec - TotalNumRows: 1.70M (1703936) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 623.607ms, non-child: 623.607ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 144.015ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.75M (1746944) - RowsReturned: 1.70M (1704960) - RowsReturnedRate: 2.73 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1022.43 KB/sec I1212 11:09:56.350251 3769 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.66M (1662293) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.367ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 652.320ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m6s, non-child: 1m6s, % non-child: 100.00%) - KuduApplyTimer: 56s066ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.05 K/sec - TotalNumRows: 1.66M (1661269) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 648.885ms, non-child: 648.885ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 150.995ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.70M (1704277) - RowsReturned: 1.66M (1662293) - RowsReturnedRate: 2.57 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 988.28 KB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(2s000ms): 97.74 MB, 114.01 MB, 114.14 MB, 114.36 MB, 114.34 MB, 114.29 MB, 114.31 MB, 114.31 MB, 114.27 MB, 114.34 MB, 114.50 MB, 114.21 MB, 108.34 MB, 106.38 MB, 106.25 MB, 106.46 MB, 106.30 MB, 106.41 MB, 106.32 MB, 106.27 MB, 106.56 MB, 106.22 MB, 106.28 MB, 106.38 MB, 106.28 MB, 98.57 MB, 98.27 MB, 98.46 MB, 98.37 MB, 98.29 MB, 94.70 MB, 90.39 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.63M (1631232) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.256ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 680.101ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m4s, non-child: 1m4s, % non-child: 100.00%) - KuduApplyTimer: 54s376ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.36 K/sec - TotalNumRows: 1.63M (1630208) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 676.905ms, non-child: 676.905ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 58.16 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 134.691ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.67M (1673216) - RowsReturned: 1.63M (1631232) - RowsReturnedRate: 2.41 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1.06 MB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(2s000ms): 100.97 MB, 102.26 MB, 102.38 MB, 102.57 MB, 102.57 MB, 102.49 MB, 102.65 MB, 102.56 MB, 102.49 MB, 102.67 MB, 102.67 MB, 102.43 MB, 94.57 MB, 94.65 MB, 94.57 MB, 94.69 MB, 94.60 MB, 94.66 MB, 94.51 MB, 94.49 MB, 94.98 MB, 94.49 MB, 94.50 MB, 94.65 MB, 94.61 MB, 88.65 MB, 86.59 MB, 86.73 MB, 86.62 MB, 86.56 MB, 86.59 MB, 80.84 MB, 78.46 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.65M (1650688) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.102ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 649.723ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m6s, non-child: 1m6s, % non-child: 100.00%) - KuduApplyTimer: 56s160ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.86 K/sec - TotalNumRows: 1.65M (1649664) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 646.142ms, non-child: 646.142ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 174.280ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.69M (1692672) - RowsReturned: 1.65M (1650688) - RowsReturnedRate: 2.55 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 852.52 KB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB, 90.35 MB, 90.50 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.70M (1704960) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.743ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 627.137ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m8s, non-child: 1m8s, % non-child: 100.00%) - KuduApplyTimer: 57s662ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.94 K/sec - TotalNumRows: 1.70M (1703936) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 623.607ms, non-child: 623.607ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 144.015ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.75M (1746944) - RowsReturned: 1.70M (1704960) - RowsReturnedRate: 2.73 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1022.43 KB/sec I1212 11:09:56.742729 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 33618.2us I1212 11:09:56.928634 12755 outbound_call.cc:206] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.0.0.1:31200, user_credentials={real_user=mj}} blocked reactor thread for 41694.3us I1212 11:09:57.346276 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:09:57.346285 3766 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000000 done=false I1212 11:09:57.346294 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000000 status=0 done=false I1212 11:09:57.346652 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 651.889ms 685.919ms 5.11M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:57.347151 3766 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000000 Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(2s000ms): 97.74 MB, 114.01 MB, 114.14 MB, 114.36 MB, 114.34 MB, 114.29 MB, 114.31 MB, 114.31 MB, 114.27 MB, 114.34 MB, 114.50 MB, 114.21 MB, 108.34 MB, 106.38 MB, 106.25 MB, 106.46 MB, 106.30 MB, 106.41 MB, 106.32 MB, 106.27 MB, 106.56 MB, 106.22 MB, 106.28 MB, 106.38 MB, 106.28 MB, 98.57 MB, 98.27 MB, 98.46 MB, 98.37 MB, 98.29 MB, 94.70 MB, 90.39 MB, 90.41 MB, 90.47 MB, 84.42 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.76M (1757184) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.261ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 689.534ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m9s, non-child: 1m9s, % non-child: 100.00%) - KuduApplyTimer: 58s541ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.36 K/sec - TotalNumRows: 1.76M (1756160) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 685.919ms, non-child: 685.919ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 58.16 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 144.986ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.80M (1799168) - RowsReturned: 1.76M (1757184) - RowsReturnedRate: 2.56 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1012.04 KB/sec I1212 11:09:57.349009 3766 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 104.600ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.70M (1704277) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.369ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 62.676ms - TotalThreadsSysTime: 2.809ms - TotalThreadsUserTime: 23.158ms - TotalThreadsVoluntaryContextSwitches: 168 (168) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 655.464ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m7s, non-child: 1m7s, % non-child: 100.00%) - KuduApplyTimer: 57s455ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.05 K/sec - TotalNumRows: 1.70M (1703253) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 651.889ms, non-child: 651.889ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 154.427ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.75M (1746261) - RowsReturned: 1.70M (1704277) - RowsReturnedRate: 2.62 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 962.33 KB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(2s000ms): 97.74 MB, 114.01 MB, 114.14 MB, 114.36 MB, 114.34 MB, 114.29 MB, 114.31 MB, 114.31 MB, 114.27 MB, 114.34 MB, 114.50 MB, 114.21 MB, 108.34 MB, 106.38 MB, 106.25 MB, 106.46 MB, 106.30 MB, 106.41 MB, 106.32 MB, 106.27 MB, 106.56 MB, 106.22 MB, 106.28 MB, 106.38 MB, 106.28 MB, 98.57 MB, 98.27 MB, 98.46 MB, 98.37 MB, 98.29 MB, 94.70 MB, 90.39 MB, 90.41 MB, 90.47 MB, 84.42 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.76M (1757184) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.261ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 689.534ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m9s, non-child: 1m9s, % non-child: 100.00%) - KuduApplyTimer: 58s541ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.36 K/sec - TotalNumRows: 1.76M (1756160) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 685.919ms, non-child: 685.919ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 58.16 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 144.986ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.80M (1799168) - RowsReturned: 1.76M (1757184) - RowsReturnedRate: 2.56 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1012.04 KB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 101.808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(2s000ms): 100.97 MB, 102.26 MB, 102.38 MB, 102.57 MB, 102.57 MB, 102.49 MB, 102.65 MB, 102.56 MB, 102.49 MB, 102.67 MB, 102.67 MB, 102.43 MB, 94.57 MB, 94.65 MB, 94.57 MB, 94.69 MB, 94.60 MB, 94.66 MB, 94.51 MB, 94.49 MB, 94.98 MB, 94.49 MB, 94.50 MB, 94.65 MB, 94.61 MB, 88.65 MB, 86.59 MB, 86.73 MB, 86.62 MB, 86.56 MB, 86.59 MB, 80.84 MB, 78.46 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.65M (1650688) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.102ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 59.881ms - TotalThreadsSysTime: 4.411ms - TotalThreadsUserTime: 22.620ms - TotalThreadsVoluntaryContextSwitches: 174 (174) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 649.723ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m6s, non-child: 1m6s, % non-child: 100.00%) - KuduApplyTimer: 56s160ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.86 K/sec - TotalNumRows: 1.65M (1649664) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 646.142ms, non-child: 646.142ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 174.280ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.69M (1692672) - RowsReturned: 1.65M (1650688) - RowsReturnedRate: 2.55 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 852.52 KB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB, 90.35 MB, 90.50 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.70M (1704960) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.743ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 627.137ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m8s, non-child: 1m8s, % non-child: 100.00%) - KuduApplyTimer: 57s662ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.94 K/sec - TotalNumRows: 1.70M (1703936) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 623.607ms, non-child: 623.607ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 144.015ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.75M (1746944) - RowsReturned: 1.70M (1704960) - RowsReturnedRate: 2.73 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1022.43 KB/sec I1212 11:09:57.458076 12731 plan-fragment-executor.cc:408] Reporting final profile for instance 25407d49fc4cde6f:d575dd6200000002 I1212 11:09:57.458659 12731 plan-fragment-executor.cc:412] Fragment 25407d49fc4cde6f:d575dd6200000002:(Total: 1m10s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(2s000ms): 100.97 MB, 102.26 MB, 102.38 MB, 102.57 MB, 102.57 MB, 102.49 MB, 102.65 MB, 102.56 MB, 102.49 MB, 102.67 MB, 102.67 MB, 102.43 MB, 94.57 MB, 94.65 MB, 94.57 MB, 94.69 MB, 94.60 MB, 94.66 MB, 94.51 MB, 94.49 MB, 94.98 MB, 94.49 MB, 94.50 MB, 94.65 MB, 94.61 MB, 88.65 MB, 86.59 MB, 86.73 MB, 86.62 MB, 86.56 MB, 86.59 MB, 80.84 MB, 78.46 MB, 78.49 MB, 28.81 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.72M (1724693) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.102ms - TotalThreadsInvoluntaryContextSwitches: 9.47K (9468) - TotalThreadsTotalWallClockTime: 2m18s - TotalThreadsSysTime: 15s301ms - TotalThreadsUserTime: 57s500ms - TotalThreadsVoluntaryContextSwitches: 2.01K (2012) Fragment Instance Lifecycle Timings: - ExecTime: 1m10s - ExecTreeExecTime: 667.686ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m9s, non-child: 0.000ns, % non-child: 0.00%) - KuduApplyTimer: 58s642ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.89 K/sec - TotalNumRows: 1.72M (1724693) CodeGen:(Total: 85.001ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 663.840ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.79 MB (58503541) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.79 MB (58503541) - DecompressionTime: 176.365ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 295.689ms - RowBatchQueuePutWaitTime: 1m3s - RowsRead: 1.72M (1724693) - RowsReturned: 1.72M (1724693) - RowsReturnedRate: 2.60 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1248) - ScannerThreadsTotalWallClockTime: 1m8s - MaterializeTupleTime(*): 4s459ms - ScannerThreadsSysTime: 48.615ms - ScannerThreadsUserTime: 4s513ms - ScannerThreadsVoluntaryContextSwitches: 1.69K (1692) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 815.97 KB/sec I1212 11:09:57.458705 12731 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=25407d49fc4cde6f:d575dd6200000002 I1212 11:09:57.458837 12720 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:09:57.458850 12720 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:09:57.459405 5418 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000002 I1212 11:09:57.459415 5418 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000002 done=true I1212 11:09:57.459424 5418 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000002 status=0 done=true I1212 11:09:57.459862 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 657.789ms 685.919ms 5.19M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:09:57.459869 5418 progress-updater.cc:65] Query 25407d49fc4cde6f:d575dd6200000000: 33% Complete (1 out of 3) I1212 11:09:57.460350 5418 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000002 Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 1m10s, non-child: 174.941ms, % non-child: 0.25%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(2s000ms): 100.97 MB, 102.26 MB, 102.38 MB, 102.57 MB, 102.57 MB, 102.49 MB, 102.65 MB, 102.56 MB, 102.49 MB, 102.67 MB, 102.67 MB, 102.43 MB, 94.57 MB, 94.65 MB, 94.57 MB, 94.69 MB, 94.60 MB, 94.66 MB, 94.51 MB, 94.49 MB, 94.98 MB, 94.49 MB, 94.50 MB, 94.65 MB, 94.61 MB, 88.65 MB, 86.59 MB, 86.73 MB, 86.62 MB, 86.56 MB, 86.59 MB, 80.84 MB, 78.46 MB, 78.49 MB, 28.81 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.72M (1724693) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.102ms - TotalThreadsInvoluntaryContextSwitches: 9.47K (9468) - TotalThreadsTotalWallClockTime: 2m18s - TotalThreadsSysTime: 15s301ms - TotalThreadsUserTime: 57s500ms - TotalThreadsVoluntaryContextSwitches: 2.01K (2012) Fragment Instance Lifecycle Timings: - ExecTime: 1m10s - ExecTreeExecTime: 667.686ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m9s, non-child: 1m9s, % non-child: 100.00%) - KuduApplyTimer: 58s642ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.89 K/sec - TotalNumRows: 1.72M (1724693) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 663.840ms, non-child: 663.840ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.79 MB (58503541) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.79 MB (58503541) - DecompressionTime: 176.365ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 295.689ms - RowBatchQueuePutWaitTime: 1m3s - RowsRead: 1.72M (1724693) - RowsReturned: 1.72M (1724693) - RowsReturnedRate: 2.60 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1248) - ScannerThreadsTotalWallClockTime: 1m8s - MaterializeTupleTime(*): 4s459ms - ScannerThreadsSysTime: 48.615ms - ScannerThreadsUserTime: 4s513ms - ScannerThreadsVoluntaryContextSwitches: 1.69K (1692) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 815.97 KB/sec I1212 11:09:57.462023 5418 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 23s471ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 1.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.73M (1728945) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.369ms - TotalThreadsInvoluntaryContextSwitches: 3.16K (3158) - TotalThreadsTotalWallClockTime: 46s233ms - TotalThreadsSysTime: 5s101ms - TotalThreadsUserTime: 19s182ms - TotalThreadsVoluntaryContextSwitches: 781 (781) Fragment Instance Lifecycle Timings: - ExecTime: 23s366ms - ExecTreeExecTime: 661.452ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m8s, non-child: 1m8s, % non-child: 100.00%) - KuduApplyTimer: 58s282ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.07 K/sec - TotalNumRows: 1.73M (1728263) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 657.789ms, non-child: 657.789ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 18.60 MB (19501180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 18.60 MB (19501180) - DecompressionTime: 155.122ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 98.563ms - RowBatchQueuePutWaitTime: 21s142ms - RowsRead: 1.76M (1756935) - RowsReturned: 1.73M (1728945) - RowsReturnedRate: 2.63 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 416 (416) - ScannerThreadsTotalWallClockTime: 22s803ms - MaterializeTupleTime(*): 1s486ms - ScannerThreadsSysTime: 16.204ms - ScannerThreadsUserTime: 1s504ms - ScannerThreadsVoluntaryContextSwitches: 564 (564) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 950.15 KB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(2s000ms): 97.74 MB, 114.01 MB, 114.14 MB, 114.36 MB, 114.34 MB, 114.29 MB, 114.31 MB, 114.31 MB, 114.27 MB, 114.34 MB, 114.50 MB, 114.21 MB, 108.34 MB, 106.38 MB, 106.25 MB, 106.46 MB, 106.30 MB, 106.41 MB, 106.32 MB, 106.27 MB, 106.56 MB, 106.22 MB, 106.28 MB, 106.38 MB, 106.28 MB, 98.57 MB, 98.27 MB, 98.46 MB, 98.37 MB, 98.29 MB, 94.70 MB, 90.39 MB, 90.41 MB, 90.47 MB, 84.42 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.76M (1757184) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.261ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 689.534ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m9s, non-child: 1m9s, % non-child: 100.00%) - KuduApplyTimer: 58s541ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.36 K/sec - TotalNumRows: 1.76M (1756160) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 685.919ms, non-child: 685.919ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 58.16 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 144.986ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.80M (1799168) - RowsReturned: 1.76M (1757184) - RowsReturnedRate: 2.56 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1012.04 KB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 1m10s, non-child: 174.941ms, % non-child: 0.25%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(2s000ms): 100.97 MB, 102.26 MB, 102.38 MB, 102.57 MB, 102.57 MB, 102.49 MB, 102.65 MB, 102.56 MB, 102.49 MB, 102.67 MB, 102.67 MB, 102.43 MB, 94.57 MB, 94.65 MB, 94.57 MB, 94.69 MB, 94.60 MB, 94.66 MB, 94.51 MB, 94.49 MB, 94.98 MB, 94.49 MB, 94.50 MB, 94.65 MB, 94.61 MB, 88.65 MB, 86.59 MB, 86.73 MB, 86.62 MB, 86.56 MB, 86.59 MB, 80.84 MB, 78.46 MB, 78.49 MB, 28.81 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.72M (1724693) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.102ms - TotalThreadsInvoluntaryContextSwitches: 9.47K (9468) - TotalThreadsTotalWallClockTime: 2m18s - TotalThreadsSysTime: 15s301ms - TotalThreadsUserTime: 57s500ms - TotalThreadsVoluntaryContextSwitches: 2.01K (2012) Fragment Instance Lifecycle Timings: - ExecTime: 1m10s - ExecTreeExecTime: 667.686ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m9s, non-child: 1m9s, % non-child: 100.00%) - KuduApplyTimer: 58s642ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.89 K/sec - TotalNumRows: 1.72M (1724693) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 663.840ms, non-child: 663.840ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.79 MB (58503541) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.79 MB (58503541) - DecompressionTime: 176.365ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 295.689ms - RowBatchQueuePutWaitTime: 1m3s - RowsRead: 1.72M (1724693) - RowsReturned: 1.72M (1724693) - RowsReturnedRate: 2.60 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1248) - ScannerThreadsTotalWallClockTime: 1m8s - MaterializeTupleTime(*): 4s459ms - ScannerThreadsSysTime: 48.615ms - ScannerThreadsUserTime: 4s513ms - ScannerThreadsVoluntaryContextSwitches: 1.69K (1692) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 815.97 KB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB, 90.35 MB, 90.50 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.70M (1704960) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.743ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 627.137ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m8s, non-child: 1m8s, % non-child: 100.00%) - KuduApplyTimer: 57s662ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.94 K/sec - TotalNumRows: 1.70M (1703936) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 623.607ms, non-child: 623.607ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 144.015ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.75M (1746944) - RowsReturned: 1.70M (1704960) - RowsReturnedRate: 2.73 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 1022.43 KB/sec I1212 11:09:57.462061 5418 coordinator.cc:1546] Fragment instance completed: id=25407d49fc4cde6f:d575dd6200000002 host=mj-desktop.ca.cloudera.com:22000 remaining=2 I1212 11:09:57.462066 5418 coordinator.cc:1556] query_id=25407d49fc4cde6f:d575dd6200000000: first in-progress backend: mj-desktop.ca.cloudera.com:22002 I1212 11:09:57.462146 12720 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:09:57.462213 12720 query-exec-mgr.cc:103] Instance completed. instance_id=25407d49fc4cde6f:d575dd6200000002 I1212 11:09:57.462220 12720 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=25407d49fc4cde6f:d575dd6200000000 refcnt=1 I1212 11:10:01.351289 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000001 I1212 11:10:01.351299 3769 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000001 done=false I1212 11:10:01.351307 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000001 status=0 done=false I1212 11:10:01.351735 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 659.416ms 685.919ms 5.32M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:10:01.352233 3769 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000001 Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB, 90.35 MB, 90.50 MB, 88.49 MB, 82.39 MB, 82.64 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.84M (1839104) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.749ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 632.466ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m13s, non-child: 1m13s, % non-child: 100.00%) - KuduApplyTimer: 1m1s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.07 K/sec - TotalNumRows: 1.84M (1838080) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 628.490ms, non-child: 628.490ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 153.835ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.88M (1881088) - RowsReturned: 1.84M (1839104) - RowsReturnedRate: 2.93 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 953.37 KB/sec I1212 11:10:01.354126 3769 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 23s471ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 1.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.77M (1773660) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.371ms - TotalThreadsInvoluntaryContextSwitches: 3.16K (3158) - TotalThreadsTotalWallClockTime: 46s233ms - TotalThreadsSysTime: 5s101ms - TotalThreadsUserTime: 19s182ms - TotalThreadsVoluntaryContextSwitches: 781 (781) Fragment Instance Lifecycle Timings: - ExecTime: 23s366ms - ExecTreeExecTime: 663.228ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m10s, non-child: 1m10s, % non-child: 100.00%) - KuduApplyTimer: 59s689ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.11 K/sec - TotalNumRows: 1.77M (1772977) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 659.416ms, non-child: 659.416ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 18.60 MB (19501180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 18.60 MB (19501180) - DecompressionTime: 158.395ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 98.563ms - RowBatchQueuePutWaitTime: 21s142ms - RowsRead: 1.80M (1801649) - RowsReturned: 1.77M (1773660) - RowsReturnedRate: 2.70 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 416 (416) - ScannerThreadsTotalWallClockTime: 22s803ms - MaterializeTupleTime(*): 1s486ms - ScannerThreadsSysTime: 16.204ms - ScannerThreadsUserTime: 1s504ms - ScannerThreadsVoluntaryContextSwitches: 564 (564) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 927.12 KB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(2s000ms): 97.74 MB, 114.01 MB, 114.14 MB, 114.36 MB, 114.34 MB, 114.29 MB, 114.31 MB, 114.31 MB, 114.27 MB, 114.34 MB, 114.50 MB, 114.21 MB, 108.34 MB, 106.38 MB, 106.25 MB, 106.46 MB, 106.30 MB, 106.41 MB, 106.32 MB, 106.27 MB, 106.56 MB, 106.22 MB, 106.28 MB, 106.38 MB, 106.28 MB, 98.57 MB, 98.27 MB, 98.46 MB, 98.37 MB, 98.29 MB, 94.70 MB, 90.39 MB, 90.41 MB, 90.47 MB, 84.42 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.76M (1757184) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.261ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 689.534ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m9s, non-child: 1m9s, % non-child: 100.00%) - KuduApplyTimer: 58s541ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.36 K/sec - TotalNumRows: 1.76M (1756160) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 685.919ms, non-child: 685.919ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 58.16 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 144.986ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.80M (1799168) - RowsReturned: 1.76M (1757184) - RowsReturnedRate: 2.56 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 1012.04 KB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 1m10s, non-child: 174.941ms, % non-child: 0.25%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(2s000ms): 100.97 MB, 102.26 MB, 102.38 MB, 102.57 MB, 102.57 MB, 102.49 MB, 102.65 MB, 102.56 MB, 102.49 MB, 102.67 MB, 102.67 MB, 102.43 MB, 94.57 MB, 94.65 MB, 94.57 MB, 94.69 MB, 94.60 MB, 94.66 MB, 94.51 MB, 94.49 MB, 94.98 MB, 94.49 MB, 94.50 MB, 94.65 MB, 94.61 MB, 88.65 MB, 86.59 MB, 86.73 MB, 86.62 MB, 86.56 MB, 86.59 MB, 80.84 MB, 78.46 MB, 78.49 MB, 28.81 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.72M (1724693) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.102ms - TotalThreadsInvoluntaryContextSwitches: 9.47K (9468) - TotalThreadsTotalWallClockTime: 2m18s - TotalThreadsSysTime: 15s301ms - TotalThreadsUserTime: 57s500ms - TotalThreadsVoluntaryContextSwitches: 2.01K (2012) Fragment Instance Lifecycle Timings: - ExecTime: 1m10s - ExecTreeExecTime: 667.686ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m9s, non-child: 1m9s, % non-child: 100.00%) - KuduApplyTimer: 58s642ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.89 K/sec - TotalNumRows: 1.72M (1724693) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 663.840ms, non-child: 663.840ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.79 MB (58503541) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.79 MB (58503541) - DecompressionTime: 176.365ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 295.689ms - RowBatchQueuePutWaitTime: 1m3s - RowsRead: 1.72M (1724693) - RowsReturned: 1.72M (1724693) - RowsReturnedRate: 2.60 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1248) - ScannerThreadsTotalWallClockTime: 1m8s - MaterializeTupleTime(*): 4s459ms - ScannerThreadsSysTime: 48.615ms - ScannerThreadsUserTime: 4s513ms - ScannerThreadsVoluntaryContextSwitches: 1.69K (1692) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 815.97 KB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB, 90.35 MB, 90.50 MB, 88.49 MB, 82.39 MB, 82.64 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.84M (1839104) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.749ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 632.466ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m13s, non-child: 1m13s, % non-child: 100.00%) - KuduApplyTimer: 1m1s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.07 K/sec - TotalNumRows: 1.84M (1838080) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 628.490ms, non-child: 628.490ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 153.835ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.88M (1881088) - RowsReturned: 1.84M (1839104) - RowsReturnedRate: 2.93 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 953.37 KB/sec I1212 11:10:02.351469 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:10:02.351481 3766 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000000 done=false I1212 11:10:02.351492 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000000 status=0 done=false I1212 11:10:02.351905 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 662.826ms 696.149ms 5.46M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:10:02.352401 3766 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000000 Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(2s000ms): 97.74 MB, 114.01 MB, 114.14 MB, 114.36 MB, 114.34 MB, 114.29 MB, 114.31 MB, 114.31 MB, 114.27 MB, 114.34 MB, 114.50 MB, 114.21 MB, 108.34 MB, 106.38 MB, 106.25 MB, 106.46 MB, 106.30 MB, 106.41 MB, 106.32 MB, 106.27 MB, 106.56 MB, 106.22 MB, 106.28 MB, 106.38 MB, 106.28 MB, 98.57 MB, 98.27 MB, 98.46 MB, 98.37 MB, 98.29 MB, 94.70 MB, 90.39 MB, 90.41 MB, 90.47 MB, 84.42 MB, 82.51 MB, 82.44 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.89M (1893376) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.261ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 700.169ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m14s, non-child: 1m14s, % non-child: 100.00%) - KuduApplyTimer: 1m2s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.49 K/sec - TotalNumRows: 1.89M (1892352) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 696.149ms, non-child: 696.149ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 58.16 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 155.862ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.94M (1935360) - RowsReturned: 1.89M (1893376) - RowsReturnedRate: 2.72 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 944.58 KB/sec I1212 11:10:02.354148 3766 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 23s471ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 1.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.82M (1819057) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.371ms - TotalThreadsInvoluntaryContextSwitches: 3.16K (3158) - TotalThreadsTotalWallClockTime: 46s233ms - TotalThreadsSysTime: 5s101ms - TotalThreadsUserTime: 19s182ms - TotalThreadsVoluntaryContextSwitches: 781 (781) Fragment Instance Lifecycle Timings: - ExecTime: 23s366ms - ExecTreeExecTime: 666.774ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m12s, non-child: 1m12s, % non-child: 100.00%) - KuduApplyTimer: 1m1s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.15 K/sec - TotalNumRows: 1.82M (1818375) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 662.826ms, non-child: 662.826ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 18.60 MB (19501180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 18.60 MB (19501180) - DecompressionTime: 162.020ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 98.563ms - RowBatchQueuePutWaitTime: 21s142ms - RowsRead: 1.85M (1847047) - RowsReturned: 1.82M (1819057) - RowsReturnedRate: 2.75 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 416 (416) - ScannerThreadsTotalWallClockTime: 22s803ms - MaterializeTupleTime(*): 1s486ms - ScannerThreadsSysTime: 16.204ms - ScannerThreadsUserTime: 1s504ms - ScannerThreadsVoluntaryContextSwitches: 564 (564) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 904.64 KB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(2s000ms): 97.74 MB, 114.01 MB, 114.14 MB, 114.36 MB, 114.34 MB, 114.29 MB, 114.31 MB, 114.31 MB, 114.27 MB, 114.34 MB, 114.50 MB, 114.21 MB, 108.34 MB, 106.38 MB, 106.25 MB, 106.46 MB, 106.30 MB, 106.41 MB, 106.32 MB, 106.27 MB, 106.56 MB, 106.22 MB, 106.28 MB, 106.38 MB, 106.28 MB, 98.57 MB, 98.27 MB, 98.46 MB, 98.37 MB, 98.29 MB, 94.70 MB, 90.39 MB, 90.41 MB, 90.47 MB, 84.42 MB, 82.51 MB, 82.44 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.89M (1893376) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.261ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 700.169ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m14s, non-child: 1m14s, % non-child: 100.00%) - KuduApplyTimer: 1m2s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.49 K/sec - TotalNumRows: 1.89M (1892352) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 696.149ms, non-child: 696.149ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 58.16 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 155.862ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.94M (1935360) - RowsReturned: 1.89M (1893376) - RowsReturnedRate: 2.72 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 944.58 KB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 1m10s, non-child: 174.941ms, % non-child: 0.25%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(2s000ms): 100.97 MB, 102.26 MB, 102.38 MB, 102.57 MB, 102.57 MB, 102.49 MB, 102.65 MB, 102.56 MB, 102.49 MB, 102.67 MB, 102.67 MB, 102.43 MB, 94.57 MB, 94.65 MB, 94.57 MB, 94.69 MB, 94.60 MB, 94.66 MB, 94.51 MB, 94.49 MB, 94.98 MB, 94.49 MB, 94.50 MB, 94.65 MB, 94.61 MB, 88.65 MB, 86.59 MB, 86.73 MB, 86.62 MB, 86.56 MB, 86.59 MB, 80.84 MB, 78.46 MB, 78.49 MB, 28.81 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.72M (1724693) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.102ms - TotalThreadsInvoluntaryContextSwitches: 9.47K (9468) - TotalThreadsTotalWallClockTime: 2m18s - TotalThreadsSysTime: 15s301ms - TotalThreadsUserTime: 57s500ms - TotalThreadsVoluntaryContextSwitches: 2.01K (2012) Fragment Instance Lifecycle Timings: - ExecTime: 1m10s - ExecTreeExecTime: 667.686ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m9s, non-child: 1m9s, % non-child: 100.00%) - KuduApplyTimer: 58s642ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.89 K/sec - TotalNumRows: 1.72M (1724693) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 663.840ms, non-child: 663.840ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.79 MB (58503541) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.79 MB (58503541) - DecompressionTime: 176.365ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 295.689ms - RowBatchQueuePutWaitTime: 1m3s - RowsRead: 1.72M (1724693) - RowsReturned: 1.72M (1724693) - RowsReturnedRate: 2.60 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1248) - ScannerThreadsTotalWallClockTime: 1m8s - MaterializeTupleTime(*): 4s459ms - ScannerThreadsSysTime: 48.615ms - ScannerThreadsUserTime: 4s513ms - ScannerThreadsVoluntaryContextSwitches: 1.69K (1692) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 815.97 KB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB, 90.35 MB, 90.50 MB, 88.49 MB, 82.39 MB, 82.64 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.84M (1839104) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.749ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 632.466ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m13s, non-child: 1m13s, % non-child: 100.00%) - KuduApplyTimer: 1m1s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.07 K/sec - TotalNumRows: 1.84M (1838080) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 628.490ms, non-child: 628.490ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 153.835ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.88M (1881088) - RowsReturned: 1.84M (1839104) - RowsReturnedRate: 2.93 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 953.37 KB/sec I1212 11:10:06.355149 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000001 I1212 11:10:06.355156 3769 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000001 done=false I1212 11:10:06.355164 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000001 status=0 done=false I1212 11:10:06.355499 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 663.699ms 696.149ms 5.60M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:10:06.355775 3769 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000001 Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB, 90.35 MB, 90.50 MB, 88.49 MB, 82.39 MB, 82.64 MB, 82.44 MB, 76.52 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.98M (1980416) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.752ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 635.503ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m18s, non-child: 1m18s, % non-child: 100.00%) - KuduApplyTimer: 1m6s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.27 K/sec - TotalNumRows: 1.98M (1979392) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 631.108ms, non-child: 631.108ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 164.296ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.02M (2022400) - RowsReturned: 1.98M (1980416) - RowsReturnedRate: 3.14 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 893.04 KB/sec I1212 11:10:06.356783 3769 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 23s471ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 1.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.87M (1866161) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.372ms - TotalThreadsInvoluntaryContextSwitches: 3.16K (3158) - TotalThreadsTotalWallClockTime: 46s233ms - TotalThreadsSysTime: 5s101ms - TotalThreadsUserTime: 19s182ms - TotalThreadsVoluntaryContextSwitches: 781 (781) Fragment Instance Lifecycle Timings: - ExecTime: 23s366ms - ExecTreeExecTime: 667.786ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m13s, non-child: 1m13s, % non-child: 100.00%) - KuduApplyTimer: 1m2s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.22 K/sec - TotalNumRows: 1.87M (1865479) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 663.699ms, non-child: 663.699ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 18.60 MB (19501180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 18.60 MB (19501180) - DecompressionTime: 165.507ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 98.563ms - RowBatchQueuePutWaitTime: 21s142ms - RowsRead: 1.89M (1894151) - RowsReturned: 1.87M (1866161) - RowsReturnedRate: 2.82 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 416 (416) - ScannerThreadsTotalWallClockTime: 22s803ms - MaterializeTupleTime(*): 1s486ms - ScannerThreadsSysTime: 16.204ms - ScannerThreadsUserTime: 1s504ms - ScannerThreadsVoluntaryContextSwitches: 564 (564) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 884.53 KB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(2s000ms): 97.74 MB, 114.01 MB, 114.14 MB, 114.36 MB, 114.34 MB, 114.29 MB, 114.31 MB, 114.31 MB, 114.27 MB, 114.34 MB, 114.50 MB, 114.21 MB, 108.34 MB, 106.38 MB, 106.25 MB, 106.46 MB, 106.30 MB, 106.41 MB, 106.32 MB, 106.27 MB, 106.56 MB, 106.22 MB, 106.28 MB, 106.38 MB, 106.28 MB, 98.57 MB, 98.27 MB, 98.46 MB, 98.37 MB, 98.29 MB, 94.70 MB, 90.39 MB, 90.41 MB, 90.47 MB, 84.42 MB, 82.51 MB, 82.44 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 1.89M (1893376) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.261ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 700.169ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m14s, non-child: 1m14s, % non-child: 100.00%) - KuduApplyTimer: 1m2s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.49 K/sec - TotalNumRows: 1.89M (1892352) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 696.149ms, non-child: 696.149ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 58.16 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 155.862ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.94M (1935360) - RowsReturned: 1.89M (1893376) - RowsReturnedRate: 2.72 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 944.58 KB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 1m10s, non-child: 174.941ms, % non-child: 0.25%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(2s000ms): 100.97 MB, 102.26 MB, 102.38 MB, 102.57 MB, 102.57 MB, 102.49 MB, 102.65 MB, 102.56 MB, 102.49 MB, 102.67 MB, 102.67 MB, 102.43 MB, 94.57 MB, 94.65 MB, 94.57 MB, 94.69 MB, 94.60 MB, 94.66 MB, 94.51 MB, 94.49 MB, 94.98 MB, 94.49 MB, 94.50 MB, 94.65 MB, 94.61 MB, 88.65 MB, 86.59 MB, 86.73 MB, 86.62 MB, 86.56 MB, 86.59 MB, 80.84 MB, 78.46 MB, 78.49 MB, 28.81 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.72M (1724693) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.102ms - TotalThreadsInvoluntaryContextSwitches: 9.47K (9468) - TotalThreadsTotalWallClockTime: 2m18s - TotalThreadsSysTime: 15s301ms - TotalThreadsUserTime: 57s500ms - TotalThreadsVoluntaryContextSwitches: 2.01K (2012) Fragment Instance Lifecycle Timings: - ExecTime: 1m10s - ExecTreeExecTime: 667.686ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m9s, non-child: 1m9s, % non-child: 100.00%) - KuduApplyTimer: 58s642ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.89 K/sec - TotalNumRows: 1.72M (1724693) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 663.840ms, non-child: 663.840ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.79 MB (58503541) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.79 MB (58503541) - DecompressionTime: 176.365ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 295.689ms - RowBatchQueuePutWaitTime: 1m3s - RowsRead: 1.72M (1724693) - RowsReturned: 1.72M (1724693) - RowsReturnedRate: 2.60 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1248) - ScannerThreadsTotalWallClockTime: 1m8s - MaterializeTupleTime(*): 4s459ms - ScannerThreadsSysTime: 48.615ms - ScannerThreadsUserTime: 4s513ms - ScannerThreadsVoluntaryContextSwitches: 1.69K (1692) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 815.97 KB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB, 90.35 MB, 90.50 MB, 88.49 MB, 82.39 MB, 82.64 MB, 82.44 MB, 76.52 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.98M (1980416) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.752ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 635.503ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m18s, non-child: 1m18s, % non-child: 100.00%) - KuduApplyTimer: 1m6s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.27 K/sec - TotalNumRows: 1.98M (1979392) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 631.108ms, non-child: 631.108ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 164.296ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.02M (2022400) - RowsReturned: 1.98M (1980416) - RowsReturnedRate: 3.14 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 893.04 KB/sec I1212 11:10:07.355132 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:10:07.355139 3766 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000000 done=false I1212 11:10:07.355146 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000000 status=0 done=false I1212 11:10:07.355432 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 664.578ms 698.787ms 5.74M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:10:07.355701 3766 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000000 Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(2s000ms): 97.74 MB, 114.01 MB, 114.14 MB, 114.36 MB, 114.34 MB, 114.29 MB, 114.31 MB, 114.31 MB, 114.27 MB, 114.34 MB, 114.50 MB, 114.21 MB, 108.34 MB, 106.38 MB, 106.25 MB, 106.46 MB, 106.30 MB, 106.41 MB, 106.32 MB, 106.27 MB, 106.56 MB, 106.22 MB, 106.28 MB, 106.38 MB, 106.28 MB, 98.57 MB, 98.27 MB, 98.46 MB, 98.37 MB, 98.29 MB, 94.70 MB, 90.39 MB, 90.41 MB, 90.47 MB, 84.42 MB, 82.51 MB, 82.44 MB, 80.54 MB, 74.49 MB, 74.42 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 2.04M (2035712) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.267ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 703.207ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m19s, non-child: 1m19s, % non-child: 100.00%) - KuduApplyTimer: 1m7s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.66 K/sec - TotalNumRows: 2.03M (2034688) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 698.787ms, non-child: 698.787ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 58.16 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 166.599ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.08M (2076672) - RowsReturned: 2.04M (2035712) - RowsReturnedRate: 2.91 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 885.54 KB/sec I1212 11:10:07.356688 3766 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 23s471ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 1.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.91M (1913607) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.374ms - TotalThreadsInvoluntaryContextSwitches: 3.16K (3158) - TotalThreadsTotalWallClockTime: 46s233ms - TotalThreadsSysTime: 5s101ms - TotalThreadsUserTime: 19s182ms - TotalThreadsVoluntaryContextSwitches: 781 (781) Fragment Instance Lifecycle Timings: - ExecTime: 23s366ms - ExecTreeExecTime: 668.799ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m15s, non-child: 1m15s, % non-child: 100.00%) - KuduApplyTimer: 1m3s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.28 K/sec - TotalNumRows: 1.91M (1912924) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 664.578ms, non-child: 664.578ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 18.60 MB (19501180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 18.60 MB (19501180) - DecompressionTime: 169.087ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 98.563ms - RowBatchQueuePutWaitTime: 21s142ms - RowsRead: 1.94M (1941255) - RowsReturned: 1.91M (1913607) - RowsReturnedRate: 2.88 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 416 (416) - ScannerThreadsTotalWallClockTime: 22s803ms - MaterializeTupleTime(*): 1s486ms - ScannerThreadsSysTime: 16.204ms - ScannerThreadsUserTime: 1s504ms - ScannerThreadsVoluntaryContextSwitches: 564 (564) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 864.85 KB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(2s000ms): 97.74 MB, 114.01 MB, 114.14 MB, 114.36 MB, 114.34 MB, 114.29 MB, 114.31 MB, 114.31 MB, 114.27 MB, 114.34 MB, 114.50 MB, 114.21 MB, 108.34 MB, 106.38 MB, 106.25 MB, 106.46 MB, 106.30 MB, 106.41 MB, 106.32 MB, 106.27 MB, 106.56 MB, 106.22 MB, 106.28 MB, 106.38 MB, 106.28 MB, 98.57 MB, 98.27 MB, 98.46 MB, 98.37 MB, 98.29 MB, 94.70 MB, 90.39 MB, 90.41 MB, 90.47 MB, 84.42 MB, 82.51 MB, 82.44 MB, 80.54 MB, 74.49 MB, 74.42 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 2.04M (2035712) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.267ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 703.207ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m19s, non-child: 1m19s, % non-child: 100.00%) - KuduApplyTimer: 1m7s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.66 K/sec - TotalNumRows: 2.03M (2034688) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 698.787ms, non-child: 698.787ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 58.16 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 166.599ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.08M (2076672) - RowsReturned: 2.04M (2035712) - RowsReturnedRate: 2.91 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 885.54 KB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 1m10s, non-child: 174.941ms, % non-child: 0.25%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(2s000ms): 100.97 MB, 102.26 MB, 102.38 MB, 102.57 MB, 102.57 MB, 102.49 MB, 102.65 MB, 102.56 MB, 102.49 MB, 102.67 MB, 102.67 MB, 102.43 MB, 94.57 MB, 94.65 MB, 94.57 MB, 94.69 MB, 94.60 MB, 94.66 MB, 94.51 MB, 94.49 MB, 94.98 MB, 94.49 MB, 94.50 MB, 94.65 MB, 94.61 MB, 88.65 MB, 86.59 MB, 86.73 MB, 86.62 MB, 86.56 MB, 86.59 MB, 80.84 MB, 78.46 MB, 78.49 MB, 28.81 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.72M (1724693) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.102ms - TotalThreadsInvoluntaryContextSwitches: 9.47K (9468) - TotalThreadsTotalWallClockTime: 2m18s - TotalThreadsSysTime: 15s301ms - TotalThreadsUserTime: 57s500ms - TotalThreadsVoluntaryContextSwitches: 2.01K (2012) Fragment Instance Lifecycle Timings: - ExecTime: 1m10s - ExecTreeExecTime: 667.686ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m9s, non-child: 1m9s, % non-child: 100.00%) - KuduApplyTimer: 58s642ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.89 K/sec - TotalNumRows: 1.72M (1724693) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 663.840ms, non-child: 663.840ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.79 MB (58503541) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.79 MB (58503541) - DecompressionTime: 176.365ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 295.689ms - RowBatchQueuePutWaitTime: 1m3s - RowsRead: 1.72M (1724693) - RowsReturned: 1.72M (1724693) - RowsReturnedRate: 2.60 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1248) - ScannerThreadsTotalWallClockTime: 1m8s - MaterializeTupleTime(*): 4s459ms - ScannerThreadsSysTime: 48.615ms - ScannerThreadsUserTime: 4s513ms - ScannerThreadsVoluntaryContextSwitches: 1.69K (1692) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 815.97 KB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB, 90.35 MB, 90.50 MB, 88.49 MB, 82.39 MB, 82.64 MB, 82.44 MB, 76.52 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 1.98M (1980416) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.752ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 68.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 24.165ms - TotalThreadsVoluntaryContextSwitches: 165 (165) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 635.503ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m18s, non-child: 1m18s, % non-child: 100.00%) - KuduApplyTimer: 1m6s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.27 K/sec - TotalNumRows: 1.98M (1979392) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 631.108ms, non-child: 631.108ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 164.296ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.02M (2022400) - RowsReturned: 1.98M (1980416) - RowsReturnedRate: 3.14 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 893.04 KB/sec I1212 11:10:11.357931 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000001 I1212 11:10:11.357940 3769 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000001 done=false I1212 11:10:11.357949 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000001 status=0 done=false I1212 11:10:11.358345 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 665.400ms 698.787ms 5.88M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:10:11.358352 3769 progress-updater.cc:65] Query 25407d49fc4cde6f:d575dd6200000000: 66% Complete (2 out of 3) I1212 11:10:11.358824 3769 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000001 Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB, 90.35 MB, 90.50 MB, 88.49 MB, 82.39 MB, 82.64 MB, 82.44 MB, 76.52 MB, 74.39 MB, 74.44 MB, 52.47 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 2.12M (2120704) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.752ms - TotalThreadsInvoluntaryContextSwitches: 1.53K (1528) - TotalThreadsTotalWallClockTime: 1m23s - TotalThreadsSysTime: 12.136ms - TotalThreadsUserTime: 5s473ms - TotalThreadsVoluntaryContextSwitches: 2.25K (2254) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 638.383ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m23s, non-child: 1m23s, % non-child: 100.00%) - KuduApplyTimer: 1m10s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.44 K/sec - TotalNumRows: 2.12M (2119680) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 633.574ms, non-child: 633.574ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 172.836ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.13M (2133979) - RowsReturned: 2.12M (2120704) - RowsReturnedRate: 3.35 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.52K (1525) - ScannerThreadsTotalWallClockTime: 1m23s - MaterializeTupleTime(*): 5s336ms - ScannerThreadsSysTime: 12.136ms - ScannerThreadsUserTime: 5s449ms - ScannerThreadsVoluntaryContextSwitches: 2.09K (2089) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 839.89 KB/sec I1212 11:10:11.360479 3769 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 23s471ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 1.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 1.96M (1960369) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.374ms - TotalThreadsInvoluntaryContextSwitches: 3.67K (3666) - TotalThreadsTotalWallClockTime: 1m13s - TotalThreadsSysTime: 5s105ms - TotalThreadsUserTime: 20s998ms - TotalThreadsVoluntaryContextSwitches: 1.48K (1477) Fragment Instance Lifecycle Timings: - ExecTime: 23s366ms - ExecTreeExecTime: 669.759ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m17s, non-child: 1m17s, % non-child: 100.00%) - KuduApplyTimer: 1m5s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.33 K/sec - TotalNumRows: 1.96M (1959687) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 665.400ms, non-child: 665.400ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 18.60 MB (19501180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 18.60 MB (19501180) - DecompressionTime: 171.933ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 98.563ms - RowBatchQueuePutWaitTime: 21s142ms - RowsRead: 1.98M (1978448) - RowsReturned: 1.96M (1960369) - RowsReturnedRate: 2.95 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 924 (924) - ScannerThreadsTotalWallClockTime: 50s502ms - MaterializeTupleTime(*): 3s265ms - ScannerThreadsSysTime: 20.250ms - ScannerThreadsUserTime: 3s320ms - ScannerThreadsVoluntaryContextSwitches: 1.26K (1260) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 847.13 KB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 101.796ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(2s000ms): 97.74 MB, 114.01 MB, 114.14 MB, 114.36 MB, 114.34 MB, 114.29 MB, 114.31 MB, 114.31 MB, 114.27 MB, 114.34 MB, 114.50 MB, 114.21 MB, 108.34 MB, 106.38 MB, 106.25 MB, 106.46 MB, 106.30 MB, 106.41 MB, 106.32 MB, 106.27 MB, 106.56 MB, 106.22 MB, 106.28 MB, 106.38 MB, 106.28 MB, 98.57 MB, 98.27 MB, 98.46 MB, 98.37 MB, 98.29 MB, 94.70 MB, 90.39 MB, 90.41 MB, 90.47 MB, 84.42 MB, 82.51 MB, 82.44 MB, 80.54 MB, 74.49 MB, 74.42 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 2.04M (2035712) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.267ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 59.887ms - TotalThreadsSysTime: 4.017ms - TotalThreadsUserTime: 22.689ms - TotalThreadsVoluntaryContextSwitches: 166 (166) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 703.207ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m19s, non-child: 1m19s, % non-child: 100.00%) - KuduApplyTimer: 1m7s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.66 K/sec - TotalNumRows: 2.03M (2034688) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 698.787ms, non-child: 698.787ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 58.16 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 166.599ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.08M (2076672) - RowsReturned: 2.04M (2035712) - RowsReturnedRate: 2.91 M/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 885.54 KB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 1m10s, non-child: 174.941ms, % non-child: 0.25%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(2s000ms): 100.97 MB, 102.26 MB, 102.38 MB, 102.57 MB, 102.57 MB, 102.49 MB, 102.65 MB, 102.56 MB, 102.49 MB, 102.67 MB, 102.67 MB, 102.43 MB, 94.57 MB, 94.65 MB, 94.57 MB, 94.69 MB, 94.60 MB, 94.66 MB, 94.51 MB, 94.49 MB, 94.98 MB, 94.49 MB, 94.50 MB, 94.65 MB, 94.61 MB, 88.65 MB, 86.59 MB, 86.73 MB, 86.62 MB, 86.56 MB, 86.59 MB, 80.84 MB, 78.46 MB, 78.49 MB, 28.81 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.72M (1724693) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.102ms - TotalThreadsInvoluntaryContextSwitches: 9.47K (9468) - TotalThreadsTotalWallClockTime: 2m18s - TotalThreadsSysTime: 15s301ms - TotalThreadsUserTime: 57s500ms - TotalThreadsVoluntaryContextSwitches: 2.01K (2012) Fragment Instance Lifecycle Timings: - ExecTime: 1m10s - ExecTreeExecTime: 667.686ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m9s, non-child: 1m9s, % non-child: 100.00%) - KuduApplyTimer: 58s642ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.89 K/sec - TotalNumRows: 1.72M (1724693) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 663.840ms, non-child: 663.840ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.79 MB (58503541) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.79 MB (58503541) - DecompressionTime: 176.365ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 295.689ms - RowBatchQueuePutWaitTime: 1m3s - RowsRead: 1.72M (1724693) - RowsReturned: 1.72M (1724693) - RowsReturnedRate: 2.60 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1248) - ScannerThreadsTotalWallClockTime: 1m8s - MaterializeTupleTime(*): 4s459ms - ScannerThreadsSysTime: 48.615ms - ScannerThreadsUserTime: 4s513ms - ScannerThreadsVoluntaryContextSwitches: 1.69K (1692) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 815.97 KB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB, 90.35 MB, 90.50 MB, 88.49 MB, 82.39 MB, 82.64 MB, 82.44 MB, 76.52 MB, 74.39 MB, 74.44 MB, 52.47 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 2.12M (2120704) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.752ms - TotalThreadsInvoluntaryContextSwitches: 1.53K (1528) - TotalThreadsTotalWallClockTime: 1m23s - TotalThreadsSysTime: 12.136ms - TotalThreadsUserTime: 5s473ms - TotalThreadsVoluntaryContextSwitches: 2.25K (2254) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 638.383ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m23s, non-child: 1m23s, % non-child: 100.00%) - KuduApplyTimer: 1m10s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.44 K/sec - TotalNumRows: 2.12M (2119680) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 633.574ms, non-child: 633.574ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 172.836ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.13M (2133979) - RowsReturned: 2.12M (2120704) - RowsReturnedRate: 3.35 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.52K (1525) - ScannerThreadsTotalWallClockTime: 1m23s - MaterializeTupleTime(*): 5s336ms - ScannerThreadsSysTime: 12.136ms - ScannerThreadsUserTime: 5s449ms - ScannerThreadsVoluntaryContextSwitches: 2.09K (2089) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 839.89 KB/sec I1212 11:10:11.399446 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:10:11.399456 3766 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000000 done=true I1212 11:10:11.399464 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000000 status=0 done=true I1212 11:10:11.399842 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 667.019ms 703.643ms 5.99M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:10:11.399849 3766 progress-updater.cc:55] Query 25407d49fc4cde6f:d575dd6200000000 100% Complete (3 out of 3) I1212 11:10:11.400343 3766 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000000 Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 1m24s, non-child: 284.307ms, % non-child: 0.34%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(2s000ms): 97.74 MB, 114.01 MB, 114.14 MB, 114.36 MB, 114.34 MB, 114.29 MB, 114.31 MB, 114.31 MB, 114.27 MB, 114.34 MB, 114.50 MB, 114.21 MB, 108.34 MB, 106.38 MB, 106.25 MB, 106.46 MB, 106.30 MB, 106.41 MB, 106.32 MB, 106.27 MB, 106.56 MB, 106.22 MB, 106.28 MB, 106.38 MB, 106.28 MB, 98.57 MB, 98.27 MB, 98.46 MB, 98.37 MB, 98.29 MB, 94.70 MB, 90.39 MB, 90.41 MB, 90.47 MB, 84.42 MB, 82.51 MB, 82.44 MB, 80.54 MB, 74.49 MB, 74.42 MB, 74.40 MB, 39.19 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 2.14M (2142543) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.267ms - TotalThreadsInvoluntaryContextSwitches: 12.35K (12351) - TotalThreadsTotalWallClockTime: 2m46s - TotalThreadsSysTime: 18s832ms - TotalThreadsUserTime: 1m8s - TotalThreadsVoluntaryContextSwitches: 2.44K (2442) Fragment Instance Lifecycle Timings: - ExecTime: 1m24s - ExecTreeExecTime: 708.405ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m23s, non-child: 1m23s, % non-child: 100.00%) - KuduApplyTimer: 1m10s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.79 K/sec - TotalNumRows: 2.14M (2142543) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 703.643ms, non-child: 703.643ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:99.4% 1:0.5952% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 58.16 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.98 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 69.19 MB (72548403) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 69.19 MB (72548403) - DecompressionTime: 171.033ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 368.953ms - RowBatchQueuePutWaitTime: 1m16s - RowsRead: 2.14M (2142543) - RowsReturned: 2.14M (2142543) - RowsReturnedRate: 3.04 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.66K (1664) - ScannerThreadsTotalWallClockTime: 1m22s - MaterializeTupleTime(*): 5s447ms - ScannerThreadsSysTime: 16.572ms - ScannerThreadsUserTime: 5s559ms - ScannerThreadsVoluntaryContextSwitches: 2.10K (2096) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 843.38 KB/sec I1212 11:10:11.402027 3766 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 51s484ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 1.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 2.00M (1995980) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.374ms - TotalThreadsInvoluntaryContextSwitches: 7.78K (7782) - TotalThreadsTotalWallClockTime: 2m9s - TotalThreadsSysTime: 11s381ms - TotalThreadsUserTime: 43s780ms - TotalThreadsVoluntaryContextSwitches: 2.24K (2236) Fragment Instance Lifecycle Timings: - ExecTime: 51s380ms - ExecTreeExecTime: 671.491ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m18s, non-child: 1m18s, % non-child: 100.00%) - KuduApplyTimer: 1m6s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.38 K/sec - TotalNumRows: 2.00M (1995638) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 667.019ms, non-child: 667.019ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.98 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 41.66 MB (43683981) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 41.66 MB (43683981) - DecompressionTime: 173.411ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 221.547ms - RowBatchQueuePutWaitTime: 46s599ms - RowsRead: 2.00M (2000405) - RowsReturned: 2.00M (1995980) - RowsReturnedRate: 3.00 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.48K (1479) - ScannerThreadsTotalWallClockTime: 1m17s - MaterializeTupleTime(*): 5s080ms - ScannerThreadsSysTime: 25.774ms - ScannerThreadsUserTime: 5s174ms - ScannerThreadsVoluntaryContextSwitches: 1.96K (1959) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 833.08 KB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 1m24s, non-child: 284.307ms, % non-child: 0.34%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(2s000ms): 97.74 MB, 114.01 MB, 114.14 MB, 114.36 MB, 114.34 MB, 114.29 MB, 114.31 MB, 114.31 MB, 114.27 MB, 114.34 MB, 114.50 MB, 114.21 MB, 108.34 MB, 106.38 MB, 106.25 MB, 106.46 MB, 106.30 MB, 106.41 MB, 106.32 MB, 106.27 MB, 106.56 MB, 106.22 MB, 106.28 MB, 106.38 MB, 106.28 MB, 98.57 MB, 98.27 MB, 98.46 MB, 98.37 MB, 98.29 MB, 94.70 MB, 90.39 MB, 90.41 MB, 90.47 MB, 84.42 MB, 82.51 MB, 82.44 MB, 80.54 MB, 74.49 MB, 74.42 MB, 74.40 MB, 39.19 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 2.14M (2142543) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.267ms - TotalThreadsInvoluntaryContextSwitches: 12.35K (12351) - TotalThreadsTotalWallClockTime: 2m46s - TotalThreadsSysTime: 18s832ms - TotalThreadsUserTime: 1m8s - TotalThreadsVoluntaryContextSwitches: 2.44K (2442) Fragment Instance Lifecycle Timings: - ExecTime: 1m24s - ExecTreeExecTime: 708.405ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m23s, non-child: 1m23s, % non-child: 100.00%) - KuduApplyTimer: 1m10s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.79 K/sec - TotalNumRows: 2.14M (2142543) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 703.643ms, non-child: 703.643ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:99.4% 1:0.5952% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 58.16 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.98 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 69.19 MB (72548403) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 69.19 MB (72548403) - DecompressionTime: 171.033ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 368.953ms - RowBatchQueuePutWaitTime: 1m16s - RowsRead: 2.14M (2142543) - RowsReturned: 2.14M (2142543) - RowsReturnedRate: 3.04 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.66K (1664) - ScannerThreadsTotalWallClockTime: 1m22s - MaterializeTupleTime(*): 5s447ms - ScannerThreadsSysTime: 16.572ms - ScannerThreadsUserTime: 5s559ms - ScannerThreadsVoluntaryContextSwitches: 2.10K (2096) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 843.38 KB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 1m10s, non-child: 174.941ms, % non-child: 0.25%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(2s000ms): 100.97 MB, 102.26 MB, 102.38 MB, 102.57 MB, 102.57 MB, 102.49 MB, 102.65 MB, 102.56 MB, 102.49 MB, 102.67 MB, 102.67 MB, 102.43 MB, 94.57 MB, 94.65 MB, 94.57 MB, 94.69 MB, 94.60 MB, 94.66 MB, 94.51 MB, 94.49 MB, 94.98 MB, 94.49 MB, 94.50 MB, 94.65 MB, 94.61 MB, 88.65 MB, 86.59 MB, 86.73 MB, 86.62 MB, 86.56 MB, 86.59 MB, 80.84 MB, 78.46 MB, 78.49 MB, 28.81 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.72M (1724693) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.102ms - TotalThreadsInvoluntaryContextSwitches: 9.47K (9468) - TotalThreadsTotalWallClockTime: 2m18s - TotalThreadsSysTime: 15s301ms - TotalThreadsUserTime: 57s500ms - TotalThreadsVoluntaryContextSwitches: 2.01K (2012) Fragment Instance Lifecycle Timings: - ExecTime: 1m10s - ExecTreeExecTime: 667.686ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m9s, non-child: 1m9s, % non-child: 100.00%) - KuduApplyTimer: 58s642ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.89 K/sec - TotalNumRows: 1.72M (1724693) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 663.840ms, non-child: 663.840ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.79 MB (58503541) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.79 MB (58503541) - DecompressionTime: 176.365ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 295.689ms - RowBatchQueuePutWaitTime: 1m3s - RowsRead: 1.72M (1724693) - RowsReturned: 1.72M (1724693) - RowsReturnedRate: 2.60 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1248) - ScannerThreadsTotalWallClockTime: 1m8s - MaterializeTupleTime(*): 4s459ms - ScannerThreadsSysTime: 48.615ms - ScannerThreadsUserTime: 4s513ms - ScannerThreadsVoluntaryContextSwitches: 1.69K (1692) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 815.97 KB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 110.198ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB, 90.35 MB, 90.50 MB, 88.49 MB, 82.39 MB, 82.64 MB, 82.44 MB, 76.52 MB, 74.39 MB, 74.44 MB, 52.47 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 2.12M (2120704) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.752ms - TotalThreadsInvoluntaryContextSwitches: 1.53K (1528) - TotalThreadsTotalWallClockTime: 1m23s - TotalThreadsSysTime: 12.136ms - TotalThreadsUserTime: 5s473ms - TotalThreadsVoluntaryContextSwitches: 2.25K (2254) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 638.383ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m23s, non-child: 1m23s, % non-child: 100.00%) - KuduApplyTimer: 1m10s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.44 K/sec - TotalNumRows: 2.12M (2119680) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 633.574ms, non-child: 633.574ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 172.836ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.13M (2133979) - RowsReturned: 2.12M (2120704) - RowsReturnedRate: 3.35 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.52K (1525) - ScannerThreadsTotalWallClockTime: 1m23s - MaterializeTupleTime(*): 5s336ms - ScannerThreadsSysTime: 12.136ms - ScannerThreadsUserTime: 5s449ms - ScannerThreadsVoluntaryContextSwitches: 2.09K (2089) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 839.89 KB/sec I1212 11:10:11.402070 3766 coordinator.cc:1546] Fragment instance completed: id=25407d49fc4cde6f:d575dd6200000000 host=mj-desktop.ca.cloudera.com:22002 remaining=1 I1212 11:10:11.402076 3766 coordinator.cc:1556] query_id=25407d49fc4cde6f:d575dd6200000000: first in-progress backend: mj-desktop.ca.cloudera.com:22001 I1212 11:10:11.932595 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=25407d49fc4cde6f:d575dd6200000001 I1212 11:10:11.932601 3769 impala-server.cc:1076] ReportExecStatus() instance_id=25407d49fc4cde6f:d575dd6200000001 done=true I1212 11:10:11.932608 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=25407d49fc4cde6f:d575dd6200000001 status=0 done=true I1212 11:10:11.932895 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 667.099ms 703.643ms 6.00M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:10:11.933173 3769 coordinator.cc:1521] profile for instance_id=25407d49fc4cde6f:d575dd6200000001 Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 1m24s, non-child: 78.797ms, % non-child: 0.09%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB, 90.35 MB, 90.50 MB, 88.49 MB, 82.39 MB, 82.64 MB, 82.44 MB, 76.52 MB, 74.39 MB, 74.44 MB, 52.47 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 2.13M (2133979) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.752ms - TotalThreadsInvoluntaryContextSwitches: 12.26K (12255) - TotalThreadsTotalWallClockTime: 2m47s - TotalThreadsSysTime: 18s704ms - TotalThreadsUserTime: 1m8s - TotalThreadsVoluntaryContextSwitches: 2.42K (2424) Fragment Instance Lifecycle Timings: - ExecTime: 1m24s - ExecTreeExecTime: 638.667ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m23s, non-child: 1m23s, % non-child: 100.00%) - KuduApplyTimer: 1m10s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.44 K/sec - TotalNumRows: 2.13M (2133979) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 633.814ms, non-child: 633.814ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:99.41% 1:0.5917% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.98 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 68.91 MB (72258910) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 68.91 MB (72258910) - DecompressionTime: 172.836ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 342.312ms - RowBatchQueuePutWaitTime: 1m17s - RowsRead: 2.13M (2133979) - RowsReturned: 2.13M (2133979) - RowsReturnedRate: 3.37 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.52K (1525) - ScannerThreadsTotalWallClockTime: 1m23s - MaterializeTupleTime(*): 5s336ms - ScannerThreadsSysTime: 12.136ms - ScannerThreadsUserTime: 5s449ms - ScannerThreadsVoluntaryContextSwitches: 2.09K (2089) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 834.92 KB/sec I1212 11:10:11.934244 3769 coordinator.cc:1529] cumulative profile for query_id=25407d49fc4cde6f:d575dd6200000000 Execution Profile 25407d49fc4cde6f:d575dd6200000000:(Total: 1.273ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 3, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 1m19s, non-child: 179.348ms, % non-child: 0.23%) - AverageThreadTokens: 1.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 110.91 MB (116297471) - PerHostPeakMemUsage: 110.91 MB (116297471) - RowsProduced: 2.00M (2000405) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 312.374ms - TotalThreadsInvoluntaryContextSwitches: 11.36K (11358) - TotalThreadsTotalWallClockTime: 2m37s - TotalThreadsSysTime: 17s612ms - TotalThreadsUserTime: 1m4s - TotalThreadsVoluntaryContextSwitches: 2.29K (2292) Fragment Instance Lifecycle Timings: - ExecTime: 1m19s - ExecTreeExecTime: 671.586ms - OpenTime: 62.690ms - ExecTreeOpenTime: 76.297us - PrepareTime: 41.866ms - ExecTreePrepareTime: 959.662us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m18s, non-child: 1m18s, % non-child: 100.00%) - KuduApplyTimer: 1m6s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.38 K/sec - TotalNumRows: 2.00M (2000405) CodeGen:(Total: 85.027ms, non-child: 85.027ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.281ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 25.248ms HDFS_SCAN_NODE (id=0):(Total: 667.099ms, non-child: 667.099ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.98 - BytesRead: 64.63 MB (67770284) - BytesReadDataNodeCache: 0 - BytesReadLocal: 64.63 MB (67770284) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 64.63 MB (67770284) - DecompressionTime: 173.411ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 90.82 MB (95230154) - PerReadThreadRawHdfsThroughput: 193.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 335.651ms - RowBatchQueuePutWaitTime: 1m12s - RowsRead: 2.00M (2000405) - RowsReturned: 2.00M (2000405) - RowsReturnedRate: 3.00 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.48K (1479) - ScannerThreadsTotalWallClockTime: 1m17s - MaterializeTupleTime(*): 5s080ms - ScannerThreadsSysTime: 25.774ms - ScannerThreadsUserTime: 5s174ms - ScannerThreadsVoluntaryContextSwitches: 1.96K (1959) - TotalRawHdfsReadTime(*): 333.752ms - TotalReadThroughput: 831.42 KB/sec Fragment F00: Instance 25407d49fc4cde6f:d575dd6200000000 (host=mj-desktop.ca.cloudera.com:22002):(Total: 1m24s, non-child: 284.307ms, % non-child: 0.34%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB MemoryUsage(2s000ms): 97.74 MB, 114.01 MB, 114.14 MB, 114.36 MB, 114.34 MB, 114.29 MB, 114.31 MB, 114.31 MB, 114.27 MB, 114.34 MB, 114.50 MB, 114.21 MB, 108.34 MB, 106.38 MB, 106.25 MB, 106.46 MB, 106.30 MB, 106.41 MB, 106.32 MB, 106.27 MB, 106.56 MB, 106.22 MB, 106.28 MB, 106.38 MB, 106.28 MB, 98.57 MB, 98.27 MB, 98.46 MB, 98.37 MB, 98.29 MB, 94.70 MB, 90.39 MB, 90.41 MB, 90.47 MB, 84.42 MB, 82.51 MB, 82.44 MB, 80.54 MB, 74.49 MB, 74.42 MB, 74.40 MB, 39.19 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.81 MB (120386806) - PerHostPeakMemUsage: 114.81 MB (120386806) - RowsProduced: 2.14M (2142543) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 345.267ms - TotalThreadsInvoluntaryContextSwitches: 12.35K (12351) - TotalThreadsTotalWallClockTime: 2m46s - TotalThreadsSysTime: 18s832ms - TotalThreadsUserTime: 1m8s - TotalThreadsVoluntaryContextSwitches: 2.44K (2442) Fragment Instance Lifecycle Timings: - ExecTime: 1m24s - ExecTreeExecTime: 708.405ms - OpenTime: 59.896ms - ExecTreeOpenTime: 77.175us - PrepareTime: 41.862ms - ExecTreePrepareTime: 944.057us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m23s, non-child: 1m23s, % non-child: 100.00%) - KuduApplyTimer: 1m10s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.79 K/sec - TotalNumRows: 2.14M (2142543) CodeGen:(Total: 85.042ms, non-child: 85.042ms, % non-child: 100.00%) - CodegenTime: 3.526ms - CompileTime: 20.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.177ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.988ms HDFS_SCAN_NODE (id=0):(Total: 703.643ms, non-child: 703.643ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/69.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:99.4% 1:0.5952% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 58.16 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB, 69.19 MB - FooterProcessingTime: (Avg: 45.672ms ; Min: 45.672ms ; Max: 45.672ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.98 - BytesRead: 69.19 MB (72548403) - BytesReadDataNodeCache: 0 - BytesReadLocal: 69.19 MB (72548403) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 69.19 MB (72548403) - DecompressionTime: 171.033ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.80 MB (99406187) - PerReadThreadRawHdfsThroughput: 196.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 368.953ms - RowBatchQueuePutWaitTime: 1m16s - RowsRead: 2.14M (2142543) - RowsReturned: 2.14M (2142543) - RowsReturnedRate: 3.04 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.66K (1664) - ScannerThreadsTotalWallClockTime: 1m22s - MaterializeTupleTime(*): 5s447ms - ScannerThreadsSysTime: 16.572ms - ScannerThreadsUserTime: 5s559ms - ScannerThreadsVoluntaryContextSwitches: 2.10K (2096) - TotalRawHdfsReadTime(*): 351.999ms - TotalReadThroughput: 843.38 KB/sec Instance 25407d49fc4cde6f:d575dd6200000002 (host=mj-desktop.ca.cloudera.com:22000):(Total: 1m10s, non-child: 174.941ms, % non-child: 0.25%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB MemoryUsage(2s000ms): 100.97 MB, 102.26 MB, 102.38 MB, 102.57 MB, 102.57 MB, 102.49 MB, 102.65 MB, 102.56 MB, 102.49 MB, 102.67 MB, 102.67 MB, 102.43 MB, 94.57 MB, 94.65 MB, 94.57 MB, 94.69 MB, 94.60 MB, 94.66 MB, 94.51 MB, 94.49 MB, 94.98 MB, 94.49 MB, 94.50 MB, 94.65 MB, 94.61 MB, 88.65 MB, 86.59 MB, 86.73 MB, 86.62 MB, 86.56 MB, 86.59 MB, 80.84 MB, 78.46 MB, 78.49 MB, 28.81 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - BloomFilterBytes: 0 - PeakMemoryUsage: 103.12 MB (108133150) - PerHostPeakMemUsage: 103.12 MB (108133150) - RowsProduced: 1.72M (1724693) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 274.102ms - TotalThreadsInvoluntaryContextSwitches: 9.47K (9468) - TotalThreadsTotalWallClockTime: 2m18s - TotalThreadsSysTime: 15s301ms - TotalThreadsUserTime: 57s500ms - TotalThreadsVoluntaryContextSwitches: 2.01K (2012) Fragment Instance Lifecycle Timings: - ExecTime: 1m10s - ExecTreeExecTime: 667.686ms - OpenTime: 59.887ms - ExecTreeOpenTime: 75.897us - PrepareTime: 41.876ms - ExecTreePrepareTime: 971.237us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m9s, non-child: 1m9s, % non-child: 100.00%) - KuduApplyTimer: 58s642ms - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 24.89 K/sec - TotalNumRows: 1.72M (1724693) CodeGen:(Total: 85.001ms, non-child: 85.001ms, % non-child: 100.00%) - CodegenTime: 3.539ms - CompileTime: 20.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.087ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 26.132ms HDFS_SCAN_NODE (id=0):(Total: 663.840ms, non-child: 663.840ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/55.70 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB, 55.79 MB - FooterProcessingTime: (Avg: 33.806ms ; Min: 33.806ms ; Max: 33.806ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 55.79 MB (58503541) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.79 MB (58503541) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.79 MB (58503541) - DecompressionTime: 176.365ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 83.12 MB (87152531) - PerReadThreadRawHdfsThroughput: 192.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 295.689ms - RowBatchQueuePutWaitTime: 1m3s - RowsRead: 1.72M (1724693) - RowsReturned: 1.72M (1724693) - RowsReturnedRate: 2.60 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1248) - ScannerThreadsTotalWallClockTime: 1m8s - MaterializeTupleTime(*): 4s459ms - ScannerThreadsSysTime: 48.615ms - ScannerThreadsUserTime: 4s513ms - ScannerThreadsVoluntaryContextSwitches: 1.69K (1692) - TotalRawHdfsReadTime(*): 290.019ms - TotalReadThroughput: 815.97 KB/sec Instance 25407d49fc4cde6f:d575dd6200000001 (host=mj-desktop.ca.cloudera.com:22001):(Total: 1m24s, non-child: 78.797ms, % non-child: 0.09%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB MemoryUsage(2s000ms): 96.89 MB, 114.00 MB, 114.05 MB, 114.32 MB, 114.36 MB, 114.19 MB, 114.33 MB, 114.30 MB, 114.18 MB, 114.42 MB, 114.43 MB, 114.21 MB, 108.32 MB, 106.36 MB, 106.22 MB, 106.46 MB, 106.28 MB, 106.29 MB, 106.29 MB, 106.15 MB, 106.67 MB, 106.25 MB, 106.34 MB, 106.37 MB, 106.31 MB, 102.38 MB, 98.46 MB, 98.38 MB, 98.41 MB, 98.32 MB, 98.42 MB, 92.67 MB, 90.35 MB, 90.50 MB, 88.49 MB, 82.39 MB, 82.64 MB, 82.44 MB, 76.52 MB, 74.39 MB, 74.44 MB, 52.47 MB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 114.80 MB (120372459) - PerHostPeakMemUsage: 114.80 MB (120372459) - RowsProduced: 2.13M (2133979) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 317.752ms - TotalThreadsInvoluntaryContextSwitches: 12.26K (12255) - TotalThreadsTotalWallClockTime: 2m47s - TotalThreadsSysTime: 18s704ms - TotalThreadsUserTime: 1m8s - TotalThreadsVoluntaryContextSwitches: 2.42K (2424) Fragment Instance Lifecycle Timings: - ExecTime: 1m24s - ExecTreeExecTime: 638.667ms - OpenTime: 68.289ms - ExecTreeOpenTime: 75.820us - PrepareTime: 41.861ms - ExecTreePrepareTime: 963.694us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns KuduTableSink:(Total: 1m23s, non-child: 1m23s, % non-child: 100.00%) - KuduApplyTimer: 1m10s - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 25.44 K/sec - TotalNumRows: 2.13M (2133979) CodeGen:(Total: 85.040ms, non-child: 85.040ms, % non-child: 100.00%) - CodegenTime: 3.511ms - CompileTime: 20.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 21 (21) - NumInstructions: 598 (598) - OptimizationTime: 31.578ms - PeakMemoryUsage: 299.00 KB (306176) - PrepareTime: 24.625ms HDFS_SCAN_NODE (id=0):(Total: 633.814ms, non-child: 633.814ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/68.82 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:99.41% 1:0.5917% 2:0% 3:0% 4:0% File Formats: PARQUET/SNAPPY:16 BytesRead(2s000ms): 55.94 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB, 68.91 MB - FooterProcessingTime: (Avg: 36.873ms ; Min: 36.873ms ; Max: 36.873ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.98 - BytesRead: 68.91 MB (72258910) - BytesReadDataNodeCache: 0 - BytesReadLocal: 68.91 MB (72258910) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 68.91 MB (72258910) - DecompressionTime: 172.836ms - MaxCompressedTextFileLength: 0 - NumColumns: 16 (16) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 94.54 MB (99131744) - PerReadThreadRawHdfsThroughput: 191.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 342.312ms - RowBatchQueuePutWaitTime: 1m17s - RowsRead: 2.13M (2133979) - RowsReturned: 2.13M (2133979) - RowsReturnedRate: 3.37 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.52K (1525) - ScannerThreadsTotalWallClockTime: 1m23s - MaterializeTupleTime(*): 5s336ms - ScannerThreadsSysTime: 12.136ms - ScannerThreadsUserTime: 5s449ms - ScannerThreadsVoluntaryContextSwitches: 2.09K (2089) - TotalRawHdfsReadTime(*): 359.237ms - TotalReadThroughput: 834.92 KB/sec I1212 11:10:11.934293 3769 coordinator.cc:1546] Fragment instance completed: id=25407d49fc4cde6f:d575dd6200000001 host=mj-desktop.ca.cloudera.com:22001 remaining=0 I1212 11:10:11.934311 12724 coordinator.cc:1069] All fragment instances finished successfully. I1212 11:10:11.934576 12724 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 667.099ms 703.643ms 6.00M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:10:11.934772 12724 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 667.099ms 703.643ms 6.00M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:10:11.934986 12724 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 667.099ms 703.643ms 6.00M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:10:12.470834 2681 impala-hs2-server.cc:271] OpenSession(): username=mj I1212 11:10:12.471221 2681 impala-hs2-server.cc:414] ExecuteStatement(): request=TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "&\xe4\xc0Y\baF\x12\xbb\xb0\x10\x91\xd2m\xf3\x03", 02: secret (string) = "9V#\x13\xa6\xe3F\xcb\x86\xf56\xf5B\xe0\x1e\n", }, }, 02: statement (string) = "USE ucu3e4", 04: runAsync (bool) = false, } I1212 11:10:12.471235 2681 impala-hs2-server.cc:228] TExecuteStatementReq: TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "&\xe4\xc0Y\baF\x12\xbb\xb0\x10\x91\xd2m\xf3\x03", 02: secret (string) = "9V#\x13\xa6\xe3F\xcb\x86\xf56\xf5B\xe0\x1e\n", }, }, 02: statement (string) = "USE ucu3e4", 04: runAsync (bool) = false, } I1212 11:10:12.471247 2681 impala-server.cc:742] Parsed pool options: override_options_mask=1111111111111111111111111111111111111111111111111111111111111111 set_pool_mask=0000000000000000000000000000000000000000000000000000000000000000 overlay_mask=0000000000000000000000000000000000000000000000000000000000000000 I1212 11:10:12.471287 2681 impala-hs2-server.cc:261] TClientRequest.queryOptions: TQueryOptions { 01: abort_on_error (bool) = false, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 100, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, } I1212 11:10:12.473265 2681 impala-server.cc:812] Execution request: TExecRequest { 01: stmt_type (i32) = 1, 02: query_options (struct) = TQueryOptions { 01: abort_on_error (bool) = false, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 100, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 44: mt_dop (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, }, 04: catalog_op_request (struct) = TCatalogOpRequest { 01: op_type (i32) = 3, 02: use_db_params (struct) = TUseDbParams { 01: db (string) = "ucu3e4", }, }, 05: result_set_metadata (struct) = TResultSetMetadata { 01: columns (list) = list[0] { }, }, 08: access_events (set) = set[1] { TAccessEvent { 01: name (string) = "ucu3e4", 02: object_type (i32) = 2, 03: privilege (string) = "ANY", }, }, 09: analysis_warnings (list) = list[0] { }, } I1212 11:10:12.475464 2681 thread.cc:288] Started thread 14345 - query-exec-state:wait-thread I1212 11:10:12.475492 2681 impala-hs2-server.cc:486] ExecuteStatement(): return_val=TExecuteStatementResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: operationHandle (struct) = TOperationHandle { 01: operationId (struct) = THandleIdentifier { 01: guid (string) = "\xe2\xa9\x01\xc6x\xb4L\xbf\x00\x00\x00\x00\x99k\xf6\xd3", 02: secret (string) = "\xe2\xa9\x01\xc6x\xb4L\xbf\x00\x00\x00\x00\x99k\xf6\xd3", }, 02: operationType (i32) = 0, 03: hasResultSet (bool) = false, }, } I1212 11:10:12.476431 2681 impala-hs2-server.cc:688] CloseOperation(): query_id=bf4cb478c601a9e2:d3f66b9900000000 I1212 11:10:12.476435 2681 impala-server.cc:907] UnregisterQuery(): query_id=bf4cb478c601a9e2:d3f66b9900000000 I1212 11:10:12.476438 2681 impala-server.cc:993] Cancel(): query_id=bf4cb478c601a9e2:d3f66b9900000000 I1212 11:10:12.476888 2681 impala-hs2-server.cc:414] ExecuteStatement(): request=TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "&\xe4\xc0Y\baF\x12\xbb\xb0\x10\x91\xd2m\xf3\x03", 02: secret (string) = "9V#\x13\xa6\xe3F\xcb\x86\xf56\xf5B\xe0\x1e\n", }, }, 02: statement (string) = "select * from lineitem where l_orderkey = -1", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "1m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:12.476905 2681 impala-hs2-server.cc:228] TExecuteStatementReq: TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "&\xe4\xc0Y\baF\x12\xbb\xb0\x10\x91\xd2m\xf3\x03", 02: secret (string) = "9V#\x13\xa6\xe3F\xcb\x86\xf56\xf5B\xe0\x1e\n", }, }, 02: statement (string) = "select * from lineitem where l_orderkey = -1", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "1m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:12.476945 2681 impala-server.cc:742] Parsed pool options: override_options_mask=1111111111111111111111111111111110111111111111111111111111000010 set_pool_mask=0000000000000000000000000000000000000000000000000000000000000000 overlay_mask=0000000000000000000000000000000000000000000000000000000000000000 I1212 11:10:12.476974 2681 impala-hs2-server.cc:261] TClientRequest.queryOptions: TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 1048576, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, } I1212 11:10:12.483945 14346 AsyncKuduClient.java:1367] Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) I1212 11:10:12.486865 14347 AsyncKuduClient.java:1367] Learned about tablet de1fe37fdb46438abfbc154bf7fb439b for table 'impala::ucu3e4.lineitem' with partition [, 0x00000001) I1212 11:10:12.487067 14347 AsyncKuduClient.java:1367] Learned about tablet 91d0d8d3b0e34afc9d7fa522e61f40ef for table 'impala::ucu3e4.lineitem' with partition [0x00000001, 0x00000002) I1212 11:10:12.487293 14347 AsyncKuduClient.java:1367] Learned about tablet dc26b34fb84d4ff8baae3f44b23f0ae2 for table 'impala::ucu3e4.lineitem' with partition [0x00000002, ) I1212 11:10:12.492789 2681 impala-server.cc:812] Execution request: TExecRequest { 01: stmt_type (i32) = 0, 02: query_options (struct) = TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 1048576, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 44: mt_dop (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, }, 03: query_exec_request (struct) = TQueryExecRequest { 01: desc_tbl (struct) = TDescriptorTable { 01: slotDescriptors (list) = list[16] { [0] = TSlotDescriptor { 01: id (i32) = 0, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 0, }, 06: byteOffset (i32) = 128, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 8, }, [1] = TSlotDescriptor { 01: id (i32) = 1, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 1, }, 06: byteOffset (i32) = 184, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 15, }, [2] = TSlotDescriptor { 01: id (i32) = 2, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 2, }, 06: byteOffset (i32) = 136, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 9, }, [3] = TSlotDescriptor { 01: id (i32) = 3, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 3, }, 06: byteOffset (i32) = 144, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 10, }, [4] = TSlotDescriptor { 01: id (i32) = 4, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 4, }, 06: byteOffset (i32) = 152, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 11, }, [5] = TSlotDescriptor { 01: id (i32) = 5, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 5, }, 06: byteOffset (i32) = 160, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 12, }, [6] = TSlotDescriptor { 01: id (i32) = 6, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 6, }, 06: byteOffset (i32) = 168, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 13, }, [7] = TSlotDescriptor { 01: id (i32) = 7, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 7, }, 06: byteOffset (i32) = 176, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 14, }, [8] = TSlotDescriptor { 01: id (i32) = 8, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 8, }, 06: byteOffset (i32) = 0, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 0, 09: slotIdx (i32) = 0, }, [9] = TSlotDescriptor { 01: id (i32) = 9, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 9, }, 06: byteOffset (i32) = 16, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 1, }, [10] = TSlotDescriptor { 01: id (i32) = 10, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 10, }, 06: byteOffset (i32) = 32, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 2, }, [11] = TSlotDescriptor { 01: id (i32) = 11, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 11, }, 06: byteOffset (i32) = 48, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 3, }, [12] = TSlotDescriptor { 01: id (i32) = 12, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 12, }, 06: byteOffset (i32) = 64, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 4, }, [13] = TSlotDescriptor { 01: id (i32) = 13, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 13, }, 06: byteOffset (i32) = 80, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 5, }, [14] = TSlotDescriptor { 01: id (i32) = 14, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 14, }, 06: byteOffset (i32) = 96, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 6, }, [15] = TSlotDescriptor { 01: id (i32) = 15, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 15, }, 06: byteOffset (i32) = 112, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 7, 09: slotIdx (i32) = 7, }, }, 02: tupleDescriptors (list) = list[1] { [0] = TTupleDescriptor { 01: id (i32) = 0, 02: byteSize (i32) = 190, 03: numNullBytes (i32) = 2, 04: tableId (i32) = 1, 05: tuplePath (list) = list[0] { }, }, }, 03: tableDescriptors (list) = list[1] { [0] = TTableDescriptor { 01: id (i32) = 1, 02: tableType (i32) = 4, 03: columnDescriptors (list) = list[16] { [0] = TColumnDescriptor { 01: name (string) = "l_orderkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [1] = TColumnDescriptor { 01: name (string) = "l_linenumber", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, }, [2] = TColumnDescriptor { 01: name (string) = "l_partkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [3] = TColumnDescriptor { 01: name (string) = "l_suppkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [4] = TColumnDescriptor { 01: name (string) = "l_quantity", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [5] = TColumnDescriptor { 01: name (string) = "l_extendedprice", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [6] = TColumnDescriptor { 01: name (string) = "l_discount", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [7] = TColumnDescriptor { 01: name (string) = "l_tax", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [8] = TColumnDescriptor { 01: name (string) = "l_returnflag", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [9] = TColumnDescriptor { 01: name (string) = "l_linestatus", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [10] = TColumnDescriptor { 01: name (string) = "l_shipdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [11] = TColumnDescriptor { 01: name (string) = "l_commitdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [12] = TColumnDescriptor { 01: name (string) = "l_receiptdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [13] = TColumnDescriptor { 01: name (string) = "l_shipinstruct", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [14] = TColumnDescriptor { 01: name (string) = "l_shipmode", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [15] = TColumnDescriptor { 01: name (string) = "l_comment", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, }, 04: numClusteringCols (i32) = 0, 07: tableName (string) = "impala::ucu3e4.lineitem", 08: dbName (string) = "ucu3e4", 10: kuduTable (struct) = TKuduTable { 01: table_name (string) = "impala::ucu3e4.lineitem", 02: master_addresses (list) = list[1] { [0] = "127.0.0.1", }, 03: key_columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 04: partition_by (list) = list[1] { [0] = TKuduPartitionParam { 01: by_hash_param (struct) = TKuduPartitionByHashParam { 01: columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 02: num_partitions (i32) = 3, }, }, }, }, }, }, }, 02: plan_exec_info (list) = list[1] { [0] = TPlanExecInfo { 01: fragments (list) = list[2] { [0] = TPlanFragment { 01: idx (i32) = 0, 02: display_name (string) = "F01", 03: plan (struct) = TPlan { 01: nodes (list) = list[1] { [0] = TPlanNode { 01: node_id (i32) = 1, 02: node_type (i32) = 6, 03: num_children (i32) = 0, 04: limit (i64) = -1, 05: row_tuples (list) = list[1] { [0] = 0, }, 06: nullable_tuples (list) = list[1] { [0] = false, }, 08: disable_codegen (bool) = false, 18: exchange_node (struct) = TExchangeNode { 01: input_row_tuples (list) = list[1] { [0] = 0, }, }, 21: label (string) = "01:EXCHANGE", 22: label_detail (string) = "UNPARTITIONED", 23: estimated_stats (struct) = TExecStats { 03: cardinality (i64) = -1, 04: memory_used (i64) = -1, }, }, }, }, 04: output_exprs (list) = list[16] { [0] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 0, }, }, }, }, [1] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 1, }, }, }, }, [2] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 2, }, }, }, }, [3] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 3, }, }, }, }, [4] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 4, }, }, }, }, [5] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 5, }, }, }, }, [6] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 6, }, }, }, }, [7] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 7, }, }, }, }, [8] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12 I1212 11:10:12.493027 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22000(local selection) I1212 11:10:12.493046 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22001(local selection) I1212 11:10:12.493059 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22002(local selection) I1212 11:10:12.493062 2681 simple-scheduler.cc:979] Total remote scan volume = 0 I1212 11:10:12.493068 2681 simple-scheduler.cc:981] Total local scan volume = 2.93 KB I1212 11:10:12.493070 2681 simple-scheduler.cc:983] Total cached scan volume = 0 I1212 11:10:12.493077 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22002, } I1212 11:10:12.493086 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](501)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:12.493090 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22001, } I1212 11:10:12.493095 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](505)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:12.493099 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, } I1212 11:10:12.493113 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](501)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:12.493165 2681 admission-controller.cc:440] Schedule for id=4f45001ed37544e0:750e0ef900000000 in pool_name=default-pool cluster_mem_needed=3.00 MB PoolConfig: max_requests=-1 max_queued=200 max_mem=-1.00 B I1212 11:10:12.493177 2681 admission-controller.cc:445] Stats: agg_num_running=1, agg_num_queued=0, agg_mem_reserved=94.22 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=0) I1212 11:10:12.493182 2681 admission-controller.cc:451] Admitted query id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.493201 2681 admission-controller.cc:457] Final: agg_num_running=2, agg_num_queued=0, agg_mem_reserved=94.22 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=2, num_queued=0, backend_mem_reserved=0) I1212 11:10:12.493224 2681 coordinator.cc:447] Exec() query_id=4f45001ed37544e0:750e0ef900000000 stmt=select * from lineitem where l_orderkey = -1 I1212 11:10:12.493265 2681 mem-tracker.cc:184] Using query memory limit: 1.00 MB I1212 11:10:12.493352 2681 coordinator.cc:602] starting 4 fragment instances for query 4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.493413 2681 coordinator.cc:737] ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- I1212 11:10:12.493558 2562 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.493566 2562 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:12.493567 2564 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22002 instance_id=4f45001ed37544e0:750e0ef900000001 I1212 11:10:12.493571 2562 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:12.493573 2564 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22002) I1212 11:10:12.493571 2565 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22001 instance_id=4f45001ed37544e0:750e0ef900000002 I1212 11:10:12.493582 2564 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22002 I1212 11:10:12.493584 2565 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22001) I1212 11:10:12.493589 2565 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22001 I1212 11:10:12.493590 2566 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=4f45001ed37544e0:750e0ef900000003 I1212 11:10:12.493597 2566 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:12.493599 2566 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:12.493769 3396 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.493775 3396 query-exec-mgr.cc:45] StartFInstance() instance_id=4f45001ed37544e0:750e0ef900000000 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:12.493793 3396 query-exec-mgr.cc:69] new QueryState: query_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.493798 5418 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=4f45001ed37544e0:750e0ef900000003 I1212 11:10:12.493803 5418 query-exec-mgr.cc:45] StartFInstance() instance_id=4f45001ed37544e0:750e0ef900000003 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:12.493831 3396 query-exec-mgr.cc:77] QueryState: query_id=4f45001ed37544e0:750e0ef900000000 refcnt=1 I1212 11:10:12.493839 5418 query-exec-mgr.cc:77] QueryState: query_id=4f45001ed37544e0:750e0ef900000000 refcnt=2 I1212 11:10:12.493870 3396 query-state.cc:58] RegisterFInstance(): instance_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.493875 5418 query-state.cc:58] RegisterFInstance(): instance_id=4f45001ed37544e0:750e0ef900000003 I1212 11:10:12.493962 3396 thread.cc:288] Started thread 14360 - query-exec-mgr:exec-fragment-instance-4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.493963 14360 plan-fragment-executor.cc:123] Prepare(): instance_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.493966 14361 plan-fragment-executor.cc:123] Prepare(): instance_id=4f45001ed37544e0:750e0ef900000003 I1212 11:10:12.493968 5418 thread.cc:288] Started thread 14361 - query-exec-mgr:exec-fragment-instance-4f45001ed37544e0:750e0ef900000003 I1212 11:10:12.493994 14360 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 5711971834786039008, 02: lo (i64) = 8434695614721163264, }, 02: per_fragment_instance_idx (i32) = 0, 03: per_node_scan_ranges (map) = map[0] { }, 04: per_exch_num_senders (map) = map[1] { 1 -> 3, }, 05: destinations (list) = list[0] { }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = -1, } I1212 11:10:12.494009 2565 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=4f45001ed37544e0:750e0ef900000002 I1212 11:10:12.494011 14361 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 5711971834786039008, 02: lo (i64) = 8434695614721163267, }, 02: per_fragment_instance_idx (i32) = 2, 03: per_node_scan_ranges (map) = map[1] { 0 -> list[1] { [0] = TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](501)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, }, }, }, 04: per_exch_num_senders (map) = map[0] { }, 05: destinations (list) = list[1] { [0] = TPlanFragmentDestination { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 5711971834786039008, 02: lo (i64) = 8434695614721163264, }, 02: server (struct) = TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, }, }, }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = 2, } I1212 11:10:12.494015 2565 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22001 back to cache I1212 11:10:12.494030 2564 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=4f45001ed37544e0:750e0ef900000001 I1212 11:10:12.494035 2562 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.494037 2564 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22002 back to cache I1212 11:10:12.494038 2566 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=4f45001ed37544e0:750e0ef900000003 I1212 11:10:12.494040 2562 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:12.494042 2566 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:12.494065 14361 plan-fragment-executor.cc:145] Using query memory limit from query options: 1.00 MB I1212 11:10:12.494068 14360 plan-fragment-executor.cc:145] Using query memory limit from query options: 1.00 MB I1212 11:10:12.494072 14361 mem-tracker.cc:184] Using query memory limit: 1.00 MB I1212 11:10:12.494076 14360 mem-tracker.cc:184] Using query memory limit: 1.00 MB I1212 11:10:12.494079 2681 coordinator.cc:640] started 4 fragment instances for query 4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.494124 2681 query-exec-mgr.cc:123] GetQueryState(): query_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.494130 2681 query-state.cc:65] GetFInstanceState(): instance_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.494278 14360 plan-fragment-executor.cc:174] descriptor table for fragment=4f45001ed37544e0:750e0ef900000000 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:12.494292 14361 plan-fragment-executor.cc:174] descriptor table for fragment=4f45001ed37544e0:750e0ef900000003 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:12.494336 14360 data-stream-mgr.cc:80] creating receiver for fragment=4f45001ed37544e0:750e0ef900000000, node=1 I1212 11:10:12.494415 14361 plan-fragment-executor.cc:285] Hdfs split stats (:<# splits>/) for query=4f45001ed37544e0:750e0ef900000000: I1212 11:10:12.494499 14361 thread.cc:288] Started thread 14372 - DataStreamSender:SenderThread(1:1) I1212 11:10:12.512015 3769 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=4f45001ed37544e0:750e0ef900000000, node=1 I1212 11:10:12.512029 3769 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=4f45001ed37544e0:750e0ef900000000 node_id=1 #senders=2 I1212 11:10:12.512043 3769 data-stream-mgr.cc:216] Reduced stream ID cache from 9 items, to 0, eviction took: 0 I1212 11:10:12.512437 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=4f45001ed37544e0:750e0ef900000002 I1212 11:10:12.512457 3769 impala-server.cc:1076] ReportExecStatus() instance_id=4f45001ed37544e0:750e0ef900000002 done=true I1212 11:10:12.512464 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=4f45001ed37544e0:750e0ef900000002 status=0 done=true I1212 11:10:12.512904 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 0.000ns 0.000ns 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 1.334ms 4.004ms 0 -1 198.00 KB 0 I1212 11:10:12.512917 3769 progress-updater.cc:65] Query 4f45001ed37544e0:750e0ef900000000: 33% Complete (1 out of 3) I1212 11:10:12.515749 3766 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=4f45001ed37544e0:750e0ef900000000, node=1 I1212 11:10:12.515775 3766 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=4f45001ed37544e0:750e0ef900000000 node_id=1 #senders=1 I1212 11:10:12.516075 14360 plan-fragment-executor.cc:261] plan_root= ExchangeNode(#senders=3 conjuncts=[]) I1212 11:10:12.516095 14360 plan-fragment-executor.cc:296] Open(): instance_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.516129 2681 coordinator.cc:1181] Byte split for fragment 1 min: 0, max: 0, avg: 0, stddev: 0 I1212 11:10:12.516134 2681 coordinator.cc:1184] data volume for ipaddress 0xbfebd40: 0 I1212 11:10:12.516139 2681 coordinator.cc:1184] data volume for ipaddress 0xbfed600: 0 I1212 11:10:12.516140 2681 coordinator.cc:1184] data volume for ipaddress 0xbfed4e0: 0 I1212 11:10:12.516196 14405 plan-fragment-executor.cc:378] ReportProfileThread(): instance_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.516201 14360 thread.cc:288] Started thread 14405 - plan-fragment-executor:report-profile I1212 11:10:12.516206 14361 plan-fragment-executor.cc:261] plan_root= KuduScanNode(tupleid=0) I1212 11:10:12.516217 14361 plan-fragment-executor.cc:296] Open(): instance_id=4f45001ed37544e0:750e0ef900000003 I1212 11:10:12.516223 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=4f45001ed37544e0:750e0ef900000001 I1212 11:10:12.516232 3766 impala-server.cc:1076] ReportExecStatus() instance_id=4f45001ed37544e0:750e0ef900000001 done=true I1212 11:10:12.516273 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=4f45001ed37544e0:750e0ef900000001 status=0 done=true I1212 11:10:12.516295 14406 plan-fragment-executor.cc:378] ReportProfileThread(): instance_id=4f45001ed37544e0:750e0ef900000003 I1212 11:10:12.516322 14361 thread.cc:288] Started thread 14406 - plan-fragment-executor:report-profile I1212 11:10:12.516507 3769 coordinator.cc:1521] profile for instance_id=4f45001ed37544e0:750e0ef900000002 Instance 4f45001ed37544e0:750e0ef900000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 17.948ms, non-child: 773.264us, % non-child: 4.31%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 251.000ns - TotalStorageWaitTime: 1.646ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 6.412ms - TotalThreadsSysTime: 565.000us - TotalThreadsUserTime: 2.433ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 2.332ms - ExecTreeExecTime: 2.171ms - OpenTime: 1.899ms - ExecTreeOpenTime: 1.759ms - PrepareTime: 13.671ms - ExecTreePrepareTime: 90.327us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 20.605us, non-child: 20.605us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.150ms, non-child: 13.150ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.594ms KUDU_SCAN_NODE (id=0):(Total: 4.004ms, non-child: 4.004ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2.191ms - MaterializeTupleTime(*): 2.164ms - ScannerThreadsSysTime: 565.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:12.516839 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 0.000ns 0.000ns 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3.909ms 7.723ms 0 -1 198.00 KB 0 I1212 11:10:12.516855 3766 progress-updater.cc:65] Query 4f45001ed37544e0:750e0ef900000000: 66% Complete (2 out of 3) I1212 11:10:12.517169 3766 coordinator.cc:1521] profile for instance_id=4f45001ed37544e0:750e0ef900000001 Instance 4f45001ed37544e0:750e0ef900000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 21.751ms, non-child: 850.038us, % non-child: 3.91%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 161.000ns - TotalStorageWaitTime: 5.227ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 13.782ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 3.312ms - TotalThreadsVoluntaryContextSwitches: 82 (82) Fragment Instance Lifecycle Timings: - ExecTime: 5.955ms - ExecTreeExecTime: 5.750ms - OpenTime: 2.085ms - ExecTreeOpenTime: 1.947ms - PrepareTime: 13.666ms - ExecTreePrepareTime: 43.148us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 32.522us, non-child: 32.522us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.145ms, non-child: 13.145ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.505ms KUDU_SCAN_NODE (id=0):(Total: 7.723ms, non-child: 7.723ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 5.766ms - MaterializeTupleTime(*): 5.743ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 789.000us - ScannerThreadsVoluntaryContextSwitches: 72 (72) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:12.517370 3769 coordinator.cc:1529] cumulative profile for query_id=4f45001ed37544e0:750e0ef900000000 Execution Profile 4f45001ed37544e0:750e0ef900000000:(Total: 22.891ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Averaged Fragment F00:(Total: 19.850ms, non-child: 773.264us, % non-child: 4.31%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 206.000ns - TotalStorageWaitTime: 3.436ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 10.097ms - TotalThreadsSysTime: 282.500us - TotalThreadsUserTime: 2.872ms - TotalThreadsVoluntaryContextSwitches: 49 (49) Fragment Instance Lifecycle Timings: - ExecTime: 4.143ms - ExecTreeExecTime: 3.961ms - OpenTime: 1.992ms - ExecTreeOpenTime: 1.853ms - PrepareTime: 13.669ms - ExecTreePrepareTime: 66.737us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 26.563us, non-child: 26.563us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.147ms, non-child: 13.147ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.550ms KUDU_SCAN_NODE (id=0):(Total: 5.864ms, non-child: 5.864ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.979ms - MaterializeTupleTime(*): 3.954ms - ScannerThreadsSysTime: 282.500us - ScannerThreadsUserTime: 394.500us - ScannerThreadsVoluntaryContextSwitches: 38 (38) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 4f45001ed37544e0:750e0ef900000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 17.948ms, non-child: 773.264us, % non-child: 4.31%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 251.000ns - TotalStorageWaitTime: 1.646ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 6.412ms - TotalThreadsSysTime: 565.000us - TotalThreadsUserTime: 2.433ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 2.332ms - ExecTreeExecTime: 2.171ms - OpenTime: 1.899ms - ExecTreeOpenTime: 1.759ms - PrepareTime: 13.671ms - ExecTreePrepareTime: 90.327us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 20.605us, non-child: 20.605us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.150ms, non-child: 13.150ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.594ms KUDU_SCAN_NODE (id=0):(Total: 4.004ms, non-child: 4.004ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2.191ms - MaterializeTupleTime(*): 2.164ms - ScannerThreadsSysTime: 565.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Instance 4f45001ed37544e0:750e0ef900000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 21.751ms, non-child: 850.038us, % non-child: 3.91%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 161.000ns - TotalStorageWaitTime: 5.227ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 13.782ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 3.312ms - TotalThreadsVoluntaryContextSwitches: 82 (82) Fragment Instance Lifecycle Timings: - ExecTime: 5.955ms - ExecTreeExecTime: 5.750ms - OpenTime: 2.085ms - ExecTreeOpenTime: 1.947ms - PrepareTime: 13.666ms - ExecTreePrepareTime: 43.148us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 32.522us, non-child: 32.522us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.145ms, non-child: 13.145ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.505ms KUDU_SCAN_NODE (id=0):(Total: 7.723ms, non-child: 7.723ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 5.766ms - MaterializeTupleTime(*): 5.743ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 789.000us - ScannerThreadsVoluntaryContextSwitches: 72 (72) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:12.517396 3769 coordinator.cc:1546] Fragment instance completed: id=4f45001ed37544e0:750e0ef900000002 host=mj-desktop.ca.cloudera.com:22001 remaining=3 I1212 11:10:12.517401 3769 coordinator.cc:1556] query_id=4f45001ed37544e0:750e0ef900000000: first in-progress backend: mj-desktop.ca.cloudera.com:22000 I1212 11:10:12.517714 14361 kudu-scan-node.cc:128] Latest observed Kudu timestamp: 0 I1212 11:10:12.517765 3766 coordinator.cc:1529] cumulative profile for query_id=4f45001ed37544e0:750e0ef900000000 Execution Profile 4f45001ed37544e0:750e0ef900000000:(Total: 22.891ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Averaged Fragment F00:(Total: 19.850ms, non-child: 811.652us, % non-child: 4.09%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 206.000ns - TotalStorageWaitTime: 3.436ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 10.097ms - TotalThreadsSysTime: 282.500us - TotalThreadsUserTime: 2.872ms - TotalThreadsVoluntaryContextSwitches: 49 (49) Fragment Instance Lifecycle Timings: - ExecTime: 4.143ms - ExecTreeExecTime: 3.961ms - OpenTime: 1.992ms - ExecTreeOpenTime: 1.853ms - PrepareTime: 13.669ms - ExecTreePrepareTime: 66.737us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 26.563us, non-child: 26.563us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.147ms, non-child: 13.147ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.550ms KUDU_SCAN_NODE (id=0):(Total: 5.864ms, non-child: 5.864ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.979ms - MaterializeTupleTime(*): 3.954ms - ScannerThreadsSysTime: 282.500us - ScannerThreadsUserTime: 394.500us - ScannerThreadsVoluntaryContextSwitches: 38 (38) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 4f45001ed37544e0:750e0ef900000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 17.948ms, non-child: 773.264us, % non-child: 4.31%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 251.000ns - TotalStorageWaitTime: 1.646ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 6.412ms - TotalThreadsSysTime: 565.000us - TotalThreadsUserTime: 2.433ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 2.332ms - ExecTreeExecTime: 2.171ms - OpenTime: 1.899ms - ExecTreeOpenTime: 1.759ms - PrepareTime: 13.671ms - ExecTreePrepareTime: 90.327us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 20.605us, non-child: 20.605us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.150ms, non-child: 13.150ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.594ms KUDU_SCAN_NODE (id=0):(Total: 4.004ms, non-child: 4.004ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2.191ms - MaterializeTupleTime(*): 2.164ms - ScannerThreadsSysTime: 565.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Instance 4f45001ed37544e0:750e0ef900000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 21.751ms, non-child: 850.038us, % non-child: 3.91%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 161.000ns - TotalStorageWaitTime: 5.227ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 13.782ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 3.312ms - TotalThreadsVoluntaryContextSwitches: 82 (82) Fragment Instance Lifecycle Timings: - ExecTime: 5.955ms - ExecTreeExecTime: 5.750ms - OpenTime: 2.085ms - ExecTreeOpenTime: 1.947ms - PrepareTime: 13.666ms - ExecTreePrepareTime: 43.148us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 32.522us, non-child: 32.522us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.145ms, non-child: 13.145ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.505ms KUDU_SCAN_NODE (id=0):(Total: 7.723ms, non-child: 7.723ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 5.766ms - MaterializeTupleTime(*): 5.743ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 789.000us - ScannerThreadsVoluntaryContextSwitches: 72 (72) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:12.517782 3766 coordinator.cc:1546] Fragment instance completed: id=4f45001ed37544e0:750e0ef900000001 host=mj-desktop.ca.cloudera.com:22002 remaining=2 I1212 11:10:12.517784 3766 coordinator.cc:1556] query_id=4f45001ed37544e0:750e0ef900000000: first in-progress backend: mj-desktop.ca.cloudera.com:22000 I1212 11:10:12.517851 2681 thread.cc:288] Started thread 14407 - query-exec-state:wait-thread I1212 11:10:12.517884 2681 impala-hs2-server.cc:486] ExecuteStatement(): return_val=TExecuteStatementResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: operationHandle (struct) = TOperationHandle { 01: operationId (struct) = THandleIdentifier { 01: guid (string) = "\xe0Du\xd3\x1e\x00EO\x00\x00\x00\x00\xf9\x0e\x0eu", 02: secret (string) = "\xe0Du\xd3\x1e\x00EO\x00\x00\x00\x00\xf9\x0e\x0eu", }, 02: operationType (i32) = 0, 03: hasResultSet (bool) = true, }, } I1212 11:10:12.518106 14361 kudu-scan-node.cc:248] Thread started: scanner-thread(1) I1212 11:10:12.518187 14361 thread.cc:288] Started thread 14417 - kudu-scan-node:scanner-thread(1) I1212 11:10:12.518643 14417 kudu-scanner.cc:148] Starting KuduScanner with ReadMode=0 timeout=180000 I1212 11:10:12.522145 14417 kudu-scan-node.cc:324] Thread done: scanner-thread(1) I1212 11:10:12.522200 14361 data-stream-sender.cc:284] Channel::FlushAndSendEos() instance_id=4f45001ed37544e0:750e0ef900000000 dest_node=1 #rows= 0 I1212 11:10:12.522214 14361 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:12.522220 14361 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:12.522224 14361 data-stream-sender.cc:311] calling TransmitData(eos=true) to terminate channel. I1212 11:10:12.522266 3396 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=4f45001ed37544e0:750e0ef900000000, node=1 I1212 11:10:12.522332 3396 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=4f45001ed37544e0:750e0ef900000000 node_id=1 #senders=0 I1212 11:10:12.522348 14360 exchange-node.cc:139] exch: has batch=false #rows=0 is_cancelled=false instance_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.522364 14361 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:12.522398 14360 exchange-node.cc:139] exch: has batch=false #rows=0 is_cancelled=false instance_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.522405 14406 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=4f45001ed37544e0:750e0ef900000003 I1212 11:10:12.522413 14405 plan-fragment-executor.cc:408] Reporting final profile for instance 4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.522439 14361 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:12.522444 14361 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:12.522574 14405 plan-fragment-executor.cc:412] Fragment 4f45001ed37544e0:750e0ef900000000:(Total: 28.370ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 0 - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 6.103ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 6.269ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.916ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Fragment Instance Lifecycle Timings: - ExecTime: 17.315us - ExecTreeExecTime: 9.715us - OpenTime: 6.265ms - ExecTreeOpenTime: 6.113ms - PrepareTime: 22.018ms - ExecTreePrepareTime: 90.273us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 21.437ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.690ms EXCHANGE_NODE (id=1):(Total: 6.119ms, non-child: 0.000ns, % non-child: 0.00%) - BytesReceived: 0 - ConvertRowBatchTime: 2.755us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 6.100ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns I1212 11:10:12.522578 14405 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.522608 14360 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:12.522614 14360 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:12.522734 5418 impala-internal-service.cc:74] ReportExecStatus(): instance_id=4f45001ed37544e0:750e0ef900000003 I1212 11:10:12.522739 5418 impala-server.cc:1076] ReportExecStatus() instance_id=4f45001ed37544e0:750e0ef900000003 done=true I1212 11:10:12.522745 5418 coordinator.cc:1437] UpdateFragmentExecStatus() instance=4f45001ed37544e0:750e0ef900000003 status=0 done=true I1212 11:10:12.522856 3396 impala-internal-service.cc:74] ReportExecStatus(): instance_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.522861 3396 impala-server.cc:1076] ReportExecStatus() instance_id=4f45001ed37544e0:750e0ef900000000 done=true I1212 11:10:12.522866 3396 coordinator.cc:1437] UpdateFragmentExecStatus() instance=4f45001ed37544e0:750e0ef900000000 status=0 done=true I1212 11:10:12.523052 3396 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 18.367us 18.367us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3.909ms 7.723ms 0 -1 198.00 KB 0 I1212 11:10:12.523142 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 18.367us 18.367us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5.843ms 7.723ms 0 -1 198.00 KB 0 I1212 11:10:12.523155 5418 progress-updater.cc:55] Query 4f45001ed37544e0:750e0ef900000000 100% Complete (3 out of 3) I1212 11:10:12.523192 3396 coordinator.cc:1521] profile for instance_id=4f45001ed37544e0:750e0ef900000000 Instance 4f45001ed37544e0:750e0ef900000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 28.370ms, non-child: 813.855us, % non-child: 2.87%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 6.103ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 6.269ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.916ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Fragment Instance Lifecycle Timings: - ExecTime: 17.315us - ExecTreeExecTime: 9.715us - OpenTime: 6.265ms - ExecTreeOpenTime: 6.113ms - PrepareTime: 22.018ms - ExecTreePrepareTime: 90.273us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 21.437ms, non-child: 21.437ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.690ms EXCHANGE_NODE (id=1):(Total: 6.119ms, non-child: 18.367us, % non-child: 0.30%) - BytesReceived: 0 - ConvertRowBatchTime: 2.755us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 6.100ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns I1212 11:10:12.523319 5418 coordinator.cc:1521] profile for instance_id=4f45001ed37544e0:750e0ef900000003 Instance 4f45001ed37544e0:750e0ef900000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 28.357ms, non-child: 972.944us, % non-child: 3.43%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 151.000ns - TotalStorageWaitTime: 3.416ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 10.144ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 3.493ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 4.185ms - ExecTreeExecTime: 3.956ms - OpenTime: 1.978ms - ExecTreeOpenTime: 1.803ms - PrepareTime: 22.151ms - ExecTreePrepareTime: 70.751us DataStreamSender (dst_id=1):(Total: 32.323us, non-child: 32.323us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 21.550ms, non-child: 21.550ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.906ms KUDU_SCAN_NODE (id=0):(Total: 5.801ms, non-child: 5.801ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.994ms - MaterializeTupleTime(*): 3.948ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 624.000us - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:12.523946 3396 coordinator.cc:1529] cumulative profile for query_id=4f45001ed37544e0:750e0ef900000000 Execution Profile 4f45001ed37544e0:750e0ef900000000:(Total: 27.433ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance 4f45001ed37544e0:750e0ef900000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 28.370ms, non-child: 813.855us, % non-child: 2.87%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 6.103ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 6.269ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.916ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Fragment Instance Lifecycle Timings: - ExecTime: 17.315us - ExecTreeExecTime: 9.715us - OpenTime: 6.265ms - ExecTreeOpenTime: 6.113ms - PrepareTime: 22.018ms - ExecTreePrepareTime: 90.273us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 21.437ms, non-child: 21.437ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.690ms EXCHANGE_NODE (id=1):(Total: 6.119ms, non-child: 18.367us, % non-child: 0.30%) - BytesReceived: 0 - ConvertRowBatchTime: 2.755us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 6.100ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 22.685ms, non-child: 865.416us, % non-child: 3.81%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 209.34 KB (214362) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 187.000ns - TotalStorageWaitTime: 3.430ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 10.112ms - TotalThreadsSysTime: 188.333us - TotalThreadsUserTime: 3.079ms - TotalThreadsVoluntaryContextSwitches: 38 (38) Fragment Instance Lifecycle Timings: - ExecTime: 4.157ms - ExecTreeExecTime: 3.959ms - OpenTime: 1.988ms - ExecTreeOpenTime: 1.837ms - PrepareTime: 16.496ms - ExecTreePrepareTime: 68.075us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 28.483us, non-child: 28.483us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 15.948ms, non-child: 15.948ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 15.335ms KUDU_SCAN_NODE (id=0):(Total: 5.843ms, non-child: 5.843ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.984ms - MaterializeTupleTime(*): 3.952ms - ScannerThreadsSysTime: 188.333us - ScannerThreadsUserTime: 471.000us - ScannerThreadsVoluntaryContextSwitches: 27 (27) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 4f45001ed37544e0:750e0ef900000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 17.948ms, non-child: 773.264us, % non-child: 4.31%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 251.000ns - TotalStorageWaitTime: 1.646ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 6.412ms - TotalThreadsSysTime: 565.000us - TotalThreadsUserTime: 2.433ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 2.332ms - ExecTreeExecTime: 2.171ms - OpenTime: 1.899ms - ExecTreeOpenTime: 1.759ms - PrepareTime: 13.671ms - ExecTreePrepareTime: 90.327us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 20.605us, non-child: 20.605us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.150ms, non-child: 13.150ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.594ms KUDU_SCAN_NODE (id=0):(Total: 4.004ms, non-child: 4.004ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2.191ms - MaterializeTupleTime(*): 2.164ms - ScannerThreadsSysTime: 565.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Instance 4f45001ed37544e0:750e0ef900000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 21.751ms, non-child: 850.038us, % non-child: 3.91%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 161.000ns - TotalStorageWaitTime: 5.227ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 13.782ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 3.312ms - TotalThreadsVoluntaryContextSwitches: 82 (82) Fragment Instance Lifecycle Timings: - ExecTime: 5.955ms - ExecTreeExecTime: 5.750ms - OpenTime: 2.085ms - ExecTreeOpenTime: 1.947ms - PrepareTime: 13.666ms - ExecTreePrepareTime: 43.148us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 32.522us, non-child: 32.522us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.145ms, non-child: 13.145ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.505ms KUDU_SCAN_NODE (id=0):(Total: 7.723ms, non-child: 7.723ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 5.766ms - MaterializeTupleTime(*): 5.743ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 789.000us - ScannerThreadsVoluntaryContextSwitches: 72 (72) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Instance 4f45001ed37544e0:750e0ef900000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 28.357ms, non-child: 972.944us, % non-child: 3.43%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 151.000ns - TotalStorageWaitTime: 3.416ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 10.144ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 3.493ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 4.185ms - ExecTreeExecTime: 3.956ms - OpenTime: 1.978ms - ExecTreeOpenTime: 1.803ms - PrepareTime: 22.151ms - ExecTreePrepareTime: 70.751us DataStreamSender (dst_id=1):(Total: 32.323us, non-child: 32.323us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 21.550ms, non-child: 21.550ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.906ms KUDU_SCAN_NODE (id=0):(Total: 5.801ms, non-child: 5.801ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.994ms - MaterializeTupleTime(*): 3.948ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 624.000us - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:12.523965 3396 coordinator.cc:1546] Fragment instance completed: id=4f45001ed37544e0:750e0ef900000000 host=mj-desktop.ca.cloudera.com:22000 remaining=1 I1212 11:10:12.524031 14360 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:12.524057 5418 coordinator.cc:1529] cumulative profile for query_id=4f45001ed37544e0:750e0ef900000000 Execution Profile 4f45001ed37544e0:750e0ef900000000:(Total: 27.433ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 0, 90th %-ile: 0, 95th %-ile: 0, 99.9th %-ile: 0 - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance 4f45001ed37544e0:750e0ef900000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 28.370ms, non-child: 813.855us, % non-child: 2.87%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 6.103ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 6.269ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.916ms - TotalThreadsVoluntaryContextSwitches: 3 (3) Fragment Instance Lifecycle Timings: - ExecTime: 17.315us - ExecTreeExecTime: 9.715us - OpenTime: 6.265ms - ExecTreeOpenTime: 6.113ms - PrepareTime: 22.018ms - ExecTreePrepareTime: 90.273us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 21.437ms, non-child: 21.437ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.690ms EXCHANGE_NODE (id=1):(Total: 6.119ms, non-child: 18.367us, % non-child: 0.30%) - BytesReceived: 0 - ConvertRowBatchTime: 2.755us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 6.100ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 22.685ms, non-child: 865.416us, % non-child: 3.81%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 209.34 KB (214362) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 187.000ns - TotalStorageWaitTime: 3.430ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 10.112ms - TotalThreadsSysTime: 188.333us - TotalThreadsUserTime: 3.079ms - TotalThreadsVoluntaryContextSwitches: 38 (38) Fragment Instance Lifecycle Timings: - ExecTime: 4.157ms - ExecTreeExecTime: 3.959ms - OpenTime: 1.988ms - ExecTreeOpenTime: 1.837ms - PrepareTime: 16.496ms - ExecTreePrepareTime: 68.075us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 28.483us, non-child: 28.483us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 15.948ms, non-child: 15.948ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 15.335ms KUDU_SCAN_NODE (id=0):(Total: 5.843ms, non-child: 5.843ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.984ms - MaterializeTupleTime(*): 3.952ms - ScannerThreadsSysTime: 188.333us - ScannerThreadsUserTime: 471.000us - ScannerThreadsVoluntaryContextSwitches: 27 (27) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 4f45001ed37544e0:750e0ef900000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 17.948ms, non-child: 773.264us, % non-child: 4.31%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 251.000ns - TotalStorageWaitTime: 1.646ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 6.412ms - TotalThreadsSysTime: 565.000us - TotalThreadsUserTime: 2.433ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 2.332ms - ExecTreeExecTime: 2.171ms - OpenTime: 1.899ms - ExecTreeOpenTime: 1.759ms - PrepareTime: 13.671ms - ExecTreePrepareTime: 90.327us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 20.605us, non-child: 20.605us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.150ms, non-child: 13.150ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.594ms KUDU_SCAN_NODE (id=0):(Total: 4.004ms, non-child: 4.004ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2.191ms - MaterializeTupleTime(*): 2.164ms - ScannerThreadsSysTime: 565.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Instance 4f45001ed37544e0:750e0ef900000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 21.751ms, non-child: 850.038us, % non-child: 3.91%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 161.000ns - TotalStorageWaitTime: 5.227ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 13.782ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 3.312ms - TotalThreadsVoluntaryContextSwitches: 82 (82) Fragment Instance Lifecycle Timings: - ExecTime: 5.955ms - ExecTreeExecTime: 5.750ms - OpenTime: 2.085ms - ExecTreeOpenTime: 1.947ms - PrepareTime: 13.666ms - ExecTreePrepareTime: 43.148us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 32.522us, non-child: 32.522us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.145ms, non-child: 13.145ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.505ms KUDU_SCAN_NODE (id=0):(Total: 7.723ms, non-child: 7.723ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 5.766ms - MaterializeTupleTime(*): 5.743ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 789.000us - ScannerThreadsVoluntaryContextSwitches: 72 (72) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Instance 4f45001ed37544e0:750e0ef900000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 28.357ms, non-child: 972.944us, % non-child: 3.43%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 151.000ns - TotalStorageWaitTime: 3.416ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 10.144ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 3.493ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 4.185ms - ExecTreeExecTime: 3.956ms - OpenTime: 1.978ms - ExecTreeOpenTime: 1.803ms - PrepareTime: 22.151ms - ExecTreePrepareTime: 70.751us DataStreamSender (dst_id=1):(Total: 32.323us, non-child: 32.323us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 21.550ms, non-child: 21.550ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.906ms KUDU_SCAN_NODE (id=0):(Total: 5.801ms, non-child: 5.801ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.994ms - MaterializeTupleTime(*): 3.948ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 624.000us - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:12.524073 5418 coordinator.cc:1546] Fragment instance completed: id=4f45001ed37544e0:750e0ef900000003 host=mj-desktop.ca.cloudera.com:22000 remaining=0 I1212 11:10:12.524109 14361 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:12.524171 14361 query-exec-mgr.cc:103] Instance completed. instance_id=4f45001ed37544e0:750e0ef900000003 I1212 11:10:12.524175 14361 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=4f45001ed37544e0:750e0ef900000000 refcnt=3 I1212 11:10:12.528872 2681 impala-hs2-server.cc:713] GetResultSetMetadata(): query_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.529009 2681 impala-hs2-server.cc:753] GetResultSetMetadata(): return_val=TGetResultSetMetadataResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: schema (struct) = TTableSchema { 01: columns (list) = list[16] { [0] = TColumnDesc { 01: columnName (string) = "l_orderkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 0, }, [1] = TColumnDesc { 01: columnName (string) = "l_linenumber", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 3, }, }, }, }, 03: position (i32) = 1, }, [2] = TColumnDesc { 01: columnName (string) = "l_partkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 2, }, [3] = TColumnDesc { 01: columnName (string) = "l_suppkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 3, }, [4] = TColumnDesc { 01: columnName (string) = "l_quantity", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 4, }, [5] = TColumnDesc { 01: columnName (string) = "l_extendedprice", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 5, }, [6] = TColumnDesc { 01: columnName (string) = "l_discount", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 6, }, [7] = TColumnDesc { 01: columnName (string) = "l_tax", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 7, }, [8] = TColumnDesc { 01: columnName (string) = "l_returnflag", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 8, }, [9] = TColumnDesc { 01: columnName (string) = "l_linestatus", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 9, }, [10] = TColumnDesc { 01: columnName (string) = "l_shipdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 10, }, [11] = TColumnDesc { 01: columnName (string) = "l_commitdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 11, }, [12] = TColumnDesc { 01: columnName (string) = "l_receiptdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 12, }, [13] = TColumnDesc { 01: columnName (string) = "l_shipinstruct", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 13, }, [14] = TColumnDesc { 01: columnName (string) = "l_shipmode", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 14, }, [15] = TColumnDesc { 01: columnName (string) = "l_comment", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 15, }, }, }, } I1212 11:10:12.529302 2681 coordinator.cc:1069] All fragment instances finished successfully. I1212 11:10:12.529332 14360 data-stream-mgr.cc:226] DeregisterRecvr(): fragment_instance_id=4f45001ed37544e0:750e0ef900000000, node=1 I1212 11:10:12.529343 14360 data-stream-recvr.cc:237] cancelled stream: fragment_instance_id_=4f45001ed37544e0:750e0ef900000000 node_id=1 I1212 11:10:12.529367 14360 query-exec-mgr.cc:103] Instance completed. instance_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.529371 14360 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=4f45001ed37544e0:750e0ef900000000 refcnt=2 I1212 11:10:12.529387 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 18.367us 18.367us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5.843ms 7.723ms 0 -1 198.00 KB 0 I1212 11:10:12.529573 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 18.367us 18.367us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5.843ms 7.723ms 0 -1 198.00 KB 0 I1212 11:10:12.529733 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 18.367us 18.367us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5.843ms 7.723ms 0 -1 198.00 KB 0 I1212 11:10:12.529882 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 18.367us 18.367us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5.843ms 7.723ms 0 -1 198.00 KB 0 I1212 11:10:12.530520 2681 impala-hs2-server.cc:688] CloseOperation(): query_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.530524 2681 impala-server.cc:907] UnregisterQuery(): query_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.530527 2681 impala-server.cc:993] Cancel(): query_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.530531 2681 coordinator.cc:1362] Cancel() query_id=4f45001ed37544e0:750e0ef900000000 I1212 11:10:12.530537 2681 coordinator.cc:1428] CancelFragmentInstances() query_id=4f45001ed37544e0:750e0ef900000000, tried to cancel 0 fragment instances I1212 11:10:12.530611 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 18.367us 18.367us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5.843ms 7.723ms 0 -1 198.00 KB 0 I1212 11:10:12.530747 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 18.367us 18.367us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5.843ms 7.723ms 0 -1 198.00 KB 0 I1212 11:10:12.530901 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 18.367us 18.367us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5.843ms 7.723ms 0 -1 198.00 KB 0 I1212 11:10:12.531033 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 18.367us 18.367us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5.843ms 7.723ms 0 -1 198.00 KB 0 I1212 11:10:12.531118 2681 admission-controller.cc:538] Released query id=4f45001ed37544e0:750e0ef900000000 agg_num_running=1, agg_num_queued=0, agg_mem_reserved=94.22 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=0) I1212 11:10:12.531131 2681 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=4f45001ed37544e0:750e0ef900000000 refcnt=1 I1212 11:10:12.540257 2681 impala-hs2-server.cc:414] ExecuteStatement(): request=TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "&\xe4\xc0Y\baF\x12\xbb\xb0\x10\x91\xd2m\xf3\x03", 02: secret (string) = "9V#\x13\xa6\xe3F\xcb\x86\xf56\xf5B\xe0\x1e\n", }, }, 02: statement (string) = "select * from lineitem where l_commitdate like '%cheese'", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "1m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:12.540302 2681 impala-hs2-server.cc:228] TExecuteStatementReq: TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "&\xe4\xc0Y\baF\x12\xbb\xb0\x10\x91\xd2m\xf3\x03", 02: secret (string) = "9V#\x13\xa6\xe3F\xcb\x86\xf56\xf5B\xe0\x1e\n", }, }, 02: statement (string) = "select * from lineitem where l_commitdate like '%cheese'", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "1m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:12.540357 2681 impala-server.cc:742] Parsed pool options: override_options_mask=1111111111111111111111111111111110111111111111111111111111000010 set_pool_mask=0000000000000000000000000000000000000000000000000000000000000000 overlay_mask=0000000000000000000000000000000000000000000000000000000000000000 I1212 11:10:12.540436 2681 impala-hs2-server.cc:261] TClientRequest.queryOptions: TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 1048576, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, } I1212 11:10:12.547693 14419 AsyncKuduClient.java:1367] Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) I1212 11:10:12.550420 14420 AsyncKuduClient.java:1367] Learned about tablet de1fe37fdb46438abfbc154bf7fb439b for table 'impala::ucu3e4.lineitem' with partition [, 0x00000001) I1212 11:10:12.550607 14420 AsyncKuduClient.java:1367] Learned about tablet 91d0d8d3b0e34afc9d7fa522e61f40ef for table 'impala::ucu3e4.lineitem' with partition [0x00000001, 0x00000002) I1212 11:10:12.550779 14420 AsyncKuduClient.java:1367] Learned about tablet dc26b34fb84d4ff8baae3f44b23f0ae2 for table 'impala::ucu3e4.lineitem' with partition [0x00000002, ) I1212 11:10:12.556006 2681 impala-server.cc:812] Execution request: TExecRequest { 01: stmt_type (i32) = 0, 02: query_options (struct) = TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 1048576, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 44: mt_dop (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, }, 03: query_exec_request (struct) = TQueryExecRequest { 01: desc_tbl (struct) = TDescriptorTable { 01: slotDescriptors (list) = list[16] { [0] = TSlotDescriptor { 01: id (i32) = 0, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 0, }, 06: byteOffset (i32) = 128, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 8, }, [1] = TSlotDescriptor { 01: id (i32) = 1, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 1, }, 06: byteOffset (i32) = 184, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 15, }, [2] = TSlotDescriptor { 01: id (i32) = 2, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 2, }, 06: byteOffset (i32) = 136, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 9, }, [3] = TSlotDescriptor { 01: id (i32) = 3, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 3, }, 06: byteOffset (i32) = 144, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 10, }, [4] = TSlotDescriptor { 01: id (i32) = 4, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 4, }, 06: byteOffset (i32) = 152, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 11, }, [5] = TSlotDescriptor { 01: id (i32) = 5, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 5, }, 06: byteOffset (i32) = 160, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 12, }, [6] = TSlotDescriptor { 01: id (i32) = 6, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 6, }, 06: byteOffset (i32) = 168, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 13, }, [7] = TSlotDescriptor { 01: id (i32) = 7, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 7, }, 06: byteOffset (i32) = 176, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 14, }, [8] = TSlotDescriptor { 01: id (i32) = 8, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 8, }, 06: byteOffset (i32) = 0, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 0, 09: slotIdx (i32) = 0, }, [9] = TSlotDescriptor { 01: id (i32) = 9, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 9, }, 06: byteOffset (i32) = 16, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 1, }, [10] = TSlotDescriptor { 01: id (i32) = 10, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 10, }, 06: byteOffset (i32) = 32, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 2, }, [11] = TSlotDescriptor { 01: id (i32) = 11, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 11, }, 06: byteOffset (i32) = 48, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 3, }, [12] = TSlotDescriptor { 01: id (i32) = 12, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 12, }, 06: byteOffset (i32) = 64, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 4, }, [13] = TSlotDescriptor { 01: id (i32) = 13, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 13, }, 06: byteOffset (i32) = 80, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 5, }, [14] = TSlotDescriptor { 01: id (i32) = 14, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 14, }, 06: byteOffset (i32) = 96, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 6, }, [15] = TSlotDescriptor { 01: id (i32) = 15, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 15, }, 06: byteOffset (i32) = 112, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 7, 09: slotIdx (i32) = 7, }, }, 02: tupleDescriptors (list) = list[1] { [0] = TTupleDescriptor { 01: id (i32) = 0, 02: byteSize (i32) = 190, 03: numNullBytes (i32) = 2, 04: tableId (i32) = 1, 05: tuplePath (list) = list[0] { }, }, }, 03: tableDescriptors (list) = list[1] { [0] = TTableDescriptor { 01: id (i32) = 1, 02: tableType (i32) = 4, 03: columnDescriptors (list) = list[16] { [0] = TColumnDescriptor { 01: name (string) = "l_orderkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [1] = TColumnDescriptor { 01: name (string) = "l_linenumber", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, }, [2] = TColumnDescriptor { 01: name (string) = "l_partkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [3] = TColumnDescriptor { 01: name (string) = "l_suppkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [4] = TColumnDescriptor { 01: name (string) = "l_quantity", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [5] = TColumnDescriptor { 01: name (string) = "l_extendedprice", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [6] = TColumnDescriptor { 01: name (string) = "l_discount", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [7] = TColumnDescriptor { 01: name (string) = "l_tax", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [8] = TColumnDescriptor { 01: name (string) = "l_returnflag", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [9] = TColumnDescriptor { 01: name (string) = "l_linestatus", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [10] = TColumnDescriptor { 01: name (string) = "l_shipdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [11] = TColumnDescriptor { 01: name (string) = "l_commitdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [12] = TColumnDescriptor { 01: name (string) = "l_receiptdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [13] = TColumnDescriptor { 01: name (string) = "l_shipinstruct", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [14] = TColumnDescriptor { 01: name (string) = "l_shipmode", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [15] = TColumnDescriptor { 01: name (string) = "l_comment", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, }, 04: numClusteringCols (i32) = 0, 07: tableName (string) = "impala::ucu3e4.lineitem", 08: dbName (string) = "ucu3e4", 10: kuduTable (struct) = TKuduTable { 01: table_name (string) = "impala::ucu3e4.lineitem", 02: master_addresses (list) = list[1] { [0] = "127.0.0.1", }, 03: key_columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 04: partition_by (list) = list[1] { [0] = TKuduPartitionParam { 01: by_hash_param (struct) = TKuduPartitionByHashParam { 01: columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 02: num_partitions (i32) = 3, }, }, }, }, }, }, }, 02: plan_exec_info (list) = list[1] { [0] = TPlanExecInfo { 01: fragments (list) = list[2] { [0] = TPlanFragment { 01: idx (i32) = 0, 02: display_name (string) = "F01", 03: plan (struct) = TPlan { 01: nodes (list) = list[1] { [0] = TPlanNode { 01: node_id (i32) = 1, 02: node_type (i32) = 6, 03: num_children (i32) = 0, 04: limit (i64) = -1, 05: row_tuples (list) = list[1] { [0] = 0, }, 06: nullable_tuples (list) = list[1] { [0] = false, }, 08: disable_codegen (bool) = false, 18: exchange_node (struct) = TExchangeNode { 01: input_row_tuples (list) = list[1] { [0] = 0, }, }, 21: label (string) = "01:EXCHANGE", 22: label_detail (string) = "UNPARTITIONED", 23: estimated_stats (struct) = TExecStats { 03: cardinality (i64) = -1, 04: memory_used (i64) = -1, }, }, }, }, 04: output_exprs (list) = list[16] { [0] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 0, }, }, }, }, [1] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 1, }, }, }, }, [2] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 2, }, }, }, }, [3] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 3, }, }, }, }, [4] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 4, }, }, }, }, [5] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 5, }, }, }, }, [6] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 6, }, }, }, }, [7] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 7, }, }, }, }, [8] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12 I1212 11:10:12.556242 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22000(local selection) I1212 11:10:12.556260 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22001(local selection) I1212 11:10:12.556274 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22002(local selection) I1212 11:10:12.556278 2681 simple-scheduler.cc:979] Total remote scan volume = 0 I1212 11:10:12.556285 2681 simple-scheduler.cc:981] Total local scan volume = 2.93 KB I1212 11:10:12.556288 2681 simple-scheduler.cc:983] Total cached scan volume = 0 I1212 11:10:12.556294 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22002, } I1212 11:10:12.556303 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:12.556308 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22001, } I1212 11:10:12.556313 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](479)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:12.556318 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, } I1212 11:10:12.556323 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:12.556372 2681 admission-controller.cc:440] Schedule for id=b9424a11e1300d47:7557db3800000000 in pool_name=default-pool cluster_mem_needed=3.00 MB PoolConfig: max_requests=-1 max_queued=200 max_mem=-1.00 B I1212 11:10:12.556383 2681 admission-controller.cc:445] Stats: agg_num_running=1, agg_num_queued=0, agg_mem_reserved=94.22 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=0) I1212 11:10:12.556388 2681 admission-controller.cc:451] Admitted query id=b9424a11e1300d47:7557db3800000000 I1212 11:10:12.556406 2681 admission-controller.cc:457] Final: agg_num_running=2, agg_num_queued=0, agg_mem_reserved=94.22 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=2, num_queued=0, backend_mem_reserved=0) I1212 11:10:12.556438 2681 coordinator.cc:447] Exec() query_id=b9424a11e1300d47:7557db3800000000 stmt=select * from lineitem where l_commitdate like '%cheese' I1212 11:10:12.556479 2681 mem-tracker.cc:184] Using query memory limit: 1.00 MB I1212 11:10:12.556555 2681 coordinator.cc:602] starting 4 fragment instances for query b9424a11e1300d47:7557db3800000000 I1212 11:10:12.556599 2681 coordinator.cc:737] ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- I1212 11:10:12.556766 2569 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22001 instance_id=b9424a11e1300d47:7557db3800000002 I1212 11:10:12.556773 2569 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22001) I1212 11:10:12.556771 2567 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:12.556777 2569 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22001 I1212 11:10:12.556777 2567 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:12.556782 2567 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:12.556794 2570 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=b9424a11e1300d47:7557db3800000003 I1212 11:10:12.556798 2568 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22002 instance_id=b9424a11e1300d47:7557db3800000001 I1212 11:10:12.556800 2570 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:12.556805 2570 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:12.556807 2568 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22002) I1212 11:10:12.556812 2568 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22002 I1212 11:10:12.557078 5418 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=b9424a11e1300d47:7557db3800000003 I1212 11:10:12.557087 5418 query-exec-mgr.cc:45] StartFInstance() instance_id=b9424a11e1300d47:7557db3800000003 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:12.557116 5418 query-exec-mgr.cc:69] new QueryState: query_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:12.557121 5418 query-exec-mgr.cc:77] QueryState: query_id=b9424a11e1300d47:7557db3800000000 refcnt=1 I1212 11:10:12.557178 5418 query-state.cc:58] RegisterFInstance(): instance_id=b9424a11e1300d47:7557db3800000003 I1212 11:10:12.557210 2569 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=b9424a11e1300d47:7557db3800000002 I1212 11:10:12.557216 2569 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22001 back to cache I1212 11:10:12.557232 3396 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:12.557240 3396 query-exec-mgr.cc:45] StartFInstance() instance_id=b9424a11e1300d47:7557db3800000000 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:12.557245 5418 thread.cc:288] Started thread 14428 - query-exec-mgr:exec-fragment-instance-b9424a11e1300d47:7557db3800000003 I1212 11:10:12.557246 14428 plan-fragment-executor.cc:123] Prepare(): instance_id=b9424a11e1300d47:7557db3800000003 I1212 11:10:12.557245 3396 query-exec-mgr.cc:77] QueryState: query_id=b9424a11e1300d47:7557db3800000000 refcnt=2 I1212 11:10:12.557297 2570 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=b9424a11e1300d47:7557db3800000003 I1212 11:10:12.557302 2570 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:12.557320 14428 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = -5097430387577057977, 02: lo (i64) = 8455467858976047107, }, 02: per_fragment_instance_idx (i32) = 2, 03: per_node_scan_ranges (map) = map[1] { 0 -> list[1] { [0] = TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, }, }, }, 04: per_exch_num_senders (map) = map[0] { }, 05: destinations (list) = list[1] { [0] = TPlanFragmentDestination { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = -5097430387577057977, 02: lo (i64) = 8455467858976047104, }, 02: server (struct) = TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, }, }, }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = 2, } I1212 11:10:12.557346 3396 query-state.cc:58] RegisterFInstance(): instance_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:12.557368 2568 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=b9424a11e1300d47:7557db3800000001 I1212 11:10:12.557373 2568 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22002 back to cache I1212 11:10:12.557397 14428 plan-fragment-executor.cc:145] Using query memory limit from query options: 1.00 MB I1212 11:10:12.557405 14428 mem-tracker.cc:184] Using query memory limit: 1.00 MB I1212 11:10:12.557412 14430 plan-fragment-executor.cc:123] Prepare(): instance_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:12.557423 3396 thread.cc:288] Started thread 14430 - query-exec-mgr:exec-fragment-instance-b9424a11e1300d47:7557db3800000000 I1212 11:10:12.557446 14430 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = -5097430387577057977, 02: lo (i64) = 8455467858976047104, }, 02: per_fragment_instance_idx (i32) = 0, 03: per_node_scan_ranges (map) = map[0] { }, 04: per_exch_num_senders (map) = map[1] { 1 -> 3, }, 05: destinations (list) = list[0] { }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = -1, } I1212 11:10:12.557458 2567 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:12.557464 2567 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:12.557514 14430 plan-fragment-executor.cc:145] Using query memory limit from query options: 1.00 MB I1212 11:10:12.557515 2681 coordinator.cc:640] started 4 fragment instances for query b9424a11e1300d47:7557db3800000000 I1212 11:10:12.557520 14430 mem-tracker.cc:184] Using query memory limit: 1.00 MB I1212 11:10:12.557554 2681 query-exec-mgr.cc:123] GetQueryState(): query_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:12.557557 2681 query-state.cc:65] GetFInstanceState(): instance_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:12.557629 14430 plan-fragment-executor.cc:174] descriptor table for fragment=b9424a11e1300d47:7557db3800000000 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:12.557632 14428 plan-fragment-executor.cc:174] descriptor table for fragment=b9424a11e1300d47:7557db3800000003 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:12.557683 14430 data-stream-mgr.cc:80] creating receiver for fragment=b9424a11e1300d47:7557db3800000000, node=1 I1212 11:10:12.557785 14428 plan-fragment-executor.cc:285] Hdfs split stats (:<# splits>/) for query=b9424a11e1300d47:7557db3800000000: I1212 11:10:12.557847 14428 thread.cc:288] Started thread 14436 - DataStreamSender:SenderThread(1:1) I1212 11:10:12.571907 14430 plan-fragment-executor.cc:261] plan_root= ExchangeNode(#senders=3 conjuncts=[]) I1212 11:10:12.571925 14430 plan-fragment-executor.cc:296] Open(): instance_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:12.571960 2681 coordinator.cc:1181] Byte split for fragment 1 min: 0, max: 0, avg: 0, stddev: 0 I1212 11:10:12.571966 2681 coordinator.cc:1184] data volume for ipaddress 0xcd1c880: 0 I1212 11:10:12.571969 2681 coordinator.cc:1184] data volume for ipaddress 0xbf50400: 0 I1212 11:10:12.571996 2681 coordinator.cc:1184] data volume for ipaddress 0xbf4f320: 0 I1212 11:10:12.572017 14430 thread.cc:288] Started thread 14439 - plan-fragment-executor:report-profile I1212 11:10:12.572016 14439 plan-fragment-executor.cc:378] ReportProfileThread(): instance_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:12.572510 2681 thread.cc:288] Started thread 14440 - query-exec-state:wait-thread I1212 11:10:12.572571 2681 impala-hs2-server.cc:486] ExecuteStatement(): return_val=TExecuteStatementResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: operationHandle (struct) = TOperationHandle { 01: operationId (struct) = THandleIdentifier { 01: guid (string) = "G\r0\xe1\x11JB\xb9\x00\x00\x00\x008\xdbWu", 02: secret (string) = "G\r0\xe1\x11JB\xb9\x00\x00\x00\x008\xdbWu", }, 02: operationType (i32) = 0, 03: hasResultSet (bool) = true, }, } I1212 11:10:12.576771 14428 plan-fragment-executor.cc:261] plan_root= KuduScanNode(tupleid=0) I1212 11:10:12.576794 14428 plan-fragment-executor.cc:296] Open(): instance_id=b9424a11e1300d47:7557db3800000003 I1212 11:10:12.576867 14428 thread.cc:288] Started thread 14446 - plan-fragment-executor:report-profile I1212 11:10:12.576866 14446 plan-fragment-executor.cc:378] ReportProfileThread(): instance_id=b9424a11e1300d47:7557db3800000003 I1212 11:10:12.585350 14428 kudu-scan-node.cc:128] Latest observed Kudu timestamp: 0 I1212 11:10:12.585670 14428 kudu-scan-node.cc:248] Thread started: scanner-thread(1) I1212 11:10:12.585876 14428 thread.cc:288] Started thread 14483 - kudu-scan-node:scanner-thread(1) I1212 11:10:12.586241 14483 kudu-scanner.cc:148] Starting KuduScanner with ReadMode=0 timeout=180000 I1212 11:10:15.727586 3769 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=b9424a11e1300d47:7557db3800000000, node=1 I1212 11:10:15.727602 3769 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=b9424a11e1300d47:7557db3800000000 node_id=1 #senders=2 I1212 11:10:15.728497 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=b9424a11e1300d47:7557db3800000002 I1212 11:10:15.728504 3769 impala-server.cc:1076] ReportExecStatus() instance_id=b9424a11e1300d47:7557db3800000002 done=true I1212 11:10:15.728513 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=b9424a11e1300d47:7557db3800000002 status=0 done=true I1212 11:10:15.728962 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 0.000ns 0.000ns 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 1s048ms 3s146ms 0 -1 202.00 KB 0 I1212 11:10:15.728974 3769 progress-updater.cc:65] Query b9424a11e1300d47:7557db3800000000: 33% Complete (1 out of 3) I1212 11:10:15.729203 3769 coordinator.cc:1521] profile for instance_id=b9424a11e1300d47:7557db3800000002 Instance b9424a11e1300d47:7557db3800000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 3s170ms, non-child: 1.996ms, % non-child: 0.06%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 216.000ns - TotalStorageWaitTime: 2s836ms - TotalThreadsInvoluntaryContextSwitches: 201 (201) - TotalThreadsTotalWallClockTime: 6s300ms - TotalThreadsSysTime: 32.115ms - TotalThreadsUserTime: 2s306ms - TotalThreadsVoluntaryContextSwitches: 523 (523) Fragment Instance Lifecycle Timings: - ExecTime: 3s145ms - ExecTreeExecTime: 3s145ms - OpenTime: 10.669ms - ExecTreeOpenTime: 2.417ms - PrepareTime: 14.435ms - ExecTreePrepareTime: 91.982us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 20.010us, non-child: 20.010us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 21.576ms, non-child: 21.576ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.538ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.230ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 14.234ms KUDU_SCAN_NODE (id=0):(Total: 3s146ms, non-child: 3s146ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000022) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 200 (200) - ScannerThreadsTotalWallClockTime: 3s145ms - MaterializeTupleTime(*): 3s144ms - ScannerThreadsSysTime: 32.115ms - ScannerThreadsUserTime: 2s296ms - ScannerThreadsVoluntaryContextSwitches: 506 (506) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:15.729507 3769 coordinator.cc:1529] cumulative profile for query_id=b9424a11e1300d47:7557db3800000000 Execution Profile b9424a11e1300d47:7557db3800000000:(Total: 15.527ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Averaged Fragment F00:(Total: 3s170ms, non-child: 1.996ms, % non-child: 0.06%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 216.000ns - TotalStorageWaitTime: 2s836ms - TotalThreadsInvoluntaryContextSwitches: 201 (201) - TotalThreadsTotalWallClockTime: 6s300ms - TotalThreadsSysTime: 32.115ms - TotalThreadsUserTime: 2s306ms - TotalThreadsVoluntaryContextSwitches: 523 (523) Fragment Instance Lifecycle Timings: - ExecTime: 3s145ms - ExecTreeExecTime: 3s145ms - OpenTime: 10.669ms - ExecTreeOpenTime: 2.417ms - PrepareTime: 14.435ms - ExecTreePrepareTime: 91.982us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 20.010us, non-child: 20.010us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 21.576ms, non-child: 21.576ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.538ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.230ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 14.234ms KUDU_SCAN_NODE (id=0):(Total: 3s146ms, non-child: 3s146ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000022) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 200 (200) - ScannerThreadsTotalWallClockTime: 3s145ms - MaterializeTupleTime(*): 3s144ms - ScannerThreadsSysTime: 32.115ms - ScannerThreadsUserTime: 2s296ms - ScannerThreadsVoluntaryContextSwitches: 506 (506) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance b9424a11e1300d47:7557db3800000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 3s170ms, non-child: 1.996ms, % non-child: 0.06%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 216.000ns - TotalStorageWaitTime: 2s836ms - TotalThreadsInvoluntaryContextSwitches: 201 (201) - TotalThreadsTotalWallClockTime: 6s300ms - TotalThreadsSysTime: 32.115ms - TotalThreadsUserTime: 2s306ms - TotalThreadsVoluntaryContextSwitches: 523 (523) Fragment Instance Lifecycle Timings: - ExecTime: 3s145ms - ExecTreeExecTime: 3s145ms - OpenTime: 10.669ms - ExecTreeOpenTime: 2.417ms - PrepareTime: 14.435ms - ExecTreePrepareTime: 91.982us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 20.010us, non-child: 20.010us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 21.576ms, non-child: 21.576ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.538ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.230ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 14.234ms KUDU_SCAN_NODE (id=0):(Total: 3s146ms, non-child: 3s146ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000022) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 200 (200) - ScannerThreadsTotalWallClockTime: 3s145ms - MaterializeTupleTime(*): 3s144ms - ScannerThreadsSysTime: 32.115ms - ScannerThreadsUserTime: 2s296ms - ScannerThreadsVoluntaryContextSwitches: 506 (506) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:15.729517 3769 coordinator.cc:1546] Fragment instance completed: id=b9424a11e1300d47:7557db3800000002 host=mj-desktop.ca.cloudera.com:22001 remaining=3 I1212 11:10:15.729521 3769 coordinator.cc:1556] query_id=b9424a11e1300d47:7557db3800000000: first in-progress backend: mj-desktop.ca.cloudera.com:22000 I1212 11:10:15.797067 3766 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=b9424a11e1300d47:7557db3800000000, node=1 I1212 11:10:15.797087 3766 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=b9424a11e1300d47:7557db3800000000 node_id=1 #senders=1 I1212 11:10:15.797852 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=b9424a11e1300d47:7557db3800000001 I1212 11:10:15.797858 3766 impala-server.cc:1076] ReportExecStatus() instance_id=b9424a11e1300d47:7557db3800000001 done=true I1212 11:10:15.797864 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=b9424a11e1300d47:7557db3800000001 status=0 done=true I1212 11:10:15.798336 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 0.000ns 0.000ns 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 2s119ms 3s212ms 0 -1 202.00 KB 0 I1212 11:10:15.798355 3766 progress-updater.cc:65] Query b9424a11e1300d47:7557db3800000000: 66% Complete (2 out of 3) I1212 11:10:15.798660 3766 coordinator.cc:1521] profile for instance_id=b9424a11e1300d47:7557db3800000001 Instance b9424a11e1300d47:7557db3800000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 3s239ms, non-child: 1.279ms, % non-child: 0.04%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 224.000ns - TotalStorageWaitTime: 2s869ms - TotalThreadsInvoluntaryContextSwitches: 255 (255) - TotalThreadsTotalWallClockTime: 6s431ms - TotalThreadsSysTime: 40.456ms - TotalThreadsUserTime: 2s365ms - TotalThreadsVoluntaryContextSwitches: 516 (516) Fragment Instance Lifecycle Timings: - ExecTime: 3s211ms - ExecTreeExecTime: 3s211ms - OpenTime: 9.066ms - ExecTreeOpenTime: 1.752ms - PrepareTime: 19.218ms - ExecTreePrepareTime: 77.400us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 26.872us, non-child: 26.872us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.539ms, non-child: 25.539ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.308ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.045ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 18.663ms KUDU_SCAN_NODE (id=0):(Total: 3s212ms, non-child: 3s212ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (1999622) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 255 (255) - ScannerThreadsTotalWallClockTime: 3s211ms - MaterializeTupleTime(*): 3s211ms - ScannerThreadsSysTime: 40.456ms - ScannerThreadsUserTime: 2s354ms - ScannerThreadsVoluntaryContextSwitches: 504 (504) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec I1212 11:10:15.799404 3766 coordinator.cc:1529] cumulative profile for query_id=b9424a11e1300d47:7557db3800000000 Execution Profile b9424a11e1300d47:7557db3800000000:(Total: 15.527ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Averaged Fragment F00:(Total: 3s205ms, non-child: 1.638ms, % non-child: 0.05%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 220.000ns - TotalStorageWaitTime: 2s853ms - TotalThreadsInvoluntaryContextSwitches: 228 (228) - TotalThreadsTotalWallClockTime: 6s366ms - TotalThreadsSysTime: 36.285ms - TotalThreadsUserTime: 2s335ms - TotalThreadsVoluntaryContextSwitches: 519 (519) Fragment Instance Lifecycle Timings: - ExecTime: 3s178ms - ExecTreeExecTime: 3s178ms - OpenTime: 9.868ms - ExecTreeOpenTime: 2.085ms - PrepareTime: 16.826ms - ExecTreePrepareTime: 84.691us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 23.441us, non-child: 23.441us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 23.557ms, non-child: 23.557ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.423ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.137ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 16.448ms KUDU_SCAN_NODE (id=0):(Total: 3s179ms, non-child: 3s179ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (1999822) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 227 (227) - ScannerThreadsTotalWallClockTime: 3s178ms - MaterializeTupleTime(*): 3s178ms - ScannerThreadsSysTime: 36.285ms - ScannerThreadsUserTime: 2s325ms - ScannerThreadsVoluntaryContextSwitches: 505 (505) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance b9424a11e1300d47:7557db3800000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 3s170ms, non-child: 1.996ms, % non-child: 0.06%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 216.000ns - TotalStorageWaitTime: 2s836ms - TotalThreadsInvoluntaryContextSwitches: 201 (201) - TotalThreadsTotalWallClockTime: 6s300ms - TotalThreadsSysTime: 32.115ms - TotalThreadsUserTime: 2s306ms - TotalThreadsVoluntaryContextSwitches: 523 (523) Fragment Instance Lifecycle Timings: - ExecTime: 3s145ms - ExecTreeExecTime: 3s145ms - OpenTime: 10.669ms - ExecTreeOpenTime: 2.417ms - PrepareTime: 14.435ms - ExecTreePrepareTime: 91.982us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 20.010us, non-child: 20.010us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 21.576ms, non-child: 21.576ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.538ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.230ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 14.234ms KUDU_SCAN_NODE (id=0):(Total: 3s146ms, non-child: 3s146ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000022) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 200 (200) - ScannerThreadsTotalWallClockTime: 3s145ms - MaterializeTupleTime(*): 3s144ms - ScannerThreadsSysTime: 32.115ms - ScannerThreadsUserTime: 2s296ms - ScannerThreadsVoluntaryContextSwitches: 506 (506) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec Instance b9424a11e1300d47:7557db3800000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 3s239ms, non-child: 1.279ms, % non-child: 0.04%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 224.000ns - TotalStorageWaitTime: 2s869ms - TotalThreadsInvoluntaryContextSwitches: 255 (255) - TotalThreadsTotalWallClockTime: 6s431ms - TotalThreadsSysTime: 40.456ms - TotalThreadsUserTime: 2s365ms - TotalThreadsVoluntaryContextSwitches: 516 (516) Fragment Instance Lifecycle Timings: - ExecTime: 3s211ms - ExecTreeExecTime: 3s211ms - OpenTime: 9.066ms - ExecTreeOpenTime: 1.752ms - PrepareTime: 19.218ms - ExecTreePrepareTime: 77.400us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 26.872us, non-child: 26.872us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.539ms, non-child: 25.539ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.308ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.045ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 18.663ms KUDU_SCAN_NODE (id=0):(Total: 3s212ms, non-child: 3s212ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (1999622) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 255 (255) - ScannerThreadsTotalWallClockTime: 3s211ms - MaterializeTupleTime(*): 3s211ms - ScannerThreadsSysTime: 40.456ms - ScannerThreadsUserTime: 2s354ms - ScannerThreadsVoluntaryContextSwitches: 504 (504) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec I1212 11:10:15.799437 3766 coordinator.cc:1546] Fragment instance completed: id=b9424a11e1300d47:7557db3800000001 host=mj-desktop.ca.cloudera.com:22002 remaining=2 I1212 11:10:15.799439 3766 coordinator.cc:1556] query_id=b9424a11e1300d47:7557db3800000000: first in-progress backend: mj-desktop.ca.cloudera.com:22000 I1212 11:10:15.860239 14483 kudu-scan-node.cc:324] Thread done: scanner-thread(1) I1212 11:10:15.860360 14428 data-stream-sender.cc:284] Channel::FlushAndSendEos() instance_id=b9424a11e1300d47:7557db3800000000 dest_node=1 #rows= 0 I1212 11:10:15.860374 14428 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:15.860380 14428 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:15.860395 14428 data-stream-sender.cc:311] calling TransmitData(eos=true) to terminate channel. I1212 11:10:15.860477 5418 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=b9424a11e1300d47:7557db3800000000, node=1 I1212 11:10:15.860498 5418 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=b9424a11e1300d47:7557db3800000000 node_id=1 #senders=0 I1212 11:10:15.860553 14430 exchange-node.cc:139] exch: has batch=false #rows=0 is_cancelled=false instance_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:15.860563 14428 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:15.860630 14446 plan-fragment-executor.cc:408] Reporting final profile for instance b9424a11e1300d47:7557db3800000003 I1212 11:10:15.860633 14430 exchange-node.cc:139] exch: has batch=false #rows=0 is_cancelled=false instance_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:15.860654 14439 plan-fragment-executor.cc:408] Reporting final profile for instance b9424a11e1300d47:7557db3800000000 I1212 11:10:15.860865 14439 plan-fragment-executor.cc:412] Fragment b9424a11e1300d47:7557db3800000000:(Total: 3s303ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 0 - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 3s288ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 3s288ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.721ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 33.566us - ExecTreeExecTime: 12.248us - OpenTime: 3s288ms - ExecTreeOpenTime: 3s288ms - PrepareTime: 14.415ms - ExecTreePrepareTime: 43.203us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 14.062ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 13.567ms EXCHANGE_NODE (id=1):(Total: 3s288ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.397us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 3s288ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns I1212 11:10:15.860869 14439 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:15.860894 14446 plan-fragment-executor.cc:412] Fragment b9424a11e1300d47:7557db3800000003:(Total: 3s303ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 0 - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 162.000ns - TotalStorageWaitTime: 2s925ms - TotalThreadsInvoluntaryContextSwitches: 250 (250) - TotalThreadsTotalWallClockTime: 6s558ms - TotalThreadsSysTime: 61.321ms - TotalThreadsUserTime: 2s388ms - TotalThreadsVoluntaryContextSwitches: 520 (520) Fragment Instance Lifecycle Timings: - ExecTime: 3s274ms - ExecTreeExecTime: 3s274ms - OpenTime: 9.090ms - ExecTreeOpenTime: 1.857ms - PrepareTime: 19.397ms - ExecTreePrepareTime: 84.017us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 26.400us, non-child: 0.000ns, % non-child: 0.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.696ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 0.000ns - CompileTime: 1.410ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 4.902ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 18.903ms KUDU_SCAN_NODE (id=0):(Total: 3s276ms, non-child: 0.000ns, % non-child: 0.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2001571) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 250 (250) - ScannerThreadsTotalWallClockTime: 3s274ms - MaterializeTupleTime(*): 3s274ms - ScannerThreadsSysTime: 60.764ms - ScannerThreadsUserTime: 2s377ms - ScannerThreadsVoluntaryContextSwitches: 507 (507) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:15.860904 14430 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:15.860918 14430 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:15.860916 14446 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=b9424a11e1300d47:7557db3800000003 I1212 11:10:15.860967 14428 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:15.860975 14428 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:15.861157 3396 impala-internal-service.cc:74] ReportExecStatus(): instance_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:15.861162 3396 impala-server.cc:1076] ReportExecStatus() instance_id=b9424a11e1300d47:7557db3800000000 done=true I1212 11:10:15.861169 3396 coordinator.cc:1437] UpdateFragmentExecStatus() instance=b9424a11e1300d47:7557db3800000000 status=0 done=true I1212 11:10:15.861289 5418 impala-internal-service.cc:74] ReportExecStatus(): instance_id=b9424a11e1300d47:7557db3800000003 I1212 11:10:15.861295 5418 impala-server.cc:1076] ReportExecStatus() instance_id=b9424a11e1300d47:7557db3800000003 done=true I1212 11:10:15.861299 5418 coordinator.cc:1437] UpdateFragmentExecStatus() instance=b9424a11e1300d47:7557db3800000003 status=0 done=true I1212 11:10:15.861359 3396 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 50.362us 50.362us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 2s119ms 3s212ms 0 -1 202.00 KB 0 I1212 11:10:15.861485 3396 coordinator.cc:1521] profile for instance_id=b9424a11e1300d47:7557db3800000000 Instance b9424a11e1300d47:7557db3800000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 3s303ms, non-child: 558.888us, % non-child: 0.02%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 3s288ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 3s288ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.721ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 33.566us - ExecTreeExecTime: 12.248us - OpenTime: 3s288ms - ExecTreeOpenTime: 3s288ms - PrepareTime: 14.415ms - ExecTreePrepareTime: 43.203us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 14.062ms, non-child: 14.062ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 13.567ms EXCHANGE_NODE (id=1):(Total: 3s288ms, non-child: 50.362us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.397us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 3s288ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns I1212 11:10:15.861647 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 50.362us 50.362us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s211ms 3s276ms 0 -1 202.00 KB 0 I1212 11:10:15.861659 5418 progress-updater.cc:55] Query b9424a11e1300d47:7557db3800000000 100% Complete (3 out of 3) I1212 11:10:15.861879 5418 coordinator.cc:1521] profile for instance_id=b9424a11e1300d47:7557db3800000003 Instance b9424a11e1300d47:7557db3800000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 3s303ms, non-child: 1.278ms, % non-child: 0.04%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 162.000ns - TotalStorageWaitTime: 2s925ms - TotalThreadsInvoluntaryContextSwitches: 250 (250) - TotalThreadsTotalWallClockTime: 6s558ms - TotalThreadsSysTime: 61.321ms - TotalThreadsUserTime: 2s388ms - TotalThreadsVoluntaryContextSwitches: 520 (520) Fragment Instance Lifecycle Timings: - ExecTime: 3s274ms - ExecTreeExecTime: 3s274ms - OpenTime: 9.090ms - ExecTreeOpenTime: 1.857ms - PrepareTime: 19.397ms - ExecTreePrepareTime: 84.017us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 26.400us, non-child: 26.400us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.696ms, non-child: 25.696ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.410ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 4.902ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 18.903ms KUDU_SCAN_NODE (id=0):(Total: 3s276ms, non-child: 3s276ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2001571) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 250 (250) - ScannerThreadsTotalWallClockTime: 3s274ms - MaterializeTupleTime(*): 3s274ms - ScannerThreadsSysTime: 60.764ms - ScannerThreadsUserTime: 2s377ms - ScannerThreadsVoluntaryContextSwitches: 507 (507) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:15.862298 3396 coordinator.cc:1529] cumulative profile for query_id=b9424a11e1300d47:7557db3800000000 Execution Profile b9424a11e1300d47:7557db3800000000:(Total: 3s303ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance b9424a11e1300d47:7557db3800000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 3s303ms, non-child: 558.888us, % non-child: 0.02%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 3s288ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 3s288ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.721ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 33.566us - ExecTreeExecTime: 12.248us - OpenTime: 3s288ms - ExecTreeOpenTime: 3s288ms - PrepareTime: 14.415ms - ExecTreePrepareTime: 43.203us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 14.062ms, non-child: 14.062ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 13.567ms EXCHANGE_NODE (id=1):(Total: 3s288ms, non-child: 50.362us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.397us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 3s288ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 3s237ms, non-child: 1.518ms, % non-child: 0.05%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 213.61 KB (218736) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 200.000ns - TotalStorageWaitTime: 2s877ms - TotalThreadsInvoluntaryContextSwitches: 235 (235) - TotalThreadsTotalWallClockTime: 6s430ms - TotalThreadsSysTime: 44.630ms - TotalThreadsUserTime: 2s353ms - TotalThreadsVoluntaryContextSwitches: 519 (519) Fragment Instance Lifecycle Timings: - ExecTime: 3s210ms - ExecTreeExecTime: 3s210ms - OpenTime: 9.609ms - ExecTreeOpenTime: 2.009ms - PrepareTime: 17.683ms - ExecTreePrepareTime: 84.466us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 24.427us, non-child: 24.427us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 24.270ms, non-child: 24.270ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.418ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.059ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 17.266ms KUDU_SCAN_NODE (id=0):(Total: 3s211ms, non-child: 3s211ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000405) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 235 (235) - ScannerThreadsTotalWallClockTime: 3s210ms - MaterializeTupleTime(*): 3s210ms - ScannerThreadsSysTime: 44.445ms - ScannerThreadsUserTime: 2s342ms - ScannerThreadsVoluntaryContextSwitches: 505 (505) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance b9424a11e1300d47:7557db3800000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 3s170ms, non-child: 1.996ms, % non-child: 0.06%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 216.000ns - TotalStorageWaitTime: 2s836ms - TotalThreadsInvoluntaryContextSwitches: 201 (201) - TotalThreadsTotalWallClockTime: 6s300ms - TotalThreadsSysTime: 32.115ms - TotalThreadsUserTime: 2s306ms - TotalThreadsVoluntaryContextSwitches: 523 (523) Fragment Instance Lifecycle Timings: - ExecTime: 3s145ms - ExecTreeExecTime: 3s145ms - OpenTime: 10.669ms - ExecTreeOpenTime: 2.417ms - PrepareTime: 14.435ms - ExecTreePrepareTime: 91.982us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 20.010us, non-child: 20.010us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 21.576ms, non-child: 21.576ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.538ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.230ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 14.234ms KUDU_SCAN_NODE (id=0):(Total: 3s146ms, non-child: 3s146ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000022) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 200 (200) - ScannerThreadsTotalWallClockTime: 3s145ms - MaterializeTupleTime(*): 3s144ms - ScannerThreadsSysTime: 32.115ms - ScannerThreadsUserTime: 2s296ms - ScannerThreadsVoluntaryContextSwitches: 506 (506) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec Instance b9424a11e1300d47:7557db3800000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 3s239ms, non-child: 1.279ms, % non-child: 0.04%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 224.000ns - TotalStorageWaitTime: 2s869ms - TotalThreadsInvoluntaryContextSwitches: 255 (255) - TotalThreadsTotalWallClockTime: 6s431ms - TotalThreadsSysTime: 40.456ms - TotalThreadsUserTime: 2s365ms - TotalThreadsVoluntaryContextSwitches: 516 (516) Fragment Instance Lifecycle Timings: - ExecTime: 3s211ms - ExecTreeExecTime: 3s211ms - OpenTime: 9.066ms - ExecTreeOpenTime: 1.752ms - PrepareTime: 19.218ms - ExecTreePrepareTime: 77.400us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 26.872us, non-child: 26.872us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.539ms, non-child: 25.539ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.308ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.045ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 18.663ms KUDU_SCAN_NODE (id=0):(Total: 3s212ms, non-child: 3s212ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (1999622) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 255 (255) - ScannerThreadsTotalWallClockTime: 3s211ms - MaterializeTupleTime(*): 3s211ms - ScannerThreadsSysTime: 40.456ms - ScannerThreadsUserTime: 2s354ms - ScannerThreadsVoluntaryContextSwitches: 504 (504) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Instance b9424a11e1300d47:7557db3800000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 3s303ms, non-child: 1.278ms, % non-child: 0.04%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 162.000ns - TotalStorageWaitTime: 2s925ms - TotalThreadsInvoluntaryContextSwitches: 250 (250) - TotalThreadsTotalWallClockTime: 6s558ms - TotalThreadsSysTime: 61.321ms - TotalThreadsUserTime: 2s388ms - TotalThreadsVoluntaryContextSwitches: 520 (520) Fragment Instance Lifecycle Timings: - ExecTime: 3s274ms - ExecTreeExecTime: 3s274ms - OpenTime: 9.090ms - ExecTreeOpenTime: 1.857ms - PrepareTime: 19.397ms - ExecTreePrepareTime: 84.017us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 26.400us, non-child: 26.400us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.696ms, non-child: 25.696ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.410ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 4.902ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 18.903ms KUDU_SCAN_NODE (id=0):(Total: 3s276ms, non-child: 3s276ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2001571) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 250 (250) - ScannerThreadsTotalWallClockTime: 3s274ms - MaterializeTupleTime(*): 3s274ms - ScannerThreadsSysTime: 60.764ms - ScannerThreadsUserTime: 2s377ms - ScannerThreadsVoluntaryContextSwitches: 507 (507) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:15.862319 3396 coordinator.cc:1546] Fragment instance completed: id=b9424a11e1300d47:7557db3800000000 host=mj-desktop.ca.cloudera.com:22000 remaining=1 I1212 11:10:15.862375 14430 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:15.862634 5418 coordinator.cc:1529] cumulative profile for query_id=b9424a11e1300d47:7557db3800000000 Execution Profile b9424a11e1300d47:7557db3800000000:(Total: 3s303ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance b9424a11e1300d47:7557db3800000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 3s303ms, non-child: 558.888us, % non-child: 0.02%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 3s288ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 3s288ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.721ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 33.566us - ExecTreeExecTime: 12.248us - OpenTime: 3s288ms - ExecTreeOpenTime: 3s288ms - PrepareTime: 14.415ms - ExecTreePrepareTime: 43.203us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 14.062ms, non-child: 14.062ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 13.567ms EXCHANGE_NODE (id=1):(Total: 3s288ms, non-child: 50.362us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.397us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 3s288ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 3s237ms, non-child: 1.518ms, % non-child: 0.05%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 213.61 KB (218736) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 200.000ns - TotalStorageWaitTime: 2s877ms - TotalThreadsInvoluntaryContextSwitches: 235 (235) - TotalThreadsTotalWallClockTime: 6s430ms - TotalThreadsSysTime: 44.630ms - TotalThreadsUserTime: 2s353ms - TotalThreadsVoluntaryContextSwitches: 519 (519) Fragment Instance Lifecycle Timings: - ExecTime: 3s210ms - ExecTreeExecTime: 3s210ms - OpenTime: 9.609ms - ExecTreeOpenTime: 2.009ms - PrepareTime: 17.683ms - ExecTreePrepareTime: 84.466us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 24.427us, non-child: 24.427us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 24.270ms, non-child: 24.270ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.418ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.059ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 17.266ms KUDU_SCAN_NODE (id=0):(Total: 3s211ms, non-child: 3s211ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000405) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 235 (235) - ScannerThreadsTotalWallClockTime: 3s210ms - MaterializeTupleTime(*): 3s210ms - ScannerThreadsSysTime: 44.445ms - ScannerThreadsUserTime: 2s342ms - ScannerThreadsVoluntaryContextSwitches: 505 (505) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance b9424a11e1300d47:7557db3800000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 3s170ms, non-child: 1.996ms, % non-child: 0.06%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 216.000ns - TotalStorageWaitTime: 2s836ms - TotalThreadsInvoluntaryContextSwitches: 201 (201) - TotalThreadsTotalWallClockTime: 6s300ms - TotalThreadsSysTime: 32.115ms - TotalThreadsUserTime: 2s306ms - TotalThreadsVoluntaryContextSwitches: 523 (523) Fragment Instance Lifecycle Timings: - ExecTime: 3s145ms - ExecTreeExecTime: 3s145ms - OpenTime: 10.669ms - ExecTreeOpenTime: 2.417ms - PrepareTime: 14.435ms - ExecTreePrepareTime: 91.982us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 20.010us, non-child: 20.010us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 21.576ms, non-child: 21.576ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.538ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.230ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 14.234ms KUDU_SCAN_NODE (id=0):(Total: 3s146ms, non-child: 3s146ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000022) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 200 (200) - ScannerThreadsTotalWallClockTime: 3s145ms - MaterializeTupleTime(*): 3s144ms - ScannerThreadsSysTime: 32.115ms - ScannerThreadsUserTime: 2s296ms - ScannerThreadsVoluntaryContextSwitches: 506 (506) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec Instance b9424a11e1300d47:7557db3800000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 3s239ms, non-child: 1.279ms, % non-child: 0.04%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 224.000ns - TotalStorageWaitTime: 2s869ms - TotalThreadsInvoluntaryContextSwitches: 255 (255) - TotalThreadsTotalWallClockTime: 6s431ms - TotalThreadsSysTime: 40.456ms - TotalThreadsUserTime: 2s365ms - TotalThreadsVoluntaryContextSwitches: 516 (516) Fragment Instance Lifecycle Timings: - ExecTime: 3s211ms - ExecTreeExecTime: 3s211ms - OpenTime: 9.066ms - ExecTreeOpenTime: 1.752ms - PrepareTime: 19.218ms - ExecTreePrepareTime: 77.400us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 26.872us, non-child: 26.872us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.539ms, non-child: 25.539ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.308ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.045ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 18.663ms KUDU_SCAN_NODE (id=0):(Total: 3s212ms, non-child: 3s212ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (1999622) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 255 (255) - ScannerThreadsTotalWallClockTime: 3s211ms - MaterializeTupleTime(*): 3s211ms - ScannerThreadsSysTime: 40.456ms - ScannerThreadsUserTime: 2s354ms - ScannerThreadsVoluntaryContextSwitches: 504 (504) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Instance b9424a11e1300d47:7557db3800000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 3s303ms, non-child: 1.278ms, % non-child: 0.04%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 162.000ns - TotalStorageWaitTime: 2s925ms - TotalThreadsInvoluntaryContextSwitches: 250 (250) - TotalThreadsTotalWallClockTime: 6s558ms - TotalThreadsSysTime: 61.321ms - TotalThreadsUserTime: 2s388ms - TotalThreadsVoluntaryContextSwitches: 520 (520) Fragment Instance Lifecycle Timings: - ExecTime: 3s274ms - ExecTreeExecTime: 3s274ms - OpenTime: 9.090ms - ExecTreeOpenTime: 1.857ms - PrepareTime: 19.397ms - ExecTreePrepareTime: 84.017us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 26.400us, non-child: 26.400us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.696ms, non-child: 25.696ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.410ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 4.902ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 18.903ms KUDU_SCAN_NODE (id=0):(Total: 3s276ms, non-child: 3s276ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2001571) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 250 (250) - ScannerThreadsTotalWallClockTime: 3s274ms - MaterializeTupleTime(*): 3s274ms - ScannerThreadsSysTime: 60.764ms - ScannerThreadsUserTime: 2s377ms - ScannerThreadsVoluntaryContextSwitches: 507 (507) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:15.862653 5418 coordinator.cc:1546] Fragment instance completed: id=b9424a11e1300d47:7557db3800000003 host=mj-desktop.ca.cloudera.com:22000 remaining=0 I1212 11:10:15.862707 14428 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:15.862874 14428 query-exec-mgr.cc:103] Instance completed. instance_id=b9424a11e1300d47:7557db3800000003 I1212 11:10:15.862880 14428 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=b9424a11e1300d47:7557db3800000000 refcnt=3 I1212 11:10:15.890439 2681 impala-hs2-server.cc:713] GetResultSetMetadata(): query_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:15.890573 2681 impala-hs2-server.cc:753] GetResultSetMetadata(): return_val=TGetResultSetMetadataResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: schema (struct) = TTableSchema { 01: columns (list) = list[16] { [0] = TColumnDesc { 01: columnName (string) = "l_orderkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 0, }, [1] = TColumnDesc { 01: columnName (string) = "l_linenumber", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 3, }, }, }, }, 03: position (i32) = 1, }, [2] = TColumnDesc { 01: columnName (string) = "l_partkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 2, }, [3] = TColumnDesc { 01: columnName (string) = "l_suppkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 3, }, [4] = TColumnDesc { 01: columnName (string) = "l_quantity", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 4, }, [5] = TColumnDesc { 01: columnName (string) = "l_extendedprice", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 5, }, [6] = TColumnDesc { 01: columnName (string) = "l_discount", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 6, }, [7] = TColumnDesc { 01: columnName (string) = "l_tax", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 7, }, [8] = TColumnDesc { 01: columnName (string) = "l_returnflag", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 8, }, [9] = TColumnDesc { 01: columnName (string) = "l_linestatus", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 9, }, [10] = TColumnDesc { 01: columnName (string) = "l_shipdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 10, }, [11] = TColumnDesc { 01: columnName (string) = "l_commitdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 11, }, [12] = TColumnDesc { 01: columnName (string) = "l_receiptdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 12, }, [13] = TColumnDesc { 01: columnName (string) = "l_shipinstruct", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 13, }, [14] = TColumnDesc { 01: columnName (string) = "l_shipmode", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 14, }, [15] = TColumnDesc { 01: columnName (string) = "l_comment", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 15, }, }, }, } I1212 11:10:15.890869 2681 coordinator.cc:1069] All fragment instances finished successfully. I1212 11:10:15.890950 14430 data-stream-mgr.cc:226] DeregisterRecvr(): fragment_instance_id=b9424a11e1300d47:7557db3800000000, node=1 I1212 11:10:15.890964 14430 data-stream-recvr.cc:237] cancelled stream: fragment_instance_id_=b9424a11e1300d47:7557db3800000000 node_id=1 I1212 11:10:15.891010 14430 query-exec-mgr.cc:103] Instance completed. instance_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:15.891012 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 50.362us 50.362us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s211ms 3s276ms 0 -1 202.00 KB 0 I1212 11:10:15.891016 14430 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=b9424a11e1300d47:7557db3800000000 refcnt=2 I1212 11:10:15.891265 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 50.362us 50.362us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s211ms 3s276ms 0 -1 202.00 KB 0 I1212 11:10:15.891445 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 50.362us 50.362us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s211ms 3s276ms 0 -1 202.00 KB 0 I1212 11:10:15.891644 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 50.362us 50.362us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s211ms 3s276ms 0 -1 202.00 KB 0 I1212 11:10:15.891969 2681 impala-hs2-server.cc:688] CloseOperation(): query_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:15.891973 2681 impala-server.cc:907] UnregisterQuery(): query_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:15.891976 2681 impala-server.cc:993] Cancel(): query_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:15.891980 2681 coordinator.cc:1362] Cancel() query_id=b9424a11e1300d47:7557db3800000000 I1212 11:10:15.891988 2681 coordinator.cc:1428] CancelFragmentInstances() query_id=b9424a11e1300d47:7557db3800000000, tried to cancel 0 fragment instances I1212 11:10:15.892051 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 50.362us 50.362us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s211ms 3s276ms 0 -1 202.00 KB 0 I1212 11:10:15.892189 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 50.362us 50.362us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s211ms 3s276ms 0 -1 202.00 KB 0 I1212 11:10:15.892318 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 50.362us 50.362us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s211ms 3s276ms 0 -1 202.00 KB 0 I1212 11:10:15.892444 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 50.362us 50.362us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s211ms 3s276ms 0 -1 202.00 KB 0 I1212 11:10:15.892521 2681 admission-controller.cc:538] Released query id=b9424a11e1300d47:7557db3800000000 agg_num_running=1, agg_num_queued=0, agg_mem_reserved=3.00 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=1.00 MB) I1212 11:10:15.892531 2681 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=b9424a11e1300d47:7557db3800000000 refcnt=1 I1212 11:10:15.899127 2681 impala-hs2-server.cc:414] ExecuteStatement(): request=TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "&\xe4\xc0Y\baF\x12\xbb\xb0\x10\x91\xd2m\xf3\x03", 02: secret (string) = "9V#\x13\xa6\xe3F\xcb\x86\xf56\xf5B\xe0\x1e\n", }, }, 02: statement (string) = "select * from lineitem limit 90", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "1m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:15.899144 2681 impala-hs2-server.cc:228] TExecuteStatementReq: TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "&\xe4\xc0Y\baF\x12\xbb\xb0\x10\x91\xd2m\xf3\x03", 02: secret (string) = "9V#\x13\xa6\xe3F\xcb\x86\xf56\xf5B\xe0\x1e\n", }, }, 02: statement (string) = "select * from lineitem limit 90", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "1m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:15.899179 2681 impala-server.cc:742] Parsed pool options: override_options_mask=1111111111111111111111111111111110111111111111111111111111000010 set_pool_mask=0000000000000000000000000000000000000000000000000000000000000000 overlay_mask=0000000000000000000000000000000000000000000000000000000000000000 I1212 11:10:15.899207 2681 impala-hs2-server.cc:261] TClientRequest.queryOptions: TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 1048576, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, } I1212 11:10:15.901099 2681 mem-tracker.cc:184] Using query memory limit: 1.00 MB I1212 11:10:15.906219 14486 AsyncKuduClient.java:1367] Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) I1212 11:10:15.909039 14487 AsyncKuduClient.java:1367] Learned about tablet de1fe37fdb46438abfbc154bf7fb439b for table 'impala::ucu3e4.lineitem' with partition [, 0x00000001) I1212 11:10:15.909274 14487 AsyncKuduClient.java:1367] Learned about tablet 91d0d8d3b0e34afc9d7fa522e61f40ef for table 'impala::ucu3e4.lineitem' with partition [0x00000001, 0x00000002) I1212 11:10:15.909466 14487 AsyncKuduClient.java:1367] Learned about tablet dc26b34fb84d4ff8baae3f44b23f0ae2 for table 'impala::ucu3e4.lineitem' with partition [0x00000002, ) I1212 11:10:15.914692 2681 impala-server.cc:812] Execution request: TExecRequest { 01: stmt_type (i32) = 0, 02: query_options (struct) = TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 1048576, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 44: mt_dop (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, }, 03: query_exec_request (struct) = TQueryExecRequest { 01: desc_tbl (struct) = TDescriptorTable { 01: slotDescriptors (list) = list[16] { [0] = TSlotDescriptor { 01: id (i32) = 0, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 0, }, 06: byteOffset (i32) = 128, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 8, }, [1] = TSlotDescriptor { 01: id (i32) = 1, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 1, }, 06: byteOffset (i32) = 184, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 15, }, [2] = TSlotDescriptor { 01: id (i32) = 2, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 2, }, 06: byteOffset (i32) = 136, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 9, }, [3] = TSlotDescriptor { 01: id (i32) = 3, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 3, }, 06: byteOffset (i32) = 144, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 10, }, [4] = TSlotDescriptor { 01: id (i32) = 4, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 4, }, 06: byteOffset (i32) = 152, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 11, }, [5] = TSlotDescriptor { 01: id (i32) = 5, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 5, }, 06: byteOffset (i32) = 160, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 12, }, [6] = TSlotDescriptor { 01: id (i32) = 6, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 6, }, 06: byteOffset (i32) = 168, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 13, }, [7] = TSlotDescriptor { 01: id (i32) = 7, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 7, }, 06: byteOffset (i32) = 176, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 14, }, [8] = TSlotDescriptor { 01: id (i32) = 8, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 8, }, 06: byteOffset (i32) = 0, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 0, 09: slotIdx (i32) = 0, }, [9] = TSlotDescriptor { 01: id (i32) = 9, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 9, }, 06: byteOffset (i32) = 16, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 1, }, [10] = TSlotDescriptor { 01: id (i32) = 10, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 10, }, 06: byteOffset (i32) = 32, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 2, }, [11] = TSlotDescriptor { 01: id (i32) = 11, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 11, }, 06: byteOffset (i32) = 48, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 3, }, [12] = TSlotDescriptor { 01: id (i32) = 12, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 12, }, 06: byteOffset (i32) = 64, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 4, }, [13] = TSlotDescriptor { 01: id (i32) = 13, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 13, }, 06: byteOffset (i32) = 80, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 5, }, [14] = TSlotDescriptor { 01: id (i32) = 14, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 14, }, 06: byteOffset (i32) = 96, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 6, }, [15] = TSlotDescriptor { 01: id (i32) = 15, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 15, }, 06: byteOffset (i32) = 112, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 7, 09: slotIdx (i32) = 7, }, }, 02: tupleDescriptors (list) = list[1] { [0] = TTupleDescriptor { 01: id (i32) = 0, 02: byteSize (i32) = 190, 03: numNullBytes (i32) = 2, 04: tableId (i32) = 1, 05: tuplePath (list) = list[0] { }, }, }, 03: tableDescriptors (list) = list[1] { [0] = TTableDescriptor { 01: id (i32) = 1, 02: tableType (i32) = 4, 03: columnDescriptors (list) = list[16] { [0] = TColumnDescriptor { 01: name (string) = "l_orderkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [1] = TColumnDescriptor { 01: name (string) = "l_linenumber", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, }, [2] = TColumnDescriptor { 01: name (string) = "l_partkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [3] = TColumnDescriptor { 01: name (string) = "l_suppkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [4] = TColumnDescriptor { 01: name (string) = "l_quantity", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [5] = TColumnDescriptor { 01: name (string) = "l_extendedprice", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [6] = TColumnDescriptor { 01: name (string) = "l_discount", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [7] = TColumnDescriptor { 01: name (string) = "l_tax", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [8] = TColumnDescriptor { 01: name (string) = "l_returnflag", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [9] = TColumnDescriptor { 01: name (string) = "l_linestatus", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [10] = TColumnDescriptor { 01: name (string) = "l_shipdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [11] = TColumnDescriptor { 01: name (string) = "l_commitdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [12] = TColumnDescriptor { 01: name (string) = "l_receiptdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [13] = TColumnDescriptor { 01: name (string) = "l_shipinstruct", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [14] = TColumnDescriptor { 01: name (string) = "l_shipmode", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [15] = TColumnDescriptor { 01: name (string) = "l_comment", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, }, 04: numClusteringCols (i32) = 0, 07: tableName (string) = "impala::ucu3e4.lineitem", 08: dbName (string) = "ucu3e4", 10: kuduTable (struct) = TKuduTable { 01: table_name (string) = "impala::ucu3e4.lineitem", 02: master_addresses (list) = list[1] { [0] = "127.0.0.1", }, 03: key_columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 04: partition_by (list) = list[1] { [0] = TKuduPartitionParam { 01: by_hash_param (struct) = TKuduPartitionByHashParam { 01: columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 02: num_partitions (i32) = 3, }, }, }, }, }, }, }, 02: plan_exec_info (list) = list[1] { [0] = TPlanExecInfo { 01: fragments (list) = list[2] { [0] = TPlanFragment { 01: idx (i32) = 0, 02: display_name (string) = "F01", 03: plan (struct) = TPlan { 01: nodes (list) = list[1] { [0] = TPlanNode { 01: node_id (i32) = 1, 02: node_type (i32) = 6, 03: num_children (i32) = 0, 04: limit (i64) = 90, 05: row_tuples (list) = list[1] { [0] = 0, }, 06: nullable_tuples (list) = list[1] { [0] = false, }, 08: disable_codegen (bool) = false, 18: exchange_node (struct) = TExchangeNode { 01: input_row_tuples (list) = list[1] { [0] = 0, }, }, 21: label (string) = "01:EXCHANGE", 22: label_detail (string) = "UNPARTITIONED", 23: estimated_stats (struct) = TExecStats { 03: cardinality (i64) = 90, 04: memory_used (i64) = -1, }, }, }, }, 04: output_exprs (list) = list[16] { [0] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 0, }, }, }, }, [1] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 1, }, }, }, }, [2] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 2, }, }, }, }, [3] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 3, }, }, }, }, [4] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 4, }, }, }, }, [5] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 5, }, }, }, }, [6] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 6, }, }, }, }, [7] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 7, }, }, }, }, [8] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12 I1212 11:10:15.914960 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22000(local selection) I1212 11:10:15.914980 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22001(local selection) I1212 11:10:15.914995 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22002(local selection) I1212 11:10:15.914999 2681 simple-scheduler.cc:979] Total remote scan volume = 0 I1212 11:10:15.915005 2681 simple-scheduler.cc:981] Total local scan volume = 2.93 KB I1212 11:10:15.915007 2681 simple-scheduler.cc:983] Total cached scan volume = 0 I1212 11:10:15.915015 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22002, } I1212 11:10:15.915025 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:15.915030 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22001, } I1212 11:10:15.915036 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](479)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:15.915040 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, } I1212 11:10:15.915046 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:15.915097 2681 admission-controller.cc:440] Schedule for id=56430dcd9ad85bae:dd5e90f000000000 in pool_name=default-pool cluster_mem_needed=3.00 MB PoolConfig: max_requests=-1 max_queued=200 max_mem=-1.00 B I1212 11:10:15.915117 2681 admission-controller.cc:445] Stats: agg_num_running=1, agg_num_queued=0, agg_mem_reserved=3.00 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=1.00 MB) I1212 11:10:15.915122 2681 admission-controller.cc:451] Admitted query id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.915141 2681 admission-controller.cc:457] Final: agg_num_running=2, agg_num_queued=0, agg_mem_reserved=3.00 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=2, num_queued=0, backend_mem_reserved=1.00 MB) I1212 11:10:15.915166 2681 coordinator.cc:447] Exec() query_id=56430dcd9ad85bae:dd5e90f000000000 stmt=select * from lineitem limit 90 I1212 11:10:15.915215 2681 mem-tracker.cc:184] Using query memory limit: 1.00 MB I1212 11:10:15.915326 2681 coordinator.cc:602] starting 4 fragment instances for query 56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.915407 2681 coordinator.cc:737] ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- I1212 11:10:15.915544 2563 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22002 instance_id=56430dcd9ad85bae:dd5e90f000000001 I1212 11:10:15.915551 2563 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22002) I1212 11:10:15.915556 2563 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22002 I1212 11:10:15.915565 2572 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.915573 2572 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:15.915577 2572 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:15.915593 2561 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22001 instance_id=56430dcd9ad85bae:dd5e90f000000002 I1212 11:10:15.915598 2561 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22001) I1212 11:10:15.915601 2561 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22001 I1212 11:10:15.915616 2571 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=56430dcd9ad85bae:dd5e90f000000003 I1212 11:10:15.915622 2571 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:15.915627 2571 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:15.915829 3396 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.915837 3396 query-exec-mgr.cc:45] StartFInstance() instance_id=56430dcd9ad85bae:dd5e90f000000000 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:15.915839 5418 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=56430dcd9ad85bae:dd5e90f000000003 I1212 11:10:15.915844 5418 query-exec-mgr.cc:45] StartFInstance() instance_id=56430dcd9ad85bae:dd5e90f000000003 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:15.915853 3396 query-exec-mgr.cc:69] new QueryState: query_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.915858 3396 query-exec-mgr.cc:77] QueryState: query_id=56430dcd9ad85bae:dd5e90f000000000 refcnt=1 I1212 11:10:15.915863 5418 query-exec-mgr.cc:77] QueryState: query_id=56430dcd9ad85bae:dd5e90f000000000 refcnt=2 I1212 11:10:15.915895 5418 query-state.cc:58] RegisterFInstance(): instance_id=56430dcd9ad85bae:dd5e90f000000003 I1212 11:10:15.915899 3396 query-state.cc:58] RegisterFInstance(): instance_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.915958 5418 thread.cc:288] Started thread 14499 - query-exec-mgr:exec-fragment-instance-56430dcd9ad85bae:dd5e90f000000003 I1212 11:10:15.915961 14499 plan-fragment-executor.cc:123] Prepare(): instance_id=56430dcd9ad85bae:dd5e90f000000003 I1212 11:10:15.915993 2571 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=56430dcd9ad85bae:dd5e90f000000003 I1212 11:10:15.915995 14499 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 6215827087418743726, 02: lo (i64) = -2495397783050125309, }, 02: per_fragment_instance_idx (i32) = 2, 03: per_node_scan_ranges (map) = map[1] { 0 -> list[1] { [0] = TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, }, }, }, 04: per_exch_num_senders (map) = map[0] { }, 05: destinations (list) = list[1] { [0] = TPlanFragmentDestination { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 6215827087418743726, 02: lo (i64) = -2495397783050125312, }, 02: server (struct) = TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, }, }, }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = 2, } I1212 11:10:15.915999 2571 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:15.916033 2563 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=56430dcd9ad85bae:dd5e90f000000001 I1212 11:10:15.916039 2563 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22002 back to cache I1212 11:10:15.916048 14499 plan-fragment-executor.cc:145] Using query memory limit from query options: 1.00 MB I1212 11:10:15.916052 14499 mem-tracker.cc:184] Using query memory limit: 1.00 MB I1212 11:10:15.916210 14499 plan-fragment-executor.cc:174] descriptor table for fragment=56430dcd9ad85bae:dd5e90f000000003 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:15.916311 14499 plan-fragment-executor.cc:285] Hdfs split stats (:<# splits>/) for query=56430dcd9ad85bae:dd5e90f000000000: I1212 11:10:15.916368 14499 thread.cc:288] Started thread 14506 - DataStreamSender:SenderThread(1:1) I1212 11:10:15.916371 14501 plan-fragment-executor.cc:123] Prepare(): instance_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.916373 3396 thread.cc:288] Started thread 14501 - query-exec-mgr:exec-fragment-instance-56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.916399 14501 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 6215827087418743726, 02: lo (i64) = -2495397783050125312, }, 02: per_fragment_instance_idx (i32) = 0, 03: per_node_scan_ranges (map) = map[0] { }, 04: per_exch_num_senders (map) = map[1] { 1 -> 3, }, 05: destinations (list) = list[0] { }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = -1, } I1212 11:10:15.916417 2572 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.916424 2572 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:15.916432 2561 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=56430dcd9ad85bae:dd5e90f000000002 I1212 11:10:15.916438 2561 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22001 back to cache I1212 11:10:15.916466 14501 plan-fragment-executor.cc:145] Using query memory limit from query options: 1.00 MB I1212 11:10:15.916471 14501 mem-tracker.cc:184] Using query memory limit: 1.00 MB I1212 11:10:15.916568 14501 plan-fragment-executor.cc:174] descriptor table for fragment=56430dcd9ad85bae:dd5e90f000000000 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:15.916607 14501 data-stream-mgr.cc:80] creating receiver for fragment=56430dcd9ad85bae:dd5e90f000000000, node=1 I1212 11:10:15.918313 2681 coordinator.cc:640] started 4 fragment instances for query 56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.918354 2681 query-exec-mgr.cc:123] GetQueryState(): query_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.918359 2681 query-state.cc:65] GetFInstanceState(): instance_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.930013 14501 plan-fragment-executor.cc:261] plan_root= ExchangeNode(#senders=3 conjuncts=[]) I1212 11:10:15.930034 14501 plan-fragment-executor.cc:296] Open(): instance_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.930064 2681 coordinator.cc:1181] Byte split for fragment 1 min: 0, max: 0, avg: 0, stddev: 0 I1212 11:10:15.930073 2681 coordinator.cc:1184] data volume for ipaddress 0xcd1b440: 0 I1212 11:10:15.930090 2681 coordinator.cc:1184] data volume for ipaddress 0xbf4f440: 0 I1212 11:10:15.930094 2681 coordinator.cc:1184] data volume for ipaddress 0xbfed4e0: 0 I1212 11:10:15.930160 14501 thread.cc:288] Started thread 14509 - plan-fragment-executor:report-profile I1212 11:10:15.930161 14509 plan-fragment-executor.cc:378] ReportProfileThread(): instance_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.930666 2681 thread.cc:288] Started thread 14512 - query-exec-state:wait-thread I1212 11:10:15.930717 2681 impala-hs2-server.cc:486] ExecuteStatement(): return_val=TExecuteStatementResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: operationHandle (struct) = TOperationHandle { 01: operationId (struct) = THandleIdentifier { 01: guid (string) = "\xae[\xd8\x9a\xcd\rCV\x00\x00\x00\x00\xf0\x90^\xdd", 02: secret (string) = "\xae[\xd8\x9a\xcd\rCV\x00\x00\x00\x00\xf0\x90^\xdd", }, 02: operationType (i32) = 0, 03: hasResultSet (bool) = true, }, } I1212 11:10:15.938050 14499 plan-fragment-executor.cc:261] plan_root= KuduScanNode(tupleid=0) I1212 11:10:15.938069 14499 plan-fragment-executor.cc:296] Open(): instance_id=56430dcd9ad85bae:dd5e90f000000003 I1212 11:10:15.938174 14520 plan-fragment-executor.cc:378] ReportProfileThread(): instance_id=56430dcd9ad85bae:dd5e90f000000003 I1212 11:10:15.938176 14499 thread.cc:288] Started thread 14520 - plan-fragment-executor:report-profile I1212 11:10:15.939776 14499 kudu-scan-node.cc:128] Latest observed Kudu timestamp: 0 I1212 11:10:15.940347 14501 exchange-node.cc:139] exch: has batch=true #rows=90 is_cancelled=false instance_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.940448 3766 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=56430dcd9ad85bae:dd5e90f000000000, node=1 I1212 11:10:15.940457 3766 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=56430dcd9ad85bae:dd5e90f000000000 node_id=1 #senders=2 I1212 11:10:15.940491 14499 kudu-scan-node.cc:248] Thread started: scanner-thread(1) I1212 11:10:15.940613 14499 thread.cc:288] Started thread 14535 - kudu-scan-node:scanner-thread(1) I1212 11:10:15.940963 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=56430dcd9ad85bae:dd5e90f000000001 I1212 11:10:15.940975 3766 impala-server.cc:1076] ReportExecStatus() instance_id=56430dcd9ad85bae:dd5e90f000000001 done=true I1212 11:10:15.940984 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=56430dcd9ad85bae:dd5e90f000000001 status=0 done=true I1212 11:10:15.941064 14535 kudu-scanner.cc:148] Starting KuduScanner with ReadMode=0 timeout=180000 I1212 11:10:15.941486 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 0.000ns 0.000ns 0 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3.232ms 9.696ms 90 90 776.00 KB 0 I1212 11:10:15.941624 2681 impala-hs2-server.cc:713] GetResultSetMetadata(): query_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.941718 3766 coordinator.cc:1521] profile for instance_id=56430dcd9ad85bae:dd5e90f000000001 Instance 56430dcd9ad85bae:dd5e90f000000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 24.438ms, non-child: 997.234us, % non-child: 4.08%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 247.487us - TotalStorageWaitTime: 6.331ms - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 10.448ms - TotalThreadsSysTime: 3.778ms - TotalThreadsUserTime: 1.155ms - TotalThreadsVoluntaryContextSwitches: 13 (13) Fragment Instance Lifecycle Timings: - ExecTime: 8.557ms - ExecTreeExecTime: 7.947ms - OpenTime: 1.904ms - ExecTreeOpenTime: 1.717ms - PrepareTime: 13.935ms - ExecTreePrepareTime: 45.881us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 278.242us, non-child: 278.242us, % non-child: 100.00%) - BytesSent: 11.04 KB (11309) - NetworkThroughput(*): 263.86 MB/sec - OverallThroughput: 38.76 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 216.206us - TransmitDataRPCTime: 40.875us - UncompressedRowBatchSize: 23.62 KB (24188) CodeGen:(Total: 13.466ms, non-child: 13.466ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.951ms KUDU_SCAN_NODE (id=0):(Total: 9.696ms, non-child: 9.696ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 776.00 KB (794624) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 9.28 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 7.943ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:15.941802 2681 impala-hs2-server.cc:753] GetResultSetMetadata(): return_val=TGetResultSetMetadataResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: schema (struct) = TTableSchema { 01: columns (list) = list[16] { [0] = TColumnDesc { 01: columnName (string) = "l_orderkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 0, }, [1] = TColumnDesc { 01: columnName (string) = "l_linenumber", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 3, }, }, }, }, 03: position (i32) = 1, }, [2] = TColumnDesc { 01: columnName (string) = "l_partkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 2, }, [3] = TColumnDesc { 01: columnName (string) = "l_suppkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 3, }, [4] = TColumnDesc { 01: columnName (string) = "l_quantity", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 4, }, [5] = TColumnDesc { 01: columnName (string) = "l_extendedprice", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 5, }, [6] = TColumnDesc { 01: columnName (string) = "l_discount", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 6, }, [7] = TColumnDesc { 01: columnName (string) = "l_tax", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 7, }, [8] = TColumnDesc { 01: columnName (string) = "l_returnflag", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 8, }, [9] = TColumnDesc { 01: columnName (string) = "l_linestatus", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 9, }, [10] = TColumnDesc { 01: columnName (string) = "l_shipdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 10, }, [11] = TColumnDesc { 01: columnName (string) = "l_commitdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 11, }, [12] = TColumnDesc { 01: columnName (string) = "l_receiptdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 12, }, [13] = TColumnDesc { 01: columnName (string) = "l_shipinstruct", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 13, }, [14] = TColumnDesc { 01: columnName (string) = "l_shipmode", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 14, }, [15] = TColumnDesc { 01: columnName (string) = "l_comment", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 15, }, }, }, } I1212 11:10:15.942013 3766 coordinator.cc:1529] cumulative profile for query_id=56430dcd9ad85bae:dd5e90f000000000 Execution Profile 56430dcd9ad85bae:dd5e90f000000000:(Total: 24.646ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Averaged Fragment F00:(Total: 24.438ms, non-child: 997.234us, % non-child: 4.08%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 247.487us - TotalStorageWaitTime: 6.331ms - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 10.448ms - TotalThreadsSysTime: 3.778ms - TotalThreadsUserTime: 1.155ms - TotalThreadsVoluntaryContextSwitches: 13 (13) Fragment Instance Lifecycle Timings: - ExecTime: 8.557ms - ExecTreeExecTime: 7.947ms - OpenTime: 1.904ms - ExecTreeOpenTime: 1.717ms - PrepareTime: 13.935ms - ExecTreePrepareTime: 45.881us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 278.242us, non-child: 278.242us, % non-child: 100.00%) - BytesSent: 11.04 KB (11309) - NetworkThroughput(*): 263.86 MB/sec - OverallThroughput: 38.76 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 216.206us - TransmitDataRPCTime: 40.875us - UncompressedRowBatchSize: 23.62 KB (24188) CodeGen:(Total: 13.466ms, non-child: 13.466ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.951ms KUDU_SCAN_NODE (id=0):(Total: 9.696ms, non-child: 9.696ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 776.00 KB (794624) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 9.28 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 7.943ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 56430dcd9ad85bae:dd5e90f000000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 24.438ms, non-child: 997.234us, % non-child: 4.08%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 247.487us - TotalStorageWaitTime: 6.331ms - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 10.448ms - TotalThreadsSysTime: 3.778ms - TotalThreadsUserTime: 1.155ms - TotalThreadsVoluntaryContextSwitches: 13 (13) Fragment Instance Lifecycle Timings: - ExecTime: 8.557ms - ExecTreeExecTime: 7.947ms - OpenTime: 1.904ms - ExecTreeOpenTime: 1.717ms - PrepareTime: 13.935ms - ExecTreePrepareTime: 45.881us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 278.242us, non-child: 278.242us, % non-child: 100.00%) - BytesSent: 11.04 KB (11309) - NetworkThroughput(*): 263.86 MB/sec - OverallThroughput: 38.76 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 216.206us - TransmitDataRPCTime: 40.875us - UncompressedRowBatchSize: 23.62 KB (24188) CodeGen:(Total: 13.466ms, non-child: 13.466ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.951ms KUDU_SCAN_NODE (id=0):(Total: 9.696ms, non-child: 9.696ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 776.00 KB (794624) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 9.28 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 7.943ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:15.942032 3766 coordinator.cc:1546] Fragment instance completed: id=56430dcd9ad85bae:dd5e90f000000001 host=mj-desktop.ca.cloudera.com:22002 remaining=3 I1212 11:10:15.942035 3766 coordinator.cc:1556] query_id=56430dcd9ad85bae:dd5e90f000000000: first in-progress backend: mj-desktop.ca.cloudera.com:22000 I1212 11:10:15.942625 2681 coordinator.cc:1064] Coordinator waiting for fragment instances to finish, 3 remaining I1212 11:10:15.942632 14509 plan-fragment-executor.cc:408] Reporting final profile for instance 56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.942757 14509 plan-fragment-executor.cc:412] Fragment 56430dcd9ad85bae:dd5e90f000000000:(Total: 26.176ms, non-child: 0.000ns, % non-child: 0.00%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 31.97 KB (32736) - PerHostPeakMemUsage: 0 - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 10.137ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 12.552ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 4.022ms - TotalThreadsVoluntaryContextSwitches: 6 (6) Fragment Instance Lifecycle Timings: - ExecTime: 2.194ms - ExecTreeExecTime: 22.673us - OpenTime: 10.369ms - ExecTreeOpenTime: 10.193ms - PrepareTime: 13.562ms - ExecTreePrepareTime: 50.385us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 13.236ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.707ms EXCHANGE_NODE (id=1):(Total: 10.212ms, non-child: 0.000ns, % non-child: 0.00%) - BytesReceived: 11.04 KB (11309) - ConvertRowBatchTime: 20.159us - DeserializeRowBatchTimer: 72.030us - FirstBatchArrivalWaitTime: 10.134ms - PeakMemoryUsage: 0 - RowsReturned: 90 (90) - RowsReturnedRate: 8.81 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns I1212 11:10:15.942760 14509 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.942801 14501 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:15.942807 14501 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:15.943070 5418 impala-internal-service.cc:74] ReportExecStatus(): instance_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.943079 5418 impala-server.cc:1076] ReportExecStatus() instance_id=56430dcd9ad85bae:dd5e90f000000000 done=true I1212 11:10:15.943086 5418 coordinator.cc:1437] UpdateFragmentExecStatus() instance=56430dcd9ad85bae:dd5e90f000000000 status=0 done=true I1212 11:10:15.943331 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 77.612us 77.612us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3.232ms 9.696ms 90 90 776.00 KB 0 I1212 11:10:15.943495 5418 coordinator.cc:1521] profile for instance_id=56430dcd9ad85bae:dd5e90f000000000 Instance 56430dcd9ad85bae:dd5e90f000000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 26.176ms, non-child: 2.728ms, % non-child: 10.42%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 31.97 KB (32736) - PerHostPeakMemUsage: 40.64 KB (41616) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 10.137ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 12.552ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 4.022ms - TotalThreadsVoluntaryContextSwitches: 6 (6) Fragment Instance Lifecycle Timings: - ExecTime: 2.194ms - ExecTreeExecTime: 22.673us - OpenTime: 10.369ms - ExecTreeOpenTime: 10.193ms - PrepareTime: 13.562ms - ExecTreePrepareTime: 50.385us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 13.236ms, non-child: 13.236ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.707ms EXCHANGE_NODE (id=1):(Total: 10.212ms, non-child: 77.612us, % non-child: 0.76%) - BytesReceived: 11.04 KB (11309) - ConvertRowBatchTime: 20.159us - DeserializeRowBatchTimer: 72.030us - FirstBatchArrivalWaitTime: 10.134ms - PeakMemoryUsage: 0 - RowsReturned: 90 (90) - RowsReturnedRate: 8.81 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns I1212 11:10:15.944150 5418 coordinator.cc:1529] cumulative profile for query_id=56430dcd9ad85bae:dd5e90f000000000 Execution Profile 56430dcd9ad85bae:dd5e90f000000000:(Total: 24.646ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance 56430dcd9ad85bae:dd5e90f000000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 26.176ms, non-child: 2.728ms, % non-child: 10.42%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 31.97 KB (32736) - PerHostPeakMemUsage: 40.64 KB (41616) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 10.137ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 12.552ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 4.022ms - TotalThreadsVoluntaryContextSwitches: 6 (6) Fragment Instance Lifecycle Timings: - ExecTime: 2.194ms - ExecTreeExecTime: 22.673us - OpenTime: 10.369ms - ExecTreeOpenTime: 10.193ms - PrepareTime: 13.562ms - ExecTreePrepareTime: 50.385us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 13.236ms, non-child: 13.236ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.707ms EXCHANGE_NODE (id=1):(Total: 10.212ms, non-child: 77.612us, % non-child: 0.76%) - BytesReceived: 11.04 KB (11309) - ConvertRowBatchTime: 20.159us - DeserializeRowBatchTimer: 72.030us - FirstBatchArrivalWaitTime: 10.134ms - PeakMemoryUsage: 0 - RowsReturned: 90 (90) - RowsReturnedRate: 8.81 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 24.438ms, non-child: 997.234us, % non-child: 4.08%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 247.487us - TotalStorageWaitTime: 6.331ms - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 10.448ms - TotalThreadsSysTime: 3.778ms - TotalThreadsUserTime: 1.155ms - TotalThreadsVoluntaryContextSwitches: 13 (13) Fragment Instance Lifecycle Timings: - ExecTime: 8.557ms - ExecTreeExecTime: 7.947ms - OpenTime: 1.904ms - ExecTreeOpenTime: 1.717ms - PrepareTime: 13.935ms - ExecTreePrepareTime: 45.881us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 278.242us, non-child: 278.242us, % non-child: 100.00%) - BytesSent: 11.04 KB (11309) - NetworkThroughput(*): 263.86 MB/sec - OverallThroughput: 38.76 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 216.206us - TransmitDataRPCTime: 40.875us - UncompressedRowBatchSize: 23.62 KB (24188) CodeGen:(Total: 13.466ms, non-child: 13.466ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.951ms KUDU_SCAN_NODE (id=0):(Total: 9.696ms, non-child: 9.696ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 776.00 KB (794624) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 9.28 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 7.943ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 56430dcd9ad85bae:dd5e90f000000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 24.438ms, non-child: 997.234us, % non-child: 4.08%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 247.487us - TotalStorageWaitTime: 6.331ms - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 10.448ms - TotalThreadsSysTime: 3.778ms - TotalThreadsUserTime: 1.155ms - TotalThreadsVoluntaryContextSwitches: 13 (13) Fragment Instance Lifecycle Timings: - ExecTime: 8.557ms - ExecTreeExecTime: 7.947ms - OpenTime: 1.904ms - ExecTreeOpenTime: 1.717ms - PrepareTime: 13.935ms - ExecTreePrepareTime: 45.881us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 278.242us, non-child: 278.242us, % non-child: 100.00%) - BytesSent: 11.04 KB (11309) - NetworkThroughput(*): 263.86 MB/sec - OverallThroughput: 38.76 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 216.206us - TransmitDataRPCTime: 40.875us - UncompressedRowBatchSize: 23.62 KB (24188) CodeGen:(Total: 13.466ms, non-child: 13.466ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.951ms KUDU_SCAN_NODE (id=0):(Total: 9.696ms, non-child: 9.696ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 776.00 KB (794624) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 9.28 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 7.943ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:15.944176 5418 coordinator.cc:1546] Fragment instance completed: id=56430dcd9ad85bae:dd5e90f000000000 host=mj-desktop.ca.cloudera.com:22000 remaining=2 I1212 11:10:15.944180 5418 coordinator.cc:1556] query_id=56430dcd9ad85bae:dd5e90f000000000: first in-progress backend: mj-desktop.ca.cloudera.com:22001 I1212 11:10:15.944231 14501 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:15.944257 14501 data-stream-mgr.cc:226] DeregisterRecvr(): fragment_instance_id=56430dcd9ad85bae:dd5e90f000000000, node=1 I1212 11:10:15.944267 14501 data-stream-recvr.cc:237] cancelled stream: fragment_instance_id_=56430dcd9ad85bae:dd5e90f000000000 node_id=1 I1212 11:10:15.944306 14501 query-exec-mgr.cc:103] Instance completed. instance_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.944309 14501 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=56430dcd9ad85bae:dd5e90f000000000 refcnt=3 I1212 11:10:15.951172 3769 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=56430dcd9ad85bae:dd5e90f000000000, node=1 I1212 11:10:15.951767 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=56430dcd9ad85bae:dd5e90f000000002 I1212 11:10:15.951772 3769 impala-server.cc:1076] ReportExecStatus() instance_id=56430dcd9ad85bae:dd5e90f000000002 done=true I1212 11:10:15.951778 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=56430dcd9ad85bae:dd5e90f000000002 status=0 done=true I1212 11:10:15.952134 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 77.612us 77.612us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 7.394ms 12.488ms 180 90 1.13 MB 0 I1212 11:10:15.952291 3769 coordinator.cc:1521] profile for instance_id=56430dcd9ad85bae:dd5e90f000000002 Instance 56430dcd9ad85bae:dd5e90f000000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 34.770ms, non-child: 1.100ms, % non-child: 3.16%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 195.874us - TotalStorageWaitTime: 8.019ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 13.151ms - TotalThreadsSysTime: 4.264ms - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 12 (12) Fragment Instance Lifecycle Timings: - ExecTime: 10.988ms - ExecTreeExecTime: 10.402ms - OpenTime: 2.188ms - ExecTreeOpenTime: 2.043ms - PrepareTime: 21.542ms - ExecTreePrepareTime: 59.652us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 236.135us, non-child: 236.135us, % non-child: 100.00%) - BytesSent: 11.17 KB (11443) - NetworkThroughput(*): 264.81 MB/sec - OverallThroughput: 46.21 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 168.362us - TransmitDataRPCTime: 41.210us - UncompressedRowBatchSize: 23.56 KB (24125) CodeGen:(Total: 20.946ms, non-child: 20.946ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.271ms KUDU_SCAN_NODE (id=0):(Total: 12.488ms, non-child: 12.488ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.13 MB (1183744) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 7.21 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 10.399ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:15.952818 3769 coordinator.cc:1529] cumulative profile for query_id=56430dcd9ad85bae:dd5e90f000000000 Execution Profile 56430dcd9ad85bae:dd5e90f000000000:(Total: 24.646ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance 56430dcd9ad85bae:dd5e90f000000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 26.176ms, non-child: 2.728ms, % non-child: 10.42%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 31.97 KB (32736) - PerHostPeakMemUsage: 40.64 KB (41616) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 10.137ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 12.552ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 4.022ms - TotalThreadsVoluntaryContextSwitches: 6 (6) Fragment Instance Lifecycle Timings: - ExecTime: 2.194ms - ExecTreeExecTime: 22.673us - OpenTime: 10.369ms - ExecTreeOpenTime: 10.193ms - PrepareTime: 13.562ms - ExecTreePrepareTime: 50.385us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 13.236ms, non-child: 13.236ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.707ms EXCHANGE_NODE (id=1):(Total: 10.212ms, non-child: 77.612us, % non-child: 0.76%) - BytesReceived: 11.04 KB (11309) - ConvertRowBatchTime: 20.159us - DeserializeRowBatchTimer: 72.030us - FirstBatchArrivalWaitTime: 10.134ms - PeakMemoryUsage: 0 - RowsReturned: 90 (90) - RowsReturnedRate: 8.81 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 29.604ms, non-child: 1.048ms, % non-child: 3.54%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 221.680us - TotalStorageWaitTime: 7.175ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 11.799ms - TotalThreadsSysTime: 4.021ms - TotalThreadsUserTime: 577.500us - TotalThreadsVoluntaryContextSwitches: 12 (12) Fragment Instance Lifecycle Timings: - ExecTime: 9.772ms - ExecTreeExecTime: 9.175ms - OpenTime: 2.046ms - ExecTreeOpenTime: 1.880ms - PrepareTime: 17.738ms - ExecTreePrepareTime: 52.766us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 257.188us, non-child: 257.188us, % non-child: 100.00%) - BytesSent: 11.11 KB (11376) - NetworkThroughput(*): 264.33 MB/sec - OverallThroughput: 42.49 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 192.284us - TransmitDataRPCTime: 41.042us - UncompressedRowBatchSize: 23.59 KB (24156) CodeGen:(Total: 17.206ms, non-child: 17.206ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 16.611ms KUDU_SCAN_NODE (id=0):(Total: 11.092ms, non-child: 11.092ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 966.00 KB (989184) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 8.24 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 9.171ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 56430dcd9ad85bae:dd5e90f000000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 24.438ms, non-child: 997.234us, % non-child: 4.08%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 247.487us - TotalStorageWaitTime: 6.331ms - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 10.448ms - TotalThreadsSysTime: 3.778ms - TotalThreadsUserTime: 1.155ms - TotalThreadsVoluntaryContextSwitches: 13 (13) Fragment Instance Lifecycle Timings: - ExecTime: 8.557ms - ExecTreeExecTime: 7.947ms - OpenTime: 1.904ms - ExecTreeOpenTime: 1.717ms - PrepareTime: 13.935ms - ExecTreePrepareTime: 45.881us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 278.242us, non-child: 278.242us, % non-child: 100.00%) - BytesSent: 11.04 KB (11309) - NetworkThroughput(*): 263.86 MB/sec - OverallThroughput: 38.76 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 216.206us - TransmitDataRPCTime: 40.875us - UncompressedRowBatchSize: 23.62 KB (24188) CodeGen:(Total: 13.466ms, non-child: 13.466ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.951ms KUDU_SCAN_NODE (id=0):(Total: 9.696ms, non-child: 9.696ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 776.00 KB (794624) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 9.28 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 7.943ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Instance 56430dcd9ad85bae:dd5e90f000000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 34.770ms, non-child: 1.100ms, % non-child: 3.16%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 195.874us - TotalStorageWaitTime: 8.019ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 13.151ms - TotalThreadsSysTime: 4.264ms - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 12 (12) Fragment Instance Lifecycle Timings: - ExecTime: 10.988ms - ExecTreeExecTime: 10.402ms - OpenTime: 2.188ms - ExecTreeOpenTime: 2.043ms - PrepareTime: 21.542ms - ExecTreePrepareTime: 59.652us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 236.135us, non-child: 236.135us, % non-child: 100.00%) - BytesSent: 11.17 KB (11443) - NetworkThroughput(*): 264.81 MB/sec - OverallThroughput: 46.21 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 168.362us - TransmitDataRPCTime: 41.210us - UncompressedRowBatchSize: 23.56 KB (24125) CodeGen:(Total: 20.946ms, non-child: 20.946ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.271ms KUDU_SCAN_NODE (id=0):(Total: 12.488ms, non-child: 12.488ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.13 MB (1183744) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 7.21 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 10.399ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:15.952834 3769 coordinator.cc:1546] Fragment instance completed: id=56430dcd9ad85bae:dd5e90f000000002 host=mj-desktop.ca.cloudera.com:22001 remaining=1 I1212 11:10:15.952837 3769 coordinator.cc:1556] query_id=56430dcd9ad85bae:dd5e90f000000000: first in-progress backend: mj-desktop.ca.cloudera.com:22000 I1212 11:10:15.953099 14535 mem-tracker.h:171] TryConsume failed, bytes=194560 consumption=1192624 limit=1048576 attempting to GC I1212 11:10:15.953344 14506 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:15.953349 14506 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:15.953430 14506 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:15.989722 14499 status.cc:47] Memory limit exceeded @ 0x11cb3fc impala::Status::Status() @ 0x11cb16c impala::Status::MemLimitExceeded() @ 0x136d1fa impala::RuntimeState::SetMemLimitExceeded() @ 0x136d65d impala::RuntimeState::CheckQueryState() @ 0x19d9ac2 impala::DataStreamSender::Send() @ 0x19e7711 impala::PlanFragmentExecutor::ExecInternal() @ 0x19e713a impala::PlanFragmentExecutor::Exec() @ 0x19e08cd impala::FragmentInstanceState::Exec() @ 0x19ebfd3 impala::QueryExecMgr::ExecFInstance() @ 0x19ef51e boost::_mfi::mf1<>::operator()() @ 0x19ef3c1 boost::_bi::list2<>::operator()<>() @ 0x19ef085 boost::_bi::bind_t<>::operator()() @ 0x19eeb5c boost::detail::function::void_function_obj_invoker0<>::invoke() @ 0x1348fbc boost::function0<>::operator()() @ 0x15eeb13 impala::Thread::SuperviseThread() @ 0x15f5aec boost::_bi::list4<>::operator()<>() @ 0x15f5a2f boost::_bi::bind_t<>::operator()() @ 0x15f598a boost::detail::thread_data<>::run() @ 0x1a54fda thread_proxy @ 0x7f284362a184 start_thread @ 0x7f284335737d (unknown) I1212 11:10:15.989802 14499 runtime-state.cc:209] Error from query 56430dcd9ad85bae:dd5e90f000000000: Memory Limit Exceeded by fragment: 56430dcd9ad85bae:dd5e90f000000003 Query(56430dcd9ad85bae:dd5e90f000000000): memory limit exceeded. Limit=1.00 MB Total=1.14 MB Peak=1.15 MB Fragment 56430dcd9ad85bae:dd5e90f000000003: Total=1.14 MB Peak=1.15 MB KUDU_SCAN_NODE (id=0): Total=586.00 KB Peak=1.13 MB DataStreamSender (dst_id=1): Total=688.00 B Peak=688.00 B CodeGen: Total=0 Peak=0 Block Manager: Total=0 Peak=0 Fragment 56430dcd9ad85bae:dd5e90f000000000: Total=0 Peak=31.97 KB EXCHANGE_NODE (id=1): Total=0 Peak=0 CodeGen: Total=0 Peak=0 I1212 11:10:15.989814 14499 runtime-state.cc:209] Error from query 56430dcd9ad85bae:dd5e90f000000000: WARNING: The following tables are missing relevant table and/or column statistics. ucu3e4.lineitem I1212 11:10:15.989845 14520 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=56430dcd9ad85bae:dd5e90f000000003 I1212 11:10:15.989892 14499 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:15.989900 14499 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:15.990213 5418 impala-internal-service.cc:74] ReportExecStatus(): instance_id=56430dcd9ad85bae:dd5e90f000000003 I1212 11:10:15.990218 5418 impala-server.cc:1076] ReportExecStatus() instance_id=56430dcd9ad85bae:dd5e90f000000003 done=true I1212 11:10:15.990227 5418 coordinator.cc:1437] UpdateFragmentExecStatus() instance=56430dcd9ad85bae:dd5e90f000000003 status=7 done=true I1212 11:10:15.990239 5418 coordinator.cc:1488] instance_id=56430dcd9ad85bae:dd5e90f000000003 error log: Memory Limit Exceeded by fragment: 56430dcd9ad85bae:dd5e90f000000003 Query(56430dcd9ad85bae:dd5e90f000000000): memory limit exceeded. Limit=1.00 MB Total=1.14 MB Peak=1.15 MB Fragment 56430dcd9ad85bae:dd5e90f000000003: Total=1.14 MB Peak=1.15 MB KUDU_SCAN_NODE (id=0): Total=586.00 KB Peak=1.13 MB DataStreamSender (dst_id=1): Total=688.00 B Peak=688.00 B CodeGen: Total=0 Peak=0 Block Manager: Total=0 Peak=0 Fragment 56430dcd9ad85bae:dd5e90f000000000: Total=0 Peak=31.97 KB EXCHANGE_NODE (id=1): Total=0 Peak=0 CodeGen: Total=0 Peak=0 WARNING: The following tables are missing relevant table and/or column statistics. ucu3e4.lineitem I1212 11:10:15.990267 5418 coordinator.cc:1521] profile for instance_id=56430dcd9ad85bae:dd5e90f000000003 Instance 56430dcd9ad85bae:dd5e90f000000003 (host=mj-desktop.ca.cloudera.com:22000): I1212 11:10:15.990890 5418 coordinator.cc:1529] cumulative profile for query_id=56430dcd9ad85bae:dd5e90f000000000 Execution Profile 56430dcd9ad85bae:dd5e90f000000000:(Total: 24.646ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance 56430dcd9ad85bae:dd5e90f000000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 26.176ms, non-child: 2.728ms, % non-child: 10.42%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 31.97 KB (32736) - PerHostPeakMemUsage: 40.64 KB (41616) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 10.137ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 12.552ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 4.022ms - TotalThreadsVoluntaryContextSwitches: 6 (6) Fragment Instance Lifecycle Timings: - ExecTime: 2.194ms - ExecTreeExecTime: 22.673us - OpenTime: 10.369ms - ExecTreeOpenTime: 10.193ms - PrepareTime: 13.562ms - ExecTreePrepareTime: 50.385us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 13.236ms, non-child: 13.236ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.707ms EXCHANGE_NODE (id=1):(Total: 10.212ms, non-child: 77.612us, % non-child: 0.76%) - BytesReceived: 11.04 KB (11309) - ConvertRowBatchTime: 20.159us - DeserializeRowBatchTimer: 72.030us - FirstBatchArrivalWaitTime: 10.134ms - PeakMemoryUsage: 0 - RowsReturned: 90 (90) - RowsReturnedRate: 8.81 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 29.604ms, non-child: 1.048ms, % non-child: 3.54%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 221.680us - TotalStorageWaitTime: 7.175ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 11.799ms - TotalThreadsSysTime: 4.021ms - TotalThreadsUserTime: 577.500us - TotalThreadsVoluntaryContextSwitches: 12 (12) Fragment Instance Lifecycle Timings: - ExecTime: 9.772ms - ExecTreeExecTime: 9.175ms - OpenTime: 2.046ms - ExecTreeOpenTime: 1.880ms - PrepareTime: 17.738ms - ExecTreePrepareTime: 52.766us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 257.188us, non-child: 257.188us, % non-child: 100.00%) - BytesSent: 11.11 KB (11376) - NetworkThroughput(*): 264.33 MB/sec - OverallThroughput: 42.49 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 192.284us - TransmitDataRPCTime: 41.042us - UncompressedRowBatchSize: 23.59 KB (24156) CodeGen:(Total: 17.206ms, non-child: 17.206ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 16.611ms KUDU_SCAN_NODE (id=0):(Total: 11.092ms, non-child: 11.092ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 966.00 KB (989184) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 8.24 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 9.171ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 56430dcd9ad85bae:dd5e90f000000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 24.438ms, non-child: 997.234us, % non-child: 4.08%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 247.487us - TotalStorageWaitTime: 6.331ms - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 10.448ms - TotalThreadsSysTime: 3.778ms - TotalThreadsUserTime: 1.155ms - TotalThreadsVoluntaryContextSwitches: 13 (13) Fragment Instance Lifecycle Timings: - ExecTime: 8.557ms - ExecTreeExecTime: 7.947ms - OpenTime: 1.904ms - ExecTreeOpenTime: 1.717ms - PrepareTime: 13.935ms - ExecTreePrepareTime: 45.881us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 278.242us, non-child: 278.242us, % non-child: 100.00%) - BytesSent: 11.04 KB (11309) - NetworkThroughput(*): 263.86 MB/sec - OverallThroughput: 38.76 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 216.206us - TransmitDataRPCTime: 40.875us - UncompressedRowBatchSize: 23.62 KB (24188) CodeGen:(Total: 13.466ms, non-child: 13.466ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.951ms KUDU_SCAN_NODE (id=0):(Total: 9.696ms, non-child: 9.696ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 776.00 KB (794624) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 9.28 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 7.943ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Instance 56430dcd9ad85bae:dd5e90f000000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 34.770ms, non-child: 1.100ms, % non-child: 3.16%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 195.874us - TotalStorageWaitTime: 8.019ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 13.151ms - TotalThreadsSysTime: 4.264ms - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 12 (12) Fragment Instance Lifecycle Timings: - ExecTime: 10.988ms - ExecTreeExecTime: 10.402ms - OpenTime: 2.188ms - ExecTreeOpenTime: 2.043ms - PrepareTime: 21.542ms - ExecTreePrepareTime: 59.652us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 236.135us, non-child: 236.135us, % non-child: 100.00%) - BytesSent: 11.17 KB (11443) - NetworkThroughput(*): 264.81 MB/sec - OverallThroughput: 46.21 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 168.362us - TransmitDataRPCTime: 41.210us - UncompressedRowBatchSize: 23.56 KB (24125) CodeGen:(Total: 20.946ms, non-child: 20.946ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.271ms KUDU_SCAN_NODE (id=0):(Total: 12.488ms, non-child: 12.488ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.13 MB (1183744) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 7.21 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 10.399ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:15.990909 5418 coordinator.cc:1362] Cancel() query_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.990916 5418 coordinator.cc:1428] CancelFragmentInstances() query_id=56430dcd9ad85bae:dd5e90f000000000, tried to cancel 0 fragment instances I1212 11:10:15.990998 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 77.612us 77.612us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 7.394ms 12.488ms 180 90 1.13 MB 0 I1212 11:10:15.991210 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 77.612us 77.612us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 7.394ms 12.488ms 180 90 1.13 MB 0 I1212 11:10:15.991351 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 77.612us 77.612us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 7.394ms 12.488ms 180 90 1.13 MB 0 I1212 11:10:15.991413 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 77.612us 77.612us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 7.394ms 12.488ms 180 90 1.13 MB 0 I1212 11:10:15.991461 5418 coordinator.cc:766] Query id=56430dcd9ad85bae:dd5e90f000000000 failed because fragment id=56430dcd9ad85bae:dd5e90f000000003 on host=mj-desktop.ca.cloudera.com:22000 failed. I1212 11:10:15.991482 2681 coordinator.cc:1071] All fragment instances finished due to one or more errors. Memory limit exceeded I1212 11:10:15.991499 2681 impala-server.cc:907] UnregisterQuery(): query_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.991503 2681 impala-server.cc:993] Cancel(): query_id=56430dcd9ad85bae:dd5e90f000000000 I1212 11:10:15.991523 14499 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:15.991554 2681 admission-controller.cc:538] Released query id=56430dcd9ad85bae:dd5e90f000000000 agg_num_running=1, agg_num_queued=0, agg_mem_reserved=3.00 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=1.00 MB) I1212 11:10:15.991567 2681 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=56430dcd9ad85bae:dd5e90f000000000 refcnt=2 I1212 11:10:15.994616 2681 impala-hs2-server.cc:373] CloseSession(): request=TCloseSessionReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "&\xe4\xc0Y\baF\x12\xbb\xb0\x10\x91\xd2m\xf3\x03", 02: secret (string) = "9V#\x13\xa6\xe3F\xcb\x86\xf56\xf5B\xe0\x1e\n", }, }, } I1212 11:10:15.998774 14535 status.cc:47] Memory limit exceeded @ 0x11cb3fc impala::Status::Status() @ 0x11cb16c impala::Status::MemLimitExceeded() @ 0x13630db impala::MemTracker::MemLimitExceeded() @ 0x13ffd91 impala::RowBatch::ResizeAndAllocateTupleBuffer() @ 0x17f3069 impala::KuduScanner::GetNext() @ 0x178e85b impala::KuduScanNode::ProcessScanToken() @ 0x178eb75 impala::KuduScanNode::RunScannerThread() @ 0x1790a94 boost::_mfi::mf2<>::operator()() @ 0x179095a boost::_bi::list3<>::operator()<>() @ 0x17904db boost::_bi::bind_t<>::operator()() @ 0x1790311 boost::detail::function::void_function_obj_invoker0<>::invoke() @ 0x1348fbc boost::function0<>::operator()() @ 0x15eeb13 impala::Thread::SuperviseThread() @ 0x15f5aec boost::_bi::list4<>::operator()<>() @ 0x15f5a2f boost::_bi::bind_t<>::operator()() @ 0x15f598a boost::detail::thread_data<>::run() @ 0x1a54fda thread_proxy @ 0x7f284362a184 start_thread @ 0x7f284335737d (unknown) I1212 11:10:15.998813 14535 status.cc:181] Failed to allocate tuple buffer I1212 11:10:15.998919 14535 runtime-state.cc:209] Error from query 56430dcd9ad85bae:dd5e90f000000000: Memory Limit Exceeded by fragment: 56430dcd9ad85bae:dd5e90f000000003 KUDU_SCAN_NODE (id=0) could not allocate 190.00 KB without exceeding limit. Query(56430dcd9ad85bae:dd5e90f000000000): Limit=1.00 MB Total=586.00 KB Peak=1.15 MB Fragment 56430dcd9ad85bae:dd5e90f000000003: Total=586.00 KB Peak=1.15 MB KUDU_SCAN_NODE (id=0): Total=586.00 KB Peak=1.13 MB CodeGen: Total=0 Peak=0 Block Manager: Total=0 Peak=0 Fragment 56430dcd9ad85bae:dd5e90f000000000: Total=0 Peak=31.97 KB EXCHANGE_NODE (id=1): Total=0 Peak=0 CodeGen: Total=0 Peak=0 I1212 11:10:15.999039 14535 kudu-scan-node.cc:324] Thread done: scanner-thread(1) I1212 11:10:15.999336 14499 query-exec-mgr.cc:103] Instance completed. instance_id=56430dcd9ad85bae:dd5e90f000000003 I1212 11:10:15.999342 14499 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=56430dcd9ad85bae:dd5e90f000000000 refcnt=1 I1212 11:10:16.030998 2681 status.cc:114] Session closed @ 0x11cc7af impala::Status::Status() @ 0x147e95c impala::ImpalaServer::CloseSessionInternal() @ 0x14d36a8 impala::ImpalaServer::CloseSession() @ 0x1958d62 apache::hive::service::cli::thrift::TCLIServiceProcessor::process_CloseSession() @ 0x1958348 apache::hive::service::cli::thrift::TCLIServiceProcessor::dispatchCall() @ 0x1931f95 impala::ImpalaHiveServer2ServiceProcessor::dispatchCall() @ 0x117366e apache::thrift::TDispatchProcessor::process() @ 0x27d689b apache::thrift::server::TThreadPoolServer::Task::run() @ 0x27bf109 apache::thrift::concurrency::ThreadManager::Worker::run() @ 0x133a3bd impala::ThriftThread::RunRunnable() @ 0x133bae9 boost::_mfi::mf2<>::operator()() @ 0x133b97f boost::_bi::list3<>::operator()<>() @ 0x133b6cb boost::_bi::bind_t<>::operator()() @ 0x133b5de boost::detail::function::void_function_obj_invoker0<>::invoke() @ 0x1348fbc boost::function0<>::operator()() @ 0x15eeb13 impala::Thread::SuperviseThread() @ 0x15f5aec boost::_bi::list4<>::operator()<>() @ 0x15f5a2f boost::_bi::bind_t<>::operator()() @ 0x15f598a boost::detail::thread_data<>::run() @ 0x1a54fda thread_proxy @ 0x7f284362a184 start_thread @ 0x7f284335737d (unknown) I1212 11:10:16.031998 2681 impala-hs2-server.cc:271] OpenSession(): username=mj I1212 11:10:16.032414 2681 impala-hs2-server.cc:414] ExecuteStatement(): request=TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\xf2|\xcc\xd5t@I\x94\x88\xb7P\xc3\b\xc9\xa8B", 02: secret (string) = "\xa1\x02\xf8tSZ@2\x8d|\x0f\x9c\xb2\x01\xf4\xf4", }, }, 02: statement (string) = "USE ucu3e4", 04: runAsync (bool) = false, } I1212 11:10:16.032445 2681 impala-hs2-server.cc:228] TExecuteStatementReq: TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\xf2|\xcc\xd5t@I\x94\x88\xb7P\xc3\b\xc9\xa8B", 02: secret (string) = "\xa1\x02\xf8tSZ@2\x8d|\x0f\x9c\xb2\x01\xf4\xf4", }, }, 02: statement (string) = "USE ucu3e4", 04: runAsync (bool) = false, } I1212 11:10:16.032456 2681 impala-server.cc:742] Parsed pool options: override_options_mask=1111111111111111111111111111111111111111111111111111111111111111 set_pool_mask=0000000000000000000000000000000000000000000000000000000000000000 overlay_mask=0000000000000000000000000000000000000000000000000000000000000000 I1212 11:10:16.032486 2681 impala-hs2-server.cc:261] TClientRequest.queryOptions: TQueryOptions { 01: abort_on_error (bool) = false, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 100, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, } I1212 11:10:16.034567 2681 impala-server.cc:812] Execution request: TExecRequest { 01: stmt_type (i32) = 1, 02: query_options (struct) = TQueryOptions { 01: abort_on_error (bool) = false, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 100, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 44: mt_dop (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, }, 04: catalog_op_request (struct) = TCatalogOpRequest { 01: op_type (i32) = 3, 02: use_db_params (struct) = TUseDbParams { 01: db (string) = "ucu3e4", }, }, 05: result_set_metadata (struct) = TResultSetMetadata { 01: columns (list) = list[0] { }, }, 08: access_events (set) = set[1] { TAccessEvent { 01: name (string) = "ucu3e4", 02: object_type (i32) = 2, 03: privilege (string) = "ANY", }, }, 09: analysis_warnings (list) = list[0] { }, } I1212 11:10:16.036953 2681 thread.cc:288] Started thread 14538 - query-exec-state:wait-thread I1212 11:10:16.036986 2681 impala-hs2-server.cc:486] ExecuteStatement(): return_val=TExecuteStatementResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: operationHandle (struct) = TOperationHandle { 01: operationId (struct) = THandleIdentifier { 01: guid (string) = "jL4k\x80\xf7A\xd3\x00\x00\x00\x00\xe0\xc0\x86\x1b", 02: secret (string) = "jL4k\x80\xf7A\xd3\x00\x00\x00\x00\xe0\xc0\x86\x1b", }, 02: operationType (i32) = 0, 03: hasResultSet (bool) = false, }, } I1212 11:10:16.037925 2681 impala-hs2-server.cc:688] CloseOperation(): query_id=d341f7806b344c6a:1b86c0e000000000 I1212 11:10:16.037945 2681 impala-server.cc:907] UnregisterQuery(): query_id=d341f7806b344c6a:1b86c0e000000000 I1212 11:10:16.037948 2681 impala-server.cc:993] Cancel(): query_id=d341f7806b344c6a:1b86c0e000000000 I1212 11:10:16.038409 2681 impala-hs2-server.cc:414] ExecuteStatement(): request=TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\xf2|\xcc\xd5t@I\x94\x88\xb7P\xc3\b\xc9\xa8B", 02: secret (string) = "\xa1\x02\xf8tSZ@2\x8d|\x0f\x9c\xb2\x01\xf4\xf4", }, }, 02: statement (string) = "select * from lineitem where l_orderkey = -1", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "10m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:16.038426 2681 impala-hs2-server.cc:228] TExecuteStatementReq: TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\xf2|\xcc\xd5t@I\x94\x88\xb7P\xc3\b\xc9\xa8B", 02: secret (string) = "\xa1\x02\xf8tSZ@2\x8d|\x0f\x9c\xb2\x01\xf4\xf4", }, }, 02: statement (string) = "select * from lineitem where l_orderkey = -1", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "10m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:16.038471 2681 impala-server.cc:742] Parsed pool options: override_options_mask=1111111111111111111111111111111110111111111111111111111111000010 set_pool_mask=0000000000000000000000000000000000000000000000000000000000000000 overlay_mask=0000000000000000000000000000000000000000000000000000000000000000 I1212 11:10:16.038501 2681 impala-hs2-server.cc:261] TClientRequest.queryOptions: TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 10485760, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, } I1212 11:10:16.045436 14539 AsyncKuduClient.java:1367] Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) I1212 11:10:16.048130 14540 AsyncKuduClient.java:1367] Learned about tablet de1fe37fdb46438abfbc154bf7fb439b for table 'impala::ucu3e4.lineitem' with partition [, 0x00000001) I1212 11:10:16.048323 14540 AsyncKuduClient.java:1367] Learned about tablet 91d0d8d3b0e34afc9d7fa522e61f40ef for table 'impala::ucu3e4.lineitem' with partition [0x00000001, 0x00000002) I1212 11:10:16.048502 14540 AsyncKuduClient.java:1367] Learned about tablet dc26b34fb84d4ff8baae3f44b23f0ae2 for table 'impala::ucu3e4.lineitem' with partition [0x00000002, ) I1212 11:10:16.056110 2681 impala-server.cc:812] Execution request: TExecRequest { 01: stmt_type (i32) = 0, 02: query_options (struct) = TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 10485760, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 44: mt_dop (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, }, 03: query_exec_request (struct) = TQueryExecRequest { 01: desc_tbl (struct) = TDescriptorTable { 01: slotDescriptors (list) = list[16] { [0] = TSlotDescriptor { 01: id (i32) = 0, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 0, }, 06: byteOffset (i32) = 128, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 8, }, [1] = TSlotDescriptor { 01: id (i32) = 1, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 1, }, 06: byteOffset (i32) = 184, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 15, }, [2] = TSlotDescriptor { 01: id (i32) = 2, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 2, }, 06: byteOffset (i32) = 136, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 9, }, [3] = TSlotDescriptor { 01: id (i32) = 3, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 3, }, 06: byteOffset (i32) = 144, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 10, }, [4] = TSlotDescriptor { 01: id (i32) = 4, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 4, }, 06: byteOffset (i32) = 152, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 11, }, [5] = TSlotDescriptor { 01: id (i32) = 5, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 5, }, 06: byteOffset (i32) = 160, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 12, }, [6] = TSlotDescriptor { 01: id (i32) = 6, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 6, }, 06: byteOffset (i32) = 168, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 13, }, [7] = TSlotDescriptor { 01: id (i32) = 7, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 7, }, 06: byteOffset (i32) = 176, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 14, }, [8] = TSlotDescriptor { 01: id (i32) = 8, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 8, }, 06: byteOffset (i32) = 0, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 0, 09: slotIdx (i32) = 0, }, [9] = TSlotDescriptor { 01: id (i32) = 9, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 9, }, 06: byteOffset (i32) = 16, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 1, }, [10] = TSlotDescriptor { 01: id (i32) = 10, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 10, }, 06: byteOffset (i32) = 32, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 2, }, [11] = TSlotDescriptor { 01: id (i32) = 11, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 11, }, 06: byteOffset (i32) = 48, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 3, }, [12] = TSlotDescriptor { 01: id (i32) = 12, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 12, }, 06: byteOffset (i32) = 64, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 4, }, [13] = TSlotDescriptor { 01: id (i32) = 13, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 13, }, 06: byteOffset (i32) = 80, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 5, }, [14] = TSlotDescriptor { 01: id (i32) = 14, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 14, }, 06: byteOffset (i32) = 96, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 6, }, [15] = TSlotDescriptor { 01: id (i32) = 15, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 15, }, 06: byteOffset (i32) = 112, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 7, 09: slotIdx (i32) = 7, }, }, 02: tupleDescriptors (list) = list[1] { [0] = TTupleDescriptor { 01: id (i32) = 0, 02: byteSize (i32) = 190, 03: numNullBytes (i32) = 2, 04: tableId (i32) = 1, 05: tuplePath (list) = list[0] { }, }, }, 03: tableDescriptors (list) = list[1] { [0] = TTableDescriptor { 01: id (i32) = 1, 02: tableType (i32) = 4, 03: columnDescriptors (list) = list[16] { [0] = TColumnDescriptor { 01: name (string) = "l_orderkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [1] = TColumnDescriptor { 01: name (string) = "l_linenumber", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, }, [2] = TColumnDescriptor { 01: name (string) = "l_partkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [3] = TColumnDescriptor { 01: name (string) = "l_suppkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [4] = TColumnDescriptor { 01: name (string) = "l_quantity", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [5] = TColumnDescriptor { 01: name (string) = "l_extendedprice", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [6] = TColumnDescriptor { 01: name (string) = "l_discount", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [7] = TColumnDescriptor { 01: name (string) = "l_tax", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [8] = TColumnDescriptor { 01: name (string) = "l_returnflag", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [9] = TColumnDescriptor { 01: name (string) = "l_linestatus", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [10] = TColumnDescriptor { 01: name (string) = "l_shipdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [11] = TColumnDescriptor { 01: name (string) = "l_commitdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [12] = TColumnDescriptor { 01: name (string) = "l_receiptdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [13] = TColumnDescriptor { 01: name (string) = "l_shipinstruct", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [14] = TColumnDescriptor { 01: name (string) = "l_shipmode", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [15] = TColumnDescriptor { 01: name (string) = "l_comment", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, }, 04: numClusteringCols (i32) = 0, 07: tableName (string) = "impala::ucu3e4.lineitem", 08: dbName (string) = "ucu3e4", 10: kuduTable (struct) = TKuduTable { 01: table_name (string) = "impala::ucu3e4.lineitem", 02: master_addresses (list) = list[1] { [0] = "127.0.0.1", }, 03: key_columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 04: partition_by (list) = list[1] { [0] = TKuduPartitionParam { 01: by_hash_param (struct) = TKuduPartitionByHashParam { 01: columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 02: num_partitions (i32) = 3, }, }, }, }, }, }, }, 02: plan_exec_info (list) = list[1] { [0] = TPlanExecInfo { 01: fragments (list) = list[2] { [0] = TPlanFragment { 01: idx (i32) = 0, 02: display_name (string) = "F01", 03: plan (struct) = TPlan { 01: nodes (list) = list[1] { [0] = TPlanNode { 01: node_id (i32) = 1, 02: node_type (i32) = 6, 03: num_children (i32) = 0, 04: limit (i64) = -1, 05: row_tuples (list) = list[1] { [0] = 0, }, 06: nullable_tuples (list) = list[1] { [0] = false, }, 08: disable_codegen (bool) = false, 18: exchange_node (struct) = TExchangeNode { 01: input_row_tuples (list) = list[1] { [0] = 0, }, }, 21: label (string) = "01:EXCHANGE", 22: label_detail (string) = "UNPARTITIONED", 23: estimated_stats (struct) = TExecStats { 03: cardinality (i64) = -1, 04: memory_used (i64) = -1, }, }, }, }, 04: output_exprs (list) = list[16] { [0] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 0, }, }, }, }, [1] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 1, }, }, }, }, [2] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 2, }, }, }, }, [3] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 3, }, }, }, }, [4] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 4, }, }, }, }, [5] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 5, }, }, }, }, [6] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 6, }, }, }, }, [7] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 7, }, }, }, }, [8] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 1 I1212 11:10:16.056504 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22000(local selection) I1212 11:10:16.056535 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22001(local selection) I1212 11:10:16.056560 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22002(local selection) I1212 11:10:16.056566 2681 simple-scheduler.cc:979] Total remote scan volume = 0 I1212 11:10:16.056576 2681 simple-scheduler.cc:981] Total local scan volume = 2.93 KB I1212 11:10:16.056579 2681 simple-scheduler.cc:983] Total cached scan volume = 0 I1212 11:10:16.056591 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22002, } I1212 11:10:16.056607 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](501)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:16.056613 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22001, } I1212 11:10:16.056625 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](505)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:16.056632 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, } I1212 11:10:16.056644 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](501)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:16.056716 2681 admission-controller.cc:440] Schedule for id=e64afa7ac70ab070:88fe99b900000000 in pool_name=default-pool cluster_mem_needed=30.00 MB PoolConfig: max_requests=-1 max_queued=200 max_mem=-1.00 B I1212 11:10:16.056733 2681 admission-controller.cc:445] Stats: agg_num_running=1, agg_num_queued=0, agg_mem_reserved=3.00 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=1.00 MB) I1212 11:10:16.056753 2681 admission-controller.cc:451] Admitted query id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.056783 2681 admission-controller.cc:457] Final: agg_num_running=2, agg_num_queued=0, agg_mem_reserved=3.00 MB, local_host(local_mem_admitted=3.78 GB, num_admitted_running=2, num_queued=0, backend_mem_reserved=1.00 MB) I1212 11:10:16.056816 2681 coordinator.cc:447] Exec() query_id=e64afa7ac70ab070:88fe99b900000000 stmt=select * from lineitem where l_orderkey = -1 I1212 11:10:16.056885 2681 mem-tracker.cc:184] Using query memory limit: 10.00 MB I1212 11:10:16.056990 2681 coordinator.cc:602] starting 4 fragment instances for query e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.057065 2681 coordinator.cc:737] ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- I1212 11:10:16.057224 2564 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22002 instance_id=e64afa7ac70ab070:88fe99b900000001 I1212 11:10:16.057230 2565 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.057234 2564 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22002) I1212 11:10:16.057238 2562 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22001 instance_id=e64afa7ac70ab070:88fe99b900000002 I1212 11:10:16.057257 2566 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=e64afa7ac70ab070:88fe99b900000003 I1212 11:10:16.057374 2564 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22002 I1212 11:10:16.057468 2565 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:16.057476 2565 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:16.057580 2562 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22001) I1212 11:10:16.057590 2562 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22001 I1212 11:10:16.057592 2566 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:16.057600 2566 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:16.057714 3396 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.057723 3396 query-exec-mgr.cc:45] StartFInstance() instance_id=e64afa7ac70ab070:88fe99b900000000 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:16.057741 3396 query-exec-mgr.cc:69] new QueryState: query_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.057746 3396 query-exec-mgr.cc:77] QueryState: query_id=e64afa7ac70ab070:88fe99b900000000 refcnt=1 I1212 11:10:16.057798 3396 query-state.cc:58] RegisterFInstance(): instance_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.057837 5418 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=e64afa7ac70ab070:88fe99b900000003 I1212 11:10:16.057857 5418 query-exec-mgr.cc:45] StartFInstance() instance_id=e64afa7ac70ab070:88fe99b900000003 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:16.057862 5418 query-exec-mgr.cc:77] QueryState: query_id=e64afa7ac70ab070:88fe99b900000000 refcnt=2 I1212 11:10:16.057937 5418 query-state.cc:58] RegisterFInstance(): instance_id=e64afa7ac70ab070:88fe99b900000003 I1212 11:10:16.058074 14549 plan-fragment-executor.cc:123] Prepare(): instance_id=e64afa7ac70ab070:88fe99b900000003 I1212 11:10:16.058074 5418 thread.cc:288] Started thread 14549 - query-exec-mgr:exec-fragment-instance-e64afa7ac70ab070:88fe99b900000003 I1212 11:10:16.058121 14549 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = -1852392891477217168, 02: lo (i64) = -8575247620618846205, }, 02: per_fragment_instance_idx (i32) = 2, 03: per_node_scan_ranges (map) = map[1] { 0 -> list[1] { [0] = TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](501)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, }, }, }, 04: per_exch_num_senders (map) = map[0] { }, 05: destinations (list) = list[1] { [0] = TPlanFragmentDestination { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = -1852392891477217168, 02: lo (i64) = -8575247620618846208, }, 02: server (struct) = TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, }, }, }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = 2, } I1212 11:10:16.058159 2566 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=e64afa7ac70ab070:88fe99b900000003 I1212 11:10:16.058161 2564 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=e64afa7ac70ab070:88fe99b900000001 I1212 11:10:16.058171 2564 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22002 back to cache I1212 11:10:16.058171 2566 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:16.058233 3396 thread.cc:288] Started thread 14548 - query-exec-mgr:exec-fragment-instance-e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.058257 2562 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=e64afa7ac70ab070:88fe99b900000002 I1212 11:10:16.058264 2562 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22001 back to cache I1212 11:10:16.058279 14549 plan-fragment-executor.cc:145] Using query memory limit from query options: 10.00 MB I1212 11:10:16.058291 14549 mem-tracker.cc:184] Using query memory limit: 10.00 MB I1212 11:10:16.058310 2565 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.058315 2565 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:16.058362 14548 plan-fragment-executor.cc:123] Prepare(): instance_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.058358 2681 coordinator.cc:640] started 4 fragment instances for query e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.058393 14548 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = -1852392891477217168, 02: lo (i64) = -8575247620618846208, }, 02: per_fragment_instance_idx (i32) = 0, 03: per_node_scan_ranges (map) = map[0] { }, 04: per_exch_num_senders (map) = map[1] { 1 -> 3, }, 05: destinations (list) = list[0] { }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = -1, } I1212 11:10:16.058401 2681 query-exec-mgr.cc:123] GetQueryState(): query_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.058408 2681 query-state.cc:65] GetFInstanceState(): instance_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.058447 14549 plan-fragment-executor.cc:174] descriptor table for fragment=e64afa7ac70ab070:88fe99b900000003 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:16.058547 14549 plan-fragment-executor.cc:285] Hdfs split stats (:<# splits>/) for query=e64afa7ac70ab070:88fe99b900000000: I1212 11:10:16.058452 14548 plan-fragment-executor.cc:145] Using query memory limit from query options: 10.00 MB I1212 11:10:16.059057 14548 mem-tracker.cc:184] Using query memory limit: 10.00 MB I1212 11:10:16.059260 14548 plan-fragment-executor.cc:174] descriptor table for fragment=e64afa7ac70ab070:88fe99b900000000 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:16.059339 14548 data-stream-mgr.cc:80] creating receiver for fragment=e64afa7ac70ab070:88fe99b900000000, node=1 I1212 11:10:16.063508 14549 thread.cc:288] Started thread 14552 - DataStreamSender:SenderThread(1:1) I1212 11:10:16.078816 14548 plan-fragment-executor.cc:261] plan_root= ExchangeNode(#senders=3 conjuncts=[]) I1212 11:10:16.078838 14548 plan-fragment-executor.cc:296] Open(): instance_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.078865 2681 coordinator.cc:1181] Byte split for fragment 1 min: 0, max: 0, avg: 0, stddev: 0 I1212 11:10:16.078871 2681 coordinator.cc:1184] data volume for ipaddress 0xbf4fb00: 0 I1212 11:10:16.078872 2681 coordinator.cc:1184] data volume for ipaddress 0xbf51840: 0 I1212 11:10:16.078874 2681 coordinator.cc:1184] data volume for ipaddress 0xbfeb0e0: 0 I1212 11:10:16.078920 14548 thread.cc:288] Started thread 14561 - plan-fragment-executor:report-profile I1212 11:10:16.078919 14561 plan-fragment-executor.cc:378] ReportProfileThread(): instance_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.079152 2681 thread.cc:288] Started thread 14562 - query-exec-state:wait-thread I1212 11:10:16.079196 2681 impala-hs2-server.cc:486] ExecuteStatement(): return_val=TExecuteStatementResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: operationHandle (struct) = TOperationHandle { 01: operationId (struct) = THandleIdentifier { 01: guid (string) = "p\xb0\n\xc7z\xfaJ\xe6\x00\x00\x00\x00\xb9\x99\xfe\x88", 02: secret (string) = "p\xb0\n\xc7z\xfaJ\xe6\x00\x00\x00\x00\xb9\x99\xfe\x88", }, 02: operationType (i32) = 0, 03: hasResultSet (bool) = true, }, } I1212 11:10:16.081919 14549 plan-fragment-executor.cc:261] plan_root= KuduScanNode(tupleid=0) I1212 11:10:16.081935 14549 plan-fragment-executor.cc:296] Open(): instance_id=e64afa7ac70ab070:88fe99b900000003 I1212 11:10:16.082020 14565 plan-fragment-executor.cc:378] ReportProfileThread(): instance_id=e64afa7ac70ab070:88fe99b900000003 I1212 11:10:16.082025 14549 thread.cc:288] Started thread 14565 - plan-fragment-executor:report-profile I1212 11:10:16.083314 3769 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=e64afa7ac70ab070:88fe99b900000000, node=1 I1212 11:10:16.083328 3769 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=e64afa7ac70ab070:88fe99b900000000 node_id=1 #senders=2 I1212 11:10:16.083858 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=e64afa7ac70ab070:88fe99b900000002 I1212 11:10:16.083866 3769 impala-server.cc:1076] ReportExecStatus() instance_id=e64afa7ac70ab070:88fe99b900000002 done=true I1212 11:10:16.083874 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=e64afa7ac70ab070:88fe99b900000002 status=0 done=true I1212 11:10:16.084481 14549 kudu-scan-node.cc:128] Latest observed Kudu timestamp: 0 I1212 11:10:16.084801 14549 kudu-scan-node.cc:248] Thread started: scanner-thread(1) I1212 11:10:16.084903 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 0.000ns 0.000ns 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3.402ms 10.207ms 0 -1 198.00 KB 0 I1212 11:10:16.084909 14549 thread.cc:288] Started thread 14580 - kudu-scan-node:scanner-thread(1) I1212 11:10:16.084915 3769 progress-updater.cc:65] Query e64afa7ac70ab070:88fe99b900000000: 33% Complete (1 out of 3) I1212 11:10:16.085063 3769 coordinator.cc:1521] profile for instance_id=e64afa7ac70ab070:88fe99b900000002 Instance e64afa7ac70ab070:88fe99b900000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 25.121ms, non-child: 1.016ms, % non-child: 4.05%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 978.000ns - TotalStorageWaitTime: 2.563ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 13.633ms - TotalThreadsSysTime: 698.000us - TotalThreadsUserTime: 3.603ms - TotalThreadsVoluntaryContextSwitches: 19 (19) Fragment Instance Lifecycle Timings: - ExecTime: 3.356ms - ExecTreeExecTime: 3.137ms - OpenTime: 7.217ms - ExecTreeOpenTime: 7.037ms - PrepareTime: 14.485ms - ExecTreePrepareTime: 52.673us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 22.210us, non-child: 22.210us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.875ms, non-child: 13.875ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 13.301ms KUDU_SCAN_NODE (id=0):(Total: 10.207ms, non-child: 10.207ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.075ms - MaterializeTupleTime(*): 3.130ms - ScannerThreadsSysTime: 698.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:16.085310 14580 kudu-scanner.cc:148] Starting KuduScanner with ReadMode=0 timeout=180000 I1212 11:10:16.085353 3769 coordinator.cc:1529] cumulative profile for query_id=e64afa7ac70ab070:88fe99b900000000 Execution Profile e64afa7ac70ab070:88fe99b900000000:(Total: 22.004ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 2ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Averaged Fragment F00:(Total: 25.121ms, non-child: 1.016ms, % non-child: 4.05%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 978.000ns - TotalStorageWaitTime: 2.563ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 13.633ms - TotalThreadsSysTime: 698.000us - TotalThreadsUserTime: 3.603ms - TotalThreadsVoluntaryContextSwitches: 19 (19) Fragment Instance Lifecycle Timings: - ExecTime: 3.356ms - ExecTreeExecTime: 3.137ms - OpenTime: 7.217ms - ExecTreeOpenTime: 7.037ms - PrepareTime: 14.485ms - ExecTreePrepareTime: 52.673us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 22.210us, non-child: 22.210us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.875ms, non-child: 13.875ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 13.301ms KUDU_SCAN_NODE (id=0):(Total: 10.207ms, non-child: 10.207ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.075ms - MaterializeTupleTime(*): 3.130ms - ScannerThreadsSysTime: 698.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance e64afa7ac70ab070:88fe99b900000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 25.121ms, non-child: 1.016ms, % non-child: 4.05%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 978.000ns - TotalStorageWaitTime: 2.563ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 13.633ms - TotalThreadsSysTime: 698.000us - TotalThreadsUserTime: 3.603ms - TotalThreadsVoluntaryContextSwitches: 19 (19) Fragment Instance Lifecycle Timings: - ExecTime: 3.356ms - ExecTreeExecTime: 3.137ms - OpenTime: 7.217ms - ExecTreeOpenTime: 7.037ms - PrepareTime: 14.485ms - ExecTreePrepareTime: 52.673us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 22.210us, non-child: 22.210us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.875ms, non-child: 13.875ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 13.301ms KUDU_SCAN_NODE (id=0):(Total: 10.207ms, non-child: 10.207ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.075ms - MaterializeTupleTime(*): 3.130ms - ScannerThreadsSysTime: 698.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:16.085364 3769 coordinator.cc:1546] Fragment instance completed: id=e64afa7ac70ab070:88fe99b900000002 host=mj-desktop.ca.cloudera.com:22001 remaining=3 I1212 11:10:16.085367 3769 coordinator.cc:1556] query_id=e64afa7ac70ab070:88fe99b900000000: first in-progress backend: mj-desktop.ca.cloudera.com:22000 I1212 11:10:16.086860 14580 kudu-scan-node.cc:324] Thread done: scanner-thread(1) I1212 11:10:16.086930 14549 data-stream-sender.cc:284] Channel::FlushAndSendEos() instance_id=e64afa7ac70ab070:88fe99b900000000 dest_node=1 #rows= 0 I1212 11:10:16.086944 14549 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:16.086951 14549 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:16.086957 14549 data-stream-sender.cc:311] calling TransmitData(eos=true) to terminate channel. I1212 11:10:16.087008 5418 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=e64afa7ac70ab070:88fe99b900000000, node=1 I1212 11:10:16.087023 5418 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=e64afa7ac70ab070:88fe99b900000000 node_id=1 #senders=1 I1212 11:10:16.087055 14549 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:16.087083 14565 plan-fragment-executor.cc:408] Reporting final profile for instance e64afa7ac70ab070:88fe99b900000003 I1212 11:10:16.087307 3766 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=e64afa7ac70ab070:88fe99b900000000, node=1 I1212 11:10:16.087314 3766 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=e64afa7ac70ab070:88fe99b900000000 node_id=1 #senders=0 I1212 11:10:16.087342 14548 exchange-node.cc:139] exch: has batch=false #rows=0 is_cancelled=false instance_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.087363 14565 plan-fragment-executor.cc:412] Fragment e64afa7ac70ab070:88fe99b900000003:(Total: 28.824ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 0 - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 260.000ns - TotalStorageWaitTime: 1.460ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 7.101ms - TotalThreadsSysTime: 636.000us - TotalThreadsUserTime: 2.606ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 2.135ms - ExecTreeExecTime: 1.945ms - OpenTime: 2.984ms - ExecTreeOpenTime: 2.846ms - PrepareTime: 23.660ms - ExecTreePrepareTime: 42.833us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 29.156us, non-child: 0.000ns, % non-child: 0.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 18.255ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 17.575ms KUDU_SCAN_NODE (id=0):(Total: 4.817ms, non-child: 0.000ns, % non-child: 0.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 1.996ms - MaterializeTupleTime(*): 1.938ms - ScannerThreadsSysTime: 636.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:16.087388 14548 exchange-node.cc:139] exch: has batch=false #rows=0 is_cancelled=false instance_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.087391 14565 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=e64afa7ac70ab070:88fe99b900000003 I1212 11:10:16.087415 14561 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.087446 14549 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:16.087452 14549 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:16.087458 14548 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:16.087465 14548 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:16.087697 5418 impala-internal-service.cc:74] ReportExecStatus(): instance_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.087702 5418 impala-server.cc:1076] ReportExecStatus() instance_id=e64afa7ac70ab070:88fe99b900000000 done=true I1212 11:10:16.087708 5418 coordinator.cc:1437] UpdateFragmentExecStatus() instance=e64afa7ac70ab070:88fe99b900000000 status=0 done=true I1212 11:10:16.087779 3396 impala-internal-service.cc:74] ReportExecStatus(): instance_id=e64afa7ac70ab070:88fe99b900000003 I1212 11:10:16.087784 3396 impala-server.cc:1076] ReportExecStatus() instance_id=e64afa7ac70ab070:88fe99b900000003 done=true I1212 11:10:16.087787 3396 coordinator.cc:1437] UpdateFragmentExecStatus() instance=e64afa7ac70ab070:88fe99b900000003 status=0 done=true I1212 11:10:16.087864 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 33.189us 33.189us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3.402ms 10.207ms 0 -1 198.00 KB 0 I1212 11:10:16.087982 5418 coordinator.cc:1521] profile for instance_id=e64afa7ac70ab070:88fe99b900000000 Instance e64afa7ac70ab070:88fe99b900000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 28.976ms, non-child: 1.309ms, % non-child: 4.52%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 8.377ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 8.535ms - TotalThreadsSysTime: 128.000us - TotalThreadsUserTime: 513.000us - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 30.987us - ExecTreeExecTime: 21.145us - OpenTime: 8.519ms - ExecTreeOpenTime: 8.389ms - PrepareTime: 20.378ms - ExecTreePrepareTime: 71.712us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 19.259ms, non-child: 19.259ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 18.583ms EXCHANGE_NODE (id=1):(Total: 8.407ms, non-child: 33.189us, % non-child: 0.39%) - BytesReceived: 0 - ConvertRowBatchTime: 2.285us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 8.373ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns I1212 11:10:16.088135 3396 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 33.189us 33.189us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5.008ms 10.207ms 0 -1 198.00 KB 0 I1212 11:10:16.088146 3396 progress-updater.cc:65] Query e64afa7ac70ab070:88fe99b900000000: 66% Complete (2 out of 3) I1212 11:10:16.088299 3396 coordinator.cc:1521] profile for instance_id=e64afa7ac70ab070:88fe99b900000003 Instance e64afa7ac70ab070:88fe99b900000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 28.824ms, non-child: 5.722ms, % non-child: 19.85%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 260.000ns - TotalStorageWaitTime: 1.460ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 7.101ms - TotalThreadsSysTime: 636.000us - TotalThreadsUserTime: 2.606ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 2.135ms - ExecTreeExecTime: 1.945ms - OpenTime: 2.984ms - ExecTreeOpenTime: 2.846ms - PrepareTime: 23.660ms - ExecTreePrepareTime: 42.833us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 29.156us, non-child: 29.156us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 18.255ms, non-child: 18.255ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 17.575ms KUDU_SCAN_NODE (id=0):(Total: 4.817ms, non-child: 4.817ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 1.996ms - MaterializeTupleTime(*): 1.938ms - ScannerThreadsSysTime: 636.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:16.088531 5418 coordinator.cc:1529] cumulative profile for query_id=e64afa7ac70ab070:88fe99b900000000 Execution Profile e64afa7ac70ab070:88fe99b900000000:(Total: 30.243ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 2ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance e64afa7ac70ab070:88fe99b900000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 28.976ms, non-child: 1.309ms, % non-child: 4.52%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 8.377ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 8.535ms - TotalThreadsSysTime: 128.000us - TotalThreadsUserTime: 513.000us - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 30.987us - ExecTreeExecTime: 21.145us - OpenTime: 8.519ms - ExecTreeOpenTime: 8.389ms - PrepareTime: 20.378ms - ExecTreePrepareTime: 71.712us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 19.259ms, non-child: 19.259ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 18.583ms EXCHANGE_NODE (id=1):(Total: 8.407ms, non-child: 33.189us, % non-child: 0.39%) - BytesReceived: 0 - ConvertRowBatchTime: 2.285us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 8.373ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 26.973ms, non-child: 3.369ms, % non-child: 12.49%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 210.67 KB (215728) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 619.000ns - TotalStorageWaitTime: 2.011ms - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 10.367ms - TotalThreadsSysTime: 667.000us - TotalThreadsUserTime: 3.104ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 2.745ms - ExecTreeExecTime: 2.541ms - OpenTime: 5.101ms - ExecTreeOpenTime: 4.941ms - PrepareTime: 19.072ms - ExecTreePrepareTime: 47.753us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 25.683us, non-child: 25.683us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 16.065ms, non-child: 16.065ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 15.438ms KUDU_SCAN_NODE (id=0):(Total: 7.512ms, non-child: 7.512ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2.536ms - MaterializeTupleTime(*): 2.534ms - ScannerThreadsSysTime: 667.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance e64afa7ac70ab070:88fe99b900000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 25.121ms, non-child: 1.016ms, % non-child: 4.05%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 978.000ns - TotalStorageWaitTime: 2.563ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 13.633ms - TotalThreadsSysTime: 698.000us - TotalThreadsUserTime: 3.603ms - TotalThreadsVoluntaryContextSwitches: 19 (19) Fragment Instance Lifecycle Timings: - ExecTime: 3.356ms - ExecTreeExecTime: 3.137ms - OpenTime: 7.217ms - ExecTreeOpenTime: 7.037ms - PrepareTime: 14.485ms - ExecTreePrepareTime: 52.673us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 22.210us, non-child: 22.210us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.875ms, non-child: 13.875ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 13.301ms KUDU_SCAN_NODE (id=0):(Total: 10.207ms, non-child: 10.207ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.075ms - MaterializeTupleTime(*): 3.130ms - ScannerThreadsSysTime: 698.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Instance e64afa7ac70ab070:88fe99b900000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 28.824ms, non-child: 5.722ms, % non-child: 19.85%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 260.000ns - TotalStorageWaitTime: 1.460ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 7.101ms - TotalThreadsSysTime: 636.000us - TotalThreadsUserTime: 2.606ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 2.135ms - ExecTreeExecTime: 1.945ms - OpenTime: 2.984ms - ExecTreeOpenTime: 2.846ms - PrepareTime: 23.660ms - ExecTreePrepareTime: 42.833us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 29.156us, non-child: 29.156us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 18.255ms, non-child: 18.255ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 17.575ms KUDU_SCAN_NODE (id=0):(Total: 4.817ms, non-child: 4.817ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 1.996ms - MaterializeTupleTime(*): 1.938ms - ScannerThreadsSysTime: 636.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:16.088546 5418 coordinator.cc:1546] Fragment instance completed: id=e64afa7ac70ab070:88fe99b900000000 host=mj-desktop.ca.cloudera.com:22000 remaining=2 I1212 11:10:16.088548 5418 coordinator.cc:1556] query_id=e64afa7ac70ab070:88fe99b900000000: first in-progress backend: mj-desktop.ca.cloudera.com:22002 I1212 11:10:16.088589 14548 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:16.088814 3396 coordinator.cc:1529] cumulative profile for query_id=e64afa7ac70ab070:88fe99b900000000 Execution Profile e64afa7ac70ab070:88fe99b900000000:(Total: 30.243ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 2ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance e64afa7ac70ab070:88fe99b900000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 28.976ms, non-child: 1.309ms, % non-child: 4.52%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 8.377ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 8.535ms - TotalThreadsSysTime: 128.000us - TotalThreadsUserTime: 513.000us - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 30.987us - ExecTreeExecTime: 21.145us - OpenTime: 8.519ms - ExecTreeOpenTime: 8.389ms - PrepareTime: 20.378ms - ExecTreePrepareTime: 71.712us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 19.259ms, non-child: 19.259ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 18.583ms EXCHANGE_NODE (id=1):(Total: 8.407ms, non-child: 33.189us, % non-child: 0.39%) - BytesReceived: 0 - ConvertRowBatchTime: 2.285us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 8.373ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 26.973ms, non-child: 3.369ms, % non-child: 12.49%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 210.67 KB (215728) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 619.000ns - TotalStorageWaitTime: 2.011ms - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 10.367ms - TotalThreadsSysTime: 667.000us - TotalThreadsUserTime: 3.104ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 2.745ms - ExecTreeExecTime: 2.541ms - OpenTime: 5.101ms - ExecTreeOpenTime: 4.941ms - PrepareTime: 19.072ms - ExecTreePrepareTime: 47.753us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 25.683us, non-child: 25.683us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 16.065ms, non-child: 16.065ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 15.438ms KUDU_SCAN_NODE (id=0):(Total: 7.512ms, non-child: 7.512ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2.536ms - MaterializeTupleTime(*): 2.534ms - ScannerThreadsSysTime: 667.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance e64afa7ac70ab070:88fe99b900000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 25.121ms, non-child: 1.016ms, % non-child: 4.05%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 978.000ns - TotalStorageWaitTime: 2.563ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 13.633ms - TotalThreadsSysTime: 698.000us - TotalThreadsUserTime: 3.603ms - TotalThreadsVoluntaryContextSwitches: 19 (19) Fragment Instance Lifecycle Timings: - ExecTime: 3.356ms - ExecTreeExecTime: 3.137ms - OpenTime: 7.217ms - ExecTreeOpenTime: 7.037ms - PrepareTime: 14.485ms - ExecTreePrepareTime: 52.673us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 22.210us, non-child: 22.210us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.875ms, non-child: 13.875ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 13.301ms KUDU_SCAN_NODE (id=0):(Total: 10.207ms, non-child: 10.207ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.075ms - MaterializeTupleTime(*): 3.130ms - ScannerThreadsSysTime: 698.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Instance e64afa7ac70ab070:88fe99b900000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 28.824ms, non-child: 5.722ms, % non-child: 19.85%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 260.000ns - TotalStorageWaitTime: 1.460ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 7.101ms - TotalThreadsSysTime: 636.000us - TotalThreadsUserTime: 2.606ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 2.135ms - ExecTreeExecTime: 1.945ms - OpenTime: 2.984ms - ExecTreeOpenTime: 2.846ms - PrepareTime: 23.660ms - ExecTreePrepareTime: 42.833us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 29.156us, non-child: 29.156us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 18.255ms, non-child: 18.255ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 17.575ms KUDU_SCAN_NODE (id=0):(Total: 4.817ms, non-child: 4.817ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 1.996ms - MaterializeTupleTime(*): 1.938ms - ScannerThreadsSysTime: 636.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:16.088829 3396 coordinator.cc:1546] Fragment instance completed: id=e64afa7ac70ab070:88fe99b900000003 host=mj-desktop.ca.cloudera.com:22000 remaining=1 I1212 11:10:16.088831 3396 coordinator.cc:1556] query_id=e64afa7ac70ab070:88fe99b900000000: first in-progress backend: mj-desktop.ca.cloudera.com:22002 I1212 11:10:16.088874 14549 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:16.088968 14549 query-exec-mgr.cc:103] Instance completed. instance_id=e64afa7ac70ab070:88fe99b900000003 I1212 11:10:16.088975 14549 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=e64afa7ac70ab070:88fe99b900000000 refcnt=3 I1212 11:10:16.088979 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=e64afa7ac70ab070:88fe99b900000001 I1212 11:10:16.088984 3766 impala-server.cc:1076] ReportExecStatus() instance_id=e64afa7ac70ab070:88fe99b900000001 done=true I1212 11:10:16.089006 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=e64afa7ac70ab070:88fe99b900000001 status=0 done=true I1212 11:10:16.089346 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 33.189us 33.189us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 6.578ms 10.207ms 0 -1 198.00 KB 0 I1212 11:10:16.089355 3766 progress-updater.cc:55] Query e64afa7ac70ab070:88fe99b900000000 100% Complete (3 out of 3) I1212 11:10:16.089535 3766 coordinator.cc:1521] profile for instance_id=e64afa7ac70ab070:88fe99b900000001 Instance e64afa7ac70ab070:88fe99b900000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 28.813ms, non-child: 4.213ms, % non-child: 14.62%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 278.000ns - TotalStorageWaitTime: 1.844ms - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 7.282ms - TotalThreadsSysTime: 812.000us - TotalThreadsUserTime: 789.000us - TotalThreadsVoluntaryContextSwitches: 18 (18) Fragment Instance Lifecycle Timings: - ExecTime: 2.466ms - ExecTreeExecTime: 2.314ms - OpenTime: 2.488ms - ExecTreeOpenTime: 2.355ms - PrepareTime: 23.792ms - ExecTreePrepareTime: 60.100us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 31.347us, non-child: 31.347us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 19.858ms, non-child: 19.858ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 19.283ms KUDU_SCAN_NODE (id=0):(Total: 4.709ms, non-child: 4.709ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 2.355ms - MaterializeTupleTime(*): 2.307ms - ScannerThreadsSysTime: 615.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:16.090126 3766 coordinator.cc:1529] cumulative profile for query_id=e64afa7ac70ab070:88fe99b900000000 Execution Profile e64afa7ac70ab070:88fe99b900000000:(Total: 30.243ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 2ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance e64afa7ac70ab070:88fe99b900000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 28.976ms, non-child: 1.309ms, % non-child: 4.52%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 8.377ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 8.535ms - TotalThreadsSysTime: 128.000us - TotalThreadsUserTime: 513.000us - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 30.987us - ExecTreeExecTime: 21.145us - OpenTime: 8.519ms - ExecTreeOpenTime: 8.389ms - PrepareTime: 20.378ms - ExecTreePrepareTime: 71.712us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 19.259ms, non-child: 19.259ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 18.583ms EXCHANGE_NODE (id=1):(Total: 8.407ms, non-child: 33.189us, % non-child: 0.39%) - BytesReceived: 0 - ConvertRowBatchTime: 2.285us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 8.373ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 27.586ms, non-child: 3.650ms, % non-child: 13.23%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 209.34 KB (214362) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 505.000ns - TotalStorageWaitTime: 1.955ms - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 9.339ms - TotalThreadsSysTime: 715.333us - TotalThreadsUserTime: 2.332ms - TotalThreadsVoluntaryContextSwitches: 17 (17) Fragment Instance Lifecycle Timings: - ExecTime: 2.652ms - ExecTreeExecTime: 2.466ms - OpenTime: 4.230ms - ExecTreeOpenTime: 4.079ms - PrepareTime: 20.646ms - ExecTreePrepareTime: 51.868us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 27.571us, non-child: 27.571us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 17.329ms, non-child: 17.329ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 16.720ms KUDU_SCAN_NODE (id=0):(Total: 6.578ms, non-child: 6.578ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2.476ms - MaterializeTupleTime(*): 2.458ms - ScannerThreadsSysTime: 649.666us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance e64afa7ac70ab070:88fe99b900000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 25.121ms, non-child: 1.016ms, % non-child: 4.05%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 978.000ns - TotalStorageWaitTime: 2.563ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 13.633ms - TotalThreadsSysTime: 698.000us - TotalThreadsUserTime: 3.603ms - TotalThreadsVoluntaryContextSwitches: 19 (19) Fragment Instance Lifecycle Timings: - ExecTime: 3.356ms - ExecTreeExecTime: 3.137ms - OpenTime: 7.217ms - ExecTreeOpenTime: 7.037ms - PrepareTime: 14.485ms - ExecTreePrepareTime: 52.673us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 22.210us, non-child: 22.210us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 13.875ms, non-child: 13.875ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 13.301ms KUDU_SCAN_NODE (id=0):(Total: 10.207ms, non-child: 10.207ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 3.075ms - MaterializeTupleTime(*): 3.130ms - ScannerThreadsSysTime: 698.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Instance e64afa7ac70ab070:88fe99b900000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 28.824ms, non-child: 5.722ms, % non-child: 19.85%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 260.000ns - TotalStorageWaitTime: 1.460ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 7.101ms - TotalThreadsSysTime: 636.000us - TotalThreadsUserTime: 2.606ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 2.135ms - ExecTreeExecTime: 1.945ms - OpenTime: 2.984ms - ExecTreeOpenTime: 2.846ms - PrepareTime: 23.660ms - ExecTreePrepareTime: 42.833us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 29.156us, non-child: 29.156us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 18.255ms, non-child: 18.255ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 17.575ms KUDU_SCAN_NODE (id=0):(Total: 4.817ms, non-child: 4.817ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 1.996ms - MaterializeTupleTime(*): 1.938ms - ScannerThreadsSysTime: 636.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Instance e64afa7ac70ab070:88fe99b900000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 28.813ms, non-child: 4.213ms, % non-child: 14.62%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 278.000ns - TotalStorageWaitTime: 1.844ms - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 7.282ms - TotalThreadsSysTime: 812.000us - TotalThreadsUserTime: 789.000us - TotalThreadsVoluntaryContextSwitches: 18 (18) Fragment Instance Lifecycle Timings: - ExecTime: 2.466ms - ExecTreeExecTime: 2.314ms - OpenTime: 2.488ms - ExecTreeOpenTime: 2.355ms - PrepareTime: 23.792ms - ExecTreePrepareTime: 60.100us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 31.347us, non-child: 31.347us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 19.858ms, non-child: 19.858ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 19.283ms KUDU_SCAN_NODE (id=0):(Total: 4.709ms, non-child: 4.709ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 2.355ms - MaterializeTupleTime(*): 2.307ms - ScannerThreadsSysTime: 615.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:16.090150 3766 coordinator.cc:1546] Fragment instance completed: id=e64afa7ac70ab070:88fe99b900000001 host=mj-desktop.ca.cloudera.com:22002 remaining=0 I1212 11:10:16.090158 2681 impala-hs2-server.cc:713] GetResultSetMetadata(): query_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.090294 2681 impala-hs2-server.cc:753] GetResultSetMetadata(): return_val=TGetResultSetMetadataResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: schema (struct) = TTableSchema { 01: columns (list) = list[16] { [0] = TColumnDesc { 01: columnName (string) = "l_orderkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 0, }, [1] = TColumnDesc { 01: columnName (string) = "l_linenumber", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 3, }, }, }, }, 03: position (i32) = 1, }, [2] = TColumnDesc { 01: columnName (string) = "l_partkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 2, }, [3] = TColumnDesc { 01: columnName (string) = "l_suppkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 3, }, [4] = TColumnDesc { 01: columnName (string) = "l_quantity", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 4, }, [5] = TColumnDesc { 01: columnName (string) = "l_extendedprice", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 5, }, [6] = TColumnDesc { 01: columnName (string) = "l_discount", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 6, }, [7] = TColumnDesc { 01: columnName (string) = "l_tax", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 7, }, [8] = TColumnDesc { 01: columnName (string) = "l_returnflag", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 8, }, [9] = TColumnDesc { 01: columnName (string) = "l_linestatus", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 9, }, [10] = TColumnDesc { 01: columnName (string) = "l_shipdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 10, }, [11] = TColumnDesc { 01: columnName (string) = "l_commitdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 11, }, [12] = TColumnDesc { 01: columnName (string) = "l_receiptdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 12, }, [13] = TColumnDesc { 01: columnName (string) = "l_shipinstruct", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 13, }, [14] = TColumnDesc { 01: columnName (string) = "l_shipmode", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 14, }, [15] = TColumnDesc { 01: columnName (string) = "l_comment", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 15, }, }, }, } I1212 11:10:16.090575 2681 coordinator.cc:1069] All fragment instances finished successfully. I1212 11:10:16.090596 14548 data-stream-mgr.cc:226] DeregisterRecvr(): fragment_instance_id=e64afa7ac70ab070:88fe99b900000000, node=1 I1212 11:10:16.090607 14548 data-stream-recvr.cc:237] cancelled stream: fragment_instance_id_=e64afa7ac70ab070:88fe99b900000000 node_id=1 I1212 11:10:16.090639 14548 query-exec-mgr.cc:103] Instance completed. instance_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.090644 14548 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=e64afa7ac70ab070:88fe99b900000000 refcnt=2 I1212 11:10:16.090682 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 33.189us 33.189us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 6.578ms 10.207ms 0 -1 198.00 KB 0 I1212 11:10:16.090867 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 33.189us 33.189us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 6.578ms 10.207ms 0 -1 198.00 KB 0 I1212 11:10:16.091013 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 33.189us 33.189us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 6.578ms 10.207ms 0 -1 198.00 KB 0 I1212 11:10:16.091157 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 33.189us 33.189us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 6.578ms 10.207ms 0 -1 198.00 KB 0 I1212 11:10:16.091459 2681 impala-hs2-server.cc:688] CloseOperation(): query_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.091464 2681 impala-server.cc:907] UnregisterQuery(): query_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.091467 2681 impala-server.cc:993] Cancel(): query_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.091472 2681 coordinator.cc:1362] Cancel() query_id=e64afa7ac70ab070:88fe99b900000000 I1212 11:10:16.091480 2681 coordinator.cc:1428] CancelFragmentInstances() query_id=e64afa7ac70ab070:88fe99b900000000, tried to cancel 0 fragment instances I1212 11:10:16.091557 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 33.189us 33.189us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 6.578ms 10.207ms 0 -1 198.00 KB 0 I1212 11:10:16.091702 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 33.189us 33.189us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 6.578ms 10.207ms 0 -1 198.00 KB 0 I1212 11:10:16.091840 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 33.189us 33.189us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 6.578ms 10.207ms 0 -1 198.00 KB 0 I1212 11:10:16.091976 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 33.189us 33.189us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 6.578ms 10.207ms 0 -1 198.00 KB 0 I1212 11:10:16.092056 2681 admission-controller.cc:538] Released query id=e64afa7ac70ab070:88fe99b900000000 agg_num_running=1, agg_num_queued=0, agg_mem_reserved=3.00 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=1.00 MB) I1212 11:10:16.092066 2681 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=e64afa7ac70ab070:88fe99b900000000 refcnt=1 I1212 11:10:16.101193 2681 impala-hs2-server.cc:414] ExecuteStatement(): request=TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\xf2|\xcc\xd5t@I\x94\x88\xb7P\xc3\b\xc9\xa8B", 02: secret (string) = "\xa1\x02\xf8tSZ@2\x8d|\x0f\x9c\xb2\x01\xf4\xf4", }, }, 02: statement (string) = "select * from lineitem where l_commitdate like '%cheese'", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "10m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:16.101212 2681 impala-hs2-server.cc:228] TExecuteStatementReq: TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\xf2|\xcc\xd5t@I\x94\x88\xb7P\xc3\b\xc9\xa8B", 02: secret (string) = "\xa1\x02\xf8tSZ@2\x8d|\x0f\x9c\xb2\x01\xf4\xf4", }, }, 02: statement (string) = "select * from lineitem where l_commitdate like '%cheese'", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "10m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:16.101250 2681 impala-server.cc:742] Parsed pool options: override_options_mask=1111111111111111111111111111111110111111111111111111111111000010 set_pool_mask=0000000000000000000000000000000000000000000000000000000000000000 overlay_mask=0000000000000000000000000000000000000000000000000000000000000000 I1212 11:10:16.101296 2681 impala-hs2-server.cc:261] TClientRequest.queryOptions: TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 10485760, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, } I1212 11:10:16.107825 14583 AsyncKuduClient.java:1367] Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) I1212 11:10:16.110445 14584 AsyncKuduClient.java:1367] Learned about tablet de1fe37fdb46438abfbc154bf7fb439b for table 'impala::ucu3e4.lineitem' with partition [, 0x00000001) I1212 11:10:16.110616 14584 AsyncKuduClient.java:1367] Learned about tablet 91d0d8d3b0e34afc9d7fa522e61f40ef for table 'impala::ucu3e4.lineitem' with partition [0x00000001, 0x00000002) I1212 11:10:16.110770 14584 AsyncKuduClient.java:1367] Learned about tablet dc26b34fb84d4ff8baae3f44b23f0ae2 for table 'impala::ucu3e4.lineitem' with partition [0x00000002, ) I1212 11:10:16.116039 2681 impala-server.cc:812] Execution request: TExecRequest { 01: stmt_type (i32) = 0, 02: query_options (struct) = TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 10485760, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 44: mt_dop (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, }, 03: query_exec_request (struct) = TQueryExecRequest { 01: desc_tbl (struct) = TDescriptorTable { 01: slotDescriptors (list) = list[16] { [0] = TSlotDescriptor { 01: id (i32) = 0, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 0, }, 06: byteOffset (i32) = 128, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 8, }, [1] = TSlotDescriptor { 01: id (i32) = 1, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 1, }, 06: byteOffset (i32) = 184, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 15, }, [2] = TSlotDescriptor { 01: id (i32) = 2, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 2, }, 06: byteOffset (i32) = 136, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 9, }, [3] = TSlotDescriptor { 01: id (i32) = 3, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 3, }, 06: byteOffset (i32) = 144, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 10, }, [4] = TSlotDescriptor { 01: id (i32) = 4, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 4, }, 06: byteOffset (i32) = 152, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 11, }, [5] = TSlotDescriptor { 01: id (i32) = 5, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 5, }, 06: byteOffset (i32) = 160, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 12, }, [6] = TSlotDescriptor { 01: id (i32) = 6, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 6, }, 06: byteOffset (i32) = 168, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 13, }, [7] = TSlotDescriptor { 01: id (i32) = 7, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 7, }, 06: byteOffset (i32) = 176, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 14, }, [8] = TSlotDescriptor { 01: id (i32) = 8, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 8, }, 06: byteOffset (i32) = 0, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 0, 09: slotIdx (i32) = 0, }, [9] = TSlotDescriptor { 01: id (i32) = 9, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 9, }, 06: byteOffset (i32) = 16, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 1, }, [10] = TSlotDescriptor { 01: id (i32) = 10, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 10, }, 06: byteOffset (i32) = 32, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 2, }, [11] = TSlotDescriptor { 01: id (i32) = 11, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 11, }, 06: byteOffset (i32) = 48, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 3, }, [12] = TSlotDescriptor { 01: id (i32) = 12, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 12, }, 06: byteOffset (i32) = 64, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 4, }, [13] = TSlotDescriptor { 01: id (i32) = 13, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 13, }, 06: byteOffset (i32) = 80, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 5, }, [14] = TSlotDescriptor { 01: id (i32) = 14, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 14, }, 06: byteOffset (i32) = 96, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 6, }, [15] = TSlotDescriptor { 01: id (i32) = 15, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 15, }, 06: byteOffset (i32) = 112, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 7, 09: slotIdx (i32) = 7, }, }, 02: tupleDescriptors (list) = list[1] { [0] = TTupleDescriptor { 01: id (i32) = 0, 02: byteSize (i32) = 190, 03: numNullBytes (i32) = 2, 04: tableId (i32) = 1, 05: tuplePath (list) = list[0] { }, }, }, 03: tableDescriptors (list) = list[1] { [0] = TTableDescriptor { 01: id (i32) = 1, 02: tableType (i32) = 4, 03: columnDescriptors (list) = list[16] { [0] = TColumnDescriptor { 01: name (string) = "l_orderkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [1] = TColumnDescriptor { 01: name (string) = "l_linenumber", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, }, [2] = TColumnDescriptor { 01: name (string) = "l_partkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [3] = TColumnDescriptor { 01: name (string) = "l_suppkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [4] = TColumnDescriptor { 01: name (string) = "l_quantity", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [5] = TColumnDescriptor { 01: name (string) = "l_extendedprice", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [6] = TColumnDescriptor { 01: name (string) = "l_discount", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [7] = TColumnDescriptor { 01: name (string) = "l_tax", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [8] = TColumnDescriptor { 01: name (string) = "l_returnflag", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [9] = TColumnDescriptor { 01: name (string) = "l_linestatus", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [10] = TColumnDescriptor { 01: name (string) = "l_shipdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [11] = TColumnDescriptor { 01: name (string) = "l_commitdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [12] = TColumnDescriptor { 01: name (string) = "l_receiptdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [13] = TColumnDescriptor { 01: name (string) = "l_shipinstruct", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [14] = TColumnDescriptor { 01: name (string) = "l_shipmode", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [15] = TColumnDescriptor { 01: name (string) = "l_comment", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, }, 04: numClusteringCols (i32) = 0, 07: tableName (string) = "impala::ucu3e4.lineitem", 08: dbName (string) = "ucu3e4", 10: kuduTable (struct) = TKuduTable { 01: table_name (string) = "impala::ucu3e4.lineitem", 02: master_addresses (list) = list[1] { [0] = "127.0.0.1", }, 03: key_columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 04: partition_by (list) = list[1] { [0] = TKuduPartitionParam { 01: by_hash_param (struct) = TKuduPartitionByHashParam { 01: columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 02: num_partitions (i32) = 3, }, }, }, }, }, }, }, 02: plan_exec_info (list) = list[1] { [0] = TPlanExecInfo { 01: fragments (list) = list[2] { [0] = TPlanFragment { 01: idx (i32) = 0, 02: display_name (string) = "F01", 03: plan (struct) = TPlan { 01: nodes (list) = list[1] { [0] = TPlanNode { 01: node_id (i32) = 1, 02: node_type (i32) = 6, 03: num_children (i32) = 0, 04: limit (i64) = -1, 05: row_tuples (list) = list[1] { [0] = 0, }, 06: nullable_tuples (list) = list[1] { [0] = false, }, 08: disable_codegen (bool) = false, 18: exchange_node (struct) = TExchangeNode { 01: input_row_tuples (list) = list[1] { [0] = 0, }, }, 21: label (string) = "01:EXCHANGE", 22: label_detail (string) = "UNPARTITIONED", 23: estimated_stats (struct) = TExecStats { 03: cardinality (i64) = -1, 04: memory_used (i64) = -1, }, }, }, }, 04: output_exprs (list) = list[16] { [0] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 0, }, }, }, }, [1] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 1, }, }, }, }, [2] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 2, }, }, }, }, [3] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 3, }, }, }, }, [4] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 4, }, }, }, }, [5] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 5, }, }, }, }, [6] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 6, }, }, }, }, [7] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 7, }, }, }, }, [8] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 1 I1212 11:10:16.116431 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22000(local selection) I1212 11:10:16.116458 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22001(local selection) I1212 11:10:16.116474 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22002(local selection) I1212 11:10:16.116478 2681 simple-scheduler.cc:979] Total remote scan volume = 0 I1212 11:10:16.116487 2681 simple-scheduler.cc:981] Total local scan volume = 2.93 KB I1212 11:10:16.116488 2681 simple-scheduler.cc:983] Total cached scan volume = 0 I1212 11:10:16.116498 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22002, } I1212 11:10:16.116508 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:16.116513 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22001, } I1212 11:10:16.116518 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](479)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:16.116523 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, } I1212 11:10:16.116528 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:16.116585 2681 admission-controller.cc:440] Schedule for id=4b438904f491e0f5:4403307d00000000 in pool_name=default-pool cluster_mem_needed=30.00 MB PoolConfig: max_requests=-1 max_queued=200 max_mem=-1.00 B I1212 11:10:16.116602 2681 admission-controller.cc:445] Stats: agg_num_running=1, agg_num_queued=0, agg_mem_reserved=3.00 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=1.00 MB) I1212 11:10:16.116607 2681 admission-controller.cc:451] Admitted query id=4b438904f491e0f5:4403307d00000000 I1212 11:10:16.116627 2681 admission-controller.cc:457] Final: agg_num_running=2, agg_num_queued=0, agg_mem_reserved=3.00 MB, local_host(local_mem_admitted=3.78 GB, num_admitted_running=2, num_queued=0, backend_mem_reserved=1.00 MB) I1212 11:10:16.116654 2681 coordinator.cc:447] Exec() query_id=4b438904f491e0f5:4403307d00000000 stmt=select * from lineitem where l_commitdate like '%cheese' I1212 11:10:16.116703 2681 mem-tracker.cc:184] Using query memory limit: 10.00 MB I1212 11:10:16.116782 2681 coordinator.cc:602] starting 4 fragment instances for query 4b438904f491e0f5:4403307d00000000 I1212 11:10:16.116830 2681 coordinator.cc:737] ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- I1212 11:10:16.117012 2569 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:16.117020 2569 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:16.117027 2569 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:16.117250 2570 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22002 instance_id=4b438904f491e0f5:4403307d00000001 I1212 11:10:16.117256 2570 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22002) I1212 11:10:16.117259 2570 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22002 I1212 11:10:16.117267 2568 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22001 instance_id=4b438904f491e0f5:4403307d00000002 I1212 11:10:16.117274 2568 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22001) I1212 11:10:16.117274 5418 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:16.117280 2568 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22001 I1212 11:10:16.117280 5418 query-exec-mgr.cc:45] StartFInstance() instance_id=4b438904f491e0f5:4403307d00000000 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:16.117301 5418 query-exec-mgr.cc:69] new QueryState: query_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:16.117305 5418 query-exec-mgr.cc:77] QueryState: query_id=4b438904f491e0f5:4403307d00000000 refcnt=1 I1212 11:10:16.117344 5418 query-state.cc:58] RegisterFInstance(): instance_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:16.117460 14591 plan-fragment-executor.cc:123] Prepare(): instance_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:16.117463 5418 thread.cc:288] Started thread 14591 - query-exec-mgr:exec-fragment-instance-4b438904f491e0f5:4403307d00000000 I1212 11:10:16.117486 14591 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 5423329030660284661, 02: lo (i64) = 4900814132938276864, }, 02: per_fragment_instance_idx (i32) = 0, 03: per_node_scan_ranges (map) = map[0] { }, 04: per_exch_num_senders (map) = map[1] { 1 -> 3, }, 05: destinations (list) = list[0] { }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = -1, } I1212 11:10:16.117532 2567 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=4b438904f491e0f5:4403307d00000003 I1212 11:10:16.117537 2567 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:16.117540 14591 plan-fragment-executor.cc:145] Using query memory limit from query options: 10.00 MB I1212 11:10:16.117542 2567 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:16.117545 14591 mem-tracker.cc:184] Using query memory limit: 10.00 MB I1212 11:10:16.117555 2569 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:16.117563 2569 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:16.117714 14591 plan-fragment-executor.cc:174] descriptor table for fragment=4b438904f491e0f5:4403307d00000000 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:16.117784 2570 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=4b438904f491e0f5:4403307d00000001 I1212 11:10:16.117789 2570 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22002 back to cache I1212 11:10:16.117795 2568 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=4b438904f491e0f5:4403307d00000002 I1212 11:10:16.117794 14591 data-stream-mgr.cc:80] creating receiver for fragment=4b438904f491e0f5:4403307d00000000, node=1 I1212 11:10:16.117801 2568 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22001 back to cache I1212 11:10:16.117811 3396 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=4b438904f491e0f5:4403307d00000003 I1212 11:10:16.117820 3396 query-exec-mgr.cc:45] StartFInstance() instance_id=4b438904f491e0f5:4403307d00000003 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:16.117823 3396 query-exec-mgr.cc:77] QueryState: query_id=4b438904f491e0f5:4403307d00000000 refcnt=2 I1212 11:10:16.117872 3396 query-state.cc:58] RegisterFInstance(): instance_id=4b438904f491e0f5:4403307d00000003 I1212 11:10:16.117931 3396 thread.cc:288] Started thread 14594 - query-exec-mgr:exec-fragment-instance-4b438904f491e0f5:4403307d00000003 I1212 11:10:16.117933 14594 plan-fragment-executor.cc:123] Prepare(): instance_id=4b438904f491e0f5:4403307d00000003 I1212 11:10:16.117995 14594 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 5423329030660284661, 02: lo (i64) = 4900814132938276867, }, 02: per_fragment_instance_idx (i32) = 2, 03: per_node_scan_ranges (map) = map[1] { 0 -> list[1] { [0] = TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, }, }, }, 04: per_exch_num_senders (map) = map[0] { }, 05: destinations (list) = list[1] { [0] = TPlanFragmentDestination { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 5423329030660284661, 02: lo (i64) = 4900814132938276864, }, 02: server (struct) = TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, }, }, }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = 2, } I1212 11:10:16.118017 2567 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=4b438904f491e0f5:4403307d00000003 I1212 11:10:16.118022 2567 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:16.118059 14594 plan-fragment-executor.cc:145] Using query memory limit from query options: 10.00 MB I1212 11:10:16.118062 2681 coordinator.cc:640] started 4 fragment instances for query 4b438904f491e0f5:4403307d00000000 I1212 11:10:16.118067 14594 mem-tracker.cc:184] Using query memory limit: 10.00 MB I1212 11:10:16.118119 2681 query-exec-mgr.cc:123] GetQueryState(): query_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:16.118125 2681 query-state.cc:65] GetFInstanceState(): instance_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:16.118237 14594 plan-fragment-executor.cc:174] descriptor table for fragment=4b438904f491e0f5:4403307d00000003 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:16.118365 14594 plan-fragment-executor.cc:285] Hdfs split stats (:<# splits>/) for query=4b438904f491e0f5:4403307d00000000: I1212 11:10:16.118422 14594 thread.cc:288] Started thread 14597 - DataStreamSender:SenderThread(1:1) I1212 11:10:16.131074 14591 plan-fragment-executor.cc:261] plan_root= ExchangeNode(#senders=3 conjuncts=[]) I1212 11:10:16.131098 14591 plan-fragment-executor.cc:296] Open(): instance_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:16.131131 2681 coordinator.cc:1181] Byte split for fragment 1 min: 0, max: 0, avg: 0, stddev: 0 I1212 11:10:16.131139 2681 coordinator.cc:1184] data volume for ipaddress 0xbfeac60: 0 I1212 11:10:16.131145 2681 coordinator.cc:1184] data volume for ipaddress 0xbfebc20: 0 I1212 11:10:16.131147 2681 coordinator.cc:1184] data volume for ipaddress 0xbfec760: 0 I1212 11:10:16.131305 14591 thread.cc:288] Started thread 14598 - plan-fragment-executor:report-profile I1212 11:10:16.131304 14598 plan-fragment-executor.cc:378] ReportProfileThread(): instance_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:16.131359 2681 thread.cc:288] Started thread 14599 - query-exec-state:wait-thread I1212 11:10:16.131398 2681 impala-hs2-server.cc:486] ExecuteStatement(): return_val=TExecuteStatementResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: operationHandle (struct) = TOperationHandle { 01: operationId (struct) = THandleIdentifier { 01: guid (string) = "\xf5\xe0\x91\xf4\x04\x89CK\x00\x00\x00\x00}0\x03D", 02: secret (string) = "\xf5\xe0\x91\xf4\x04\x89CK\x00\x00\x00\x00}0\x03D", }, 02: operationType (i32) = 0, 03: hasResultSet (bool) = true, }, } I1212 11:10:16.139897 14594 plan-fragment-executor.cc:261] plan_root= KuduScanNode(tupleid=0) I1212 11:10:16.139919 14594 plan-fragment-executor.cc:296] Open(): instance_id=4b438904f491e0f5:4403307d00000003 I1212 11:10:16.140033 14603 plan-fragment-executor.cc:378] ReportProfileThread(): instance_id=4b438904f491e0f5:4403307d00000003 I1212 11:10:16.140038 14594 thread.cc:288] Started thread 14603 - plan-fragment-executor:report-profile I1212 11:10:16.153398 14594 kudu-scan-node.cc:128] Latest observed Kudu timestamp: 0 I1212 11:10:16.153717 14594 kudu-scan-node.cc:248] Thread started: scanner-thread(1) I1212 11:10:16.153795 14594 thread.cc:288] Started thread 14620 - kudu-scan-node:scanner-thread(1) I1212 11:10:16.154404 14620 kudu-scanner.cc:148] Starting KuduScanner with ReadMode=0 timeout=180000 I1212 11:10:19.839376 3766 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=4b438904f491e0f5:4403307d00000000, node=1 I1212 11:10:19.839393 3766 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=4b438904f491e0f5:4403307d00000000 node_id=1 #senders=2 I1212 11:10:19.840219 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=4b438904f491e0f5:4403307d00000001 I1212 11:10:19.840224 3766 impala-server.cc:1076] ReportExecStatus() instance_id=4b438904f491e0f5:4403307d00000001 done=true I1212 11:10:19.840232 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=4b438904f491e0f5:4403307d00000001 status=0 done=true I1212 11:10:19.840761 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 0.000ns 0.000ns 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 1s228ms 3s686ms 0 -1 202.00 KB 0 I1212 11:10:19.840781 3766 progress-updater.cc:65] Query 4b438904f491e0f5:4403307d00000000: 33% Complete (1 out of 3) I1212 11:10:19.840948 3766 coordinator.cc:1521] profile for instance_id=4b438904f491e0f5:4403307d00000001 Instance 4b438904f491e0f5:4403307d00000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 3s721ms, non-child: 1.392ms, % non-child: 0.04%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 164.000ns - TotalStorageWaitTime: 3s275ms - TotalThreadsInvoluntaryContextSwitches: 758 (758) - TotalThreadsTotalWallClockTime: 7s384ms - TotalThreadsSysTime: 71.934ms - TotalThreadsUserTime: 2s699ms - TotalThreadsVoluntaryContextSwitches: 521 (521) Fragment Instance Lifecycle Timings: - ExecTime: 3s685ms - ExecTreeExecTime: 3s685ms - OpenTime: 13.605ms - ExecTreeOpenTime: 1.797ms - PrepareTime: 22.749ms - ExecTreePrepareTime: 70.143us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 25.985us, non-child: 25.985us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 33.385ms, non-child: 33.385ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.842ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 8.332ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 22.523ms KUDU_SCAN_NODE (id=0):(Total: 3s686ms, non-child: 3s686ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (1999622) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 753 (753) - ScannerThreadsTotalWallClockTime: 3s685ms - MaterializeTupleTime(*): 3s685ms - ScannerThreadsSysTime: 71.410ms - ScannerThreadsUserTime: 2s685ms - ScannerThreadsVoluntaryContextSwitches: 505 (505) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec I1212 11:10:19.841398 3766 coordinator.cc:1529] cumulative profile for query_id=4b438904f491e0f5:4403307d00000000 Execution Profile 4b438904f491e0f5:4403307d00000000:(Total: 14.455ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Averaged Fragment F00:(Total: 3s721ms, non-child: 1.392ms, % non-child: 0.04%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 164.000ns - TotalStorageWaitTime: 3s275ms - TotalThreadsInvoluntaryContextSwitches: 758 (758) - TotalThreadsTotalWallClockTime: 7s384ms - TotalThreadsSysTime: 71.934ms - TotalThreadsUserTime: 2s699ms - TotalThreadsVoluntaryContextSwitches: 521 (521) Fragment Instance Lifecycle Timings: - ExecTime: 3s685ms - ExecTreeExecTime: 3s685ms - OpenTime: 13.605ms - ExecTreeOpenTime: 1.797ms - PrepareTime: 22.749ms - ExecTreePrepareTime: 70.143us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 25.985us, non-child: 25.985us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 33.385ms, non-child: 33.385ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.842ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 8.332ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 22.523ms KUDU_SCAN_NODE (id=0):(Total: 3s686ms, non-child: 3s686ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (1999622) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 753 (753) - ScannerThreadsTotalWallClockTime: 3s685ms - MaterializeTupleTime(*): 3s685ms - ScannerThreadsSysTime: 71.410ms - ScannerThreadsUserTime: 2s685ms - ScannerThreadsVoluntaryContextSwitches: 505 (505) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 4b438904f491e0f5:4403307d00000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 3s721ms, non-child: 1.392ms, % non-child: 0.04%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 164.000ns - TotalStorageWaitTime: 3s275ms - TotalThreadsInvoluntaryContextSwitches: 758 (758) - TotalThreadsTotalWallClockTime: 7s384ms - TotalThreadsSysTime: 71.934ms - TotalThreadsUserTime: 2s699ms - TotalThreadsVoluntaryContextSwitches: 521 (521) Fragment Instance Lifecycle Timings: - ExecTime: 3s685ms - ExecTreeExecTime: 3s685ms - OpenTime: 13.605ms - ExecTreeOpenTime: 1.797ms - PrepareTime: 22.749ms - ExecTreePrepareTime: 70.143us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 25.985us, non-child: 25.985us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 33.385ms, non-child: 33.385ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.842ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 8.332ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 22.523ms KUDU_SCAN_NODE (id=0):(Total: 3s686ms, non-child: 3s686ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (1999622) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 753 (753) - ScannerThreadsTotalWallClockTime: 3s685ms - MaterializeTupleTime(*): 3s685ms - ScannerThreadsSysTime: 71.410ms - ScannerThreadsUserTime: 2s685ms - ScannerThreadsVoluntaryContextSwitches: 505 (505) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec I1212 11:10:19.841415 3766 coordinator.cc:1546] Fragment instance completed: id=4b438904f491e0f5:4403307d00000001 host=mj-desktop.ca.cloudera.com:22002 remaining=3 I1212 11:10:19.841419 3766 coordinator.cc:1556] query_id=4b438904f491e0f5:4403307d00000000: first in-progress backend: mj-desktop.ca.cloudera.com:22000 I1212 11:10:19.937619 3769 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=4b438904f491e0f5:4403307d00000000, node=1 I1212 11:10:19.937635 3769 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=4b438904f491e0f5:4403307d00000000 node_id=1 #senders=1 I1212 11:10:19.938643 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=4b438904f491e0f5:4403307d00000002 I1212 11:10:19.938650 3769 impala-server.cc:1076] ReportExecStatus() instance_id=4b438904f491e0f5:4403307d00000002 done=true I1212 11:10:19.938658 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=4b438904f491e0f5:4403307d00000002 status=0 done=true I1212 11:10:19.939152 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 0.000ns 0.000ns 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 2s494ms 3s797ms 0 -1 202.00 KB 0 I1212 11:10:19.939168 3769 progress-updater.cc:65] Query 4b438904f491e0f5:4403307d00000000: 66% Complete (2 out of 3) I1212 11:10:19.939458 3769 coordinator.cc:1521] profile for instance_id=4b438904f491e0f5:4403307d00000002 Instance 4b438904f491e0f5:4403307d00000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 3s819ms, non-child: 1.121ms, % non-child: 0.03%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 252.000ns - TotalStorageWaitTime: 3s401ms - TotalThreadsInvoluntaryContextSwitches: 757 (757) - TotalThreadsTotalWallClockTime: 7s601ms - TotalThreadsSysTime: 40.516ms - TotalThreadsUserTime: 2s793ms - TotalThreadsVoluntaryContextSwitches: 523 (523) Fragment Instance Lifecycle Timings: - ExecTime: 3s796ms - ExecTreeExecTime: 3s795ms - OpenTime: 9.276ms - ExecTreeOpenTime: 1.951ms - PrepareTime: 14.441ms - ExecTreePrepareTime: 68.878us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 20.818us, non-child: 20.818us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 20.866ms, non-child: 20.866ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.317ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 4.881ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 14.105ms KUDU_SCAN_NODE (id=0):(Total: 3s797ms, non-child: 3s797ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000022) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 757 (757) - ScannerThreadsTotalWallClockTime: 3s795ms - MaterializeTupleTime(*): 3s795ms - ScannerThreadsSysTime: 40.516ms - ScannerThreadsUserTime: 2s783ms - ScannerThreadsVoluntaryContextSwitches: 507 (507) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:19.940249 3769 coordinator.cc:1529] cumulative profile for query_id=4b438904f491e0f5:4403307d00000000 Execution Profile 4b438904f491e0f5:4403307d00000000:(Total: 14.455ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Averaged Fragment F00:(Total: 3s770ms, non-child: 1.257ms, % non-child: 0.03%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 208.000ns - TotalStorageWaitTime: 3s338ms - TotalThreadsInvoluntaryContextSwitches: 757 (757) - TotalThreadsTotalWallClockTime: 7s492ms - TotalThreadsSysTime: 56.225ms - TotalThreadsUserTime: 2s746ms - TotalThreadsVoluntaryContextSwitches: 522 (522) Fragment Instance Lifecycle Timings: - ExecTime: 3s740ms - ExecTreeExecTime: 3s740ms - OpenTime: 11.440ms - ExecTreeOpenTime: 1.874ms - PrepareTime: 18.595ms - ExecTreePrepareTime: 69.510us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 23.401us, non-child: 23.401us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 27.126ms, non-child: 27.126ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.580ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 6.607ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 18.314ms KUDU_SCAN_NODE (id=0):(Total: 3s742ms, non-child: 3s742ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (1999822) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 755 (755) - ScannerThreadsTotalWallClockTime: 3s740ms - MaterializeTupleTime(*): 3s740ms - ScannerThreadsSysTime: 55.963ms - ScannerThreadsUserTime: 2s734ms - ScannerThreadsVoluntaryContextSwitches: 506 (506) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 4b438904f491e0f5:4403307d00000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 3s721ms, non-child: 1.392ms, % non-child: 0.04%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 164.000ns - TotalStorageWaitTime: 3s275ms - TotalThreadsInvoluntaryContextSwitches: 758 (758) - TotalThreadsTotalWallClockTime: 7s384ms - TotalThreadsSysTime: 71.934ms - TotalThreadsUserTime: 2s699ms - TotalThreadsVoluntaryContextSwitches: 521 (521) Fragment Instance Lifecycle Timings: - ExecTime: 3s685ms - ExecTreeExecTime: 3s685ms - OpenTime: 13.605ms - ExecTreeOpenTime: 1.797ms - PrepareTime: 22.749ms - ExecTreePrepareTime: 70.143us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 25.985us, non-child: 25.985us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 33.385ms, non-child: 33.385ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.842ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 8.332ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 22.523ms KUDU_SCAN_NODE (id=0):(Total: 3s686ms, non-child: 3s686ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (1999622) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 753 (753) - ScannerThreadsTotalWallClockTime: 3s685ms - MaterializeTupleTime(*): 3s685ms - ScannerThreadsSysTime: 71.410ms - ScannerThreadsUserTime: 2s685ms - ScannerThreadsVoluntaryContextSwitches: 505 (505) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Instance 4b438904f491e0f5:4403307d00000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 3s819ms, non-child: 1.121ms, % non-child: 0.03%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 252.000ns - TotalStorageWaitTime: 3s401ms - TotalThreadsInvoluntaryContextSwitches: 757 (757) - TotalThreadsTotalWallClockTime: 7s601ms - TotalThreadsSysTime: 40.516ms - TotalThreadsUserTime: 2s793ms - TotalThreadsVoluntaryContextSwitches: 523 (523) Fragment Instance Lifecycle Timings: - ExecTime: 3s796ms - ExecTreeExecTime: 3s795ms - OpenTime: 9.276ms - ExecTreeOpenTime: 1.951ms - PrepareTime: 14.441ms - ExecTreePrepareTime: 68.878us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 20.818us, non-child: 20.818us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 20.866ms, non-child: 20.866ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.317ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 4.881ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 14.105ms KUDU_SCAN_NODE (id=0):(Total: 3s797ms, non-child: 3s797ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000022) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 757 (757) - ScannerThreadsTotalWallClockTime: 3s795ms - MaterializeTupleTime(*): 3s795ms - ScannerThreadsSysTime: 40.516ms - ScannerThreadsUserTime: 2s783ms - ScannerThreadsVoluntaryContextSwitches: 507 (507) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:19.940271 3769 coordinator.cc:1546] Fragment instance completed: id=4b438904f491e0f5:4403307d00000002 host=mj-desktop.ca.cloudera.com:22001 remaining=2 I1212 11:10:19.940275 3769 coordinator.cc:1556] query_id=4b438904f491e0f5:4403307d00000000: first in-progress backend: mj-desktop.ca.cloudera.com:22000 I1212 11:10:19.951730 14620 kudu-scan-node.cc:324] Thread done: scanner-thread(1) I1212 11:10:19.951845 14594 data-stream-sender.cc:284] Channel::FlushAndSendEos() instance_id=4b438904f491e0f5:4403307d00000000 dest_node=1 #rows= 0 I1212 11:10:19.951858 14594 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:19.951864 14594 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:19.951869 14594 data-stream-sender.cc:311] calling TransmitData(eos=true) to terminate channel. I1212 11:10:19.951913 5418 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=4b438904f491e0f5:4403307d00000000, node=1 I1212 11:10:19.951925 5418 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=4b438904f491e0f5:4403307d00000000 node_id=1 #senders=0 I1212 11:10:19.951959 14591 exchange-node.cc:139] exch: has batch=false #rows=0 is_cancelled=false instance_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:19.951982 14594 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:19.952004 14591 exchange-node.cc:139] exch: has batch=false #rows=0 is_cancelled=false instance_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:19.952033 14603 plan-fragment-executor.cc:408] Reporting final profile for instance 4b438904f491e0f5:4403307d00000003 I1212 11:10:19.952036 14598 plan-fragment-executor.cc:408] Reporting final profile for instance 4b438904f491e0f5:4403307d00000000 I1212 11:10:19.952239 14603 plan-fragment-executor.cc:412] Fragment 4b438904f491e0f5:4403307d00000003:(Total: 3s833ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 0 - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 143.000ns - TotalStorageWaitTime: 3s382ms - TotalThreadsInvoluntaryContextSwitches: 794 (794) - TotalThreadsTotalWallClockTime: 7s610ms - TotalThreadsSysTime: 63.109ms - TotalThreadsUserTime: 2s751ms - TotalThreadsVoluntaryContextSwitches: 603 (603) Fragment Instance Lifecycle Timings: - ExecTime: 3s798ms - ExecTreeExecTime: 3s797ms - OpenTime: 13.886ms - ExecTreeOpenTime: 2.567ms - PrepareTime: 21.857ms - ExecTreePrepareTime: 65.712us DataStreamSender (dst_id=1):(Total: 26.002us, non-child: 0.000ns, % non-child: 0.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 32.145ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 0.000ns - CompileTime: 2.037ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 7.995ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 21.459ms KUDU_SCAN_NODE (id=0):(Total: 3s800ms, non-child: 0.000ns, % non-child: 0.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2001571) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 789 (789) - ScannerThreadsTotalWallClockTime: 3s798ms - MaterializeTupleTime(*): 3s797ms - ScannerThreadsSysTime: 63.109ms - ScannerThreadsUserTime: 2s737ms - ScannerThreadsVoluntaryContextSwitches: 590 (590) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:19.952244 14603 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=4b438904f491e0f5:4403307d00000003 I1212 11:10:19.952329 14594 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:19.952334 14594 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:19.952355 14598 plan-fragment-executor.cc:412] Fragment 4b438904f491e0f5:4403307d00000000:(Total: 3s834ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 0 - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 3s820ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 3s820ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.024ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 21.833us - ExecTreeExecTime: 11.757us - OpenTime: 3s820ms - ExecTreeOpenTime: 3s820ms - PrepareTime: 13.548ms - ExecTreePrepareTime: 66.579us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 13.061ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.566ms EXCHANGE_NODE (id=1):(Total: 3s820ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.482us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 3s820ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns I1212 11:10:19.952373 14598 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:19.952605 14591 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:19.952612 14591 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:19.952625 3396 impala-internal-service.cc:74] ReportExecStatus(): instance_id=4b438904f491e0f5:4403307d00000003 I1212 11:10:19.952633 3396 impala-server.cc:1076] ReportExecStatus() instance_id=4b438904f491e0f5:4403307d00000003 done=true I1212 11:10:19.952641 3396 coordinator.cc:1437] UpdateFragmentExecStatus() instance=4b438904f491e0f5:4403307d00000003 status=0 done=true I1212 11:10:19.952910 5418 impala-internal-service.cc:74] ReportExecStatus(): instance_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:19.952914 5418 impala-server.cc:1076] ReportExecStatus() instance_id=4b438904f491e0f5:4403307d00000000 done=true I1212 11:10:19.952919 5418 coordinator.cc:1437] UpdateFragmentExecStatus() instance=4b438904f491e0f5:4403307d00000000 status=0 done=true I1212 11:10:19.952996 3396 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 0.000ns 0.000ns 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s761ms 3s800ms 0 -1 202.00 KB 0 I1212 11:10:19.953006 3396 progress-updater.cc:55] Query 4b438904f491e0f5:4403307d00000000 100% Complete (3 out of 3) I1212 11:10:19.953081 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 22.299us 22.299us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s761ms 3s800ms 0 -1 202.00 KB 0 I1212 11:10:19.953205 3396 coordinator.cc:1521] profile for instance_id=4b438904f491e0f5:4403307d00000003 Instance 4b438904f491e0f5:4403307d00000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 3s833ms, non-child: 1.360ms, % non-child: 0.04%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 143.000ns - TotalStorageWaitTime: 3s382ms - TotalThreadsInvoluntaryContextSwitches: 794 (794) - TotalThreadsTotalWallClockTime: 7s610ms - TotalThreadsSysTime: 63.109ms - TotalThreadsUserTime: 2s751ms - TotalThreadsVoluntaryContextSwitches: 603 (603) Fragment Instance Lifecycle Timings: - ExecTime: 3s798ms - ExecTreeExecTime: 3s797ms - OpenTime: 13.886ms - ExecTreeOpenTime: 2.567ms - PrepareTime: 21.857ms - ExecTreePrepareTime: 65.712us DataStreamSender (dst_id=1):(Total: 26.002us, non-child: 26.002us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 32.145ms, non-child: 32.145ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.037ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 7.995ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 21.459ms KUDU_SCAN_NODE (id=0):(Total: 3s800ms, non-child: 3s800ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2001571) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 789 (789) - ScannerThreadsTotalWallClockTime: 3s798ms - MaterializeTupleTime(*): 3s797ms - ScannerThreadsSysTime: 63.109ms - ScannerThreadsUserTime: 2s737ms - ScannerThreadsVoluntaryContextSwitches: 590 (590) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:19.953232 5418 coordinator.cc:1521] profile for instance_id=4b438904f491e0f5:4403307d00000000 Instance 4b438904f491e0f5:4403307d00000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 3s834ms, non-child: 803.814us, % non-child: 0.02%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 3s820ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 3s820ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.024ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 21.833us - ExecTreeExecTime: 11.757us - OpenTime: 3s820ms - ExecTreeOpenTime: 3s820ms - PrepareTime: 13.548ms - ExecTreePrepareTime: 66.579us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 13.061ms, non-child: 13.061ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.566ms EXCHANGE_NODE (id=1):(Total: 3s820ms, non-child: 22.299us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.482us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 3s820ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns I1212 11:10:19.953779 2681 impala-hs2-server.cc:713] GetResultSetMetadata(): query_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:19.953986 2681 impala-hs2-server.cc:753] GetResultSetMetadata(): return_val=TGetResultSetMetadataResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: schema (struct) = TTableSchema { 01: columns (list) = list[16] { [0] = TColumnDesc { 01: columnName (string) = "l_orderkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 0, }, [1] = TColumnDesc { 01: columnName (string) = "l_linenumber", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 3, }, }, }, }, 03: position (i32) = 1, }, [2] = TColumnDesc { 01: columnName (string) = "l_partkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 2, }, [3] = TColumnDesc { 01: columnName (string) = "l_suppkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 3, }, [4] = TColumnDesc { 01: columnName (string) = "l_quantity", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 4, }, [5] = TColumnDesc { 01: columnName (string) = "l_extendedprice", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 5, }, [6] = TColumnDesc { 01: columnName (string) = "l_discount", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 6, }, [7] = TColumnDesc { 01: columnName (string) = "l_tax", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 7, }, [8] = TColumnDesc { 01: columnName (string) = "l_returnflag", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 8, }, [9] = TColumnDesc { 01: columnName (string) = "l_linestatus", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 9, }, [10] = TColumnDesc { 01: columnName (string) = "l_shipdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 10, }, [11] = TColumnDesc { 01: columnName (string) = "l_commitdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 11, }, [12] = TColumnDesc { 01: columnName (string) = "l_receiptdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 12, }, [13] = TColumnDesc { 01: columnName (string) = "l_shipinstruct", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 13, }, [14] = TColumnDesc { 01: columnName (string) = "l_shipmode", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 14, }, [15] = TColumnDesc { 01: columnName (string) = "l_comment", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 15, }, }, }, } I1212 11:10:19.954074 5418 coordinator.cc:1529] cumulative profile for query_id=4b438904f491e0f5:4403307d00000000 Execution Profile 4b438904f491e0f5:4403307d00000000:(Total: 3s835ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance 4b438904f491e0f5:4403307d00000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 3s834ms, non-child: 803.814us, % non-child: 0.02%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 3s820ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 3s820ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.024ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 21.833us - ExecTreeExecTime: 11.757us - OpenTime: 3s820ms - ExecTreeOpenTime: 3s820ms - PrepareTime: 13.548ms - ExecTreePrepareTime: 66.579us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 13.061ms, non-child: 13.061ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.566ms EXCHANGE_NODE (id=1):(Total: 3s820ms, non-child: 22.299us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.482us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 3s820ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 3s791ms, non-child: 1.291ms, % non-child: 0.03%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 213.61 KB (218736) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 186.000ns - TotalStorageWaitTime: 3s352ms - TotalThreadsInvoluntaryContextSwitches: 769 (769) - TotalThreadsTotalWallClockTime: 7s531ms - TotalThreadsSysTime: 58.519ms - TotalThreadsUserTime: 2s748ms - TotalThreadsVoluntaryContextSwitches: 549 (549) Fragment Instance Lifecycle Timings: - ExecTime: 3s759ms - ExecTreeExecTime: 3s759ms - OpenTime: 12.256ms - ExecTreeOpenTime: 2.105ms - PrepareTime: 19.682ms - ExecTreePrepareTime: 68.244us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 24.268us, non-child: 24.268us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 28.799ms, non-child: 28.799ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.732ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 7.070ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 19.363ms KUDU_SCAN_NODE (id=0):(Total: 3s761ms, non-child: 3s761ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000405) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 766 (766) - ScannerThreadsTotalWallClockTime: 3s759ms - MaterializeTupleTime(*): 3s759ms - ScannerThreadsSysTime: 58.345ms - ScannerThreadsUserTime: 2s735ms - ScannerThreadsVoluntaryContextSwitches: 534 (534) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 4b438904f491e0f5:4403307d00000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 3s721ms, non-child: 1.392ms, % non-child: 0.04%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 164.000ns - TotalStorageWaitTime: 3s275ms - TotalThreadsInvoluntaryContextSwitches: 758 (758) - TotalThreadsTotalWallClockTime: 7s384ms - TotalThreadsSysTime: 71.934ms - TotalThreadsUserTime: 2s699ms - TotalThreadsVoluntaryContextSwitches: 521 (521) Fragment Instance Lifecycle Timings: - ExecTime: 3s685ms - ExecTreeExecTime: 3s685ms - OpenTime: 13.605ms - ExecTreeOpenTime: 1.797ms - PrepareTime: 22.749ms - ExecTreePrepareTime: 70.143us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 25.985us, non-child: 25.985us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 33.385ms, non-child: 33.385ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.842ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 8.332ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 22.523ms KUDU_SCAN_NODE (id=0):(Total: 3s686ms, non-child: 3s686ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (1999622) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 753 (753) - ScannerThreadsTotalWallClockTime: 3s685ms - MaterializeTupleTime(*): 3s685ms - ScannerThreadsSysTime: 71.410ms - ScannerThreadsUserTime: 2s685ms - ScannerThreadsVoluntaryContextSwitches: 505 (505) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Instance 4b438904f491e0f5:4403307d00000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 3s819ms, non-child: 1.121ms, % non-child: 0.03%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 252.000ns - TotalStorageWaitTime: 3s401ms - TotalThreadsInvoluntaryContextSwitches: 757 (757) - TotalThreadsTotalWallClockTime: 7s601ms - TotalThreadsSysTime: 40.516ms - TotalThreadsUserTime: 2s793ms - TotalThreadsVoluntaryContextSwitches: 523 (523) Fragment Instance Lifecycle Timings: - ExecTime: 3s796ms - ExecTreeExecTime: 3s795ms - OpenTime: 9.276ms - ExecTreeOpenTime: 1.951ms - PrepareTime: 14.441ms - ExecTreePrepareTime: 68.878us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 20.818us, non-child: 20.818us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 20.866ms, non-child: 20.866ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.317ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 4.881ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 14.105ms KUDU_SCAN_NODE (id=0):(Total: 3s797ms, non-child: 3s797ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000022) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 757 (757) - ScannerThreadsTotalWallClockTime: 3s795ms - MaterializeTupleTime(*): 3s795ms - ScannerThreadsSysTime: 40.516ms - ScannerThreadsUserTime: 2s783ms - ScannerThreadsVoluntaryContextSwitches: 507 (507) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec Instance 4b438904f491e0f5:4403307d00000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 3s833ms, non-child: 1.360ms, % non-child: 0.04%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 143.000ns - TotalStorageWaitTime: 3s382ms - TotalThreadsInvoluntaryContextSwitches: 794 (794) - TotalThreadsTotalWallClockTime: 7s610ms - TotalThreadsSysTime: 63.109ms - TotalThreadsUserTime: 2s751ms - TotalThreadsVoluntaryContextSwitches: 603 (603) Fragment Instance Lifecycle Timings: - ExecTime: 3s798ms - ExecTreeExecTime: 3s797ms - OpenTime: 13.886ms - ExecTreeOpenTime: 2.567ms - PrepareTime: 21.857ms - ExecTreePrepareTime: 65.712us DataStreamSender (dst_id=1):(Total: 26.002us, non-child: 26.002us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 32.145ms, non-child: 32.145ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.037ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 7.995ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 21.459ms KUDU_SCAN_NODE (id=0):(Total: 3s800ms, non-child: 3s800ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2001571) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 789 (789) - ScannerThreadsTotalWallClockTime: 3s798ms - MaterializeTupleTime(*): 3s797ms - ScannerThreadsSysTime: 63.109ms - ScannerThreadsUserTime: 2s737ms - ScannerThreadsVoluntaryContextSwitches: 590 (590) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:19.954095 5418 coordinator.cc:1546] Fragment instance completed: id=4b438904f491e0f5:4403307d00000000 host=mj-desktop.ca.cloudera.com:22000 remaining=1 I1212 11:10:19.954140 14591 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:19.954252 3396 coordinator.cc:1529] cumulative profile for query_id=4b438904f491e0f5:4403307d00000000 Execution Profile 4b438904f491e0f5:4403307d00000000:(Total: 3s835ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 0, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance 4b438904f491e0f5:4403307d00000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 3s834ms, non-child: 803.814us, % non-child: 0.02%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 3s820ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 3s820ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.024ms - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 21.833us - ExecTreeExecTime: 11.757us - OpenTime: 3s820ms - ExecTreeOpenTime: 3s820ms - PrepareTime: 13.548ms - ExecTreePrepareTime: 66.579us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 13.061ms, non-child: 13.061ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 12.566ms EXCHANGE_NODE (id=1):(Total: 3s820ms, non-child: 22.299us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.482us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 3s820ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 3s791ms, non-child: 1.291ms, % non-child: 0.03%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 213.61 KB (218736) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 186.000ns - TotalStorageWaitTime: 3s352ms - TotalThreadsInvoluntaryContextSwitches: 769 (769) - TotalThreadsTotalWallClockTime: 7s531ms - TotalThreadsSysTime: 58.519ms - TotalThreadsUserTime: 2s748ms - TotalThreadsVoluntaryContextSwitches: 549 (549) Fragment Instance Lifecycle Timings: - ExecTime: 3s759ms - ExecTreeExecTime: 3s759ms - OpenTime: 12.256ms - ExecTreeOpenTime: 2.105ms - PrepareTime: 19.682ms - ExecTreePrepareTime: 68.244us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 24.268us, non-child: 24.268us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 28.799ms, non-child: 28.799ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.732ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 7.070ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 19.363ms KUDU_SCAN_NODE (id=0):(Total: 3s761ms, non-child: 3s761ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000405) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 766 (766) - ScannerThreadsTotalWallClockTime: 3s759ms - MaterializeTupleTime(*): 3s759ms - ScannerThreadsSysTime: 58.345ms - ScannerThreadsUserTime: 2s735ms - ScannerThreadsVoluntaryContextSwitches: 534 (534) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 4b438904f491e0f5:4403307d00000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 3s721ms, non-child: 1.392ms, % non-child: 0.04%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 164.000ns - TotalStorageWaitTime: 3s275ms - TotalThreadsInvoluntaryContextSwitches: 758 (758) - TotalThreadsTotalWallClockTime: 7s384ms - TotalThreadsSysTime: 71.934ms - TotalThreadsUserTime: 2s699ms - TotalThreadsVoluntaryContextSwitches: 521 (521) Fragment Instance Lifecycle Timings: - ExecTime: 3s685ms - ExecTreeExecTime: 3s685ms - OpenTime: 13.605ms - ExecTreeOpenTime: 1.797ms - PrepareTime: 22.749ms - ExecTreePrepareTime: 70.143us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 25.985us, non-child: 25.985us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 33.385ms, non-child: 33.385ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.842ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 8.332ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 22.523ms KUDU_SCAN_NODE (id=0):(Total: 3s686ms, non-child: 3s686ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (1999622) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 753 (753) - ScannerThreadsTotalWallClockTime: 3s685ms - MaterializeTupleTime(*): 3s685ms - ScannerThreadsSysTime: 71.410ms - ScannerThreadsUserTime: 2s685ms - ScannerThreadsVoluntaryContextSwitches: 505 (505) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Instance 4b438904f491e0f5:4403307d00000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 3s819ms, non-child: 1.121ms, % non-child: 0.03%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 252.000ns - TotalStorageWaitTime: 3s401ms - TotalThreadsInvoluntaryContextSwitches: 757 (757) - TotalThreadsTotalWallClockTime: 7s601ms - TotalThreadsSysTime: 40.516ms - TotalThreadsUserTime: 2s793ms - TotalThreadsVoluntaryContextSwitches: 523 (523) Fragment Instance Lifecycle Timings: - ExecTime: 3s796ms - ExecTreeExecTime: 3s795ms - OpenTime: 9.276ms - ExecTreeOpenTime: 1.951ms - PrepareTime: 14.441ms - ExecTreePrepareTime: 68.878us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 20.818us, non-child: 20.818us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 20.866ms, non-child: 20.866ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.317ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 4.881ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 14.105ms KUDU_SCAN_NODE (id=0):(Total: 3s797ms, non-child: 3s797ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000022) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 757 (757) - ScannerThreadsTotalWallClockTime: 3s795ms - MaterializeTupleTime(*): 3s795ms - ScannerThreadsSysTime: 40.516ms - ScannerThreadsUserTime: 2s783ms - ScannerThreadsVoluntaryContextSwitches: 507 (507) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec Instance 4b438904f491e0f5:4403307d00000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 3s833ms, non-child: 1.360ms, % non-child: 0.04%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 143.000ns - TotalStorageWaitTime: 3s382ms - TotalThreadsInvoluntaryContextSwitches: 794 (794) - TotalThreadsTotalWallClockTime: 7s610ms - TotalThreadsSysTime: 63.109ms - TotalThreadsUserTime: 2s751ms - TotalThreadsVoluntaryContextSwitches: 603 (603) Fragment Instance Lifecycle Timings: - ExecTime: 3s798ms - ExecTreeExecTime: 3s797ms - OpenTime: 13.886ms - ExecTreeOpenTime: 2.567ms - PrepareTime: 21.857ms - ExecTreePrepareTime: 65.712us DataStreamSender (dst_id=1):(Total: 26.002us, non-child: 26.002us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 32.145ms, non-child: 32.145ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 2.037ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 7.995ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 21.459ms KUDU_SCAN_NODE (id=0):(Total: 3s800ms, non-child: 3s800ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2001571) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 789 (789) - ScannerThreadsTotalWallClockTime: 3s798ms - MaterializeTupleTime(*): 3s797ms - ScannerThreadsSysTime: 63.109ms - ScannerThreadsUserTime: 2s737ms - ScannerThreadsVoluntaryContextSwitches: 590 (590) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:19.954300 3396 coordinator.cc:1546] Fragment instance completed: id=4b438904f491e0f5:4403307d00000003 host=mj-desktop.ca.cloudera.com:22000 remaining=0 I1212 11:10:19.954375 14594 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:19.954463 2681 coordinator.cc:1069] All fragment instances finished successfully. I1212 11:10:19.954483 14591 data-stream-mgr.cc:226] DeregisterRecvr(): fragment_instance_id=4b438904f491e0f5:4403307d00000000, node=1 I1212 11:10:19.954491 14591 data-stream-recvr.cc:237] cancelled stream: fragment_instance_id_=4b438904f491e0f5:4403307d00000000 node_id=1 I1212 11:10:19.954512 14594 query-exec-mgr.cc:103] Instance completed. instance_id=4b438904f491e0f5:4403307d00000003 I1212 11:10:19.954514 14591 query-exec-mgr.cc:103] Instance completed. instance_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:19.954517 14591 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=4b438904f491e0f5:4403307d00000000 refcnt=3 I1212 11:10:19.954517 14594 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=4b438904f491e0f5:4403307d00000000 refcnt=2 I1212 11:10:19.954586 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 22.299us 22.299us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s761ms 3s800ms 0 -1 202.00 KB 0 I1212 11:10:19.954880 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 22.299us 22.299us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s761ms 3s800ms 0 -1 202.00 KB 0 I1212 11:10:19.955108 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 22.299us 22.299us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s761ms 3s800ms 0 -1 202.00 KB 0 I1212 11:10:19.955294 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 22.299us 22.299us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s761ms 3s800ms 0 -1 202.00 KB 0 I1212 11:10:19.955639 2681 impala-hs2-server.cc:688] CloseOperation(): query_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:19.955646 2681 impala-server.cc:907] UnregisterQuery(): query_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:19.955651 2681 impala-server.cc:993] Cancel(): query_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:19.955657 2681 coordinator.cc:1362] Cancel() query_id=4b438904f491e0f5:4403307d00000000 I1212 11:10:19.955667 2681 coordinator.cc:1428] CancelFragmentInstances() query_id=4b438904f491e0f5:4403307d00000000, tried to cancel 0 fragment instances I1212 11:10:19.955770 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 22.299us 22.299us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s761ms 3s800ms 0 -1 202.00 KB 0 I1212 11:10:19.955972 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 22.299us 22.299us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s761ms 3s800ms 0 -1 202.00 KB 0 I1212 11:10:19.956171 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 22.299us 22.299us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s761ms 3s800ms 0 -1 202.00 KB 0 I1212 11:10:19.956351 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 22.299us 22.299us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s761ms 3s800ms 0 -1 202.00 KB 0 I1212 11:10:19.956476 2681 admission-controller.cc:538] Released query id=4b438904f491e0f5:4403307d00000000 agg_num_running=1, agg_num_queued=0, agg_mem_reserved=32.00 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=10.00 MB) I1212 11:10:19.956490 2681 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=4b438904f491e0f5:4403307d00000000 refcnt=1 I1212 11:10:19.966678 2681 impala-hs2-server.cc:414] ExecuteStatement(): request=TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\xf2|\xcc\xd5t@I\x94\x88\xb7P\xc3\b\xc9\xa8B", 02: secret (string) = "\xa1\x02\xf8tSZ@2\x8d|\x0f\x9c\xb2\x01\xf4\xf4", }, }, 02: statement (string) = "select * from lineitem limit 90", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "10m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:19.966711 2681 impala-hs2-server.cc:228] TExecuteStatementReq: TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\xf2|\xcc\xd5t@I\x94\x88\xb7P\xc3\b\xc9\xa8B", 02: secret (string) = "\xa1\x02\xf8tSZ@2\x8d|\x0f\x9c\xb2\x01\xf4\xf4", }, }, 02: statement (string) = "select * from lineitem limit 90", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "10m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:19.966766 2681 impala-server.cc:742] Parsed pool options: override_options_mask=1111111111111111111111111111111110111111111111111111111111000010 set_pool_mask=0000000000000000000000000000000000000000000000000000000000000000 overlay_mask=0000000000000000000000000000000000000000000000000000000000000000 I1212 11:10:19.966846 2681 impala-hs2-server.cc:261] TClientRequest.queryOptions: TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 10485760, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, } I1212 11:10:19.969707 2681 mem-tracker.cc:184] Using query memory limit: 10.00 MB I1212 11:10:19.975131 14630 AsyncKuduClient.java:1367] Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) I1212 11:10:19.977831 14631 AsyncKuduClient.java:1367] Learned about tablet de1fe37fdb46438abfbc154bf7fb439b for table 'impala::ucu3e4.lineitem' with partition [, 0x00000001) I1212 11:10:19.978109 14631 AsyncKuduClient.java:1367] Learned about tablet 91d0d8d3b0e34afc9d7fa522e61f40ef for table 'impala::ucu3e4.lineitem' with partition [0x00000001, 0x00000002) I1212 11:10:19.978386 14631 AsyncKuduClient.java:1367] Learned about tablet dc26b34fb84d4ff8baae3f44b23f0ae2 for table 'impala::ucu3e4.lineitem' with partition [0x00000002, ) I1212 11:10:19.984074 2681 impala-server.cc:812] Execution request: TExecRequest { 01: stmt_type (i32) = 0, 02: query_options (struct) = TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 10485760, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 44: mt_dop (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, }, 03: query_exec_request (struct) = TQueryExecRequest { 01: desc_tbl (struct) = TDescriptorTable { 01: slotDescriptors (list) = list[16] { [0] = TSlotDescriptor { 01: id (i32) = 0, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 0, }, 06: byteOffset (i32) = 128, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 8, }, [1] = TSlotDescriptor { 01: id (i32) = 1, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 1, }, 06: byteOffset (i32) = 184, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 15, }, [2] = TSlotDescriptor { 01: id (i32) = 2, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 2, }, 06: byteOffset (i32) = 136, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 9, }, [3] = TSlotDescriptor { 01: id (i32) = 3, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 3, }, 06: byteOffset (i32) = 144, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 10, }, [4] = TSlotDescriptor { 01: id (i32) = 4, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 4, }, 06: byteOffset (i32) = 152, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 11, }, [5] = TSlotDescriptor { 01: id (i32) = 5, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 5, }, 06: byteOffset (i32) = 160, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 12, }, [6] = TSlotDescriptor { 01: id (i32) = 6, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 6, }, 06: byteOffset (i32) = 168, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 13, }, [7] = TSlotDescriptor { 01: id (i32) = 7, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 7, }, 06: byteOffset (i32) = 176, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 14, }, [8] = TSlotDescriptor { 01: id (i32) = 8, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 8, }, 06: byteOffset (i32) = 0, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 0, 09: slotIdx (i32) = 0, }, [9] = TSlotDescriptor { 01: id (i32) = 9, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 9, }, 06: byteOffset (i32) = 16, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 1, }, [10] = TSlotDescriptor { 01: id (i32) = 10, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 10, }, 06: byteOffset (i32) = 32, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 2, }, [11] = TSlotDescriptor { 01: id (i32) = 11, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 11, }, 06: byteOffset (i32) = 48, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 3, }, [12] = TSlotDescriptor { 01: id (i32) = 12, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 12, }, 06: byteOffset (i32) = 64, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 4, }, [13] = TSlotDescriptor { 01: id (i32) = 13, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 13, }, 06: byteOffset (i32) = 80, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 5, }, [14] = TSlotDescriptor { 01: id (i32) = 14, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 14, }, 06: byteOffset (i32) = 96, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 6, }, [15] = TSlotDescriptor { 01: id (i32) = 15, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 15, }, 06: byteOffset (i32) = 112, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 7, 09: slotIdx (i32) = 7, }, }, 02: tupleDescriptors (list) = list[1] { [0] = TTupleDescriptor { 01: id (i32) = 0, 02: byteSize (i32) = 190, 03: numNullBytes (i32) = 2, 04: tableId (i32) = 1, 05: tuplePath (list) = list[0] { }, }, }, 03: tableDescriptors (list) = list[1] { [0] = TTableDescriptor { 01: id (i32) = 1, 02: tableType (i32) = 4, 03: columnDescriptors (list) = list[16] { [0] = TColumnDescriptor { 01: name (string) = "l_orderkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [1] = TColumnDescriptor { 01: name (string) = "l_linenumber", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, }, [2] = TColumnDescriptor { 01: name (string) = "l_partkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [3] = TColumnDescriptor { 01: name (string) = "l_suppkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [4] = TColumnDescriptor { 01: name (string) = "l_quantity", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [5] = TColumnDescriptor { 01: name (string) = "l_extendedprice", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [6] = TColumnDescriptor { 01: name (string) = "l_discount", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [7] = TColumnDescriptor { 01: name (string) = "l_tax", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [8] = TColumnDescriptor { 01: name (string) = "l_returnflag", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [9] = TColumnDescriptor { 01: name (string) = "l_linestatus", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [10] = TColumnDescriptor { 01: name (string) = "l_shipdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [11] = TColumnDescriptor { 01: name (string) = "l_commitdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [12] = TColumnDescriptor { 01: name (string) = "l_receiptdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [13] = TColumnDescriptor { 01: name (string) = "l_shipinstruct", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [14] = TColumnDescriptor { 01: name (string) = "l_shipmode", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [15] = TColumnDescriptor { 01: name (string) = "l_comment", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, }, 04: numClusteringCols (i32) = 0, 07: tableName (string) = "impala::ucu3e4.lineitem", 08: dbName (string) = "ucu3e4", 10: kuduTable (struct) = TKuduTable { 01: table_name (string) = "impala::ucu3e4.lineitem", 02: master_addresses (list) = list[1] { [0] = "127.0.0.1", }, 03: key_columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 04: partition_by (list) = list[1] { [0] = TKuduPartitionParam { 01: by_hash_param (struct) = TKuduPartitionByHashParam { 01: columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 02: num_partitions (i32) = 3, }, }, }, }, }, }, }, 02: plan_exec_info (list) = list[1] { [0] = TPlanExecInfo { 01: fragments (list) = list[2] { [0] = TPlanFragment { 01: idx (i32) = 0, 02: display_name (string) = "F01", 03: plan (struct) = TPlan { 01: nodes (list) = list[1] { [0] = TPlanNode { 01: node_id (i32) = 1, 02: node_type (i32) = 6, 03: num_children (i32) = 0, 04: limit (i64) = 90, 05: row_tuples (list) = list[1] { [0] = 0, }, 06: nullable_tuples (list) = list[1] { [0] = false, }, 08: disable_codegen (bool) = false, 18: exchange_node (struct) = TExchangeNode { 01: input_row_tuples (list) = list[1] { [0] = 0, }, }, 21: label (string) = "01:EXCHANGE", 22: label_detail (string) = "UNPARTITIONED", 23: estimated_stats (struct) = TExecStats { 03: cardinality (i64) = 90, 04: memory_used (i64) = -1, }, }, }, }, 04: output_exprs (list) = list[16] { [0] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 0, }, }, }, }, [1] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 1, }, }, }, }, [2] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 2, }, }, }, }, [3] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 3, }, }, }, }, [4] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 4, }, }, }, }, [5] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 5, }, }, }, }, [6] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 6, }, }, }, }, [7] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 7, }, }, }, }, [8] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 1 I1212 11:10:19.984441 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22000(local selection) I1212 11:10:19.984472 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22001(local selection) I1212 11:10:19.984498 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22002(local selection) I1212 11:10:19.984504 2681 simple-scheduler.cc:979] Total remote scan volume = 0 I1212 11:10:19.984513 2681 simple-scheduler.cc:981] Total local scan volume = 2.93 KB I1212 11:10:19.984515 2681 simple-scheduler.cc:983] Total cached scan volume = 0 I1212 11:10:19.984527 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22002, } I1212 11:10:19.984544 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:19.984551 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22001, } I1212 11:10:19.984563 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](479)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:19.984570 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, } I1212 11:10:19.984594 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:19.984679 2681 admission-controller.cc:440] Schedule for id=ca4e75b194e0a9f3:5cdfeeb700000000 in pool_name=default-pool cluster_mem_needed=30.00 MB PoolConfig: max_requests=-1 max_queued=200 max_mem=-1.00 B I1212 11:10:19.984696 2681 admission-controller.cc:445] Stats: agg_num_running=1, agg_num_queued=0, agg_mem_reserved=32.00 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=10.00 MB) I1212 11:10:19.984704 2681 admission-controller.cc:451] Admitted query id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:19.984735 2681 admission-controller.cc:457] Final: agg_num_running=2, agg_num_queued=0, agg_mem_reserved=32.00 MB, local_host(local_mem_admitted=3.78 GB, num_admitted_running=2, num_queued=0, backend_mem_reserved=10.00 MB) I1212 11:10:19.984779 2681 coordinator.cc:447] Exec() query_id=ca4e75b194e0a9f3:5cdfeeb700000000 stmt=select * from lineitem limit 90 I1212 11:10:19.984843 2681 mem-tracker.cc:184] Using query memory limit: 10.00 MB I1212 11:10:19.984947 2681 coordinator.cc:602] starting 4 fragment instances for query ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:19.985019 2681 coordinator.cc:737] ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- I1212 11:10:19.985177 2569 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:19.985183 2569 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:19.985188 2569 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:19.985198 2572 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22001 instance_id=ca4e75b194e0a9f3:5cdfeeb700000002 I1212 11:10:19.985198 2563 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22002 instance_id=ca4e75b194e0a9f3:5cdfeeb700000001 I1212 11:10:19.985210 2563 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22002) I1212 11:10:19.985219 2563 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22002 I1212 11:10:19.985312 2572 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22001) I1212 11:10:19.985319 2572 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22001 I1212 11:10:19.985323 2561 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=ca4e75b194e0a9f3:5cdfeeb700000003 I1212 11:10:19.985328 2561 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:19.985332 2561 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:19.985375 5418 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:19.985381 5418 query-exec-mgr.cc:45] StartFInstance() instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:19.985399 5418 query-exec-mgr.cc:69] new QueryState: query_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:19.985401 5418 query-exec-mgr.cc:77] QueryState: query_id=ca4e75b194e0a9f3:5cdfeeb700000000 refcnt=1 I1212 11:10:19.985450 5418 query-state.cc:58] RegisterFInstance(): instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:19.985543 5418 thread.cc:288] Started thread 14646 - query-exec-mgr:exec-fragment-instance-ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:19.985544 14646 plan-fragment-executor.cc:123] Prepare(): instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:19.985543 3396 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=ca4e75b194e0a9f3:5cdfeeb700000003 I1212 11:10:19.985560 3396 query-exec-mgr.cc:45] StartFInstance() instance_id=ca4e75b194e0a9f3:5cdfeeb700000003 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:19.985565 3396 query-exec-mgr.cc:77] QueryState: query_id=ca4e75b194e0a9f3:5cdfeeb700000000 refcnt=2 I1212 11:10:19.985584 14646 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = -3869025624297264653, 02: lo (i64) = 6692330041042272256, }, 02: per_fragment_instance_idx (i32) = 0, 03: per_node_scan_ranges (map) = map[0] { }, 04: per_exch_num_senders (map) = map[1] { 1 -> 3, }, 05: destinations (list) = list[0] { }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = -1, } I1212 11:10:19.985615 2569 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:19.985616 3396 query-state.cc:58] RegisterFInstance(): instance_id=ca4e75b194e0a9f3:5cdfeeb700000003 I1212 11:10:19.985620 2569 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:19.985656 14646 plan-fragment-executor.cc:145] Using query memory limit from query options: 10.00 MB I1212 11:10:19.985663 14646 mem-tracker.cc:184] Using query memory limit: 10.00 MB I1212 11:10:19.985740 2563 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=ca4e75b194e0a9f3:5cdfeeb700000001 I1212 11:10:19.985746 2563 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22002 back to cache I1212 11:10:19.985854 2572 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=ca4e75b194e0a9f3:5cdfeeb700000002 I1212 11:10:19.985859 2572 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22001 back to cache I1212 11:10:19.985862 14646 plan-fragment-executor.cc:174] descriptor table for fragment=ca4e75b194e0a9f3:5cdfeeb700000000 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:19.985935 14646 data-stream-mgr.cc:80] creating receiver for fragment=ca4e75b194e0a9f3:5cdfeeb700000000, node=1 I1212 11:10:19.986197 14648 plan-fragment-executor.cc:123] Prepare(): instance_id=ca4e75b194e0a9f3:5cdfeeb700000003 I1212 11:10:19.986204 3396 thread.cc:288] Started thread 14648 - query-exec-mgr:exec-fragment-instance-ca4e75b194e0a9f3:5cdfeeb700000003 I1212 11:10:19.986237 14648 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = -3869025624297264653, 02: lo (i64) = 6692330041042272259, }, 02: per_fragment_instance_idx (i32) = 2, 03: per_node_scan_ranges (map) = map[1] { 0 -> list[1] { [0] = TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, }, }, }, 04: per_exch_num_senders (map) = map[0] { }, 05: destinations (list) = list[1] { [0] = TPlanFragmentDestination { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = -3869025624297264653, 02: lo (i64) = 6692330041042272256, }, 02: server (struct) = TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, }, }, }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = 2, } I1212 11:10:19.986277 2561 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=ca4e75b194e0a9f3:5cdfeeb700000003 I1212 11:10:19.986282 2561 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:19.986290 14648 plan-fragment-executor.cc:145] Using query memory limit from query options: 10.00 MB I1212 11:10:19.986296 14648 mem-tracker.cc:184] Using query memory limit: 10.00 MB I1212 11:10:19.986312 2681 coordinator.cc:640] started 4 fragment instances for query ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:19.986351 2681 query-exec-mgr.cc:123] GetQueryState(): query_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:19.986356 2681 query-state.cc:65] GetFInstanceState(): instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:19.986394 14648 plan-fragment-executor.cc:174] descriptor table for fragment=ca4e75b194e0a9f3:5cdfeeb700000003 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:19.986485 14648 plan-fragment-executor.cc:285] Hdfs split stats (:<# splits>/) for query=ca4e75b194e0a9f3:5cdfeeb700000000: I1212 11:10:19.986582 14648 thread.cc:288] Started thread 14666 - DataStreamSender:SenderThread(1:1) I1212 11:10:20.000582 14648 plan-fragment-executor.cc:261] plan_root= KuduScanNode(tupleid=0) I1212 11:10:20.000602 14648 plan-fragment-executor.cc:296] Open(): instance_id=ca4e75b194e0a9f3:5cdfeeb700000003 I1212 11:10:20.000718 14668 plan-fragment-executor.cc:378] ReportProfileThread(): instance_id=ca4e75b194e0a9f3:5cdfeeb700000003 I1212 11:10:20.000722 14648 thread.cc:288] Started thread 14668 - plan-fragment-executor:report-profile I1212 11:10:20.006186 14646 plan-fragment-executor.cc:261] plan_root= ExchangeNode(#senders=3 conjuncts=[]) I1212 11:10:20.006218 14646 plan-fragment-executor.cc:296] Open(): instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:20.006247 2681 coordinator.cc:1181] Byte split for fragment 1 min: 0, max: 0, avg: 0, stddev: 0 I1212 11:10:20.006253 2681 coordinator.cc:1184] data volume for ipaddress 0xcd1c1c0: 0 I1212 11:10:20.006255 2681 coordinator.cc:1184] data volume for ipaddress 0xcd1c400: 0 I1212 11:10:20.006258 2681 coordinator.cc:1184] data volume for ipaddress 0xbf50400: 0 I1212 11:10:20.006296 14685 plan-fragment-executor.cc:378] ReportProfileThread(): instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:20.006299 14646 thread.cc:288] Started thread 14685 - plan-fragment-executor:report-profile I1212 11:10:20.006427 2681 thread.cc:288] Started thread 14688 - query-exec-state:wait-thread I1212 11:10:20.006458 2681 impala-hs2-server.cc:486] ExecuteStatement(): return_val=TExecuteStatementResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: operationHandle (struct) = TOperationHandle { 01: operationId (struct) = THandleIdentifier { 01: guid (string) = "\xf3\xa9\xe0\x94\xb1uN\xca\x00\x00\x00\x00\xb7\xee\xdf\\", 02: secret (string) = "\xf3\xa9\xe0\x94\xb1uN\xca\x00\x00\x00\x00\xb7\xee\xdf\\", }, 02: operationType (i32) = 0, 03: hasResultSet (bool) = true, }, } I1212 11:10:20.007149 14648 kudu-scan-node.cc:128] Latest observed Kudu timestamp: 0 I1212 11:10:20.007508 14648 kudu-scan-node.cc:248] Thread started: scanner-thread(1) I1212 11:10:20.007587 14648 thread.cc:288] Started thread 14692 - kudu-scan-node:scanner-thread(1) I1212 11:10:20.007973 14692 kudu-scanner.cc:148] Starting KuduScanner with ReadMode=0 timeout=180000 I1212 11:10:20.019529 14648 data-stream-sender.cc:284] Channel::FlushAndSendEos() instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 dest_node=1 #rows= 0 I1212 11:10:20.019569 14666 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:20.019579 14666 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.019845 14646 exchange-node.cc:139] exch: has batch=true #rows=90 is_cancelled=false instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:20.020541 14666 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:20.020576 14648 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:20.020582 14648 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.020587 14648 data-stream-sender.cc:311] calling TransmitData(eos=true) to terminate channel. I1212 11:10:20.020632 3396 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=ca4e75b194e0a9f3:5cdfeeb700000000, node=1 I1212 11:10:20.020661 3396 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 node_id=1 #senders=2 I1212 11:10:20.020788 14648 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:20.020794 3769 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=ca4e75b194e0a9f3:5cdfeeb700000000, node=1 I1212 11:10:20.020805 3769 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 node_id=1 #senders=1 I1212 11:10:20.020826 14668 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=ca4e75b194e0a9f3:5cdfeeb700000003 I1212 11:10:20.020898 14648 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:20.020905 14648 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.021280 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=ca4e75b194e0a9f3:5cdfeeb700000002 I1212 11:10:20.021284 3769 impala-server.cc:1076] ReportExecStatus() instance_id=ca4e75b194e0a9f3:5cdfeeb700000002 done=true I1212 11:10:20.021291 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=ca4e75b194e0a9f3:5cdfeeb700000002 status=0 done=true I1212 11:10:20.021299 5418 impala-internal-service.cc:74] ReportExecStatus(): instance_id=ca4e75b194e0a9f3:5cdfeeb700000003 I1212 11:10:20.021308 5418 impala-server.cc:1076] ReportExecStatus() instance_id=ca4e75b194e0a9f3:5cdfeeb700000003 done=true I1212 11:10:20.021314 5418 coordinator.cc:1437] UpdateFragmentExecStatus() instance=ca4e75b194e0a9f3:5cdfeeb700000003 status=0 done=true I1212 11:10:20.021723 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 0.000ns 0.000ns 0 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 4.142ms 12.427ms 90 90 1.13 MB 0 I1212 11:10:20.021850 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 0.000ns 0.000ns 0 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 10.301ms 18.478ms 180 90 1.13 MB 0 I1212 11:10:20.021927 3769 coordinator.cc:1521] profile for instance_id=ca4e75b194e0a9f3:5cdfeeb700000002 Instance ca4e75b194e0a9f3:5cdfeeb700000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 34.949ms, non-child: 1.138ms, % non-child: 3.26%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 293.888us - TotalStorageWaitTime: 8.807ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 13.323ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 2.383ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 11.223ms - ExecTreeExecTime: 10.442ms - OpenTime: 2.110ms - ExecTreeOpenTime: 1.938ms - PrepareTime: 21.572ms - ExecTreePrepareTime: 63.338us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 406.569us, non-child: 406.569us, % non-child: 100.00%) - BytesSent: 11.18 KB (11444) - NetworkThroughput(*): 348.05 MB/sec - OverallThroughput: 26.84 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 347.672us - TransmitDataRPCTime: 31.357us - UncompressedRowBatchSize: 23.56 KB (24125) CodeGen:(Total: 20.977ms, non-child: 20.977ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.325ms KUDU_SCAN_NODE (id=0):(Total: 12.427ms, non-child: 12.427ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.13 MB (1183744) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 7.24 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 10.440ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:20.022132 5418 coordinator.cc:1521] profile for instance_id=ca4e75b194e0a9f3:5cdfeeb700000003 Instance ca4e75b194e0a9f3:5cdfeeb700000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 34.542ms, non-child: 1.876ms, % non-child: 5.43%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.18 MB (1241836) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.027ms - TotalStorageWaitTime: 9.324ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 20.174ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 3.748ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 13.192ms - ExecTreeExecTime: 11.642ms - OpenTime: 6.995ms - ExecTreeOpenTime: 6.809ms - PrepareTime: 14.308ms - ExecTreePrepareTime: 48.174us DataStreamSender (dst_id=1):(Total: 307.792us, non-child: 307.792us, % non-child: 100.00%) - BytesSent: 11.15 KB (11420) - NetworkThroughput(*): 323.08 MB/sec - OverallThroughput: 35.38 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 256.896us - TransmitDataRPCTime: 33.710us - UncompressedRowBatchSize: 23.80 KB (24375) CodeGen:(Total: 13.880ms, non-child: 13.880ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 13.306ms KUDU_SCAN_NODE (id=0):(Total: 18.478ms, non-child: 18.478ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 776.00 KB (794624) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 4.87 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 11.638ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:20.022402 3769 coordinator.cc:1529] cumulative profile for query_id=ca4e75b194e0a9f3:5cdfeeb700000000 Execution Profile ca4e75b194e0a9f3:5cdfeeb700000000:(Total: 34.987ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Averaged Fragment F00:(Total: 34.746ms, non-child: 1.507ms, % non-child: 4.34%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.16 MB (1217230) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 660.725us - TotalStorageWaitTime: 9.065ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 16.749ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 3.065ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 12.208ms - ExecTreeExecTime: 11.042ms - OpenTime: 4.553ms - ExecTreeOpenTime: 4.373ms - PrepareTime: 17.940ms - ExecTreePrepareTime: 55.756us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 357.180us, non-child: 357.180us, % non-child: 100.00%) - BytesSent: 11.16 KB (11432) - NetworkThroughput(*): 335.56 MB/sec - OverallThroughput: 31.11 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 302.284us - TransmitDataRPCTime: 32.533us - UncompressedRowBatchSize: 23.68 KB (24250) CodeGen:(Total: 17.428ms, non-child: 17.428ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 16.815ms KUDU_SCAN_NODE (id=0):(Total: 15.452ms, non-child: 15.452ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 966.00 KB (989184) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 6.06 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 11.039ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance ca4e75b194e0a9f3:5cdfeeb700000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 34.949ms, non-child: 1.138ms, % non-child: 3.26%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 293.888us - TotalStorageWaitTime: 8.807ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 13.323ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 2.383ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 11.223ms - ExecTreeExecTime: 10.442ms - OpenTime: 2.110ms - ExecTreeOpenTime: 1.938ms - PrepareTime: 21.572ms - ExecTreePrepareTime: 63.338us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 406.569us, non-child: 406.569us, % non-child: 100.00%) - BytesSent: 11.18 KB (11444) - NetworkThroughput(*): 348.05 MB/sec - OverallThroughput: 26.84 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 347.672us - TransmitDataRPCTime: 31.357us - UncompressedRowBatchSize: 23.56 KB (24125) CodeGen:(Total: 20.977ms, non-child: 20.977ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.325ms KUDU_SCAN_NODE (id=0):(Total: 12.427ms, non-child: 12.427ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.13 MB (1183744) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 7.24 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 10.440ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Instance ca4e75b194e0a9f3:5cdfeeb700000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 34.542ms, non-child: 1.876ms, % non-child: 5.43%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.18 MB (1241836) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.027ms - TotalStorageWaitTime: 9.324ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 20.174ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 3.748ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 13.192ms - ExecTreeExecTime: 11.642ms - OpenTime: 6.995ms - ExecTreeOpenTime: 6.809ms - PrepareTime: 14.308ms - ExecTreePrepareTime: 48.174us DataStreamSender (dst_id=1):(Total: 307.792us, non-child: 307.792us, % non-child: 100.00%) - BytesSent: 11.15 KB (11420) - NetworkThroughput(*): 323.08 MB/sec - OverallThroughput: 35.38 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 256.896us - TransmitDataRPCTime: 33.710us - UncompressedRowBatchSize: 23.80 KB (24375) CodeGen:(Total: 13.880ms, non-child: 13.880ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 13.306ms KUDU_SCAN_NODE (id=0):(Total: 18.478ms, non-child: 18.478ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 776.00 KB (794624) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 4.87 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 11.638ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:20.022424 3769 coordinator.cc:1546] Fragment instance completed: id=ca4e75b194e0a9f3:5cdfeeb700000002 host=mj-desktop.ca.cloudera.com:22001 remaining=3 I1212 11:10:20.022428 3769 coordinator.cc:1556] query_id=ca4e75b194e0a9f3:5cdfeeb700000000: first in-progress backend: mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.022965 5418 coordinator.cc:1529] cumulative profile for query_id=ca4e75b194e0a9f3:5cdfeeb700000000 Execution Profile ca4e75b194e0a9f3:5cdfeeb700000000:(Total: 34.987ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Averaged Fragment F00:(Total: 34.746ms, non-child: 1.507ms, % non-child: 4.34%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.16 MB (1217230) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 660.725us - TotalStorageWaitTime: 9.065ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 16.749ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 3.065ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 12.208ms - ExecTreeExecTime: 11.042ms - OpenTime: 4.553ms - ExecTreeOpenTime: 4.373ms - PrepareTime: 17.940ms - ExecTreePrepareTime: 55.756us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 357.180us, non-child: 357.180us, % non-child: 100.00%) - BytesSent: 11.16 KB (11432) - NetworkThroughput(*): 335.56 MB/sec - OverallThroughput: 31.11 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 302.284us - TransmitDataRPCTime: 32.533us - UncompressedRowBatchSize: 23.68 KB (24250) CodeGen:(Total: 17.428ms, non-child: 17.428ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 16.815ms KUDU_SCAN_NODE (id=0):(Total: 15.452ms, non-child: 15.452ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 966.00 KB (989184) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 6.06 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 11.039ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance ca4e75b194e0a9f3:5cdfeeb700000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 34.949ms, non-child: 1.138ms, % non-child: 3.26%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 293.888us - TotalStorageWaitTime: 8.807ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 13.323ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 2.383ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 11.223ms - ExecTreeExecTime: 10.442ms - OpenTime: 2.110ms - ExecTreeOpenTime: 1.938ms - PrepareTime: 21.572ms - ExecTreePrepareTime: 63.338us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 406.569us, non-child: 406.569us, % non-child: 100.00%) - BytesSent: 11.18 KB (11444) - NetworkThroughput(*): 348.05 MB/sec - OverallThroughput: 26.84 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 347.672us - TransmitDataRPCTime: 31.357us - UncompressedRowBatchSize: 23.56 KB (24125) CodeGen:(Total: 20.977ms, non-child: 20.977ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.325ms KUDU_SCAN_NODE (id=0):(Total: 12.427ms, non-child: 12.427ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.13 MB (1183744) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 7.24 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 10.440ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Instance ca4e75b194e0a9f3:5cdfeeb700000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 34.542ms, non-child: 1.876ms, % non-child: 5.43%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.18 MB (1241836) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.027ms - TotalStorageWaitTime: 9.324ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 20.174ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 3.748ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 13.192ms - ExecTreeExecTime: 11.642ms - OpenTime: 6.995ms - ExecTreeOpenTime: 6.809ms - PrepareTime: 14.308ms - ExecTreePrepareTime: 48.174us DataStreamSender (dst_id=1):(Total: 307.792us, non-child: 307.792us, % non-child: 100.00%) - BytesSent: 11.15 KB (11420) - NetworkThroughput(*): 323.08 MB/sec - OverallThroughput: 35.38 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 256.896us - TransmitDataRPCTime: 33.710us - UncompressedRowBatchSize: 23.80 KB (24375) CodeGen:(Total: 13.880ms, non-child: 13.880ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 13.306ms KUDU_SCAN_NODE (id=0):(Total: 18.478ms, non-child: 18.478ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 776.00 KB (794624) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 4.87 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 11.638ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:20.022994 5418 coordinator.cc:1546] Fragment instance completed: id=ca4e75b194e0a9f3:5cdfeeb700000003 host=mj-desktop.ca.cloudera.com:22000 remaining=2 I1212 11:10:20.023005 5418 coordinator.cc:1556] query_id=ca4e75b194e0a9f3:5cdfeeb700000000: first in-progress backend: mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.023056 14648 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:20.024937 3766 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=ca4e75b194e0a9f3:5cdfeeb700000000, node=1 I1212 11:10:20.024947 3766 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 node_id=1 #senders=0 I1212 11:10:20.025415 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=ca4e75b194e0a9f3:5cdfeeb700000001 I1212 11:10:20.025424 3766 impala-server.cc:1076] ReportExecStatus() instance_id=ca4e75b194e0a9f3:5cdfeeb700000001 done=true I1212 11:10:20.025432 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=ca4e75b194e0a9f3:5cdfeeb700000001 status=0 done=true I1212 11:10:20.025938 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 0.000ns 0.000ns 0 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 15.542ms 18.478ms 270 90 1.13 MB 0 I1212 11:10:20.026243 3766 coordinator.cc:1521] profile for instance_id=ca4e75b194e0a9f3:5cdfeeb700000001 Instance ca4e75b194e0a9f3:5cdfeeb700000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 39.179ms, non-child: 1.111ms, % non-child: 2.84%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 251.075us - TotalStorageWaitTime: 6.862ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 16.351ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 2.299ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 10.144ms - ExecTreeExecTime: 9.591ms - OpenTime: 6.219ms - ExecTreeOpenTime: 6.098ms - PrepareTime: 22.763ms - ExecTreePrepareTime: 45.847us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 226.333us, non-child: 226.333us, % non-child: 100.00%) - BytesSent: 11.04 KB (11309) - NetworkThroughput(*): 294.24 MB/sec - OverallThroughput: 47.65 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 162.696us - TransmitDataRPCTime: 36.654us - UncompressedRowBatchSize: 23.62 KB (24188) CodeGen:(Total: 22.119ms, non-child: 22.119ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 21.552ms KUDU_SCAN_NODE (id=0):(Total: 15.722ms, non-child: 15.722ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.13 MB (1183744) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 5.72 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 9.588ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:20.027385 3766 coordinator.cc:1529] cumulative profile for query_id=ca4e75b194e0a9f3:5cdfeeb700000000 Execution Profile ca4e75b194e0a9f3:5cdfeeb700000000:(Total: 34.987ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Averaged Fragment F00:(Total: 36.223ms, non-child: 1.375ms, % non-child: 3.80%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.15 MB (1209028) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 524.174us - TotalStorageWaitTime: 8.331ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 16.616ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 2.810ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 11.520ms - ExecTreeExecTime: 10.558ms - OpenTime: 5.108ms - ExecTreeOpenTime: 4.948ms - PrepareTime: 19.548ms - ExecTreePrepareTime: 52.453us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 313.564us, non-child: 313.564us, % non-child: 100.00%) - BytesSent: 11.12 KB (11391) - NetworkThroughput(*): 321.79 MB/sec - OverallThroughput: 36.63 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 255.754us - TransmitDataRPCTime: 33.907us - UncompressedRowBatchSize: 23.66 KB (24229) CodeGen:(Total: 18.992ms, non-child: 18.992ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 18.394ms KUDU_SCAN_NODE (id=0):(Total: 15.542ms, non-child: 15.542ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.01 MB (1054037) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 5.95 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 10.555ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance ca4e75b194e0a9f3:5cdfeeb700000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 34.949ms, non-child: 1.138ms, % non-child: 3.26%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 293.888us - TotalStorageWaitTime: 8.807ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 13.323ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 2.383ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 11.223ms - ExecTreeExecTime: 10.442ms - OpenTime: 2.110ms - ExecTreeOpenTime: 1.938ms - PrepareTime: 21.572ms - ExecTreePrepareTime: 63.338us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 406.569us, non-child: 406.569us, % non-child: 100.00%) - BytesSent: 11.18 KB (11444) - NetworkThroughput(*): 348.05 MB/sec - OverallThroughput: 26.84 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 347.672us - TransmitDataRPCTime: 31.357us - UncompressedRowBatchSize: 23.56 KB (24125) CodeGen:(Total: 20.977ms, non-child: 20.977ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.325ms KUDU_SCAN_NODE (id=0):(Total: 12.427ms, non-child: 12.427ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.13 MB (1183744) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 7.24 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 10.440ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Instance ca4e75b194e0a9f3:5cdfeeb700000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 34.542ms, non-child: 1.876ms, % non-child: 5.43%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.18 MB (1241836) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.027ms - TotalStorageWaitTime: 9.324ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 20.174ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 3.748ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 13.192ms - ExecTreeExecTime: 11.642ms - OpenTime: 6.995ms - ExecTreeOpenTime: 6.809ms - PrepareTime: 14.308ms - ExecTreePrepareTime: 48.174us DataStreamSender (dst_id=1):(Total: 307.792us, non-child: 307.792us, % non-child: 100.00%) - BytesSent: 11.15 KB (11420) - NetworkThroughput(*): 323.08 MB/sec - OverallThroughput: 35.38 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 256.896us - TransmitDataRPCTime: 33.710us - UncompressedRowBatchSize: 23.80 KB (24375) CodeGen:(Total: 13.880ms, non-child: 13.880ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 13.306ms KUDU_SCAN_NODE (id=0):(Total: 18.478ms, non-child: 18.478ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 776.00 KB (794624) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 4.87 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 11.638ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Instance ca4e75b194e0a9f3:5cdfeeb700000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 39.179ms, non-child: 1.111ms, % non-child: 2.84%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 251.075us - TotalStorageWaitTime: 6.862ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 16.351ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 2.299ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 10.144ms - ExecTreeExecTime: 9.591ms - OpenTime: 6.219ms - ExecTreeOpenTime: 6.098ms - PrepareTime: 22.763ms - ExecTreePrepareTime: 45.847us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 226.333us, non-child: 226.333us, % non-child: 100.00%) - BytesSent: 11.04 KB (11309) - NetworkThroughput(*): 294.24 MB/sec - OverallThroughput: 47.65 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 162.696us - TransmitDataRPCTime: 36.654us - UncompressedRowBatchSize: 23.62 KB (24188) CodeGen:(Total: 22.119ms, non-child: 22.119ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 21.552ms KUDU_SCAN_NODE (id=0):(Total: 15.722ms, non-child: 15.722ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.13 MB (1183744) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 5.72 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 9.588ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:20.027425 3766 coordinator.cc:1546] Fragment instance completed: id=ca4e75b194e0a9f3:5cdfeeb700000001 host=mj-desktop.ca.cloudera.com:22002 remaining=1 I1212 11:10:20.027431 3766 coordinator.cc:1556] query_id=ca4e75b194e0a9f3:5cdfeeb700000000: first in-progress backend: mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.027781 2681 impala-hs2-server.cc:713] GetResultSetMetadata(): query_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:20.027997 2681 impala-hs2-server.cc:753] GetResultSetMetadata(): return_val=TGetResultSetMetadataResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: schema (struct) = TTableSchema { 01: columns (list) = list[16] { [0] = TColumnDesc { 01: columnName (string) = "l_orderkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 0, }, [1] = TColumnDesc { 01: columnName (string) = "l_linenumber", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 3, }, }, }, }, 03: position (i32) = 1, }, [2] = TColumnDesc { 01: columnName (string) = "l_partkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 2, }, [3] = TColumnDesc { 01: columnName (string) = "l_suppkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 3, }, [4] = TColumnDesc { 01: columnName (string) = "l_quantity", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 4, }, [5] = TColumnDesc { 01: columnName (string) = "l_extendedprice", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 5, }, [6] = TColumnDesc { 01: columnName (string) = "l_discount", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 6, }, [7] = TColumnDesc { 01: columnName (string) = "l_tax", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 7, }, [8] = TColumnDesc { 01: columnName (string) = "l_returnflag", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 8, }, [9] = TColumnDesc { 01: columnName (string) = "l_linestatus", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 9, }, [10] = TColumnDesc { 01: columnName (string) = "l_shipdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 10, }, [11] = TColumnDesc { 01: columnName (string) = "l_commitdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 11, }, [12] = TColumnDesc { 01: columnName (string) = "l_receiptdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 12, }, [13] = TColumnDesc { 01: columnName (string) = "l_shipinstruct", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 13, }, [14] = TColumnDesc { 01: columnName (string) = "l_shipmode", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 14, }, [15] = TColumnDesc { 01: columnName (string) = "l_comment", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 15, }, }, }, } I1212 11:10:20.028973 14685 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:20.029022 2681 coordinator.cc:1064] Coordinator waiting for fragment instances to finish, 1 remaining I1212 11:10:20.029034 14646 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:20.029041 14646 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.029379 3396 impala-internal-service.cc:74] ReportExecStatus(): instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:20.029388 3396 impala-server.cc:1076] ReportExecStatus() instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 done=true I1212 11:10:20.029395 3396 coordinator.cc:1437] UpdateFragmentExecStatus() instance=ca4e75b194e0a9f3:5cdfeeb700000000 status=0 done=true I1212 11:10:20.029662 3396 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 73.543us 73.543us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 15.542ms 18.478ms 270 90 1.13 MB 0 I1212 11:10:20.029893 3396 coordinator.cc:1521] profile for instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 Instance ca4e75b194e0a9f3:5cdfeeb700000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 43.324ms, non-child: 9.736ms, % non-child: 22.47%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 80.03 KB (81948) - PerHostPeakMemUsage: 1.18 MB (1241836) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 13.489ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 22.686ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 4.665ms - TotalThreadsVoluntaryContextSwitches: 6 (6) Fragment Instance Lifecycle Timings: - ExecTime: 9.027ms - ExecTreeExecTime: 28.745us - OpenTime: 13.679ms - ExecTreeOpenTime: 13.535ms - PrepareTime: 20.545ms - ExecTreePrepareTime: 62.774us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 20.027ms, non-child: 20.027ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 19.419ms EXCHANGE_NODE (id=1):(Total: 13.560ms, non-child: 73.543us, % non-child: 0.54%) - BytesReceived: 33.37 KB (34173) - ConvertRowBatchTime: 25.356us - DeserializeRowBatchTimer: 274.358us - FirstBatchArrivalWaitTime: 13.485ms - PeakMemoryUsage: 0 - RowsReturned: 90 (90) - RowsReturnedRate: 6.64 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns I1212 11:10:20.031154 3396 coordinator.cc:1529] cumulative profile for query_id=ca4e75b194e0a9f3:5cdfeeb700000000 Execution Profile ca4e75b194e0a9f3:5cdfeeb700000000:(Total: 34.987ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance ca4e75b194e0a9f3:5cdfeeb700000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 43.324ms, non-child: 9.736ms, % non-child: 22.47%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 80.03 KB (81948) - PerHostPeakMemUsage: 1.18 MB (1241836) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 13.489ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 22.686ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 4.665ms - TotalThreadsVoluntaryContextSwitches: 6 (6) Fragment Instance Lifecycle Timings: - ExecTime: 9.027ms - ExecTreeExecTime: 28.745us - OpenTime: 13.679ms - ExecTreeOpenTime: 13.535ms - PrepareTime: 20.545ms - ExecTreePrepareTime: 62.774us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 20.027ms, non-child: 20.027ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 19.419ms EXCHANGE_NODE (id=1):(Total: 13.560ms, non-child: 73.543us, % non-child: 0.54%) - BytesReceived: 33.37 KB (34173) - ConvertRowBatchTime: 25.356us - DeserializeRowBatchTimer: 274.358us - FirstBatchArrivalWaitTime: 13.485ms - PeakMemoryUsage: 0 - RowsReturned: 90 (90) - RowsReturnedRate: 6.64 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 36.223ms, non-child: 1.375ms, % non-child: 3.80%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.15 MB (1209028) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 524.174us - TotalStorageWaitTime: 8.331ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 16.616ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 2.810ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 11.520ms - ExecTreeExecTime: 10.558ms - OpenTime: 5.108ms - ExecTreeOpenTime: 4.948ms - PrepareTime: 19.548ms - ExecTreePrepareTime: 52.453us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 313.564us, non-child: 313.564us, % non-child: 100.00%) - BytesSent: 11.12 KB (11391) - NetworkThroughput(*): 321.79 MB/sec - OverallThroughput: 36.63 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 255.754us - TransmitDataRPCTime: 33.907us - UncompressedRowBatchSize: 23.66 KB (24229) CodeGen:(Total: 18.992ms, non-child: 18.992ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 18.394ms KUDU_SCAN_NODE (id=0):(Total: 15.542ms, non-child: 15.542ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.01 MB (1054037) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 5.95 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 10.555ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance ca4e75b194e0a9f3:5cdfeeb700000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 34.949ms, non-child: 1.138ms, % non-child: 3.26%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 293.888us - TotalStorageWaitTime: 8.807ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 13.323ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 2.383ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 11.223ms - ExecTreeExecTime: 10.442ms - OpenTime: 2.110ms - ExecTreeOpenTime: 1.938ms - PrepareTime: 21.572ms - ExecTreePrepareTime: 63.338us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 406.569us, non-child: 406.569us, % non-child: 100.00%) - BytesSent: 11.18 KB (11444) - NetworkThroughput(*): 348.05 MB/sec - OverallThroughput: 26.84 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 347.672us - TransmitDataRPCTime: 31.357us - UncompressedRowBatchSize: 23.56 KB (24125) CodeGen:(Total: 20.977ms, non-child: 20.977ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 20.325ms KUDU_SCAN_NODE (id=0):(Total: 12.427ms, non-child: 12.427ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.13 MB (1183744) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 7.24 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 10.440ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Instance ca4e75b194e0a9f3:5cdfeeb700000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 34.542ms, non-child: 1.876ms, % non-child: 5.43%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.18 MB (1241836) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.027ms - TotalStorageWaitTime: 9.324ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 20.174ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 3.748ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 13.192ms - ExecTreeExecTime: 11.642ms - OpenTime: 6.995ms - ExecTreeOpenTime: 6.809ms - PrepareTime: 14.308ms - ExecTreePrepareTime: 48.174us DataStreamSender (dst_id=1):(Total: 307.792us, non-child: 307.792us, % non-child: 100.00%) - BytesSent: 11.15 KB (11420) - NetworkThroughput(*): 323.08 MB/sec - OverallThroughput: 35.38 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 256.896us - TransmitDataRPCTime: 33.710us - UncompressedRowBatchSize: 23.80 KB (24375) CodeGen:(Total: 13.880ms, non-child: 13.880ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 13.306ms KUDU_SCAN_NODE (id=0):(Total: 18.478ms, non-child: 18.478ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 776.00 KB (794624) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 4.87 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 11.638ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Instance ca4e75b194e0a9f3:5cdfeeb700000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 39.179ms, non-child: 1.111ms, % non-child: 2.84%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 251.075us - TotalStorageWaitTime: 6.862ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 16.351ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 2.299ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 10.144ms - ExecTreeExecTime: 9.591ms - OpenTime: 6.219ms - ExecTreeOpenTime: 6.098ms - PrepareTime: 22.763ms - ExecTreePrepareTime: 45.847us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 0 - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 226.333us, non-child: 226.333us, % non-child: 100.00%) - BytesSent: 11.04 KB (11309) - NetworkThroughput(*): 294.24 MB/sec - OverallThroughput: 47.65 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 162.696us - TransmitDataRPCTime: 36.654us - UncompressedRowBatchSize: 23.62 KB (24188) CodeGen:(Total: 22.119ms, non-child: 22.119ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 21.552ms KUDU_SCAN_NODE (id=0):(Total: 15.722ms, non-child: 15.722ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.13 MB (1183744) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 5.72 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 9.588ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:20.031184 3396 coordinator.cc:1546] Fragment instance completed: id=ca4e75b194e0a9f3:5cdfeeb700000000 host=mj-desktop.ca.cloudera.com:22000 remaining=0 I1212 11:10:20.031252 2681 coordinator.cc:1069] All fragment instances finished successfully. I1212 11:10:20.031374 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 73.543us 73.543us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 15.542ms 18.478ms 270 90 1.13 MB 0 I1212 11:10:20.031611 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 73.543us 73.543us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 15.542ms 18.478ms 270 90 1.13 MB 0 I1212 11:10:20.031841 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 73.543us 73.543us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 15.542ms 18.478ms 270 90 1.13 MB 0 I1212 11:10:20.032055 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 73.543us 73.543us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 15.542ms 18.478ms 270 90 1.13 MB 0 I1212 11:10:20.032723 14646 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:20.032802 14646 data-stream-mgr.cc:226] DeregisterRecvr(): fragment_instance_id=ca4e75b194e0a9f3:5cdfeeb700000000, node=1 I1212 11:10:20.032814 14646 data-stream-recvr.cc:237] cancelled stream: fragment_instance_id_=ca4e75b194e0a9f3:5cdfeeb700000000 node_id=1 I1212 11:10:20.032860 14646 query-exec-mgr.cc:103] Instance completed. instance_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:20.032866 14646 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=ca4e75b194e0a9f3:5cdfeeb700000000 refcnt=3 I1212 11:10:20.033987 2681 impala-hs2-server.cc:373] CloseSession(): request=TCloseSessionReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\xf2|\xcc\xd5t@I\x94\x88\xb7P\xc3\b\xc9\xa8B", 02: secret (string) = "\xa1\x02\xf8tSZ@2\x8d|\x0f\x9c\xb2\x01\xf4\xf4", }, }, } I1212 11:10:20.087543 2681 status.cc:114] Session closed @ 0x11cc7af impala::Status::Status() @ 0x147e95c impala::ImpalaServer::CloseSessionInternal() @ 0x14d36a8 impala::ImpalaServer::CloseSession() @ 0x1958d62 apache::hive::service::cli::thrift::TCLIServiceProcessor::process_CloseSession() @ 0x1958348 apache::hive::service::cli::thrift::TCLIServiceProcessor::dispatchCall() @ 0x1931f95 impala::ImpalaHiveServer2ServiceProcessor::dispatchCall() @ 0x117366e apache::thrift::TDispatchProcessor::process() @ 0x27d689b apache::thrift::server::TThreadPoolServer::Task::run() @ 0x27bf109 apache::thrift::concurrency::ThreadManager::Worker::run() @ 0x133a3bd impala::ThriftThread::RunRunnable() @ 0x133bae9 boost::_mfi::mf2<>::operator()() @ 0x133b97f boost::_bi::list3<>::operator()<>() @ 0x133b6cb boost::_bi::bind_t<>::operator()() @ 0x133b5de boost::detail::function::void_function_obj_invoker0<>::invoke() @ 0x1348fbc boost::function0<>::operator()() @ 0x15eeb13 impala::Thread::SuperviseThread() @ 0x15f5aec boost::_bi::list4<>::operator()<>() @ 0x15f5a2f boost::_bi::bind_t<>::operator()() @ 0x15f598a boost::detail::thread_data<>::run() @ 0x1a54fda thread_proxy @ 0x7f284362a184 start_thread @ 0x7f284335737d (unknown) I1212 11:10:20.087559 2681 impala-server.cc:907] UnregisterQuery(): query_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:20.087571 2681 impala-server.cc:993] Cancel(): query_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:20.087582 2681 coordinator.cc:1362] Cancel() query_id=ca4e75b194e0a9f3:5cdfeeb700000000 I1212 11:10:20.087595 2681 coordinator.cc:1428] CancelFragmentInstances() query_id=ca4e75b194e0a9f3:5cdfeeb700000000, tried to cancel 0 fragment instances I1212 11:10:20.087784 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 73.543us 73.543us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 15.542ms 18.478ms 270 90 1.13 MB 0 I1212 11:10:20.088119 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 73.543us 73.543us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 15.542ms 18.478ms 270 90 1.13 MB 0 I1212 11:10:20.088397 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 73.543us 73.543us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 15.542ms 18.478ms 270 90 1.13 MB 0 I1212 11:10:20.088624 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 73.543us 73.543us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 15.542ms 18.478ms 270 90 1.13 MB 0 I1212 11:10:20.088773 2681 admission-controller.cc:538] Released query id=ca4e75b194e0a9f3:5cdfeeb700000000 agg_num_running=1, agg_num_queued=0, agg_mem_reserved=32.00 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=10.00 MB) I1212 11:10:20.088789 2681 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=ca4e75b194e0a9f3:5cdfeeb700000000 refcnt=2 I1212 11:10:20.093469 2681 impala-hs2-server.cc:271] OpenSession(): username=mj I1212 11:10:20.093863 2681 impala-hs2-server.cc:414] ExecuteStatement(): request=TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\x04#\x89K{\x84C#\x90,\x8d\xa4\n(\x8e\x84", 02: secret (string) = "\x9e\x8d!z\x8erD\xe7\xa8\x91\n\x83\x93\xea0\x10", }, }, 02: statement (string) = "USE ucu3e4", 04: runAsync (bool) = false, } I1212 11:10:20.093886 2681 impala-hs2-server.cc:228] TExecuteStatementReq: TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\x04#\x89K{\x84C#\x90,\x8d\xa4\n(\x8e\x84", 02: secret (string) = "\x9e\x8d!z\x8erD\xe7\xa8\x91\n\x83\x93\xea0\x10", }, }, 02: statement (string) = "USE ucu3e4", 04: runAsync (bool) = false, } I1212 11:10:20.093904 2681 impala-server.cc:742] Parsed pool options: override_options_mask=1111111111111111111111111111111111111111111111111111111111111111 set_pool_mask=0000000000000000000000000000000000000000000000000000000000000000 overlay_mask=0000000000000000000000000000000000000000000000000000000000000000 I1212 11:10:20.093961 2681 impala-hs2-server.cc:261] TClientRequest.queryOptions: TQueryOptions { 01: abort_on_error (bool) = false, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 100, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, } I1212 11:10:20.097024 2681 impala-server.cc:812] Execution request: TExecRequest { 01: stmt_type (i32) = 1, 02: query_options (struct) = TQueryOptions { 01: abort_on_error (bool) = false, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 100, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 44: mt_dop (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, }, 04: catalog_op_request (struct) = TCatalogOpRequest { 01: op_type (i32) = 3, 02: use_db_params (struct) = TUseDbParams { 01: db (string) = "ucu3e4", }, }, 05: result_set_metadata (struct) = TResultSetMetadata { 01: columns (list) = list[0] { }, }, 08: access_events (set) = set[1] { TAccessEvent { 01: name (string) = "ucu3e4", 02: object_type (i32) = 2, 03: privilege (string) = "ANY", }, }, 09: analysis_warnings (list) = list[0] { }, } I1212 11:10:20.101161 2681 thread.cc:288] Started thread 14728 - query-exec-state:wait-thread I1212 11:10:20.101203 2681 impala-hs2-server.cc:486] ExecuteStatement(): return_val=TExecuteStatementResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: operationHandle (struct) = TOperationHandle { 01: operationId (struct) = THandleIdentifier { 01: guid (string) = "\x0e\xe4\x1c#?_M\x95\x00\x00\x00\x00s~\x831", 02: secret (string) = "\x0e\xe4\x1c#?_M\x95\x00\x00\x00\x00s~\x831", }, 02: operationType (i32) = 0, 03: hasResultSet (bool) = false, }, } I1212 11:10:20.102313 2681 impala-hs2-server.cc:688] CloseOperation(): query_id=954d5f3f231ce40e:31837e7300000000 I1212 11:10:20.102319 2681 impala-server.cc:907] UnregisterQuery(): query_id=954d5f3f231ce40e:31837e7300000000 I1212 11:10:20.102326 2681 impala-server.cc:993] Cancel(): query_id=954d5f3f231ce40e:31837e7300000000 I1212 11:10:20.102915 2681 impala-hs2-server.cc:414] ExecuteStatement(): request=TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\x04#\x89K{\x84C#\x90,\x8d\xa4\n(\x8e\x84", 02: secret (string) = "\x9e\x8d!z\x8erD\xe7\xa8\x91\n\x83\x93\xea0\x10", }, }, 02: statement (string) = "select * from lineitem where l_orderkey = -1", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "0m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:20.102952 2681 impala-hs2-server.cc:228] TExecuteStatementReq: TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\x04#\x89K{\x84C#\x90,\x8d\xa4\n(\x8e\x84", 02: secret (string) = "\x9e\x8d!z\x8erD\xe7\xa8\x91\n\x83\x93\xea0\x10", }, }, 02: statement (string) = "select * from lineitem where l_orderkey = -1", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "0m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:20.103008 2681 impala-server.cc:742] Parsed pool options: override_options_mask=1111111111111111111111111111111110111111111111111111111111000010 set_pool_mask=0000000000000000000000000000000000000000000000000000000000000000 overlay_mask=0000000000000000000000000000000000000000000000000000000000000000 I1212 11:10:20.103065 2681 impala-hs2-server.cc:261] TClientRequest.queryOptions: TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, } I1212 11:10:20.112305 14729 AsyncKuduClient.java:1367] Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) I1212 11:10:20.123211 14730 AsyncKuduClient.java:1367] Learned about tablet de1fe37fdb46438abfbc154bf7fb439b for table 'impala::ucu3e4.lineitem' with partition [, 0x00000001) I1212 11:10:20.123486 14730 AsyncKuduClient.java:1367] Learned about tablet 91d0d8d3b0e34afc9d7fa522e61f40ef for table 'impala::ucu3e4.lineitem' with partition [0x00000001, 0x00000002) I1212 11:10:20.123723 14730 AsyncKuduClient.java:1367] Learned about tablet dc26b34fb84d4ff8baae3f44b23f0ae2 for table 'impala::ucu3e4.lineitem' with partition [0x00000002, ) I1212 11:10:20.133266 2681 impala-server.cc:812] Execution request: TExecRequest { 01: stmt_type (i32) = 0, 02: query_options (struct) = TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 44: mt_dop (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, }, 03: query_exec_request (struct) = TQueryExecRequest { 01: desc_tbl (struct) = TDescriptorTable { 01: slotDescriptors (list) = list[16] { [0] = TSlotDescriptor { 01: id (i32) = 0, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 0, }, 06: byteOffset (i32) = 128, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 8, }, [1] = TSlotDescriptor { 01: id (i32) = 1, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 1, }, 06: byteOffset (i32) = 184, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 15, }, [2] = TSlotDescriptor { 01: id (i32) = 2, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 2, }, 06: byteOffset (i32) = 136, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 9, }, [3] = TSlotDescriptor { 01: id (i32) = 3, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 3, }, 06: byteOffset (i32) = 144, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 10, }, [4] = TSlotDescriptor { 01: id (i32) = 4, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 4, }, 06: byteOffset (i32) = 152, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 11, }, [5] = TSlotDescriptor { 01: id (i32) = 5, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 5, }, 06: byteOffset (i32) = 160, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 12, }, [6] = TSlotDescriptor { 01: id (i32) = 6, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 6, }, 06: byteOffset (i32) = 168, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 13, }, [7] = TSlotDescriptor { 01: id (i32) = 7, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 7, }, 06: byteOffset (i32) = 176, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 14, }, [8] = TSlotDescriptor { 01: id (i32) = 8, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 8, }, 06: byteOffset (i32) = 0, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 0, 09: slotIdx (i32) = 0, }, [9] = TSlotDescriptor { 01: id (i32) = 9, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 9, }, 06: byteOffset (i32) = 16, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 1, }, [10] = TSlotDescriptor { 01: id (i32) = 10, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 10, }, 06: byteOffset (i32) = 32, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 2, }, [11] = TSlotDescriptor { 01: id (i32) = 11, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 11, }, 06: byteOffset (i32) = 48, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 3, }, [12] = TSlotDescriptor { 01: id (i32) = 12, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 12, }, 06: byteOffset (i32) = 64, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 4, }, [13] = TSlotDescriptor { 01: id (i32) = 13, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 13, }, 06: byteOffset (i32) = 80, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 5, }, [14] = TSlotDescriptor { 01: id (i32) = 14, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 14, }, 06: byteOffset (i32) = 96, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 6, }, [15] = TSlotDescriptor { 01: id (i32) = 15, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 15, }, 06: byteOffset (i32) = 112, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 7, 09: slotIdx (i32) = 7, }, }, 02: tupleDescriptors (list) = list[1] { [0] = TTupleDescriptor { 01: id (i32) = 0, 02: byteSize (i32) = 190, 03: numNullBytes (i32) = 2, 04: tableId (i32) = 1, 05: tuplePath (list) = list[0] { }, }, }, 03: tableDescriptors (list) = list[1] { [0] = TTableDescriptor { 01: id (i32) = 1, 02: tableType (i32) = 4, 03: columnDescriptors (list) = list[16] { [0] = TColumnDescriptor { 01: name (string) = "l_orderkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [1] = TColumnDescriptor { 01: name (string) = "l_linenumber", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, }, [2] = TColumnDescriptor { 01: name (string) = "l_partkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [3] = TColumnDescriptor { 01: name (string) = "l_suppkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [4] = TColumnDescriptor { 01: name (string) = "l_quantity", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [5] = TColumnDescriptor { 01: name (string) = "l_extendedprice", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [6] = TColumnDescriptor { 01: name (string) = "l_discount", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [7] = TColumnDescriptor { 01: name (string) = "l_tax", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [8] = TColumnDescriptor { 01: name (string) = "l_returnflag", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [9] = TColumnDescriptor { 01: name (string) = "l_linestatus", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [10] = TColumnDescriptor { 01: name (string) = "l_shipdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [11] = TColumnDescriptor { 01: name (string) = "l_commitdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [12] = TColumnDescriptor { 01: name (string) = "l_receiptdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [13] = TColumnDescriptor { 01: name (string) = "l_shipinstruct", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [14] = TColumnDescriptor { 01: name (string) = "l_shipmode", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [15] = TColumnDescriptor { 01: name (string) = "l_comment", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, }, 04: numClusteringCols (i32) = 0, 07: tableName (string) = "impala::ucu3e4.lineitem", 08: dbName (string) = "ucu3e4", 10: kuduTable (struct) = TKuduTable { 01: table_name (string) = "impala::ucu3e4.lineitem", 02: master_addresses (list) = list[1] { [0] = "127.0.0.1", }, 03: key_columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 04: partition_by (list) = list[1] { [0] = TKuduPartitionParam { 01: by_hash_param (struct) = TKuduPartitionByHashParam { 01: columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 02: num_partitions (i32) = 3, }, }, }, }, }, }, }, 02: plan_exec_info (list) = list[1] { [0] = TPlanExecInfo { 01: fragments (list) = list[2] { [0] = TPlanFragment { 01: idx (i32) = 0, 02: display_name (string) = "F01", 03: plan (struct) = TPlan { 01: nodes (list) = list[1] { [0] = TPlanNode { 01: node_id (i32) = 1, 02: node_type (i32) = 6, 03: num_children (i32) = 0, 04: limit (i64) = -1, 05: row_tuples (list) = list[1] { [0] = 0, }, 06: nullable_tuples (list) = list[1] { [0] = false, }, 08: disable_codegen (bool) = false, 18: exchange_node (struct) = TExchangeNode { 01: input_row_tuples (list) = list[1] { [0] = 0, }, }, 21: label (string) = "01:EXCHANGE", 22: label_detail (string) = "UNPARTITIONED", 23: estimated_stats (struct) = TExecStats { 03: cardinality (i64) = -1, 04: memory_used (i64) = -1, }, }, }, }, 04: output_exprs (list) = list[16] { [0] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 0, }, }, }, }, [1] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 1, }, }, }, }, [2] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 2, }, }, }, }, [3] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 3, }, }, }, }, [4] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 4, }, }, }, }, [5] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 5, }, }, }, }, [6] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 6, }, }, }, }, [7] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 7, }, }, }, }, [8] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, I1212 11:10:20.133704 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22000(local selection) I1212 11:10:20.133743 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22001(local selection) I1212 11:10:20.133774 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22002(local selection) I1212 11:10:20.133783 2681 simple-scheduler.cc:979] Total remote scan volume = 0 I1212 11:10:20.133795 2681 simple-scheduler.cc:981] Total local scan volume = 2.93 KB I1212 11:10:20.133800 2681 simple-scheduler.cc:983] Total cached scan volume = 0 I1212 11:10:20.133813 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22002, } I1212 11:10:20.133844 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](501)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:20.133857 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22001, } I1212 11:10:20.133872 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](505)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:20.133880 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, } I1212 11:10:20.133895 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](501)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:20.133985 2681 admission-controller.cc:440] Schedule for id=7645436891c726e0:a9b5656a00000000 in pool_name=default-pool cluster_mem_needed=12.00 GB PoolConfig: max_requests=-1 max_queued=200 max_mem=-1.00 B I1212 11:10:20.134006 2681 admission-controller.cc:445] Stats: agg_num_running=1, agg_num_queued=0, agg_mem_reserved=32.00 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=10.00 MB) I1212 11:10:20.134016 2681 admission-controller.cc:451] Admitted query id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.134054 2681 admission-controller.cc:457] Final: agg_num_running=2, agg_num_queued=0, agg_mem_reserved=32.00 MB, local_host(local_mem_admitted=15.75 GB, num_admitted_running=2, num_queued=0, backend_mem_reserved=10.00 MB) I1212 11:10:20.134095 2681 coordinator.cc:447] Exec() query_id=7645436891c726e0:a9b5656a00000000 stmt=select * from lineitem where l_orderkey = -1 I1212 11:10:20.134302 2681 coordinator.cc:602] starting 4 fragment instances for query 7645436891c726e0:a9b5656a00000000 I1212 11:10:20.134402 2681 coordinator.cc:737] ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- I1212 11:10:20.134605 2564 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.134613 2564 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:20.134620 2564 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.134925 5418 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.134937 5418 query-exec-mgr.cc:45] StartFInstance() instance_id=7645436891c726e0:a9b5656a00000000 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.134950 2566 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22002 instance_id=7645436891c726e0:a9b5656a00000001 I1212 11:10:20.134959 2566 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22002) I1212 11:10:20.134965 2566 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22002 I1212 11:10:20.134963 5418 query-exec-mgr.cc:69] new QueryState: query_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.134969 5418 query-exec-mgr.cc:77] QueryState: query_id=7645436891c726e0:a9b5656a00000000 refcnt=1 I1212 11:10:20.135048 5418 query-state.cc:58] RegisterFInstance(): instance_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.135144 5418 thread.cc:288] Started thread 14744 - query-exec-mgr:exec-fragment-instance-7645436891c726e0:a9b5656a00000000 I1212 11:10:20.135146 14744 plan-fragment-executor.cc:123] Prepare(): instance_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.135180 2562 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22001 instance_id=7645436891c726e0:a9b5656a00000002 I1212 11:10:20.135187 2562 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22001) I1212 11:10:20.135188 14744 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 8522291986269939424, 02: lo (i64) = -6217952204574162944, }, 02: per_fragment_instance_idx (i32) = 0, 03: per_node_scan_ranges (map) = map[0] { }, 04: per_exch_num_senders (map) = map[1] { 1 -> 3, }, 05: destinations (list) = list[0] { }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = -1, } I1212 11:10:20.135193 2562 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22001 I1212 11:10:20.135236 2564 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.135242 2564 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:20.135422 2564 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=7645436891c726e0:a9b5656a00000003 I1212 11:10:20.135429 2564 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:20.135433 2564 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.135509 14744 plan-fragment-executor.cc:174] descriptor table for fragment=7645436891c726e0:a9b5656a00000000 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:20.135582 14744 data-stream-mgr.cc:80] creating receiver for fragment=7645436891c726e0:a9b5656a00000000, node=1 I1212 11:10:20.135695 3396 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=7645436891c726e0:a9b5656a00000003 I1212 11:10:20.135710 3396 query-exec-mgr.cc:45] StartFInstance() instance_id=7645436891c726e0:a9b5656a00000003 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.135715 3396 query-exec-mgr.cc:77] QueryState: query_id=7645436891c726e0:a9b5656a00000000 refcnt=2 I1212 11:10:20.135764 3396 query-state.cc:58] RegisterFInstance(): instance_id=7645436891c726e0:a9b5656a00000003 I1212 11:10:20.143934 2562 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=7645436891c726e0:a9b5656a00000002 I1212 11:10:20.143946 2562 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22001 back to cache I1212 11:10:20.144134 3396 thread.cc:288] Started thread 14747 - query-exec-mgr:exec-fragment-instance-7645436891c726e0:a9b5656a00000003 I1212 11:10:20.144134 14747 plan-fragment-executor.cc:123] Prepare(): instance_id=7645436891c726e0:a9b5656a00000003 I1212 11:10:20.144207 14747 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 8522291986269939424, 02: lo (i64) = -6217952204574162941, }, 02: per_fragment_instance_idx (i32) = 2, 03: per_node_scan_ranges (map) = map[1] { 0 -> list[1] { [0] = TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](501)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, }, }, }, 04: per_exch_num_senders (map) = map[0] { }, 05: destinations (list) = list[1] { [0] = TPlanFragmentDestination { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 8522291986269939424, 02: lo (i64) = -6217952204574162944, }, 02: server (struct) = TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, }, }, }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = 2, } I1212 11:10:20.144227 2564 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=7645436891c726e0:a9b5656a00000003 I1212 11:10:20.144237 2564 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:20.144227 2566 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=7645436891c726e0:a9b5656a00000001 I1212 11:10:20.144280 2566 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22002 back to cache I1212 11:10:20.144323 2681 coordinator.cc:640] started 4 fragment instances for query 7645436891c726e0:a9b5656a00000000 I1212 11:10:20.144378 2681 query-exec-mgr.cc:123] GetQueryState(): query_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.144387 2681 query-state.cc:65] GetFInstanceState(): instance_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.144465 14747 plan-fragment-executor.cc:174] descriptor table for fragment=7645436891c726e0:a9b5656a00000003 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:20.144619 14747 plan-fragment-executor.cc:285] Hdfs split stats (:<# splits>/) for query=7645436891c726e0:a9b5656a00000000: I1212 11:10:20.149689 14747 thread.cc:288] Started thread 14749 - DataStreamSender:SenderThread(1:1) I1212 11:10:20.158285 14744 plan-fragment-executor.cc:261] plan_root= ExchangeNode(#senders=3 conjuncts=[]) I1212 11:10:20.162367 2681 coordinator.cc:1181] Byte split for fragment 1 min: 0, max: 0, avg: 0, stddev: 0 I1212 11:10:20.162382 2681 coordinator.cc:1184] data volume for ipaddress 0xbfec2e0: 0 I1212 11:10:20.162386 2681 coordinator.cc:1184] data volume for ipaddress 0xbfebd40: 0 I1212 11:10:20.162398 2681 coordinator.cc:1184] data volume for ipaddress 0xbf50400: 0 I1212 11:10:20.162598 14744 plan-fragment-executor.cc:296] Open(): instance_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.170488 2681 thread.cc:288] Started thread 14753 - query-exec-state:wait-thread I1212 11:10:20.170553 2681 impala-hs2-server.cc:486] ExecuteStatement(): return_val=TExecuteStatementResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: operationHandle (struct) = TOperationHandle { 01: operationId (struct) = THandleIdentifier { 01: guid (string) = "\xe0&\xc7\x91hCEv\x00\x00\x00\x00je\xb5\xa9", 02: secret (string) = "\xe0&\xc7\x91hCEv\x00\x00\x00\x00je\xb5\xa9", }, 02: operationType (i32) = 0, 03: hasResultSet (bool) = true, }, } I1212 11:10:20.172363 14744 thread.cc:288] Started thread 14754 - plan-fragment-executor:report-profile I1212 11:10:20.172360 14754 plan-fragment-executor.cc:378] ReportProfileThread(): instance_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.175568 14747 plan-fragment-executor.cc:261] plan_root= KuduScanNode(tupleid=0) I1212 11:10:20.175585 14747 plan-fragment-executor.cc:296] Open(): instance_id=7645436891c726e0:a9b5656a00000003 I1212 11:10:20.175770 14766 plan-fragment-executor.cc:378] ReportProfileThread(): instance_id=7645436891c726e0:a9b5656a00000003 I1212 11:10:20.175786 14747 thread.cc:288] Started thread 14766 - plan-fragment-executor:report-profile I1212 11:10:20.178545 14747 kudu-scan-node.cc:128] Latest observed Kudu timestamp: 0 I1212 11:10:20.178926 14747 kudu-scan-node.cc:248] Thread started: scanner-thread(1) I1212 11:10:20.182590 14747 thread.cc:288] Started thread 14784 - kudu-scan-node:scanner-thread(1) I1212 11:10:20.184738 3766 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=7645436891c726e0:a9b5656a00000000, node=1 I1212 11:10:20.184782 3766 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=7645436891c726e0:a9b5656a00000000 node_id=1 #senders=2 I1212 11:10:20.185232 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=7645436891c726e0:a9b5656a00000001 I1212 11:10:20.185241 3766 impala-server.cc:1076] ReportExecStatus() instance_id=7645436891c726e0:a9b5656a00000001 done=true I1212 11:10:20.185248 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=7645436891c726e0:a9b5656a00000001 status=0 done=true I1212 11:10:20.185689 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 0.000ns 0.000ns 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3.893ms 11.679ms 0 -1 198.00 KB 0 I1212 11:10:20.185704 3766 progress-updater.cc:65] Query 7645436891c726e0:a9b5656a00000000: 33% Complete (1 out of 3) I1212 11:10:20.185904 3766 coordinator.cc:1521] profile for instance_id=7645436891c726e0:a9b5656a00000001 Instance 7645436891c726e0:a9b5656a00000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 40.513ms, non-child: 3.558ms, % non-child: 8.78%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 250.000ns - TotalStorageWaitTime: 6.953ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 19.566ms - TotalThreadsSysTime: 896.000us - TotalThreadsUserTime: 3.332ms - TotalThreadsVoluntaryContextSwitches: 86 (86) Fragment Instance Lifecycle Timings: - ExecTime: 7.781ms - ExecTreeExecTime: 7.591ms - OpenTime: 4.234ms - ExecTreeOpenTime: 4.049ms - PrepareTime: 28.450ms - ExecTreePrepareTime: 58.608us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 24.607us, non-child: 24.607us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.250ms, non-child: 25.250ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 24.735ms KUDU_SCAN_NODE (id=0):(Total: 11.679ms, non-child: 11.679ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 7.569ms - MaterializeTupleTime(*): 7.583ms - ScannerThreadsSysTime: 896.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 73 (73) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:20.186249 3766 coordinator.cc:1529] cumulative profile for query_id=7645436891c726e0:a9b5656a00000000 Execution Profile 7645436891c726e0:a9b5656a00000000:(Total: 28.247ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 8ms, 75th %-ile: 9ms, 90th %-ile: 9ms, 95th %-ile: 9ms, 99.9th %-ile: 9ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Averaged Fragment F00:(Total: 40.513ms, non-child: 3.558ms, % non-child: 8.78%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 250.000ns - TotalStorageWaitTime: 6.953ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 19.566ms - TotalThreadsSysTime: 896.000us - TotalThreadsUserTime: 3.332ms - TotalThreadsVoluntaryContextSwitches: 86 (86) Fragment Instance Lifecycle Timings: - ExecTime: 7.781ms - ExecTreeExecTime: 7.591ms - OpenTime: 4.234ms - ExecTreeOpenTime: 4.049ms - PrepareTime: 28.450ms - ExecTreePrepareTime: 58.608us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 24.607us, non-child: 24.607us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.250ms, non-child: 25.250ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 24.735ms KUDU_SCAN_NODE (id=0):(Total: 11.679ms, non-child: 11.679ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 7.569ms - MaterializeTupleTime(*): 7.583ms - ScannerThreadsSysTime: 896.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 73 (73) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 7645436891c726e0:a9b5656a00000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 40.513ms, non-child: 3.558ms, % non-child: 8.78%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 250.000ns - TotalStorageWaitTime: 6.953ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 19.566ms - TotalThreadsSysTime: 896.000us - TotalThreadsUserTime: 3.332ms - TotalThreadsVoluntaryContextSwitches: 86 (86) Fragment Instance Lifecycle Timings: - ExecTime: 7.781ms - ExecTreeExecTime: 7.591ms - OpenTime: 4.234ms - ExecTreeOpenTime: 4.049ms - PrepareTime: 28.450ms - ExecTreePrepareTime: 58.608us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 24.607us, non-child: 24.607us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.250ms, non-child: 25.250ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 24.735ms KUDU_SCAN_NODE (id=0):(Total: 11.679ms, non-child: 11.679ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 7.569ms - MaterializeTupleTime(*): 7.583ms - ScannerThreadsSysTime: 896.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 73 (73) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:20.186261 3766 coordinator.cc:1546] Fragment instance completed: id=7645436891c726e0:a9b5656a00000001 host=mj-desktop.ca.cloudera.com:22002 remaining=3 I1212 11:10:20.186265 3766 coordinator.cc:1556] query_id=7645436891c726e0:a9b5656a00000000: first in-progress backend: mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.186687 14784 kudu-scanner.cc:148] Starting KuduScanner with ReadMode=0 timeout=180000 I1212 11:10:20.199105 14784 kudu-scan-node.cc:324] Thread done: scanner-thread(1) I1212 11:10:20.199193 14747 data-stream-sender.cc:284] Channel::FlushAndSendEos() instance_id=7645436891c726e0:a9b5656a00000000 dest_node=1 #rows= 0 I1212 11:10:20.199213 14747 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:20.199220 14747 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.199229 14747 data-stream-sender.cc:311] calling TransmitData(eos=true) to terminate channel. I1212 11:10:20.199316 5418 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=7645436891c726e0:a9b5656a00000000, node=1 I1212 11:10:20.199337 5418 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=7645436891c726e0:a9b5656a00000000 node_id=1 #senders=1 I1212 11:10:20.199380 14747 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:20.199416 14766 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=7645436891c726e0:a9b5656a00000003 I1212 11:10:20.199499 14747 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:20.199504 14747 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.199914 3396 impala-internal-service.cc:74] ReportExecStatus(): instance_id=7645436891c726e0:a9b5656a00000003 I1212 11:10:20.199925 3396 impala-server.cc:1076] ReportExecStatus() instance_id=7645436891c726e0:a9b5656a00000003 done=true I1212 11:10:20.199935 3396 coordinator.cc:1437] UpdateFragmentExecStatus() instance=7645436891c726e0:a9b5656a00000003 status=0 done=true I1212 11:10:20.200402 3396 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 0.000ns 0.000ns 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 11.593ms 23.099ms 0 -1 198.00 KB 0 I1212 11:10:20.200517 3396 progress-updater.cc:65] Query 7645436891c726e0:a9b5656a00000000: 66% Complete (2 out of 3) I1212 11:10:20.200789 3396 coordinator.cc:1521] profile for instance_id=7645436891c726e0:a9b5656a00000003 Instance 7645436891c726e0:a9b5656a00000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 55.157ms, non-child: 6.303ms, % non-child: 11.43%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 225.000ns - TotalStorageWaitTime: 12.330ms - TotalThreadsInvoluntaryContextSwitches: 11 (11) - TotalThreadsTotalWallClockTime: 40.410ms - TotalThreadsSysTime: 889.000us - TotalThreadsUserTime: 1.892ms - TotalThreadsVoluntaryContextSwitches: 93 (93) Fragment Instance Lifecycle Timings: - ExecTime: 16.776ms - ExecTreeExecTime: 16.502ms - OpenTime: 7.019ms - ExecTreeOpenTime: 6.555ms - PrepareTime: 31.300ms - ExecTreePrepareTime: 66.022us DataStreamSender (dst_id=1):(Total: 27.927us, non-child: 27.927us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.726ms, non-child: 25.726ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 25.083ms KUDU_SCAN_NODE (id=0):(Total: 23.099ms, non-child: 23.099ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 16.634ms - MaterializeTupleTime(*): 16.493ms - ScannerThreadsSysTime: 889.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 71 (71) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:20.201023 3769 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=7645436891c726e0:a9b5656a00000000, node=1 I1212 11:10:20.201037 3769 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=7645436891c726e0:a9b5656a00000000 node_id=1 #senders=0 I1212 11:10:20.201059 14744 exchange-node.cc:139] exch: has batch=false #rows=0 is_cancelled=false instance_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.201107 14744 exchange-node.cc:139] exch: has batch=false #rows=0 is_cancelled=false instance_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.201182 14754 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.201230 14744 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:20.201236 14744 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.201586 5418 impala-internal-service.cc:74] ReportExecStatus(): instance_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.201596 5418 impala-server.cc:1076] ReportExecStatus() instance_id=7645436891c726e0:a9b5656a00000000 done=true I1212 11:10:20.201603 5418 coordinator.cc:1437] UpdateFragmentExecStatus() instance=7645436891c726e0:a9b5656a00000000 status=0 done=true I1212 11:10:20.201611 3396 coordinator.cc:1529] cumulative profile for query_id=7645436891c726e0:a9b5656a00000000 Execution Profile 7645436891c726e0:a9b5656a00000000:(Total: 28.247ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 8ms, 75th %-ile: 9ms, 90th %-ile: 9ms, 95th %-ile: 9ms, 99.9th %-ile: 9ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Averaged Fragment F00:(Total: 47.835ms, non-child: 4.930ms, % non-child: 10.31%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 210.67 KB (215728) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 237.000ns - TotalStorageWaitTime: 9.641ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 29.988ms - TotalThreadsSysTime: 892.500us - TotalThreadsUserTime: 2.612ms - TotalThreadsVoluntaryContextSwitches: 89 (89) Fragment Instance Lifecycle Timings: - ExecTime: 12.279ms - ExecTreeExecTime: 12.046ms - OpenTime: 5.626ms - ExecTreeOpenTime: 5.302ms - PrepareTime: 29.875ms - ExecTreePrepareTime: 62.315us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 26.267us, non-child: 26.267us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.488ms, non-child: 25.488ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 24.909ms KUDU_SCAN_NODE (id=0):(Total: 17.389ms, non-child: 17.389ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 12.101ms - MaterializeTupleTime(*): 12.038ms - ScannerThreadsSysTime: 892.500us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 72 (72) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 7645436891c726e0:a9b5656a00000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 40.513ms, non-child: 3.558ms, % non-child: 8.78%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 250.000ns - TotalStorageWaitTime: 6.953ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 19.566ms - TotalThreadsSysTime: 896.000us - TotalThreadsUserTime: 3.332ms - TotalThreadsVoluntaryContextSwitches: 86 (86) Fragment Instance Lifecycle Timings: - ExecTime: 7.781ms - ExecTreeExecTime: 7.591ms - OpenTime: 4.234ms - ExecTreeOpenTime: 4.049ms - PrepareTime: 28.450ms - ExecTreePrepareTime: 58.608us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 24.607us, non-child: 24.607us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.250ms, non-child: 25.250ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 24.735ms KUDU_SCAN_NODE (id=0):(Total: 11.679ms, non-child: 11.679ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 7.569ms - MaterializeTupleTime(*): 7.583ms - ScannerThreadsSysTime: 896.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 73 (73) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Instance 7645436891c726e0:a9b5656a00000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 55.157ms, non-child: 6.303ms, % non-child: 11.43%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 225.000ns - TotalStorageWaitTime: 12.330ms - TotalThreadsInvoluntaryContextSwitches: 11 (11) - TotalThreadsTotalWallClockTime: 40.410ms - TotalThreadsSysTime: 889.000us - TotalThreadsUserTime: 1.892ms - TotalThreadsVoluntaryContextSwitches: 93 (93) Fragment Instance Lifecycle Timings: - ExecTime: 16.776ms - ExecTreeExecTime: 16.502ms - OpenTime: 7.019ms - ExecTreeOpenTime: 6.555ms - PrepareTime: 31.300ms - ExecTreePrepareTime: 66.022us DataStreamSender (dst_id=1):(Total: 27.927us, non-child: 27.927us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.726ms, non-child: 25.726ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 25.083ms KUDU_SCAN_NODE (id=0):(Total: 23.099ms, non-child: 23.099ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 16.634ms - MaterializeTupleTime(*): 16.493ms - ScannerThreadsSysTime: 889.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 71 (71) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:20.201637 3396 coordinator.cc:1546] Fragment instance completed: id=7645436891c726e0:a9b5656a00000003 host=mj-desktop.ca.cloudera.com:22000 remaining=2 I1212 11:10:20.201639 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=7645436891c726e0:a9b5656a00000002 I1212 11:10:20.201647 3769 impala-server.cc:1076] ReportExecStatus() instance_id=7645436891c726e0:a9b5656a00000002 done=true I1212 11:10:20.201654 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=7645436891c726e0:a9b5656a00000002 status=0 done=true I1212 11:10:20.201876 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 29.756us 29.756us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 11.593ms 23.099ms 0 -1 198.00 KB 0 I1212 11:10:20.202105 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 29.756us 29.756us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 20.502ms 26.727ms 0 -1 198.00 KB 0 I1212 11:10:20.202121 3769 progress-updater.cc:55] Query 7645436891c726e0:a9b5656a00000000 100% Complete (3 out of 3) I1212 11:10:20.202222 14747 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:20.202343 14747 query-exec-mgr.cc:103] Instance completed. instance_id=7645436891c726e0:a9b5656a00000003 I1212 11:10:20.202350 14747 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=7645436891c726e0:a9b5656a00000000 refcnt=3 I1212 11:10:20.202369 5418 coordinator.cc:1521] profile for instance_id=7645436891c726e0:a9b5656a00000000 Instance 7645436891c726e0:a9b5656a00000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 61.608ms, non-child: 10.550ms, % non-child: 17.13%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 28.623ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 38.486ms - TotalThreadsSysTime: 26.000us - TotalThreadsUserTime: 103.000us - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 23.974us - ExecTreeExecTime: 15.263us - OpenTime: 38.480ms - ExecTreeOpenTime: 28.639ms - PrepareTime: 23.028ms - ExecTreePrepareTime: 92.924us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 22.407ms, non-child: 22.407ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 21.694ms EXCHANGE_NODE (id=1):(Total: 28.650ms, non-child: 29.756us, % non-child: 0.10%) - BytesReceived: 0 - ConvertRowBatchTime: 1.394us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 28.619ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns I1212 11:10:20.202498 2681 impala-hs2-server.cc:713] GetResultSetMetadata(): query_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.202775 2681 impala-hs2-server.cc:753] GetResultSetMetadata(): return_val=TGetResultSetMetadataResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: schema (struct) = TTableSchema { 01: columns (list) = list[16] { [0] = TColumnDesc { 01: columnName (string) = "l_orderkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 0, }, [1] = TColumnDesc { 01: columnName (string) = "l_linenumber", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 3, }, }, }, }, 03: position (i32) = 1, }, [2] = TColumnDesc { 01: columnName (string) = "l_partkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 2, }, [3] = TColumnDesc { 01: columnName (string) = "l_suppkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 3, }, [4] = TColumnDesc { 01: columnName (string) = "l_quantity", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 4, }, [5] = TColumnDesc { 01: columnName (string) = "l_extendedprice", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 5, }, [6] = TColumnDesc { 01: columnName (string) = "l_discount", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 6, }, [7] = TColumnDesc { 01: columnName (string) = "l_tax", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 7, }, [8] = TColumnDesc { 01: columnName (string) = "l_returnflag", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 8, }, [9] = TColumnDesc { 01: columnName (string) = "l_linestatus", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 9, }, [10] = TColumnDesc { 01: columnName (string) = "l_shipdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 10, }, [11] = TColumnDesc { 01: columnName (string) = "l_commitdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 11, }, [12] = TColumnDesc { 01: columnName (string) = "l_receiptdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 12, }, [13] = TColumnDesc { 01: columnName (string) = "l_shipinstruct", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 13, }, [14] = TColumnDesc { 01: columnName (string) = "l_shipmode", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 14, }, [15] = TColumnDesc { 01: columnName (string) = "l_comment", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 15, }, }, }, } I1212 11:10:20.202811 3769 coordinator.cc:1521] profile for instance_id=7645436891c726e0:a9b5656a00000002 Instance 7645436891c726e0:a9b5656a00000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 57.184ms, non-child: 1.362ms, % non-child: 2.38%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 280.000ns - TotalStorageWaitTime: 17.589ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 27.070ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 2.799ms - TotalThreadsVoluntaryContextSwitches: 49 (49) Fragment Instance Lifecycle Timings: - ExecTime: 18.564ms - ExecTreeExecTime: 18.325ms - OpenTime: 8.540ms - ExecTreeOpenTime: 8.356ms - PrepareTime: 30.007ms - ExecTreePrepareTime: 69.333us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 28.296us, non-child: 28.296us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 29.066ms, non-child: 29.066ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 28.385ms KUDU_SCAN_NODE (id=0):(Total: 26.727ms, non-child: 26.727ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 18.316ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:20.203141 2681 coordinator.cc:1064] Coordinator waiting for fragment instances to finish, 2 remaining I1212 11:10:20.203753 3769 coordinator.cc:1529] cumulative profile for query_id=7645436891c726e0:a9b5656a00000000 Execution Profile 7645436891c726e0:a9b5656a00000000:(Total: 58.920ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 8ms, 75th %-ile: 9ms, 90th %-ile: 9ms, 95th %-ile: 9ms, 99.9th %-ile: 9ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance 7645436891c726e0:a9b5656a00000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 61.608ms, non-child: 10.550ms, % non-child: 17.13%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 28.623ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 38.486ms - TotalThreadsSysTime: 26.000us - TotalThreadsUserTime: 103.000us - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 23.974us - ExecTreeExecTime: 15.263us - OpenTime: 38.480ms - ExecTreeOpenTime: 28.639ms - PrepareTime: 23.028ms - ExecTreePrepareTime: 92.924us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 22.407ms, non-child: 22.407ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 21.694ms EXCHANGE_NODE (id=1):(Total: 28.650ms, non-child: 29.756us, % non-child: 0.10%) - BytesReceived: 0 - ConvertRowBatchTime: 1.394us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 28.619ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 50.951ms, non-child: 3.741ms, % non-child: 7.34%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 209.34 KB (214362) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 251.000ns - TotalStorageWaitTime: 12.290ms - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 29.015ms - TotalThreadsSysTime: 595.000us - TotalThreadsUserTime: 2.674ms - TotalThreadsVoluntaryContextSwitches: 76 (76) Fragment Instance Lifecycle Timings: - ExecTime: 14.374ms - ExecTreeExecTime: 14.139ms - OpenTime: 6.598ms - ExecTreeOpenTime: 6.320ms - PrepareTime: 29.919ms - ExecTreePrepareTime: 64.654us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 26.943us, non-child: 26.943us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 26.681ms, non-child: 26.681ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 26.068ms KUDU_SCAN_NODE (id=0):(Total: 20.502ms, non-child: 20.502ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 8.067ms - MaterializeTupleTime(*): 14.130ms - ScannerThreadsSysTime: 595.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 48 (48) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 7645436891c726e0:a9b5656a00000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 40.513ms, non-child: 3.558ms, % non-child: 8.78%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 250.000ns - TotalStorageWaitTime: 6.953ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 19.566ms - TotalThreadsSysTime: 896.000us - TotalThreadsUserTime: 3.332ms - TotalThreadsVoluntaryContextSwitches: 86 (86) Fragment Instance Lifecycle Timings: - ExecTime: 7.781ms - ExecTreeExecTime: 7.591ms - OpenTime: 4.234ms - ExecTreeOpenTime: 4.049ms - PrepareTime: 28.450ms - ExecTreePrepareTime: 58.608us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 24.607us, non-child: 24.607us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.250ms, non-child: 25.250ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 24.735ms KUDU_SCAN_NODE (id=0):(Total: 11.679ms, non-child: 11.679ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 7.569ms - MaterializeTupleTime(*): 7.583ms - ScannerThreadsSysTime: 896.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 73 (73) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Instance 7645436891c726e0:a9b5656a00000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 55.157ms, non-child: 6.303ms, % non-child: 11.43%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 225.000ns - TotalStorageWaitTime: 12.330ms - TotalThreadsInvoluntaryContextSwitches: 11 (11) - TotalThreadsTotalWallClockTime: 40.410ms - TotalThreadsSysTime: 889.000us - TotalThreadsUserTime: 1.892ms - TotalThreadsVoluntaryContextSwitches: 93 (93) Fragment Instance Lifecycle Timings: - ExecTime: 16.776ms - ExecTreeExecTime: 16.502ms - OpenTime: 7.019ms - ExecTreeOpenTime: 6.555ms - PrepareTime: 31.300ms - ExecTreePrepareTime: 66.022us DataStreamSender (dst_id=1):(Total: 27.927us, non-child: 27.927us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.726ms, non-child: 25.726ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 25.083ms KUDU_SCAN_NODE (id=0):(Total: 23.099ms, non-child: 23.099ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 16.634ms - MaterializeTupleTime(*): 16.493ms - ScannerThreadsSysTime: 889.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 71 (71) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Instance 7645436891c726e0:a9b5656a00000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 57.184ms, non-child: 1.362ms, % non-child: 2.38%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 280.000ns - TotalStorageWaitTime: 17.589ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 27.070ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 2.799ms - TotalThreadsVoluntaryContextSwitches: 49 (49) Fragment Instance Lifecycle Timings: - ExecTime: 18.564ms - ExecTreeExecTime: 18.325ms - OpenTime: 8.540ms - ExecTreeOpenTime: 8.356ms - PrepareTime: 30.007ms - ExecTreePrepareTime: 69.333us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 28.296us, non-child: 28.296us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 29.066ms, non-child: 29.066ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 28.385ms KUDU_SCAN_NODE (id=0):(Total: 26.727ms, non-child: 26.727ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 18.316ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:20.203774 3769 coordinator.cc:1546] Fragment instance completed: id=7645436891c726e0:a9b5656a00000002 host=mj-desktop.ca.cloudera.com:22001 remaining=1 I1212 11:10:20.203775 5418 coordinator.cc:1529] cumulative profile for query_id=7645436891c726e0:a9b5656a00000000 Execution Profile 7645436891c726e0:a9b5656a00000000:(Total: 58.920ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 0, 50th %-ile: 8ms, 75th %-ile: 9ms, 90th %-ile: 9ms, 95th %-ile: 9ms, 99.9th %-ile: 9ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance 7645436891c726e0:a9b5656a00000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 61.608ms, non-child: 10.550ms, % non-child: 17.13%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 28.623ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 38.486ms - TotalThreadsSysTime: 26.000us - TotalThreadsUserTime: 103.000us - TotalThreadsVoluntaryContextSwitches: 4 (4) Fragment Instance Lifecycle Timings: - ExecTime: 23.974us - ExecTreeExecTime: 15.263us - OpenTime: 38.480ms - ExecTreeOpenTime: 28.639ms - PrepareTime: 23.028ms - ExecTreePrepareTime: 92.924us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 22.407ms, non-child: 22.407ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 21.694ms EXCHANGE_NODE (id=1):(Total: 28.650ms, non-child: 29.756us, % non-child: 0.10%) - BytesReceived: 0 - ConvertRowBatchTime: 1.394us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 28.619ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 50.951ms, non-child: 3.741ms, % non-child: 7.34%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 209.34 KB (214362) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 251.000ns - TotalStorageWaitTime: 12.290ms - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 29.015ms - TotalThreadsSysTime: 595.000us - TotalThreadsUserTime: 2.674ms - TotalThreadsVoluntaryContextSwitches: 76 (76) Fragment Instance Lifecycle Timings: - ExecTime: 14.374ms - ExecTreeExecTime: 14.139ms - OpenTime: 6.598ms - ExecTreeOpenTime: 6.320ms - PrepareTime: 29.919ms - ExecTreePrepareTime: 64.654us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 26.943us, non-child: 26.943us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 26.681ms, non-child: 26.681ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 26.068ms KUDU_SCAN_NODE (id=0):(Total: 20.502ms, non-child: 20.502ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 8.067ms - MaterializeTupleTime(*): 14.130ms - ScannerThreadsSysTime: 595.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 48 (48) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 7645436891c726e0:a9b5656a00000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 40.513ms, non-child: 3.558ms, % non-child: 8.78%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 250.000ns - TotalStorageWaitTime: 6.953ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 19.566ms - TotalThreadsSysTime: 896.000us - TotalThreadsUserTime: 3.332ms - TotalThreadsVoluntaryContextSwitches: 86 (86) Fragment Instance Lifecycle Timings: - ExecTime: 7.781ms - ExecTreeExecTime: 7.591ms - OpenTime: 4.234ms - ExecTreeOpenTime: 4.049ms - PrepareTime: 28.450ms - ExecTreePrepareTime: 58.608us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 24.607us, non-child: 24.607us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.250ms, non-child: 25.250ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 24.735ms KUDU_SCAN_NODE (id=0):(Total: 11.679ms, non-child: 11.679ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 7.569ms - MaterializeTupleTime(*): 7.583ms - ScannerThreadsSysTime: 896.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 73 (73) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Instance 7645436891c726e0:a9b5656a00000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 55.157ms, non-child: 6.303ms, % non-child: 11.43%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 214.67 KB (219824) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 225.000ns - TotalStorageWaitTime: 12.330ms - TotalThreadsInvoluntaryContextSwitches: 11 (11) - TotalThreadsTotalWallClockTime: 40.410ms - TotalThreadsSysTime: 889.000us - TotalThreadsUserTime: 1.892ms - TotalThreadsVoluntaryContextSwitches: 93 (93) Fragment Instance Lifecycle Timings: - ExecTime: 16.776ms - ExecTreeExecTime: 16.502ms - OpenTime: 7.019ms - ExecTreeOpenTime: 6.555ms - PrepareTime: 31.300ms - ExecTreePrepareTime: 66.022us DataStreamSender (dst_id=1):(Total: 27.927us, non-child: 27.927us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 25.726ms, non-child: 25.726ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 25.083ms KUDU_SCAN_NODE (id=0):(Total: 23.099ms, non-child: 23.099ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 16.634ms - MaterializeTupleTime(*): 16.493ms - ScannerThreadsSysTime: 889.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 71 (71) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec Instance 7645436891c726e0:a9b5656a00000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 57.184ms, non-child: 1.362ms, % non-child: 2.38%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 206.67 KB (211632) - PerHostPeakMemUsage: 206.67 KB (211632) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 280.000ns - TotalStorageWaitTime: 17.589ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 27.070ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 2.799ms - TotalThreadsVoluntaryContextSwitches: 49 (49) Fragment Instance Lifecycle Timings: - ExecTime: 18.564ms - ExecTreeExecTime: 18.325ms - OpenTime: 8.540ms - ExecTreeOpenTime: 8.356ms - PrepareTime: 30.007ms - ExecTreePrepareTime: 69.333us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 28.296us, non-child: 28.296us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 29.066ms, non-child: 29.066ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 28.385ms KUDU_SCAN_NODE (id=0):(Total: 26.727ms, non-child: 26.727ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 198.00 KB (202752) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 18.316ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 0 (0) - TotalReadThroughput: 0.00 /sec I1212 11:10:20.203814 5418 coordinator.cc:1546] Fragment instance completed: id=7645436891c726e0:a9b5656a00000000 host=mj-desktop.ca.cloudera.com:22000 remaining=0 I1212 11:10:20.203832 2681 coordinator.cc:1069] All fragment instances finished successfully. I1212 11:10:20.203860 14744 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:20.203877 14744 data-stream-mgr.cc:226] DeregisterRecvr(): fragment_instance_id=7645436891c726e0:a9b5656a00000000, node=1 I1212 11:10:20.203886 14744 data-stream-recvr.cc:237] cancelled stream: fragment_instance_id_=7645436891c726e0:a9b5656a00000000 node_id=1 I1212 11:10:20.203912 14744 query-exec-mgr.cc:103] Instance completed. instance_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.203917 14744 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=7645436891c726e0:a9b5656a00000000 refcnt=2 I1212 11:10:20.203956 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 29.756us 29.756us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 20.502ms 26.727ms 0 -1 198.00 KB 0 I1212 11:10:20.204200 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 29.756us 29.756us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 20.502ms 26.727ms 0 -1 198.00 KB 0 I1212 11:10:20.204432 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 29.756us 29.756us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 20.502ms 26.727ms 0 -1 198.00 KB 0 I1212 11:10:20.204653 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 29.756us 29.756us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 20.502ms 26.727ms 0 -1 198.00 KB 0 I1212 11:10:20.205030 2681 impala-hs2-server.cc:688] CloseOperation(): query_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.205037 2681 impala-server.cc:907] UnregisterQuery(): query_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.205044 2681 impala-server.cc:993] Cancel(): query_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.205050 2681 coordinator.cc:1362] Cancel() query_id=7645436891c726e0:a9b5656a00000000 I1212 11:10:20.205061 2681 coordinator.cc:1428] CancelFragmentInstances() query_id=7645436891c726e0:a9b5656a00000000, tried to cancel 0 fragment instances I1212 11:10:20.205178 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 29.756us 29.756us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 20.502ms 26.727ms 0 -1 198.00 KB 0 I1212 11:10:20.205412 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 29.756us 29.756us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 20.502ms 26.727ms 0 -1 198.00 KB 0 I1212 11:10:20.205668 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 29.756us 29.756us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 20.502ms 26.727ms 0 -1 198.00 KB 0 I1212 11:10:20.205900 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 29.756us 29.756us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 20.502ms 26.727ms 0 -1 198.00 KB 0 I1212 11:10:20.206032 2681 admission-controller.cc:538] Released query id=7645436891c726e0:a9b5656a00000000 agg_num_running=1, agg_num_queued=0, agg_mem_reserved=32.00 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=10.00 MB) I1212 11:10:20.206048 2681 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=7645436891c726e0:a9b5656a00000000 refcnt=1 I1212 11:10:20.216600 2681 impala-hs2-server.cc:414] ExecuteStatement(): request=TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\x04#\x89K{\x84C#\x90,\x8d\xa4\n(\x8e\x84", 02: secret (string) = "\x9e\x8d!z\x8erD\xe7\xa8\x91\n\x83\x93\xea0\x10", }, }, 02: statement (string) = "select * from lineitem where l_commitdate like '%cheese'", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "0m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:20.216639 2681 impala-hs2-server.cc:228] TExecuteStatementReq: TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\x04#\x89K{\x84C#\x90,\x8d\xa4\n(\x8e\x84", 02: secret (string) = "\x9e\x8d!z\x8erD\xe7\xa8\x91\n\x83\x93\xea0\x10", }, }, 02: statement (string) = "select * from lineitem where l_commitdate like '%cheese'", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "0m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:20.216678 2681 impala-server.cc:742] Parsed pool options: override_options_mask=1111111111111111111111111111111110111111111111111111111111000010 set_pool_mask=0000000000000000000000000000000000000000000000000000000000000000 overlay_mask=0000000000000000000000000000000000000000000000000000000000000000 I1212 11:10:20.216708 2681 impala-hs2-server.cc:261] TClientRequest.queryOptions: TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, } I1212 11:10:20.231389 14790 AsyncKuduClient.java:1367] Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) I1212 11:10:20.234566 14792 AsyncKuduClient.java:1367] Learned about tablet de1fe37fdb46438abfbc154bf7fb439b for table 'impala::ucu3e4.lineitem' with partition [, 0x00000001) I1212 11:10:20.234756 14792 AsyncKuduClient.java:1367] Learned about tablet 91d0d8d3b0e34afc9d7fa522e61f40ef for table 'impala::ucu3e4.lineitem' with partition [0x00000001, 0x00000002) I1212 11:10:20.235095 14792 AsyncKuduClient.java:1367] Learned about tablet dc26b34fb84d4ff8baae3f44b23f0ae2 for table 'impala::ucu3e4.lineitem' with partition [0x00000002, ) I1212 11:10:20.240708 2681 impala-server.cc:812] Execution request: TExecRequest { 01: stmt_type (i32) = 0, 02: query_options (struct) = TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 44: mt_dop (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, }, 03: query_exec_request (struct) = TQueryExecRequest { 01: desc_tbl (struct) = TDescriptorTable { 01: slotDescriptors (list) = list[16] { [0] = TSlotDescriptor { 01: id (i32) = 0, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 0, }, 06: byteOffset (i32) = 128, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 8, }, [1] = TSlotDescriptor { 01: id (i32) = 1, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 1, }, 06: byteOffset (i32) = 184, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 15, }, [2] = TSlotDescriptor { 01: id (i32) = 2, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 2, }, 06: byteOffset (i32) = 136, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 9, }, [3] = TSlotDescriptor { 01: id (i32) = 3, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 3, }, 06: byteOffset (i32) = 144, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 10, }, [4] = TSlotDescriptor { 01: id (i32) = 4, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 4, }, 06: byteOffset (i32) = 152, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 11, }, [5] = TSlotDescriptor { 01: id (i32) = 5, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 5, }, 06: byteOffset (i32) = 160, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 12, }, [6] = TSlotDescriptor { 01: id (i32) = 6, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 6, }, 06: byteOffset (i32) = 168, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 13, }, [7] = TSlotDescriptor { 01: id (i32) = 7, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 7, }, 06: byteOffset (i32) = 176, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 14, }, [8] = TSlotDescriptor { 01: id (i32) = 8, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 8, }, 06: byteOffset (i32) = 0, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 0, 09: slotIdx (i32) = 0, }, [9] = TSlotDescriptor { 01: id (i32) = 9, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 9, }, 06: byteOffset (i32) = 16, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 1, }, [10] = TSlotDescriptor { 01: id (i32) = 10, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 10, }, 06: byteOffset (i32) = 32, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 2, }, [11] = TSlotDescriptor { 01: id (i32) = 11, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 11, }, 06: byteOffset (i32) = 48, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 3, }, [12] = TSlotDescriptor { 01: id (i32) = 12, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 12, }, 06: byteOffset (i32) = 64, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 4, }, [13] = TSlotDescriptor { 01: id (i32) = 13, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 13, }, 06: byteOffset (i32) = 80, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 5, }, [14] = TSlotDescriptor { 01: id (i32) = 14, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 14, }, 06: byteOffset (i32) = 96, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 6, }, [15] = TSlotDescriptor { 01: id (i32) = 15, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 15, }, 06: byteOffset (i32) = 112, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 7, 09: slotIdx (i32) = 7, }, }, 02: tupleDescriptors (list) = list[1] { [0] = TTupleDescriptor { 01: id (i32) = 0, 02: byteSize (i32) = 190, 03: numNullBytes (i32) = 2, 04: tableId (i32) = 1, 05: tuplePath (list) = list[0] { }, }, }, 03: tableDescriptors (list) = list[1] { [0] = TTableDescriptor { 01: id (i32) = 1, 02: tableType (i32) = 4, 03: columnDescriptors (list) = list[16] { [0] = TColumnDescriptor { 01: name (string) = "l_orderkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [1] = TColumnDescriptor { 01: name (string) = "l_linenumber", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, }, [2] = TColumnDescriptor { 01: name (string) = "l_partkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [3] = TColumnDescriptor { 01: name (string) = "l_suppkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [4] = TColumnDescriptor { 01: name (string) = "l_quantity", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [5] = TColumnDescriptor { 01: name (string) = "l_extendedprice", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [6] = TColumnDescriptor { 01: name (string) = "l_discount", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [7] = TColumnDescriptor { 01: name (string) = "l_tax", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [8] = TColumnDescriptor { 01: name (string) = "l_returnflag", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [9] = TColumnDescriptor { 01: name (string) = "l_linestatus", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [10] = TColumnDescriptor { 01: name (string) = "l_shipdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [11] = TColumnDescriptor { 01: name (string) = "l_commitdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [12] = TColumnDescriptor { 01: name (string) = "l_receiptdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [13] = TColumnDescriptor { 01: name (string) = "l_shipinstruct", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [14] = TColumnDescriptor { 01: name (string) = "l_shipmode", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [15] = TColumnDescriptor { 01: name (string) = "l_comment", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, }, 04: numClusteringCols (i32) = 0, 07: tableName (string) = "impala::ucu3e4.lineitem", 08: dbName (string) = "ucu3e4", 10: kuduTable (struct) = TKuduTable { 01: table_name (string) = "impala::ucu3e4.lineitem", 02: master_addresses (list) = list[1] { [0] = "127.0.0.1", }, 03: key_columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 04: partition_by (list) = list[1] { [0] = TKuduPartitionParam { 01: by_hash_param (struct) = TKuduPartitionByHashParam { 01: columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 02: num_partitions (i32) = 3, }, }, }, }, }, }, }, 02: plan_exec_info (list) = list[1] { [0] = TPlanExecInfo { 01: fragments (list) = list[2] { [0] = TPlanFragment { 01: idx (i32) = 0, 02: display_name (string) = "F01", 03: plan (struct) = TPlan { 01: nodes (list) = list[1] { [0] = TPlanNode { 01: node_id (i32) = 1, 02: node_type (i32) = 6, 03: num_children (i32) = 0, 04: limit (i64) = -1, 05: row_tuples (list) = list[1] { [0] = 0, }, 06: nullable_tuples (list) = list[1] { [0] = false, }, 08: disable_codegen (bool) = false, 18: exchange_node (struct) = TExchangeNode { 01: input_row_tuples (list) = list[1] { [0] = 0, }, }, 21: label (string) = "01:EXCHANGE", 22: label_detail (string) = "UNPARTITIONED", 23: estimated_stats (struct) = TExecStats { 03: cardinality (i64) = -1, 04: memory_used (i64) = -1, }, }, }, }, 04: output_exprs (list) = list[16] { [0] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 0, }, }, }, }, [1] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 1, }, }, }, }, [2] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 2, }, }, }, }, [3] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 3, }, }, }, }, [4] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 4, }, }, }, }, [5] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 5, }, }, }, }, [6] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 6, }, }, }, }, [7] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 7, }, }, }, }, [8] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, I1212 11:10:20.241000 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22000(local selection) I1212 11:10:20.241027 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22001(local selection) I1212 11:10:20.241045 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22002(local selection) I1212 11:10:20.241050 2681 simple-scheduler.cc:979] Total remote scan volume = 0 I1212 11:10:20.241057 2681 simple-scheduler.cc:981] Total local scan volume = 2.93 KB I1212 11:10:20.241060 2681 simple-scheduler.cc:983] Total cached scan volume = 0 I1212 11:10:20.241070 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22002, } I1212 11:10:20.241080 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:20.241084 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22001, } I1212 11:10:20.241091 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](479)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:20.241096 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, } I1212 11:10:20.241101 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:20.241206 2681 admission-controller.cc:440] Schedule for id=7e473c244da07975:d15592e900000000 in pool_name=default-pool cluster_mem_needed=12.00 GB PoolConfig: max_requests=-1 max_queued=200 max_mem=-1.00 B I1212 11:10:20.241219 2681 admission-controller.cc:445] Stats: agg_num_running=1, agg_num_queued=0, agg_mem_reserved=32.00 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=10.00 MB) I1212 11:10:20.241227 2681 admission-controller.cc:451] Admitted query id=7e473c244da07975:d15592e900000000 I1212 11:10:20.241261 2681 admission-controller.cc:457] Final: agg_num_running=2, agg_num_queued=0, agg_mem_reserved=32.00 MB, local_host(local_mem_admitted=15.75 GB, num_admitted_running=2, num_queued=0, backend_mem_reserved=10.00 MB) I1212 11:10:20.241312 2681 coordinator.cc:447] Exec() query_id=7e473c244da07975:d15592e900000000 stmt=select * from lineitem where l_commitdate like '%cheese' I1212 11:10:20.241469 2681 coordinator.cc:602] starting 4 fragment instances for query 7e473c244da07975:d15592e900000000 I1212 11:10:20.241540 2681 coordinator.cc:737] ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- I1212 11:10:20.241699 2571 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22002 instance_id=7e473c244da07975:d15592e900000001 I1212 11:10:20.241703 2570 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22001 instance_id=7e473c244da07975:d15592e900000002 I1212 11:10:20.241706 2571 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22002) I1212 11:10:20.241716 2571 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22002 I1212 11:10:20.241719 2570 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22001) I1212 11:10:20.241729 2570 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22001 I1212 11:10:20.241732 2565 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=7e473c244da07975:d15592e900000000 I1212 11:10:20.241741 2565 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:20.241746 2565 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.241750 2568 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=7e473c244da07975:d15592e900000003 I1212 11:10:20.241758 2568 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:20.241765 2568 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.242027 3396 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=7e473c244da07975:d15592e900000000 I1212 11:10:20.242036 3396 query-exec-mgr.cc:45] StartFInstance() instance_id=7e473c244da07975:d15592e900000000 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.242050 5418 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=7e473c244da07975:d15592e900000003 I1212 11:10:20.242060 5418 query-exec-mgr.cc:45] StartFInstance() instance_id=7e473c244da07975:d15592e900000003 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:20.242063 3396 query-exec-mgr.cc:69] new QueryState: query_id=7e473c244da07975:d15592e900000000 I1212 11:10:20.242080 3396 query-exec-mgr.cc:77] QueryState: query_id=7e473c244da07975:d15592e900000000 refcnt=1 I1212 11:10:20.242151 3396 query-state.cc:58] RegisterFInstance(): instance_id=7e473c244da07975:d15592e900000000 I1212 11:10:20.242187 5418 query-exec-mgr.cc:77] QueryState: query_id=7e473c244da07975:d15592e900000000 refcnt=2 I1212 11:10:20.242233 14804 plan-fragment-executor.cc:123] Prepare(): instance_id=7e473c244da07975:d15592e900000000 I1212 11:10:20.242243 5418 query-state.cc:58] RegisterFInstance(): instance_id=7e473c244da07975:d15592e900000003 I1212 11:10:20.242267 14804 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 9099307698744228213, 02: lo (i64) = -3362620017337171968, }, 02: per_fragment_instance_idx (i32) = 0, 03: per_node_scan_ranges (map) = map[0] { }, 04: per_exch_num_senders (map) = map[1] { 1 -> 3, }, 05: destinations (list) = list[0] { }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = -1, } I1212 11:10:20.242288 3396 thread.cc:288] Started thread 14804 - query-exec-mgr:exec-fragment-instance-7e473c244da07975:d15592e900000000 I1212 11:10:20.242300 14805 plan-fragment-executor.cc:123] Prepare(): instance_id=7e473c244da07975:d15592e900000003 I1212 11:10:20.242290 2570 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=7e473c244da07975:d15592e900000002 I1212 11:10:20.242311 2570 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22001 back to cache I1212 11:10:20.242357 14805 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 9099307698744228213, 02: lo (i64) = -3362620017337171965, }, 02: per_fragment_instance_idx (i32) = 2, 03: per_node_scan_ranges (map) = map[1] { 0 -> list[1] { [0] = TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, }, }, }, 04: per_exch_num_senders (map) = map[0] { }, 05: destinations (list) = list[1] { [0] = TPlanFragmentDestination { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 9099307698744228213, 02: lo (i64) = -3362620017337171968, }, 02: server (struct) = TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, }, }, }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = 2, } I1212 11:10:20.242357 5418 thread.cc:288] Started thread 14805 - query-exec-mgr:exec-fragment-instance-7e473c244da07975:d15592e900000003 I1212 11:10:20.242420 2568 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=7e473c244da07975:d15592e900000003 I1212 11:10:20.242426 2568 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:20.242475 2565 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=7e473c244da07975:d15592e900000000 I1212 11:10:20.242481 2565 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:20.242481 2571 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=7e473c244da07975:d15592e900000001 I1212 11:10:20.242487 2571 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22002 back to cache I1212 11:10:20.242525 2681 coordinator.cc:640] started 4 fragment instances for query 7e473c244da07975:d15592e900000000 I1212 11:10:20.242560 2681 query-exec-mgr.cc:123] GetQueryState(): query_id=7e473c244da07975:d15592e900000000 I1212 11:10:20.242564 2681 query-state.cc:65] GetFInstanceState(): instance_id=7e473c244da07975:d15592e900000000 I1212 11:10:20.242575 14805 plan-fragment-executor.cc:174] descriptor table for fragment=7e473c244da07975:d15592e900000003 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:20.242581 14804 plan-fragment-executor.cc:174] descriptor table for fragment=7e473c244da07975:d15592e900000000 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:20.242638 14804 data-stream-mgr.cc:80] creating receiver for fragment=7e473c244da07975:d15592e900000000, node=1 I1212 11:10:20.242753 14805 plan-fragment-executor.cc:285] Hdfs split stats (:<# splits>/) for query=7e473c244da07975:d15592e900000000: I1212 11:10:20.242820 14805 thread.cc:288] Started thread 14806 - DataStreamSender:SenderThread(1:1) I1212 11:10:20.265076 14804 plan-fragment-executor.cc:261] plan_root= ExchangeNode(#senders=3 conjuncts=[]) I1212 11:10:20.265202 2681 coordinator.cc:1181] Byte split for fragment 1 min: 0, max: 0, avg: 0, stddev: 0 I1212 11:10:20.265208 2681 coordinator.cc:1184] data volume for ipaddress 0xbfed960: 0 I1212 11:10:20.265213 2681 coordinator.cc:1184] data volume for ipaddress 0xbfec640: 0 I1212 11:10:20.265215 2681 coordinator.cc:1184] data volume for ipaddress 0xbfedba0: 0 I1212 11:10:20.265396 14804 plan-fragment-executor.cc:296] Open(): instance_id=7e473c244da07975:d15592e900000000 I1212 11:10:20.265430 2681 thread.cc:288] Started thread 14809 - query-exec-state:wait-thread I1212 11:10:20.265473 2681 impala-hs2-server.cc:486] ExecuteStatement(): return_val=TExecuteStatementResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: operationHandle (struct) = TOperationHandle { 01: operationId (struct) = THandleIdentifier { 01: guid (string) = "uy\xa0M$:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 4s490ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 23.403ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 9.506ms - TotalThreadsVoluntaryContextSwitches: 112 (112) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 23.411ms - ExecTreeOpenTime: 14.068ms - PrepareTime: 34.247ms - ExecTreePrepareTime: 83.026us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 35.615us, non-child: 35.615us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 32.245ms, non-child: 32.245ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.453ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.212ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 24.188ms KUDU_SCAN_NODE (id=0):(Total: 14.083ms, non-child: 14.083ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 1.81M (1808000) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 452 (452) - TotalReadThroughput: 0.00 /sec I1212 11:10:25.281941 3766 coordinator.cc:1529] cumulative profile for query_id=7e473c244da07975:d15592e900000000 Execution Profile 7e473c244da07975:d15592e900000000:(Total: 23.846ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Averaged Fragment F00:(Total: 57.710ms, non-child: 11.346ms, % non-child: 19.66%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 4s490ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 23.403ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 9.506ms - TotalThreadsVoluntaryContextSwitches: 112 (112) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 23.411ms - ExecTreeOpenTime: 14.068ms - PrepareTime: 34.247ms - ExecTreePrepareTime: 83.026us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 35.615us, non-child: 35.615us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 32.245ms, non-child: 32.245ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.453ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.212ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 24.188ms KUDU_SCAN_NODE (id=0):(Total: 14.083ms, non-child: 14.083ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 1.81M (1808000) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 452 (452) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 7e473c244da07975:d15592e900000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 57.710ms, non-child: 11.346ms, % non-child: 19.66%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 4s490ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 23.403ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 9.506ms - TotalThreadsVoluntaryContextSwitches: 112 (112) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 23.411ms - ExecTreeOpenTime: 14.068ms - PrepareTime: 34.247ms - ExecTreePrepareTime: 83.026us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 35.615us, non-child: 35.615us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 32.245ms, non-child: 32.245ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.453ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.212ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 24.188ms KUDU_SCAN_NODE (id=0):(Total: 14.083ms, non-child: 14.083ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 1.81M (1808000) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 452 (452) - TotalReadThroughput: 0.00 /sec I1212 11:10:25.586030 14834 kudu-scan-node.cc:324] Thread done: scanner-thread(1) I1212 11:10:25.586058 14805 data-stream-sender.cc:284] Channel::FlushAndSendEos() instance_id=7e473c244da07975:d15592e900000000 dest_node=1 #rows= 0 I1212 11:10:25.586076 14805 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:25.586084 14805 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:25.586092 14805 data-stream-sender.cc:311] calling TransmitData(eos=true) to terminate channel. I1212 11:10:25.586156 5418 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=7e473c244da07975:d15592e900000000, node=1 I1212 11:10:25.586175 5418 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=7e473c244da07975:d15592e900000000 node_id=1 #senders=2 I1212 11:10:25.586243 14805 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:25.586282 14813 plan-fragment-executor.cc:408] Reporting final profile for instance 7e473c244da07975:d15592e900000003 I1212 11:10:25.586504 14813 plan-fragment-executor.cc:412] Fragment 7e473c244da07975:d15592e900000003:(Total: 5s343ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 35.67 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 0 - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 232.000ns - TotalStorageWaitTime: 4s760ms - TotalThreadsInvoluntaryContextSwitches: 1.25K (1251) - TotalThreadsTotalWallClockTime: 10s612ms - TotalThreadsSysTime: 60.800ms - TotalThreadsUserTime: 3s227ms - TotalThreadsVoluntaryContextSwitches: 512 (512) Fragment Instance Lifecycle Timings: - ExecTime: 5s296ms - ExecTreeExecTime: 5s296ms - OpenTime: 19.703ms - ExecTreeOpenTime: 3.035ms - PrepareTime: 27.406ms - ExecTreePrepareTime: 88.557us DataStreamSender (dst_id=1):(Total: 25.099us, non-child: 0.000ns, % non-child: 0.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 42.656ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 0.000ns - CompileTime: 1.621ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 13.382ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 26.976ms KUDU_SCAN_NODE (id=0):(Total: 5s299ms, non-child: 0.000ns, % non-child: 0.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2001571) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1245) - ScannerThreadsTotalWallClockTime: 5s296ms - MaterializeTupleTime(*): 5s296ms - ScannerThreadsSysTime: 60.800ms - ScannerThreadsUserTime: 3s214ms - ScannerThreadsVoluntaryContextSwitches: 498 (498) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:25.586532 14813 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=7e473c244da07975:d15592e900000003 I1212 11:10:25.586714 14805 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:25.586720 14805 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:25.587044 3396 impala-internal-service.cc:74] ReportExecStatus(): instance_id=7e473c244da07975:d15592e900000003 I1212 11:10:25.587054 3396 impala-server.cc:1076] ReportExecStatus() instance_id=7e473c244da07975:d15592e900000003 done=true I1212 11:10:25.587066 3396 coordinator.cc:1437] UpdateFragmentExecStatus() instance=7e473c244da07975:d15592e900000003 status=0 done=true I1212 11:10:25.587513 3396 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 0.000ns 0.000ns 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 1s771ms 5s299ms 0 -1 202.00 KB 0 I1212 11:10:25.587529 3396 progress-updater.cc:65] Query 7e473c244da07975:d15592e900000000: 33% Complete (1 out of 3) I1212 11:10:25.587827 3396 coordinator.cc:1521] profile for instance_id=7e473c244da07975:d15592e900000003 Instance 7e473c244da07975:d15592e900000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 5s343ms, non-child: 1.646ms, % non-child: 0.03%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 35.67 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 232.000ns - TotalStorageWaitTime: 4s760ms - TotalThreadsInvoluntaryContextSwitches: 1.25K (1251) - TotalThreadsTotalWallClockTime: 10s612ms - TotalThreadsSysTime: 60.800ms - TotalThreadsUserTime: 3s227ms - TotalThreadsVoluntaryContextSwitches: 512 (512) Fragment Instance Lifecycle Timings: - ExecTime: 5s296ms - ExecTreeExecTime: 5s296ms - OpenTime: 19.703ms - ExecTreeOpenTime: 3.035ms - PrepareTime: 27.406ms - ExecTreePrepareTime: 88.557us DataStreamSender (dst_id=1):(Total: 25.099us, non-child: 25.099us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 42.656ms, non-child: 42.656ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.621ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 13.382ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 26.976ms KUDU_SCAN_NODE (id=0):(Total: 5s299ms, non-child: 5s299ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2001571) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1245) - ScannerThreadsTotalWallClockTime: 5s296ms - MaterializeTupleTime(*): 5s296ms - ScannerThreadsSysTime: 60.800ms - ScannerThreadsUserTime: 3s214ms - ScannerThreadsVoluntaryContextSwitches: 498 (498) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:25.588767 3396 coordinator.cc:1529] cumulative profile for query_id=7e473c244da07975:d15592e900000000 Execution Profile 7e473c244da07975:d15592e900000000:(Total: 23.846ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Averaged Fragment F00:(Total: 2s700ms, non-child: 6.496ms, % non-child: 0.24%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 214.94 KB (220102) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 116.000ns - TotalStorageWaitTime: 4s625ms - TotalThreadsInvoluntaryContextSwitches: 627 (627) - TotalThreadsTotalWallClockTime: 5s318ms - TotalThreadsSysTime: 30.400ms - TotalThreadsUserTime: 1s618ms - TotalThreadsVoluntaryContextSwitches: 312 (312) Fragment Instance Lifecycle Timings: - ExecTime: 2s648ms - ExecTreeExecTime: 2s648ms - OpenTime: 21.557ms - ExecTreeOpenTime: 8.551ms - PrepareTime: 30.827ms - ExecTreePrepareTime: 85.791us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 30.357us, non-child: 30.357us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 37.451ms, non-child: 37.451ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.537ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 9.297ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 25.582ms KUDU_SCAN_NODE (id=0):(Total: 2s656ms, non-child: 2s656ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 1.90M (1904785) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 622 (622) - ScannerThreadsTotalWallClockTime: 2s648ms - MaterializeTupleTime(*): 2s648ms - ScannerThreadsSysTime: 30.400ms - ScannerThreadsUserTime: 1s607ms - ScannerThreadsVoluntaryContextSwitches: 249 (249) - TotalKuduScanRoundTrips: 476 (476) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 7e473c244da07975:d15592e900000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 57.710ms, non-child: 11.346ms, % non-child: 19.66%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 4s490ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 23.403ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 9.506ms - TotalThreadsVoluntaryContextSwitches: 112 (112) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 23.411ms - ExecTreeOpenTime: 14.068ms - PrepareTime: 34.247ms - ExecTreePrepareTime: 83.026us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 35.615us, non-child: 35.615us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 32.245ms, non-child: 32.245ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.453ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.212ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 24.188ms KUDU_SCAN_NODE (id=0):(Total: 14.083ms, non-child: 14.083ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 1.81M (1808000) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 452 (452) - TotalReadThroughput: 0.00 /sec Instance 7e473c244da07975:d15592e900000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 5s343ms, non-child: 1.646ms, % non-child: 0.03%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 35.67 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 232.000ns - TotalStorageWaitTime: 4s760ms - TotalThreadsInvoluntaryContextSwitches: 1.25K (1251) - TotalThreadsTotalWallClockTime: 10s612ms - TotalThreadsSysTime: 60.800ms - TotalThreadsUserTime: 3s227ms - TotalThreadsVoluntaryContextSwitches: 512 (512) Fragment Instance Lifecycle Timings: - ExecTime: 5s296ms - ExecTreeExecTime: 5s296ms - OpenTime: 19.703ms - ExecTreeOpenTime: 3.035ms - PrepareTime: 27.406ms - ExecTreePrepareTime: 88.557us DataStreamSender (dst_id=1):(Total: 25.099us, non-child: 25.099us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 42.656ms, non-child: 42.656ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.621ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 13.382ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 26.976ms KUDU_SCAN_NODE (id=0):(Total: 5s299ms, non-child: 5s299ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2001571) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1245) - ScannerThreadsTotalWallClockTime: 5s296ms - MaterializeTupleTime(*): 5s296ms - ScannerThreadsSysTime: 60.800ms - ScannerThreadsUserTime: 3s214ms - ScannerThreadsVoluntaryContextSwitches: 498 (498) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:25.588796 3396 coordinator.cc:1546] Fragment instance completed: id=7e473c244da07975:d15592e900000003 host=mj-desktop.ca.cloudera.com:22000 remaining=3 I1212 11:10:25.588801 3396 coordinator.cc:1556] query_id=7e473c244da07975:d15592e900000000: first in-progress backend: mj-desktop.ca.cloudera.com:22000 I1212 11:10:25.588867 14805 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:25.588985 14805 query-exec-mgr.cc:103] Instance completed. instance_id=7e473c244da07975:d15592e900000003 I1212 11:10:25.588989 14805 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=7e473c244da07975:d15592e900000000 refcnt=3 I1212 11:10:25.719925 3766 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=7e473c244da07975:d15592e900000000, node=1 I1212 11:10:25.719944 3766 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=7e473c244da07975:d15592e900000000 node_id=1 #senders=1 I1212 11:10:25.721004 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=7e473c244da07975:d15592e900000001 I1212 11:10:25.721012 3766 impala-server.cc:1076] ReportExecStatus() instance_id=7e473c244da07975:d15592e900000001 done=true I1212 11:10:25.721019 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=7e473c244da07975:d15592e900000001 status=0 done=true I1212 11:10:25.721349 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 0.000ns 0.000ns 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s577ms 5s433ms 0 -1 202.00 KB 0 I1212 11:10:25.721359 3766 progress-updater.cc:65] Query 7e473c244da07975:d15592e900000000: 66% Complete (2 out of 3) I1212 11:10:25.721691 3766 coordinator.cc:1521] profile for instance_id=7e473c244da07975:d15592e900000001 Instance 7e473c244da07975:d15592e900000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 5s477ms, non-child: 11.629ms, % non-child: 0.21%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 398.000ns - TotalStorageWaitTime: 4s885ms - TotalThreadsInvoluntaryContextSwitches: 1.37K (1374) - TotalThreadsTotalWallClockTime: 10s862ms - TotalThreadsSysTime: 24.134ms - TotalThreadsUserTime: 3s368ms - TotalThreadsVoluntaryContextSwitches: 624 (624) Fragment Instance Lifecycle Timings: - ExecTime: 5s419ms - ExecTreeExecTime: 5s419ms - OpenTime: 23.411ms - ExecTreeOpenTime: 14.068ms - PrepareTime: 34.247ms - ExecTreePrepareTime: 83.026us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 35.615us, non-child: 35.615us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 32.245ms, non-child: 32.245ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.453ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.212ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 24.188ms KUDU_SCAN_NODE (id=0):(Total: 5s433ms, non-child: 5s433ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (1999622) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.37K (1370) - ScannerThreadsTotalWallClockTime: 5s419ms - MaterializeTupleTime(*): 5s419ms - ScannerThreadsSysTime: 24.134ms - ScannerThreadsUserTime: 3s358ms - ScannerThreadsVoluntaryContextSwitches: 510 (510) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec I1212 11:10:25.722623 3766 coordinator.cc:1529] cumulative profile for query_id=7e473c244da07975:d15592e900000000 Execution Profile 7e473c244da07975:d15592e900000000:(Total: 23.846ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Averaged Fragment F00:(Total: 5s410ms, non-child: 6.638ms, % non-child: 0.12%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 214.94 KB (220102) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 315.000ns - TotalStorageWaitTime: 4s822ms - TotalThreadsInvoluntaryContextSwitches: 1.31K (1312) - TotalThreadsTotalWallClockTime: 10s737ms - TotalThreadsSysTime: 42.467ms - TotalThreadsUserTime: 3s298ms - TotalThreadsVoluntaryContextSwitches: 568 (568) Fragment Instance Lifecycle Timings: - ExecTime: 5s358ms - ExecTreeExecTime: 5s358ms - OpenTime: 21.557ms - ExecTreeOpenTime: 8.551ms - PrepareTime: 30.827ms - ExecTreePrepareTime: 85.791us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 30.357us, non-child: 30.357us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 37.451ms, non-child: 37.451ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.537ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 9.297ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 25.582ms KUDU_SCAN_NODE (id=0):(Total: 5s366ms, non-child: 5s366ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000596) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.31K (1307) - ScannerThreadsTotalWallClockTime: 5s358ms - MaterializeTupleTime(*): 5s358ms - ScannerThreadsSysTime: 42.467ms - ScannerThreadsUserTime: 3s286ms - ScannerThreadsVoluntaryContextSwitches: 504 (504) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 7e473c244da07975:d15592e900000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 5s477ms, non-child: 11.629ms, % non-child: 0.21%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 398.000ns - TotalStorageWaitTime: 4s885ms - TotalThreadsInvoluntaryContextSwitches: 1.37K (1374) - TotalThreadsTotalWallClockTime: 10s862ms - TotalThreadsSysTime: 24.134ms - TotalThreadsUserTime: 3s368ms - TotalThreadsVoluntaryContextSwitches: 624 (624) Fragment Instance Lifecycle Timings: - ExecTime: 5s419ms - ExecTreeExecTime: 5s419ms - OpenTime: 23.411ms - ExecTreeOpenTime: 14.068ms - PrepareTime: 34.247ms - ExecTreePrepareTime: 83.026us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 35.615us, non-child: 35.615us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 32.245ms, non-child: 32.245ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.453ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.212ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 24.188ms KUDU_SCAN_NODE (id=0):(Total: 5s433ms, non-child: 5s433ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (1999622) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.37K (1370) - ScannerThreadsTotalWallClockTime: 5s419ms - MaterializeTupleTime(*): 5s419ms - ScannerThreadsSysTime: 24.134ms - ScannerThreadsUserTime: 3s358ms - ScannerThreadsVoluntaryContextSwitches: 510 (510) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Instance 7e473c244da07975:d15592e900000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 5s343ms, non-child: 1.646ms, % non-child: 0.03%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 35.67 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 232.000ns - TotalStorageWaitTime: 4s760ms - TotalThreadsInvoluntaryContextSwitches: 1.25K (1251) - TotalThreadsTotalWallClockTime: 10s612ms - TotalThreadsSysTime: 60.800ms - TotalThreadsUserTime: 3s227ms - TotalThreadsVoluntaryContextSwitches: 512 (512) Fragment Instance Lifecycle Timings: - ExecTime: 5s296ms - ExecTreeExecTime: 5s296ms - OpenTime: 19.703ms - ExecTreeOpenTime: 3.035ms - PrepareTime: 27.406ms - ExecTreePrepareTime: 88.557us DataStreamSender (dst_id=1):(Total: 25.099us, non-child: 25.099us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 42.656ms, non-child: 42.656ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.621ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 13.382ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 26.976ms KUDU_SCAN_NODE (id=0):(Total: 5s299ms, non-child: 5s299ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2001571) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1245) - ScannerThreadsTotalWallClockTime: 5s296ms - MaterializeTupleTime(*): 5s296ms - ScannerThreadsSysTime: 60.800ms - ScannerThreadsUserTime: 3s214ms - ScannerThreadsVoluntaryContextSwitches: 498 (498) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:25.722656 3766 coordinator.cc:1546] Fragment instance completed: id=7e473c244da07975:d15592e900000001 host=mj-desktop.ca.cloudera.com:22002 remaining=2 I1212 11:10:25.722662 3766 coordinator.cc:1556] query_id=7e473c244da07975:d15592e900000000: first in-progress backend: mj-desktop.ca.cloudera.com:22000 I1212 11:10:25.874891 3769 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=7e473c244da07975:d15592e900000000, node=1 I1212 11:10:25.874912 3769 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=7e473c244da07975:d15592e900000000 node_id=1 #senders=0 I1212 11:10:25.874979 14804 exchange-node.cc:139] exch: has batch=false #rows=0 is_cancelled=false instance_id=7e473c244da07975:d15592e900000000 I1212 11:10:25.875061 14804 exchange-node.cc:139] exch: has batch=false #rows=0 is_cancelled=false instance_id=7e473c244da07975:d15592e900000000 I1212 11:10:25.875136 14812 plan-fragment-executor.cc:408] Reporting final profile for instance 7e473c244da07975:d15592e900000000 I1212 11:10:25.875444 14812 plan-fragment-executor.cc:412] Fragment 7e473c244da07975:d15592e900000000:(Total: 5s632ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 0 - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 5s603ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 5s609ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 129.000us - TotalThreadsVoluntaryContextSwitches: 5 (5) Fragment Instance Lifecycle Timings: - ExecTime: 26.059us - ExecTreeExecTime: 14.293us - OpenTime: 5s609ms - ExecTreeOpenTime: 5s603ms - PrepareTime: 22.742ms - ExecTreePrepareTime: 44.176us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 22.270ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 21.595ms EXCHANGE_NODE (id=1):(Total: 5s603ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.297us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 5s603ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns I1212 11:10:25.875450 14812 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=7e473c244da07975:d15592e900000000 I1212 11:10:25.876093 14804 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:25.876101 14804 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:25.876492 5418 impala-internal-service.cc:74] ReportExecStatus(): instance_id=7e473c244da07975:d15592e900000000 I1212 11:10:25.876502 5418 impala-server.cc:1076] ReportExecStatus() instance_id=7e473c244da07975:d15592e900000000 done=true I1212 11:10:25.876510 5418 coordinator.cc:1437] UpdateFragmentExecStatus() instance=7e473c244da07975:d15592e900000000 status=0 done=true I1212 11:10:25.876822 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 56.168us 56.168us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 3s577ms 5s433ms 0 -1 202.00 KB 0 I1212 11:10:25.877089 5418 coordinator.cc:1521] profile for instance_id=7e473c244da07975:d15592e900000000 Instance 7e473c244da07975:d15592e900000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 5s632ms, non-child: 6.378ms, % non-child: 0.11%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 5s603ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 5s609ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 129.000us - TotalThreadsVoluntaryContextSwitches: 5 (5) Fragment Instance Lifecycle Timings: - ExecTime: 26.059us - ExecTreeExecTime: 14.293us - OpenTime: 5s609ms - ExecTreeOpenTime: 5s603ms - PrepareTime: 22.742ms - ExecTreePrepareTime: 44.176us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 22.270ms, non-child: 22.270ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 21.595ms EXCHANGE_NODE (id=1):(Total: 5s603ms, non-child: 56.168us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.297us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 5s603ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns I1212 11:10:25.878253 5418 coordinator.cc:1529] cumulative profile for query_id=7e473c244da07975:d15592e900000000 Execution Profile 7e473c244da07975:d15592e900000000:(Total: 5s633ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance 7e473c244da07975:d15592e900000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 5s632ms, non-child: 6.378ms, % non-child: 0.11%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 5s603ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 5s609ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 129.000us - TotalThreadsVoluntaryContextSwitches: 5 (5) Fragment Instance Lifecycle Timings: - ExecTime: 26.059us - ExecTreeExecTime: 14.293us - OpenTime: 5s609ms - ExecTreeOpenTime: 5s603ms - PrepareTime: 22.742ms - ExecTreePrepareTime: 44.176us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 22.270ms, non-child: 22.270ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 21.595ms EXCHANGE_NODE (id=1):(Total: 5s603ms, non-child: 56.168us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.297us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 5s603ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 5s410ms, non-child: 6.638ms, % non-child: 0.12%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 214.94 KB (220102) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 315.000ns - TotalStorageWaitTime: 4s822ms - TotalThreadsInvoluntaryContextSwitches: 1.31K (1312) - TotalThreadsTotalWallClockTime: 10s737ms - TotalThreadsSysTime: 42.467ms - TotalThreadsUserTime: 3s298ms - TotalThreadsVoluntaryContextSwitches: 568 (568) Fragment Instance Lifecycle Timings: - ExecTime: 5s358ms - ExecTreeExecTime: 5s358ms - OpenTime: 21.557ms - ExecTreeOpenTime: 8.551ms - PrepareTime: 30.827ms - ExecTreePrepareTime: 85.791us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 30.357us, non-child: 30.357us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 37.451ms, non-child: 37.451ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.537ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 9.297ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 25.582ms KUDU_SCAN_NODE (id=0):(Total: 5s366ms, non-child: 5s366ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000596) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.31K (1307) - ScannerThreadsTotalWallClockTime: 5s358ms - MaterializeTupleTime(*): 5s358ms - ScannerThreadsSysTime: 42.467ms - ScannerThreadsUserTime: 3s286ms - ScannerThreadsVoluntaryContextSwitches: 504 (504) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 7e473c244da07975:d15592e900000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 5s477ms, non-child: 11.629ms, % non-child: 0.21%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 398.000ns - TotalStorageWaitTime: 4s885ms - TotalThreadsInvoluntaryContextSwitches: 1.37K (1374) - TotalThreadsTotalWallClockTime: 10s862ms - TotalThreadsSysTime: 24.134ms - TotalThreadsUserTime: 3s368ms - TotalThreadsVoluntaryContextSwitches: 624 (624) Fragment Instance Lifecycle Timings: - ExecTime: 5s419ms - ExecTreeExecTime: 5s419ms - OpenTime: 23.411ms - ExecTreeOpenTime: 14.068ms - PrepareTime: 34.247ms - ExecTreePrepareTime: 83.026us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 35.615us, non-child: 35.615us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 32.245ms, non-child: 32.245ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.453ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.212ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 24.188ms KUDU_SCAN_NODE (id=0):(Total: 5s433ms, non-child: 5s433ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (1999622) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.37K (1370) - ScannerThreadsTotalWallClockTime: 5s419ms - MaterializeTupleTime(*): 5s419ms - ScannerThreadsSysTime: 24.134ms - ScannerThreadsUserTime: 3s358ms - ScannerThreadsVoluntaryContextSwitches: 510 (510) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Instance 7e473c244da07975:d15592e900000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 5s343ms, non-child: 1.646ms, % non-child: 0.03%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 35.67 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 232.000ns - TotalStorageWaitTime: 4s760ms - TotalThreadsInvoluntaryContextSwitches: 1.25K (1251) - TotalThreadsTotalWallClockTime: 10s612ms - TotalThreadsSysTime: 60.800ms - TotalThreadsUserTime: 3s227ms - TotalThreadsVoluntaryContextSwitches: 512 (512) Fragment Instance Lifecycle Timings: - ExecTime: 5s296ms - ExecTreeExecTime: 5s296ms - OpenTime: 19.703ms - ExecTreeOpenTime: 3.035ms - PrepareTime: 27.406ms - ExecTreePrepareTime: 88.557us DataStreamSender (dst_id=1):(Total: 25.099us, non-child: 25.099us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 42.656ms, non-child: 42.656ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.621ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 13.382ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 26.976ms KUDU_SCAN_NODE (id=0):(Total: 5s299ms, non-child: 5s299ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2001571) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1245) - ScannerThreadsTotalWallClockTime: 5s296ms - MaterializeTupleTime(*): 5s296ms - ScannerThreadsSysTime: 60.800ms - ScannerThreadsUserTime: 3s214ms - ScannerThreadsVoluntaryContextSwitches: 498 (498) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:25.878288 5418 coordinator.cc:1546] Fragment instance completed: id=7e473c244da07975:d15592e900000000 host=mj-desktop.ca.cloudera.com:22000 remaining=1 I1212 11:10:25.878294 5418 coordinator.cc:1556] query_id=7e473c244da07975:d15592e900000000: first in-progress backend: mj-desktop.ca.cloudera.com:22001 I1212 11:10:25.878387 14804 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:25.878902 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=7e473c244da07975:d15592e900000002 I1212 11:10:25.878912 3769 impala-server.cc:1076] ReportExecStatus() instance_id=7e473c244da07975:d15592e900000002 done=true I1212 11:10:25.878918 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=7e473c244da07975:d15592e900000002 status=0 done=true I1212 11:10:25.879420 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 56.168us 56.168us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5s441ms 5s591ms 0 -1 202.00 KB 0 I1212 11:10:25.879436 3769 progress-updater.cc:55] Query 7e473c244da07975:d15592e900000000 100% Complete (3 out of 3) I1212 11:10:25.879781 3769 coordinator.cc:1521] profile for instance_id=7e473c244da07975:d15592e900000002 Instance 7e473c244da07975:d15592e900000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 5s632ms, non-child: 8.196ms, % non-child: 0.15%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 274.000ns - TotalStorageWaitTime: 4s995ms - TotalThreadsInvoluntaryContextSwitches: 1.49K (1494) - TotalThreadsTotalWallClockTime: 11s193ms - TotalThreadsSysTime: 64.860ms - TotalThreadsUserTime: 3s387ms - TotalThreadsVoluntaryContextSwitches: 535 (535) Fragment Instance Lifecycle Timings: - ExecTime: 5s586ms - ExecTreeExecTime: 5s585ms - OpenTime: 21.835ms - ExecTreeOpenTime: 5.989ms - PrepareTime: 24.113ms - ExecTreePrepareTime: 90.398us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 132.169us, non-child: 132.169us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 32.466ms, non-child: 32.466ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.223ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 7.119ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 23.372ms KUDU_SCAN_NODE (id=0):(Total: 5s591ms, non-child: 5s591ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000022) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.49K (1493) - ScannerThreadsTotalWallClockTime: 5s585ms - MaterializeTupleTime(*): 5s585ms - ScannerThreadsSysTime: 64.860ms - ScannerThreadsUserTime: 3s376ms - ScannerThreadsVoluntaryContextSwitches: 520 (520) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:25.881217 3769 coordinator.cc:1529] cumulative profile for query_id=7e473c244da07975:d15592e900000000 Execution Profile 7e473c244da07975:d15592e900000000:(Total: 5s633ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance 7e473c244da07975:d15592e900000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 5s632ms, non-child: 6.378ms, % non-child: 0.11%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 5s603ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 5s609ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 129.000us - TotalThreadsVoluntaryContextSwitches: 5 (5) Fragment Instance Lifecycle Timings: - ExecTime: 26.059us - ExecTreeExecTime: 14.293us - OpenTime: 5s609ms - ExecTreeOpenTime: 5s603ms - PrepareTime: 22.742ms - ExecTreePrepareTime: 44.176us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 22.270ms, non-child: 22.270ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 21.595ms EXCHANGE_NODE (id=1):(Total: 5s603ms, non-child: 56.168us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 1.297us - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 5s603ms - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 5s484ms, non-child: 7.157ms, % non-child: 0.13%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.97 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 213.61 KB (218736) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 301.000ns - TotalStorageWaitTime: 4s880ms - TotalThreadsInvoluntaryContextSwitches: 1.37K (1373) - TotalThreadsTotalWallClockTime: 10s889ms - TotalThreadsSysTime: 49.931ms - TotalThreadsUserTime: 3s327ms - TotalThreadsVoluntaryContextSwitches: 557 (557) Fragment Instance Lifecycle Timings: - ExecTime: 5s434ms - ExecTreeExecTime: 5s433ms - OpenTime: 21.650ms - ExecTreeOpenTime: 7.697ms - PrepareTime: 28.589ms - ExecTreePrepareTime: 87.327us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 64.294us, non-child: 64.294us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 35.789ms, non-child: 35.789ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.432ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 8.571ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 24.845ms KUDU_SCAN_NODE (id=0):(Total: 5s441ms, non-child: 5s441ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000405) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.37K (1369) - ScannerThreadsTotalWallClockTime: 5s433ms - MaterializeTupleTime(*): 5s433ms - ScannerThreadsSysTime: 49.931ms - ScannerThreadsUserTime: 3s316ms - ScannerThreadsVoluntaryContextSwitches: 509 (509) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 7e473c244da07975:d15592e900000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 5s477ms, non-child: 11.629ms, % non-child: 0.21%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 398.000ns - TotalStorageWaitTime: 4s885ms - TotalThreadsInvoluntaryContextSwitches: 1.37K (1374) - TotalThreadsTotalWallClockTime: 10s862ms - TotalThreadsSysTime: 24.134ms - TotalThreadsUserTime: 3s368ms - TotalThreadsVoluntaryContextSwitches: 624 (624) Fragment Instance Lifecycle Timings: - ExecTime: 5s419ms - ExecTreeExecTime: 5s419ms - OpenTime: 23.411ms - ExecTreeOpenTime: 14.068ms - PrepareTime: 34.247ms - ExecTreePrepareTime: 83.026us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 35.615us, non-child: 35.615us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 32.245ms, non-child: 32.245ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.453ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 5.212ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 24.188ms KUDU_SCAN_NODE (id=0):(Total: 5s433ms, non-child: 5s433ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (1999622) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.37K (1370) - ScannerThreadsTotalWallClockTime: 5s419ms - MaterializeTupleTime(*): 5s419ms - ScannerThreadsSysTime: 24.134ms - ScannerThreadsUserTime: 3s358ms - ScannerThreadsVoluntaryContextSwitches: 510 (510) - TotalKuduScanRoundTrips: 500 (500) - TotalReadThroughput: 0.00 /sec Instance 7e473c244da07975:d15592e900000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 5s343ms, non-child: 1.646ms, % non-child: 0.03%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 35.67 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 218.94 KB (224198) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 232.000ns - TotalStorageWaitTime: 4s760ms - TotalThreadsInvoluntaryContextSwitches: 1.25K (1251) - TotalThreadsTotalWallClockTime: 10s612ms - TotalThreadsSysTime: 60.800ms - TotalThreadsUserTime: 3s227ms - TotalThreadsVoluntaryContextSwitches: 512 (512) Fragment Instance Lifecycle Timings: - ExecTime: 5s296ms - ExecTreeExecTime: 5s296ms - OpenTime: 19.703ms - ExecTreeOpenTime: 3.035ms - PrepareTime: 27.406ms - ExecTreePrepareTime: 88.557us DataStreamSender (dst_id=1):(Total: 25.099us, non-child: 25.099us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 42.656ms, non-child: 42.656ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.621ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 13.382ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 26.976ms KUDU_SCAN_NODE (id=0):(Total: 5s299ms, non-child: 5s299ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2001571) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1245) - ScannerThreadsTotalWallClockTime: 5s296ms - MaterializeTupleTime(*): 5s296ms - ScannerThreadsSysTime: 60.800ms - ScannerThreadsUserTime: 3s214ms - ScannerThreadsVoluntaryContextSwitches: 498 (498) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec Instance 7e473c244da07975:d15592e900000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 5s632ms, non-child: 8.196ms, % non-child: 0.15%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB, 210.94 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 210.94 KB (216006) - PerHostPeakMemUsage: 210.94 KB (216006) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 274.000ns - TotalStorageWaitTime: 4s995ms - TotalThreadsInvoluntaryContextSwitches: 1.49K (1494) - TotalThreadsTotalWallClockTime: 11s193ms - TotalThreadsSysTime: 64.860ms - TotalThreadsUserTime: 3s387ms - TotalThreadsVoluntaryContextSwitches: 535 (535) Fragment Instance Lifecycle Timings: - ExecTime: 5s586ms - ExecTreeExecTime: 5s585ms - OpenTime: 21.835ms - ExecTreeOpenTime: 5.989ms - PrepareTime: 24.113ms - ExecTreePrepareTime: 90.398us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 132.169us, non-child: 132.169us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 32.466ms, non-child: 32.466ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 1.223ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 4 (4) - NumInstructions: 54 (54) - OptimizationTime: 7.119ms - PeakMemoryUsage: 27.00 KB (27648) - PrepareTime: 23.372ms KUDU_SCAN_NODE (id=0):(Total: 5s591ms, non-child: 5s591ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 202.00 KB (206848) - RowsRead: 2.00M (2000022) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1.49K (1493) - ScannerThreadsTotalWallClockTime: 5s585ms - MaterializeTupleTime(*): 5s585ms - ScannerThreadsSysTime: 64.860ms - ScannerThreadsUserTime: 3s376ms - ScannerThreadsVoluntaryContextSwitches: 520 (520) - TotalKuduScanRoundTrips: 501 (501) - TotalReadThroughput: 0.00 /sec I1212 11:10:25.881250 3769 coordinator.cc:1546] Fragment instance completed: id=7e473c244da07975:d15592e900000002 host=mj-desktop.ca.cloudera.com:22001 remaining=0 I1212 11:10:25.909581 2681 impala-hs2-server.cc:713] GetResultSetMetadata(): query_id=7e473c244da07975:d15592e900000000 I1212 11:10:25.909782 2681 impala-hs2-server.cc:753] GetResultSetMetadata(): return_val=TGetResultSetMetadataResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: schema (struct) = TTableSchema { 01: columns (list) = list[16] { [0] = TColumnDesc { 01: columnName (string) = "l_orderkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 0, }, [1] = TColumnDesc { 01: columnName (string) = "l_linenumber", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 3, }, }, }, }, 03: position (i32) = 1, }, [2] = TColumnDesc { 01: columnName (string) = "l_partkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 2, }, [3] = TColumnDesc { 01: columnName (string) = "l_suppkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 3, }, [4] = TColumnDesc { 01: columnName (string) = "l_quantity", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 4, }, [5] = TColumnDesc { 01: columnName (string) = "l_extendedprice", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 5, }, [6] = TColumnDesc { 01: columnName (string) = "l_discount", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 6, }, [7] = TColumnDesc { 01: columnName (string) = "l_tax", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 7, }, [8] = TColumnDesc { 01: columnName (string) = "l_returnflag", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 8, }, [9] = TColumnDesc { 01: columnName (string) = "l_linestatus", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 9, }, [10] = TColumnDesc { 01: columnName (string) = "l_shipdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 10, }, [11] = TColumnDesc { 01: columnName (string) = "l_commitdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 11, }, [12] = TColumnDesc { 01: columnName (string) = "l_receiptdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 12, }, [13] = TColumnDesc { 01: columnName (string) = "l_shipinstruct", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 13, }, [14] = TColumnDesc { 01: columnName (string) = "l_shipmode", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 14, }, [15] = TColumnDesc { 01: columnName (string) = "l_comment", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 15, }, }, }, } I1212 11:10:25.910214 2681 coordinator.cc:1069] All fragment instances finished successfully. I1212 11:10:25.910243 14804 data-stream-mgr.cc:226] DeregisterRecvr(): fragment_instance_id=7e473c244da07975:d15592e900000000, node=1 I1212 11:10:25.910259 14804 data-stream-recvr.cc:237] cancelled stream: fragment_instance_id_=7e473c244da07975:d15592e900000000 node_id=1 I1212 11:10:25.910308 14804 query-exec-mgr.cc:103] Instance completed. instance_id=7e473c244da07975:d15592e900000000 I1212 11:10:25.910313 14804 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=7e473c244da07975:d15592e900000000 refcnt=2 I1212 11:10:25.910370 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 56.168us 56.168us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5s441ms 5s591ms 0 -1 202.00 KB 0 I1212 11:10:25.910652 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 56.168us 56.168us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5s441ms 5s591ms 0 -1 202.00 KB 0 I1212 11:10:25.910902 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 56.168us 56.168us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5s441ms 5s591ms 0 -1 202.00 KB 0 I1212 11:10:25.911120 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 56.168us 56.168us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5s441ms 5s591ms 0 -1 202.00 KB 0 I1212 11:10:25.913749 2681 impala-hs2-server.cc:688] CloseOperation(): query_id=7e473c244da07975:d15592e900000000 I1212 11:10:25.913760 2681 impala-server.cc:907] UnregisterQuery(): query_id=7e473c244da07975:d15592e900000000 I1212 11:10:25.913769 2681 impala-server.cc:993] Cancel(): query_id=7e473c244da07975:d15592e900000000 I1212 11:10:25.913777 2681 coordinator.cc:1362] Cancel() query_id=7e473c244da07975:d15592e900000000 I1212 11:10:25.913794 2681 coordinator.cc:1428] CancelFragmentInstances() query_id=7e473c244da07975:d15592e900000000, tried to cancel 0 fragment instances I1212 11:10:25.913941 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 56.168us 56.168us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5s441ms 5s591ms 0 -1 202.00 KB 0 I1212 11:10:25.914229 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 56.168us 56.168us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5s441ms 5s591ms 0 -1 202.00 KB 0 I1212 11:10:25.914510 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 56.168us 56.168us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5s441ms 5s591ms 0 -1 202.00 KB 0 I1212 11:10:25.914746 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 56.168us 56.168us 0 -1 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 5s441ms 5s591ms 0 -1 202.00 KB 0 I1212 11:10:25.914901 2681 admission-controller.cc:538] Released query id=7e473c244da07975:d15592e900000000 agg_num_running=1, agg_num_queued=0, agg_mem_reserved=32.63 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=10.21 MB) I1212 11:10:25.914917 2681 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=7e473c244da07975:d15592e900000000 refcnt=1 I1212 11:10:25.926709 2681 impala-hs2-server.cc:414] ExecuteStatement(): request=TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\x04#\x89K{\x84C#\x90,\x8d\xa4\n(\x8e\x84", 02: secret (string) = "\x9e\x8d!z\x8erD\xe7\xa8\x91\n\x83\x93\xea0\x10", }, }, 02: statement (string) = "select * from lineitem limit 90", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "0m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:25.926730 2681 impala-hs2-server.cc:228] TExecuteStatementReq: TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\x04#\x89K{\x84C#\x90,\x8d\xa4\n(\x8e\x84", 02: secret (string) = "\x9e\x8d!z\x8erD\xe7\xa8\x91\n\x83\x93\xea0\x10", }, }, 02: statement (string) = "select * from lineitem limit 90", 03: confOverlay (map) = map[6] { "abort_on_error" -> "1", "batch_size" -> "0", "disable_codegen" -> "False", "exec_single_node_rows_threshold" -> "0", "mem_limit" -> "0m", "num_nodes" -> "0", }, 04: runAsync (bool) = false, } I1212 11:10:25.926784 2681 impala-server.cc:742] Parsed pool options: override_options_mask=1111111111111111111111111111111110111111111111111111111111000010 set_pool_mask=0000000000000000000000000000000000000000000000000000000000000000 overlay_mask=0000000000000000000000000000000000000000000000000000000000000000 I1212 11:10:25.926831 2681 impala-hs2-server.cc:261] TClientRequest.queryOptions: TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, } I1212 11:10:25.958565 14850 AsyncKuduClient.java:1367] Learned about tablet Kudu Master for table 'Kudu Master' with partition [, ) I1212 11:10:25.966718 14851 AsyncKuduClient.java:1367] Learned about tablet de1fe37fdb46438abfbc154bf7fb439b for table 'impala::ucu3e4.lineitem' with partition [, 0x00000001) I1212 11:10:25.967046 14851 AsyncKuduClient.java:1367] Learned about tablet 91d0d8d3b0e34afc9d7fa522e61f40ef for table 'impala::ucu3e4.lineitem' with partition [0x00000001, 0x00000002) I1212 11:10:25.967324 14851 AsyncKuduClient.java:1367] Learned about tablet dc26b34fb84d4ff8baae3f44b23f0ae2 for table 'impala::ucu3e4.lineitem' with partition [0x00000002, ) I1212 11:10:25.973604 2681 impala-server.cc:812] Execution request: TExecRequest { 01: stmt_type (i32) = 0, 02: query_options (struct) = TQueryOptions { 01: abort_on_error (bool) = true, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 0, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 44: mt_dop (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, }, 03: query_exec_request (struct) = TQueryExecRequest { 01: desc_tbl (struct) = TDescriptorTable { 01: slotDescriptors (list) = list[16] { [0] = TSlotDescriptor { 01: id (i32) = 0, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 0, }, 06: byteOffset (i32) = 128, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 8, }, [1] = TSlotDescriptor { 01: id (i32) = 1, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 1, }, 06: byteOffset (i32) = 184, 07: nullIndicatorByte (i32) = 0, 08: nullIndicatorBit (i32) = -1, 09: slotIdx (i32) = 15, }, [2] = TSlotDescriptor { 01: id (i32) = 2, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 2, }, 06: byteOffset (i32) = 136, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 9, }, [3] = TSlotDescriptor { 01: id (i32) = 3, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 3, }, 06: byteOffset (i32) = 144, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 10, }, [4] = TSlotDescriptor { 01: id (i32) = 4, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 4, }, 06: byteOffset (i32) = 152, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 11, }, [5] = TSlotDescriptor { 01: id (i32) = 5, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 5, }, 06: byteOffset (i32) = 160, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 12, }, [6] = TSlotDescriptor { 01: id (i32) = 6, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 6, }, 06: byteOffset (i32) = 168, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 13, }, [7] = TSlotDescriptor { 01: id (i32) = 7, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 7, }, 06: byteOffset (i32) = 176, 07: nullIndicatorByte (i32) = 189, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 14, }, [8] = TSlotDescriptor { 01: id (i32) = 8, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 8, }, 06: byteOffset (i32) = 0, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 0, 09: slotIdx (i32) = 0, }, [9] = TSlotDescriptor { 01: id (i32) = 9, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 9, }, 06: byteOffset (i32) = 16, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 1, 09: slotIdx (i32) = 1, }, [10] = TSlotDescriptor { 01: id (i32) = 10, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 10, }, 06: byteOffset (i32) = 32, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 2, 09: slotIdx (i32) = 2, }, [11] = TSlotDescriptor { 01: id (i32) = 11, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 11, }, 06: byteOffset (i32) = 48, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 3, 09: slotIdx (i32) = 3, }, [12] = TSlotDescriptor { 01: id (i32) = 12, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 12, }, 06: byteOffset (i32) = 64, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 4, 09: slotIdx (i32) = 4, }, [13] = TSlotDescriptor { 01: id (i32) = 13, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 13, }, 06: byteOffset (i32) = 80, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 5, 09: slotIdx (i32) = 5, }, [14] = TSlotDescriptor { 01: id (i32) = 14, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 14, }, 06: byteOffset (i32) = 96, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 6, 09: slotIdx (i32) = 6, }, [15] = TSlotDescriptor { 01: id (i32) = 15, 02: parent (i32) = 0, 04: slotType (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, 05: materializedPath (list) = list[1] { [0] = 15, }, 06: byteOffset (i32) = 112, 07: nullIndicatorByte (i32) = 188, 08: nullIndicatorBit (i32) = 7, 09: slotIdx (i32) = 7, }, }, 02: tupleDescriptors (list) = list[1] { [0] = TTupleDescriptor { 01: id (i32) = 0, 02: byteSize (i32) = 190, 03: numNullBytes (i32) = 2, 04: tableId (i32) = 1, 05: tuplePath (list) = list[0] { }, }, }, 03: tableDescriptors (list) = list[1] { [0] = TTableDescriptor { 01: id (i32) = 1, 02: tableType (i32) = 4, 03: columnDescriptors (list) = list[16] { [0] = TColumnDescriptor { 01: name (string) = "l_orderkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [1] = TColumnDescriptor { 01: name (string) = "l_linenumber", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, }, [2] = TColumnDescriptor { 01: name (string) = "l_partkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [3] = TColumnDescriptor { 01: name (string) = "l_suppkey", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, }, [4] = TColumnDescriptor { 01: name (string) = "l_quantity", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [5] = TColumnDescriptor { 01: name (string) = "l_extendedprice", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [6] = TColumnDescriptor { 01: name (string) = "l_discount", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [7] = TColumnDescriptor { 01: name (string) = "l_tax", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, }, [8] = TColumnDescriptor { 01: name (string) = "l_returnflag", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [9] = TColumnDescriptor { 01: name (string) = "l_linestatus", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [10] = TColumnDescriptor { 01: name (string) = "l_shipdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [11] = TColumnDescriptor { 01: name (string) = "l_commitdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [12] = TColumnDescriptor { 01: name (string) = "l_receiptdate", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [13] = TColumnDescriptor { 01: name (string) = "l_shipinstruct", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [14] = TColumnDescriptor { 01: name (string) = "l_shipmode", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, [15] = TColumnDescriptor { 01: name (string) = "l_comment", 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 12, }, }, }, }, }, }, 04: numClusteringCols (i32) = 0, 07: tableName (string) = "impala::ucu3e4.lineitem", 08: dbName (string) = "ucu3e4", 10: kuduTable (struct) = TKuduTable { 01: table_name (string) = "impala::ucu3e4.lineitem", 02: master_addresses (list) = list[1] { [0] = "127.0.0.1", }, 03: key_columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 04: partition_by (list) = list[1] { [0] = TKuduPartitionParam { 01: by_hash_param (struct) = TKuduPartitionByHashParam { 01: columns (list) = list[2] { [0] = "l_orderkey", [1] = "l_linenumber", }, 02: num_partitions (i32) = 3, }, }, }, }, }, }, }, 02: plan_exec_info (list) = list[1] { [0] = TPlanExecInfo { 01: fragments (list) = list[2] { [0] = TPlanFragment { 01: idx (i32) = 0, 02: display_name (string) = "F01", 03: plan (struct) = TPlan { 01: nodes (list) = list[1] { [0] = TPlanNode { 01: node_id (i32) = 1, 02: node_type (i32) = 6, 03: num_children (i32) = 0, 04: limit (i64) = 90, 05: row_tuples (list) = list[1] { [0] = 0, }, 06: nullable_tuples (list) = list[1] { [0] = false, }, 08: disable_codegen (bool) = false, 18: exchange_node (struct) = TExchangeNode { 01: input_row_tuples (list) = list[1] { [0] = 0, }, }, 21: label (string) = "01:EXCHANGE", 22: label_detail (string) = "UNPARTITIONED", 23: estimated_stats (struct) = TExecStats { 03: cardinality (i64) = 90, 04: memory_used (i64) = -1, }, }, }, }, 04: output_exprs (list) = list[16] { [0] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 0, }, }, }, }, [1] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 5, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 1, }, }, }, }, [2] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 2, }, }, }, }, [3] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 6, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 3, }, }, }, }, [4] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 4, }, }, }, }, [5] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 5, }, }, }, }, [6] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 6, }, }, }, }, [7] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, 02: type (struct) = TColumnType { 01: types (list) = list[1] { [0] = TTypeNode { 01: type (i32) = 0, 02: scalar_type (struct) = TScalarType { 01: type (i32) = 8, }, }, }, }, 03: num_children (i32) = 0, 14: slot_ref (struct) = TSlotRef { 01: slot_id (i32) = 7, }, }, }, }, [8] = TExpr { 01: nodes (list) = list[1] { [0] = TExprNode { 01: node_type (i32) = 12, I1212 11:10:25.973961 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22000(local selection) I1212 11:10:25.973994 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22001(local selection) I1212 11:10:25.974020 2681 simple-scheduler.cc:972] SimpleScheduler assignment to backend: mj-desktop.ca.cloudera.com:22002(local selection) I1212 11:10:25.974026 2681 simple-scheduler.cc:979] Total remote scan volume = 0 I1212 11:10:25.974036 2681 simple-scheduler.cc:981] Total local scan volume = 2.93 KB I1212 11:10:25.974040 2681 simple-scheduler.cc:983] Total cached scan volume = 0 I1212 11:10:25.974051 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22002, } I1212 11:10:25.974067 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:25.974074 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22001, } I1212 11:10:25.974086 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](479)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:25.974093 2681 simple-scheduler.cc:987] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, } I1212 11:10:25.974105 2681 simple-scheduler.cc:993] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, } I1212 11:10:25.974179 2681 admission-controller.cc:440] Schedule for id=e4100828b01f01c:5a7c79e200000000 in pool_name=default-pool cluster_mem_needed=12.00 GB PoolConfig: max_requests=-1 max_queued=200 max_mem=-1.00 B I1212 11:10:25.974196 2681 admission-controller.cc:445] Stats: agg_num_running=1, agg_num_queued=0, agg_mem_reserved=32.63 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=10.21 MB) I1212 11:10:25.974205 2681 admission-controller.cc:451] Admitted query id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:25.974236 2681 admission-controller.cc:457] Final: agg_num_running=2, agg_num_queued=0, agg_mem_reserved=32.63 MB, local_host(local_mem_admitted=15.75 GB, num_admitted_running=2, num_queued=0, backend_mem_reserved=10.21 MB) I1212 11:10:25.974541 2681 coordinator.cc:447] Exec() query_id=e4100828b01f01c:5a7c79e200000000 stmt=select * from lineitem limit 90 I1212 11:10:25.974716 2681 coordinator.cc:602] starting 4 fragment instances for query e4100828b01f01c:5a7c79e200000000 I1212 11:10:25.974792 2681 coordinator.cc:737] ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- I1212 11:10:25.975008 2567 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:25.975020 2567 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:25.975026 2567 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:25.975069 2569 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22002 instance_id=e4100828b01f01c:5a7c79e200000001 I1212 11:10:25.975069 2563 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22001 instance_id=e4100828b01f01c:5a7c79e200000002 I1212 11:10:25.975075 2569 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22002) I1212 11:10:25.975085 2569 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22002 I1212 11:10:25.975189 2572 coordinator.cc:1301] making rpc: ExecPlanFragment host=mj-desktop.ca.cloudera.com:22000 instance_id=e4100828b01f01c:5a7c79e200000003 I1212 11:10:25.975195 2572 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:25.975200 2572 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:25.975296 3396 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:25.975306 3396 query-exec-mgr.cc:45] StartFInstance() instance_id=e4100828b01f01c:5a7c79e200000000 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:25.975329 3396 query-exec-mgr.cc:69] new QueryState: query_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:25.975335 3396 query-exec-mgr.cc:77] QueryState: query_id=e4100828b01f01c:5a7c79e200000000 refcnt=1 I1212 11:10:25.975397 3396 query-state.cc:58] RegisterFInstance(): instance_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:25.975443 5418 impala-internal-service.cc:41] ExecPlanFragment(): instance_id=e4100828b01f01c:5a7c79e200000003 I1212 11:10:25.975452 5418 query-exec-mgr.cc:45] StartFInstance() instance_id=e4100828b01f01c:5a7c79e200000003 coord=mj-desktop.ca.cloudera.com:22000 I1212 11:10:25.975456 5418 query-exec-mgr.cc:77] QueryState: query_id=e4100828b01f01c:5a7c79e200000000 refcnt=2 I1212 11:10:25.975512 5418 query-state.cc:58] RegisterFInstance(): instance_id=e4100828b01f01c:5a7c79e200000003 I1212 11:10:25.975545 2563 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22001) I1212 11:10:25.975553 2563 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22001 I1212 11:10:25.976189 2563 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=e4100828b01f01c:5a7c79e200000002 I1212 11:10:25.976197 2563 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22001 back to cache I1212 11:10:25.978338 14878 plan-fragment-executor.cc:123] Prepare(): instance_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:25.978375 14878 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 1027102750695092252, 02: lo (i64) = 6520220372095205376, }, 02: per_fragment_instance_idx (i32) = 0, 03: per_node_scan_ranges (map) = map[0] { }, 04: per_exch_num_senders (map) = map[1] { 1 -> 3, }, 05: destinations (list) = list[0] { }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = -1, } I1212 11:10:25.978629 14878 plan-fragment-executor.cc:174] descriptor table for fragment=e4100828b01f01c:5a7c79e200000000 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:25.978662 3396 thread.cc:288] Started thread 14878 - query-exec-mgr:exec-fragment-instance-e4100828b01f01c:5a7c79e200000000 I1212 11:10:25.978698 14878 data-stream-mgr.cc:80] creating receiver for fragment=e4100828b01f01c:5a7c79e200000000, node=1 I1212 11:10:25.978751 2567 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:25.978757 2567 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:25.982327 5418 thread.cc:288] Started thread 14882 - query-exec-mgr:exec-fragment-instance-e4100828b01f01c:5a7c79e200000003 I1212 11:10:25.982448 2572 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=e4100828b01f01c:5a7c79e200000003 I1212 11:10:25.982455 2572 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:25.982497 14882 plan-fragment-executor.cc:123] Prepare(): instance_id=e4100828b01f01c:5a7c79e200000003 I1212 11:10:25.982553 14882 plan-fragment-executor.cc:125] fragment_instance_ctx: TPlanFragmentInstanceCtx { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 1027102750695092252, 02: lo (i64) = 6520220372095205379, }, 02: per_fragment_instance_idx (i32) = 2, 03: per_node_scan_ranges (map) = map[1] { 0 -> list[1] { [0] = TScanRangeParams { 01: scan_range (struct) = TScanRange { 03: kudu_scan_token (string) = "\x12\x17impala::ucu3e4[...](475)", }, 02: volume_id (i32) = -1, 03: is_cached (bool) = false, 04: is_remote (bool) = false, }, }, }, 04: per_exch_num_senders (map) = map[0] { }, 05: destinations (list) = list[1] { [0] = TPlanFragmentDestination { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 1027102750695092252, 02: lo (i64) = 6520220372095205376, }, 02: server (struct) = TNetworkAddress { 01: hostname (string) = "mj-desktop.ca.cloudera.com", 02: port (i32) = 22000, }, }, }, 09: request_pool (string) = "default-pool", 10: sender_id (i32) = 2, } I1212 11:10:25.982805 14882 plan-fragment-executor.cc:174] descriptor table for fragment=e4100828b01f01c:5a7c79e200000003 tuples: Tuple(id=0 size=190 slots=[Slot(id=0 type=BIGINT col_path=[0] offset=128 null=(offset=0 mask=0) slot_idx=8 field_idx=-1), Slot(id=1 type=INT col_path=[1] offset=184 null=(offset=0 mask=0) slot_idx=15 field_idx=-1), Slot(id=2 type=BIGINT col_path=[2] offset=136 null=(offset=189 mask=2) slot_idx=9 field_idx=-1), Slot(id=3 type=BIGINT col_path=[3] offset=144 null=(offset=189 mask=4) slot_idx=10 field_idx=-1), Slot(id=4 type=DOUBLE col_path=[4] offset=152 null=(offset=189 mask=8) slot_idx=11 field_idx=-1), Slot(id=5 type=DOUBLE col_path=[5] offset=160 null=(offset=189 mask=10) slot_idx=12 field_idx=-1), Slot(id=6 type=DOUBLE col_path=[6] offset=168 null=(offset=189 mask=20) slot_idx=13 field_idx=-1), Slot(id=7 type=DOUBLE col_path=[7] offset=176 null=(offset=189 mask=40) slot_idx=14 field_idx=-1), Slot(id=8 type=STRING col_path=[8] offset=0 null=(offset=188 mask=1) slot_idx=0 field_idx=-1), Slot(id=9 type=STRING col_path=[9] offset=16 null=(offset=188 mask=2) slot_idx=1 field_idx=-1), Slot(id=10 type=STRING col_path=[10] offset=32 null=(offset=188 mask=4) slot_idx=2 field_idx=-1), Slot(id=11 type=STRING col_path=[11] offset=48 null=(offset=188 mask=8) slot_idx=3 field_idx=-1), Slot(id=12 type=STRING col_path=[12] offset=64 null=(offset=188 mask=10) slot_idx=4 field_idx=-1), Slot(id=13 type=STRING col_path=[13] offset=80 null=(offset=188 mask=20) slot_idx=5 field_idx=-1), Slot(id=14 type=STRING col_path=[14] offset=96 null=(offset=188 mask=40) slot_idx=6 field_idx=-1), Slot(id=15 type=STRING col_path=[15] offset=112 null=(offset=188 mask=80) slot_idx=7 field_idx=-1)] tuple_path=[]) I1212 11:10:25.982944 14882 plan-fragment-executor.cc:285] Hdfs split stats (:<# splits>/) for query=e4100828b01f01c:5a7c79e200000000: I1212 11:10:25.983039 14882 thread.cc:288] Started thread 14885 - DataStreamSender:SenderThread(1:1) I1212 11:10:25.994552 2569 coordinator.cc:1343] rpc succeeded: ExecPlanFragment instance_id=e4100828b01f01c:5a7c79e200000001 I1212 11:10:25.994565 2569 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22002 back to cache I1212 11:10:25.994626 2681 coordinator.cc:640] started 4 fragment instances for query e4100828b01f01c:5a7c79e200000000 I1212 11:10:25.994679 2681 query-exec-mgr.cc:123] GetQueryState(): query_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:25.994688 2681 query-state.cc:65] GetFInstanceState(): instance_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:26.010344 14882 plan-fragment-executor.cc:261] plan_root= KuduScanNode(tupleid=0) I1212 11:10:26.010360 14882 plan-fragment-executor.cc:296] Open(): instance_id=e4100828b01f01c:5a7c79e200000003 I1212 11:10:26.014783 14882 thread.cc:288] Started thread 14895 - plan-fragment-executor:report-profile I1212 11:10:26.014781 14895 plan-fragment-executor.cc:378] ReportProfileThread(): instance_id=e4100828b01f01c:5a7c79e200000003 I1212 11:10:26.029765 3769 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=e4100828b01f01c:5a7c79e200000000, node=1 I1212 11:10:26.029774 3769 data-stream-recvr.cc:225] decremented senders: fragment_instance_id=e4100828b01f01c:5a7c79e200000000 node_id=1 #senders=2 I1212 11:10:26.030236 3769 impala-internal-service.cc:74] ReportExecStatus(): instance_id=e4100828b01f01c:5a7c79e200000002 I1212 11:10:26.030241 3769 impala-server.cc:1076] ReportExecStatus() instance_id=e4100828b01f01c:5a7c79e200000002 done=true I1212 11:10:26.030247 3769 coordinator.cc:1437] UpdateFragmentExecStatus() instance=e4100828b01f01c:5a7c79e200000002 status=0 done=true I1212 11:10:26.030733 3769 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 0.000ns 0.000ns 0 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 9.661ms 28.983ms 90 90 586.00 KB 0 I1212 11:10:26.031091 14878 plan-fragment-executor.cc:261] plan_root= ExchangeNode(#senders=3 conjuncts=[]) I1212 11:10:26.031113 14878 plan-fragment-executor.cc:296] Open(): instance_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:26.031141 2681 coordinator.cc:1181] Byte split for fragment 1 min: 0, max: 0, avg: 0, stddev: 0 I1212 11:10:26.031149 2681 coordinator.cc:1184] data volume for ipaddress 0xbfeb320: 0 I1212 11:10:26.031153 2681 coordinator.cc:1184] data volume for ipaddress 0xbfea120: 0 I1212 11:10:26.031158 2681 coordinator.cc:1184] data volume for ipaddress 0xbfeb560: 0 I1212 11:10:26.031345 2681 thread.cc:288] Started thread 14915 - query-exec-state:wait-thread I1212 11:10:26.031394 2681 impala-hs2-server.cc:486] ExecuteStatement(): return_val=TExecuteStatementResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: operationHandle (struct) = TOperationHandle { 01: operationId (struct) = THandleIdentifier { 01: guid (string) = "\x1c\xf0\x01\x8b\x82\x00A\x0e\x00\x00\x00\x00\xe2y|Z", 02: secret (string) = "\x1c\xf0\x01\x8b\x82\x00A\x0e\x00\x00\x00\x00\xe2y|Z", }, 02: operationType (i32) = 0, 03: hasResultSet (bool) = true, }, } I1212 11:10:26.031458 3769 coordinator.cc:1521] profile for instance_id=e4100828b01f01c:5a7c79e200000002 Instance e4100828b01f01c:5a7c79e200000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 53.467ms, non-child: 1.249ms, % non-child: 2.34%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 286.129us - TotalStorageWaitTime: 9.447ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 29.708ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.996ms - TotalThreadsVoluntaryContextSwitches: 47 (47) Fragment Instance Lifecycle Timings: - ExecTime: 12.529ms - ExecTreeExecTime: 11.920ms - OpenTime: 17.195ms - ExecTreeOpenTime: 17.015ms - PrepareTime: 23.682ms - ExecTreePrepareTime: 66.646us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 247.734us, non-child: 247.734us, % non-child: 100.00%) - BytesSent: 11.18 KB (11444) - NetworkThroughput(*): 331.47 MB/sec - OverallThroughput: 44.05 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 187.790us - TransmitDataRPCTime: 32.926us - UncompressedRowBatchSize: 23.56 KB (24125) CodeGen:(Total: 22.986ms, non-child: 22.986ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 22.210ms KUDU_SCAN_NODE (id=0):(Total: 28.983ms, non-child: 28.983ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 586.00 KB (600064) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 3.10 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 11.916ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:26.032028 3769 coordinator.cc:1529] cumulative profile for query_id=e4100828b01f01c:5a7c79e200000000 Execution Profile e4100828b01f01c:5a7c79e200000000:(Total: 56.563ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 1ms, 50th %-ile: 4ms, 75th %-ile: 8ms, 90th %-ile: 20ms, 95th %-ile: 20ms, 99.9th %-ile: 20ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Averaged Fragment F00:(Total: 53.467ms, non-child: 1.249ms, % non-child: 2.34%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 286.129us - TotalStorageWaitTime: 9.447ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 29.708ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.996ms - TotalThreadsVoluntaryContextSwitches: 47 (47) Fragment Instance Lifecycle Timings: - ExecTime: 12.529ms - ExecTreeExecTime: 11.920ms - OpenTime: 17.195ms - ExecTreeOpenTime: 17.015ms - PrepareTime: 23.682ms - ExecTreePrepareTime: 66.646us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 247.734us, non-child: 247.734us, % non-child: 100.00%) - BytesSent: 11.18 KB (11444) - NetworkThroughput(*): 331.47 MB/sec - OverallThroughput: 44.05 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 187.790us - TransmitDataRPCTime: 32.926us - UncompressedRowBatchSize: 23.56 KB (24125) CodeGen:(Total: 22.986ms, non-child: 22.986ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 22.210ms KUDU_SCAN_NODE (id=0):(Total: 28.983ms, non-child: 28.983ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 586.00 KB (600064) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 3.10 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 11.916ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance e4100828b01f01c:5a7c79e200000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 53.467ms, non-child: 1.249ms, % non-child: 2.34%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 286.129us - TotalStorageWaitTime: 9.447ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 29.708ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.996ms - TotalThreadsVoluntaryContextSwitches: 47 (47) Fragment Instance Lifecycle Timings: - ExecTime: 12.529ms - ExecTreeExecTime: 11.920ms - OpenTime: 17.195ms - ExecTreeOpenTime: 17.015ms - PrepareTime: 23.682ms - ExecTreePrepareTime: 66.646us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 247.734us, non-child: 247.734us, % non-child: 100.00%) - BytesSent: 11.18 KB (11444) - NetworkThroughput(*): 331.47 MB/sec - OverallThroughput: 44.05 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 187.790us - TransmitDataRPCTime: 32.926us - UncompressedRowBatchSize: 23.56 KB (24125) CodeGen:(Total: 22.986ms, non-child: 22.986ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 22.210ms KUDU_SCAN_NODE (id=0):(Total: 28.983ms, non-child: 28.983ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 586.00 KB (600064) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 3.10 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 11.916ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:26.032049 3769 coordinator.cc:1546] Fragment instance completed: id=e4100828b01f01c:5a7c79e200000002 host=mj-desktop.ca.cloudera.com:22001 remaining=3 I1212 11:10:26.032054 3769 coordinator.cc:1556] query_id=e4100828b01f01c:5a7c79e200000000: first in-progress backend: mj-desktop.ca.cloudera.com:22000 I1212 11:10:26.032243 14878 thread.cc:288] Started thread 14914 - plan-fragment-executor:report-profile I1212 11:10:26.032244 14914 plan-fragment-executor.cc:378] ReportProfileThread(): instance_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:26.032307 14878 exchange-node.cc:139] exch: has batch=true #rows=90 is_cancelled=false instance_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:26.042548 2681 impala-hs2-server.cc:713] GetResultSetMetadata(): query_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:26.042636 14882 kudu-scan-node.cc:128] Latest observed Kudu timestamp: 0 I1212 11:10:26.042757 2681 impala-hs2-server.cc:753] GetResultSetMetadata(): return_val=TGetResultSetMetadataResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: schema (struct) = TTableSchema { 01: columns (list) = list[16] { [0] = TColumnDesc { 01: columnName (string) = "l_orderkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 0, }, [1] = TColumnDesc { 01: columnName (string) = "l_linenumber", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 3, }, }, }, }, 03: position (i32) = 1, }, [2] = TColumnDesc { 01: columnName (string) = "l_partkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 2, }, [3] = TColumnDesc { 01: columnName (string) = "l_suppkey", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 4, }, }, }, }, 03: position (i32) = 3, }, [4] = TColumnDesc { 01: columnName (string) = "l_quantity", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 4, }, [5] = TColumnDesc { 01: columnName (string) = "l_extendedprice", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 5, }, [6] = TColumnDesc { 01: columnName (string) = "l_discount", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 6, }, [7] = TColumnDesc { 01: columnName (string) = "l_tax", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 6, }, }, }, }, 03: position (i32) = 7, }, [8] = TColumnDesc { 01: columnName (string) = "l_returnflag", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 8, }, [9] = TColumnDesc { 01: columnName (string) = "l_linestatus", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 9, }, [10] = TColumnDesc { 01: columnName (string) = "l_shipdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 10, }, [11] = TColumnDesc { 01: columnName (string) = "l_commitdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 11, }, [12] = TColumnDesc { 01: columnName (string) = "l_receiptdate", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 12, }, [13] = TColumnDesc { 01: columnName (string) = "l_shipinstruct", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 13, }, [14] = TColumnDesc { 01: columnName (string) = "l_shipmode", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 14, }, [15] = TColumnDesc { 01: columnName (string) = "l_comment", 02: typeDesc (struct) = TTypeDesc { 01: types (list) = list[1] { [0] = TTypeEntry { 01: primitiveEntry (struct) = TPrimitiveTypeEntry { 01: type (i32) = 7, }, }, }, }, 03: position (i32) = 15, }, }, }, } I1212 11:10:26.043007 14882 kudu-scan-node.cc:248] Thread started: scanner-thread(1) I1212 11:10:26.043097 14882 thread.cc:288] Started thread 14926 - kudu-scan-node:scanner-thread(1) I1212 11:10:26.043593 14926 kudu-scanner.cc:148] Starting KuduScanner with ReadMode=0 timeout=180000 I1212 11:10:26.043730 2681 coordinator.cc:1064] Coordinator waiting for fragment instances to finish, 3 remaining I1212 11:10:26.046310 14914 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:26.046380 14878 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:26.046391 14878 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:26.046771 3396 impala-internal-service.cc:74] ReportExecStatus(): instance_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:26.046780 3396 impala-server.cc:1076] ReportExecStatus() instance_id=e4100828b01f01c:5a7c79e200000000 done=true I1212 11:10:26.046790 3396 coordinator.cc:1437] UpdateFragmentExecStatus() instance=e4100828b01f01c:5a7c79e200000000 status=0 done=true I1212 11:10:26.047092 3396 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 28.480us 28.480us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 9.661ms 28.983ms 90 90 586.00 KB 0 I1212 11:10:26.047343 3396 coordinator.cc:1521] profile for instance_id=e4100828b01f01c:5a7c79e200000000 Instance e4100828b01f01c:5a7c79e200000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 65.304ms, non-child: 13.091ms, % non-child: 20.05%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 31.91 KB (32673) - PerHostPeakMemUsage: 40.58 KB (41553) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 1.553us - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 12.576ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.524ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Fragment Instance Lifecycle Timings: - ExecTime: 11.386ms - ExecTreeExecTime: 20.188us - OpenTime: 1.204ms - ExecTreeOpenTime: 10.503us - PrepareTime: 52.660ms - ExecTreePrepareTime: 59.657us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 52.184ms, non-child: 52.184ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 51.481ms EXCHANGE_NODE (id=1):(Total: 28.480us, non-child: 28.480us, % non-child: 100.00%) - BytesReceived: 11.18 KB (11444) - ConvertRowBatchTime: 18.813us - DeserializeRowBatchTimer: 93.878us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 90 (90) - RowsReturnedRate: 3.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns I1212 11:10:26.048193 3396 coordinator.cc:1529] cumulative profile for query_id=e4100828b01f01c:5a7c79e200000000 Execution Profile e4100828b01f01c:5a7c79e200000000:(Total: 57.548ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 1ms, 50th %-ile: 4ms, 75th %-ile: 8ms, 90th %-ile: 20ms, 95th %-ile: 20ms, 99.9th %-ile: 20ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance e4100828b01f01c:5a7c79e200000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 65.304ms, non-child: 13.091ms, % non-child: 20.05%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 31.91 KB (32673) - PerHostPeakMemUsage: 40.58 KB (41553) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 1.553us - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 12.576ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.524ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Fragment Instance Lifecycle Timings: - ExecTime: 11.386ms - ExecTreeExecTime: 20.188us - OpenTime: 1.204ms - ExecTreeOpenTime: 10.503us - PrepareTime: 52.660ms - ExecTreePrepareTime: 59.657us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 52.184ms, non-child: 52.184ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 51.481ms EXCHANGE_NODE (id=1):(Total: 28.480us, non-child: 28.480us, % non-child: 100.00%) - BytesReceived: 11.18 KB (11444) - ConvertRowBatchTime: 18.813us - DeserializeRowBatchTimer: 93.878us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 90 (90) - RowsReturnedRate: 3.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 53.467ms, non-child: 1.249ms, % non-child: 2.34%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 286.129us - TotalStorageWaitTime: 9.447ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 29.708ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.996ms - TotalThreadsVoluntaryContextSwitches: 47 (47) Fragment Instance Lifecycle Timings: - ExecTime: 12.529ms - ExecTreeExecTime: 11.920ms - OpenTime: 17.195ms - ExecTreeOpenTime: 17.015ms - PrepareTime: 23.682ms - ExecTreePrepareTime: 66.646us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 247.734us, non-child: 247.734us, % non-child: 100.00%) - BytesSent: 11.18 KB (11444) - NetworkThroughput(*): 331.47 MB/sec - OverallThroughput: 44.05 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 187.790us - TransmitDataRPCTime: 32.926us - UncompressedRowBatchSize: 23.56 KB (24125) CodeGen:(Total: 22.986ms, non-child: 22.986ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 22.210ms KUDU_SCAN_NODE (id=0):(Total: 28.983ms, non-child: 28.983ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 586.00 KB (600064) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 3.10 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 11.916ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance e4100828b01f01c:5a7c79e200000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 53.467ms, non-child: 1.249ms, % non-child: 2.34%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 286.129us - TotalStorageWaitTime: 9.447ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 29.708ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.996ms - TotalThreadsVoluntaryContextSwitches: 47 (47) Fragment Instance Lifecycle Timings: - ExecTime: 12.529ms - ExecTreeExecTime: 11.920ms - OpenTime: 17.195ms - ExecTreeOpenTime: 17.015ms - PrepareTime: 23.682ms - ExecTreePrepareTime: 66.646us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 247.734us, non-child: 247.734us, % non-child: 100.00%) - BytesSent: 11.18 KB (11444) - NetworkThroughput(*): 331.47 MB/sec - OverallThroughput: 44.05 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 187.790us - TransmitDataRPCTime: 32.926us - UncompressedRowBatchSize: 23.56 KB (24125) CodeGen:(Total: 22.986ms, non-child: 22.986ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 22.210ms KUDU_SCAN_NODE (id=0):(Total: 28.983ms, non-child: 28.983ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 586.00 KB (600064) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 3.10 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 11.916ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:26.048245 3396 coordinator.cc:1546] Fragment instance completed: id=e4100828b01f01c:5a7c79e200000000 host=mj-desktop.ca.cloudera.com:22000 remaining=2 I1212 11:10:26.048252 3396 coordinator.cc:1556] query_id=e4100828b01f01c:5a7c79e200000000: first in-progress backend: mj-desktop.ca.cloudera.com:22002 I1212 11:10:26.048321 14878 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:26.048357 14878 data-stream-mgr.cc:226] DeregisterRecvr(): fragment_instance_id=e4100828b01f01c:5a7c79e200000000, node=1 I1212 11:10:26.048372 14878 data-stream-recvr.cc:237] cancelled stream: fragment_instance_id_=e4100828b01f01c:5a7c79e200000000 node_id=1 I1212 11:10:26.048427 14878 query-exec-mgr.cc:103] Instance completed. instance_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:26.048434 14878 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=e4100828b01f01c:5a7c79e200000000 refcnt=3 I1212 11:10:26.057188 14882 data-stream-sender.cc:284] Channel::FlushAndSendEos() instance_id=e4100828b01f01c:5a7c79e200000000 dest_node=1 #rows= 0 I1212 11:10:26.057204 14885 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:26.057214 14885 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:26.057323 14885 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:26.057541 14882 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:26.057549 14882 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:26.057554 14882 data-stream-sender.cc:311] calling TransmitData(eos=true) to terminate channel. I1212 11:10:26.057999 3396 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=e4100828b01f01c:5a7c79e200000000, node=1 I1212 11:10:26.058032 14882 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:26.058065 14895 plan-fragment-executor.cc:419] exiting reporting thread: instance_id=e4100828b01f01c:5a7c79e200000003 I1212 11:10:26.058120 14882 client-cache.cc:46] GetClient(mj-desktop.ca.cloudera.com:22000) I1212 11:10:26.058126 14882 client-cache.cc:56] GetClient(): returning cached client for mj-desktop.ca.cloudera.com:22000 I1212 11:10:26.058465 5418 impala-internal-service.cc:74] ReportExecStatus(): instance_id=e4100828b01f01c:5a7c79e200000003 I1212 11:10:26.058473 5418 impala-server.cc:1076] ReportExecStatus() instance_id=e4100828b01f01c:5a7c79e200000003 done=true I1212 11:10:26.058481 5418 coordinator.cc:1437] UpdateFragmentExecStatus() instance=e4100828b01f01c:5a7c79e200000003 status=0 done=true I1212 11:10:26.058936 5418 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 28.480us 28.480us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 23.727ms 42.199ms 180 90 1.13 MB 0 I1212 11:10:26.059175 5418 coordinator.cc:1521] profile for instance_id=e4100828b01f01c:5a7c79e200000003 Instance e4100828b01f01c:5a7c79e200000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 75.462ms, non-child: 5.893ms, % non-child: 7.81%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 333.131us - TotalStorageWaitTime: 11.567ms - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 47.659ms - TotalThreadsSysTime: 454.000us - TotalThreadsUserTime: 1.816ms - TotalThreadsVoluntaryContextSwitches: 333 (333) Fragment Instance Lifecycle Timings: - ExecTime: 14.928ms - ExecTreeExecTime: 13.887ms - OpenTime: 32.746ms - ExecTreeOpenTime: 28.268ms - PrepareTime: 27.733ms - ExecTreePrepareTime: 63.270us DataStreamSender (dst_id=1):(Total: 202.820us, non-child: 202.820us, % non-child: 100.00%) - BytesSent: 11.14 KB (11409) - NetworkThroughput(*): 434.75 MB/sec - OverallThroughput: 53.65 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 158.733us - TransmitDataRPCTime: 25.027us - UncompressedRowBatchSize: 23.80 KB (24375) CodeGen:(Total: 27.166ms, non-child: 27.166ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 26.588ms KUDU_SCAN_NODE (id=0):(Total: 42.199ms, non-child: 42.199ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.13 MB (1183744) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 2.13 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 13.884ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:26.060196 5418 coordinator.cc:1529] cumulative profile for query_id=e4100828b01f01c:5a7c79e200000000 Execution Profile e4100828b01f01c:5a7c79e200000000:(Total: 57.548ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 1ms, 50th %-ile: 4ms, 75th %-ile: 8ms, 90th %-ile: 20ms, 95th %-ile: 20ms, 99.9th %-ile: 20ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance e4100828b01f01c:5a7c79e200000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 65.304ms, non-child: 13.091ms, % non-child: 20.05%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 31.91 KB (32673) - PerHostPeakMemUsage: 40.58 KB (41553) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 1.553us - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 12.576ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.524ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Fragment Instance Lifecycle Timings: - ExecTime: 11.386ms - ExecTreeExecTime: 20.188us - OpenTime: 1.204ms - ExecTreeOpenTime: 10.503us - PrepareTime: 52.660ms - ExecTreePrepareTime: 59.657us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 52.184ms, non-child: 52.184ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 51.481ms EXCHANGE_NODE (id=1):(Total: 28.480us, non-child: 28.480us, % non-child: 100.00%) - BytesReceived: 11.18 KB (11444) - ConvertRowBatchTime: 18.813us - DeserializeRowBatchTimer: 93.878us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 90 (90) - RowsReturnedRate: 3.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 64.464ms, non-child: 3.571ms, % non-child: 5.54%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 309.630us - TotalStorageWaitTime: 10.507ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 38.683ms - TotalThreadsSysTime: 227.000us - TotalThreadsUserTime: 1.906ms - TotalThreadsVoluntaryContextSwitches: 190 (190) Fragment Instance Lifecycle Timings: - ExecTime: 13.728ms - ExecTreeExecTime: 12.904ms - OpenTime: 24.971ms - ExecTreeOpenTime: 22.642ms - PrepareTime: 25.707ms - ExecTreePrepareTime: 64.958us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 225.277us, non-child: 225.277us, % non-child: 100.00%) - BytesSent: 11.16 KB (11426) - NetworkThroughput(*): 383.11 MB/sec - OverallThroughput: 48.85 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 173.261us - TransmitDataRPCTime: 28.976us - UncompressedRowBatchSize: 23.68 KB (24250) CodeGen:(Total: 25.076ms, non-child: 25.076ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 24.399ms KUDU_SCAN_NODE (id=0):(Total: 35.591ms, non-child: 35.591ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 871.00 KB (891904) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 2.62 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 12.900ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance e4100828b01f01c:5a7c79e200000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 53.467ms, non-child: 1.249ms, % non-child: 2.34%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 286.129us - TotalStorageWaitTime: 9.447ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 29.708ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.996ms - TotalThreadsVoluntaryContextSwitches: 47 (47) Fragment Instance Lifecycle Timings: - ExecTime: 12.529ms - ExecTreeExecTime: 11.920ms - OpenTime: 17.195ms - ExecTreeOpenTime: 17.015ms - PrepareTime: 23.682ms - ExecTreePrepareTime: 66.646us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 247.734us, non-child: 247.734us, % non-child: 100.00%) - BytesSent: 11.18 KB (11444) - NetworkThroughput(*): 331.47 MB/sec - OverallThroughput: 44.05 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 187.790us - TransmitDataRPCTime: 32.926us - UncompressedRowBatchSize: 23.56 KB (24125) CodeGen:(Total: 22.986ms, non-child: 22.986ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 22.210ms KUDU_SCAN_NODE (id=0):(Total: 28.983ms, non-child: 28.983ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 586.00 KB (600064) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 3.10 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 11.916ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Instance e4100828b01f01c:5a7c79e200000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 75.462ms, non-child: 5.893ms, % non-child: 7.81%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 333.131us - TotalStorageWaitTime: 11.567ms - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 47.659ms - TotalThreadsSysTime: 454.000us - TotalThreadsUserTime: 1.816ms - TotalThreadsVoluntaryContextSwitches: 333 (333) Fragment Instance Lifecycle Timings: - ExecTime: 14.928ms - ExecTreeExecTime: 13.887ms - OpenTime: 32.746ms - ExecTreeOpenTime: 28.268ms - PrepareTime: 27.733ms - ExecTreePrepareTime: 63.270us DataStreamSender (dst_id=1):(Total: 202.820us, non-child: 202.820us, % non-child: 100.00%) - BytesSent: 11.14 KB (11409) - NetworkThroughput(*): 434.75 MB/sec - OverallThroughput: 53.65 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 158.733us - TransmitDataRPCTime: 25.027us - UncompressedRowBatchSize: 23.80 KB (24375) CodeGen:(Total: 27.166ms, non-child: 27.166ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 26.588ms KUDU_SCAN_NODE (id=0):(Total: 42.199ms, non-child: 42.199ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.13 MB (1183744) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 2.13 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 13.884ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:26.060230 5418 coordinator.cc:1546] Fragment instance completed: id=e4100828b01f01c:5a7c79e200000003 host=mj-desktop.ca.cloudera.com:22000 remaining=1 I1212 11:10:26.060235 5418 coordinator.cc:1556] query_id=e4100828b01f01c:5a7c79e200000000: first in-progress backend: mj-desktop.ca.cloudera.com:22002 I1212 11:10:26.060333 14882 client-cache.cc:148] Releasing client for mj-desktop.ca.cloudera.com:22000 back to cache I1212 11:10:26.066148 3766 data-stream-mgr.cc:195] CloseSender(): fragment_instance_id=e4100828b01f01c:5a7c79e200000000, node=1 I1212 11:10:26.067126 3766 impala-internal-service.cc:74] ReportExecStatus(): instance_id=e4100828b01f01c:5a7c79e200000001 I1212 11:10:26.067136 3766 impala-server.cc:1076] ReportExecStatus() instance_id=e4100828b01f01c:5a7c79e200000001 done=true I1212 11:10:26.067144 3766 coordinator.cc:1437] UpdateFragmentExecStatus() instance=e4100828b01f01c:5a7c79e200000001 status=0 done=true I1212 11:10:26.067631 3766 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 28.480us 28.480us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 36.069ms 42.199ms 270 90 1.13 MB 0 I1212 11:10:26.067945 3766 coordinator.cc:1521] profile for instance_id=e4100828b01f01c:5a7c79e200000001 Instance e4100828b01f01c:5a7c79e200000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 71.377ms, non-child: 6.346ms, % non-child: 8.89%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 160.063us - TotalStorageWaitTime: 28.986ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 37.648ms - TotalThreadsSysTime: 307.000us - TotalThreadsUserTime: 1.537ms - TotalThreadsVoluntaryContextSwitches: 19 (19) Fragment Instance Lifecycle Timings: - ExecTime: 32.015ms - ExecTreeExecTime: 31.457ms - OpenTime: 5.648ms - ExecTreeOpenTime: 5.519ms - PrepareTime: 33.643ms - ExecTreePrepareTime: 64.288us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 297.361us, non-child: 297.361us, % non-child: 100.00%) - BytesSent: 11.04 KB (11309) - NetworkThroughput(*): 323.03 MB/sec - OverallThroughput: 36.27 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 233.380us - TransmitDataRPCTime: 33.387us - UncompressedRowBatchSize: 23.62 KB (24188) CodeGen:(Total: 27.709ms, non-child: 27.709ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 21.334ms KUDU_SCAN_NODE (id=0):(Total: 37.024ms, non-child: 37.024ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 776.00 KB (794624) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 2.43 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 31.453ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:26.069347 3766 coordinator.cc:1529] cumulative profile for query_id=e4100828b01f01c:5a7c79e200000000 Execution Profile e4100828b01f01c:5a7c79e200000000:(Total: 57.548ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 4, 25th %-ile: 1ms, 50th %-ile: 4ms, 75th %-ile: 8ms, 90th %-ile: 20ms, 95th %-ile: 20ms, 99.9th %-ile: 20ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01: Instance e4100828b01f01c:5a7c79e200000000 (host=mj-desktop.ca.cloudera.com:22000):(Total: 65.304ms, non-child: 13.091ms, % non-child: 20.05%) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 31.91 KB (32673) - PerHostPeakMemUsage: 40.58 KB (41553) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 1.553us - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 12.576ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.524ms - TotalThreadsVoluntaryContextSwitches: 5 (5) Fragment Instance Lifecycle Timings: - ExecTime: 11.386ms - ExecTreeExecTime: 20.188us - OpenTime: 1.204ms - ExecTreeOpenTime: 10.503us - PrepareTime: 52.660ms - ExecTreePrepareTime: 59.657us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 52.184ms, non-child: 52.184ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 51.481ms EXCHANGE_NODE (id=1):(Total: 28.480us, non-child: 28.480us, % non-child: 100.00%) - BytesReceived: 11.18 KB (11444) - ConvertRowBatchTime: 18.813us - DeserializeRowBatchTimer: 93.878us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 90 (90) - RowsReturnedRate: 3.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 66.768ms, non-child: 4.496ms, % non-child: 6.73%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 259.774us - TotalStorageWaitTime: 16.667ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 38.338ms - TotalThreadsSysTime: 253.666us - TotalThreadsUserTime: 1.783ms - TotalThreadsVoluntaryContextSwitches: 133 (133) Fragment Instance Lifecycle Timings: - ExecTime: 19.824ms - ExecTreeExecTime: 19.088ms - OpenTime: 18.530ms - ExecTreeOpenTime: 16.934ms - PrepareTime: 28.352ms - ExecTreePrepareTime: 64.733us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 249.305us, non-child: 249.305us, % non-child: 100.00%) - BytesSent: 11.12 KB (11387) - NetworkThroughput(*): 363.08 MB/sec - OverallThroughput: 44.66 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 193.301us - TransmitDataRPCTime: 30.446us - UncompressedRowBatchSize: 23.66 KB (24229) CodeGen:(Total: 25.954ms, non-child: 25.954ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 23.378ms KUDU_SCAN_NODE (id=0):(Total: 36.069ms, non-child: 36.069ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 839.33 KB (859477) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 2.56 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 19.084ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Fragment F00: Instance e4100828b01f01c:5a7c79e200000002 (host=mj-desktop.ca.cloudera.com:22001):(Total: 53.467ms, non-child: 1.249ms, % non-child: 2.34%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 286.129us - TotalStorageWaitTime: 9.447ms - TotalThreadsInvoluntaryContextSwitches: 1 (1) - TotalThreadsTotalWallClockTime: 29.708ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 1.996ms - TotalThreadsVoluntaryContextSwitches: 47 (47) Fragment Instance Lifecycle Timings: - ExecTime: 12.529ms - ExecTreeExecTime: 11.920ms - OpenTime: 17.195ms - ExecTreeOpenTime: 17.015ms - PrepareTime: 23.682ms - ExecTreePrepareTime: 66.646us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 247.734us, non-child: 247.734us, % non-child: 100.00%) - BytesSent: 11.18 KB (11444) - NetworkThroughput(*): 331.47 MB/sec - OverallThroughput: 44.05 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 187.790us - TransmitDataRPCTime: 32.926us - UncompressedRowBatchSize: 23.56 KB (24125) CodeGen:(Total: 22.986ms, non-child: 22.986ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 22.210ms KUDU_SCAN_NODE (id=0):(Total: 28.983ms, non-child: 28.983ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 586.00 KB (600064) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 3.10 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 11.916ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Instance e4100828b01f01c:5a7c79e200000003 (host=mj-desktop.ca.cloudera.com:22000):(Total: 75.462ms, non-child: 5.893ms, % non-child: 7.81%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 333.131us - TotalStorageWaitTime: 11.567ms - TotalThreadsInvoluntaryContextSwitches: 2 (2) - TotalThreadsTotalWallClockTime: 47.659ms - TotalThreadsSysTime: 454.000us - TotalThreadsUserTime: 1.816ms - TotalThreadsVoluntaryContextSwitches: 333 (333) Fragment Instance Lifecycle Timings: - ExecTime: 14.928ms - ExecTreeExecTime: 13.887ms - OpenTime: 32.746ms - ExecTreeOpenTime: 28.268ms - PrepareTime: 27.733ms - ExecTreePrepareTime: 63.270us DataStreamSender (dst_id=1):(Total: 202.820us, non-child: 202.820us, % non-child: 100.00%) - BytesSent: 11.14 KB (11409) - NetworkThroughput(*): 434.75 MB/sec - OverallThroughput: 53.65 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 158.733us - TransmitDataRPCTime: 25.027us - UncompressedRowBatchSize: 23.80 KB (24375) CodeGen:(Total: 27.166ms, non-child: 27.166ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 26.588ms KUDU_SCAN_NODE (id=0):(Total: 42.199ms, non-child: 42.199ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.13 MB (1183744) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 2.13 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 13.884ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec Instance e4100828b01f01c:5a7c79e200000001 (host=mj-desktop.ca.cloudera.com:22002):(Total: 71.377ms, non-child: 6.346ms, % non-child: 8.89%) Hdfs split stats (:<# splits>/): - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.14 MB (1192624) - PerHostPeakMemUsage: 1.14 MB (1192624) - RowsProduced: 90 (90) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 160.063us - TotalStorageWaitTime: 28.986ms - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 37.648ms - TotalThreadsSysTime: 307.000us - TotalThreadsUserTime: 1.537ms - TotalThreadsVoluntaryContextSwitches: 19 (19) Fragment Instance Lifecycle Timings: - ExecTime: 32.015ms - ExecTreeExecTime: 31.457ms - OpenTime: 5.648ms - ExecTreeOpenTime: 5.519ms - PrepareTime: 33.643ms - ExecTreePrepareTime: 64.288us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 6.68 GB (7176689152) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=1):(Total: 297.361us, non-child: 297.361us, % non-child: 100.00%) - BytesSent: 11.04 KB (11309) - NetworkThroughput(*): 323.03 MB/sec - OverallThroughput: 36.27 MB/sec - PeakMemoryUsage: 688.00 B (688) - RowsReturned: 90 (90) - SerializeBatchTime: 233.380us - TransmitDataRPCTime: 33.387us - UncompressedRowBatchSize: 23.62 KB (24188) CodeGen:(Total: 27.709ms, non-child: 27.709ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993852) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 21.334ms KUDU_SCAN_NODE (id=0):(Total: 37.024ms, non-child: 37.024ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 776.00 KB (794624) - RowsRead: 4.00K (4000) - RowsReturned: 90 (90) - RowsReturnedRate: 2.43 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 31.453ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalKuduScanRoundTrips: 1 (1) - TotalReadThroughput: 0.00 /sec I1212 11:10:26.069385 3766 coordinator.cc:1546] Fragment instance completed: id=e4100828b01f01c:5a7c79e200000001 host=mj-desktop.ca.cloudera.com:22002 remaining=0 I1212 11:10:26.069407 2681 coordinator.cc:1069] All fragment instances finished successfully. I1212 11:10:26.069548 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 28.480us 28.480us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 36.069ms 42.199ms 270 90 1.13 MB 0 I1212 11:10:26.069828 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 28.480us 28.480us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 36.069ms 42.199ms 270 90 1.13 MB 0 I1212 11:10:26.070099 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 28.480us 28.480us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 36.069ms 42.199ms 270 90 1.13 MB 0 I1212 11:10:26.070340 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 28.480us 28.480us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 36.069ms 42.199ms 270 90 1.13 MB 0 I1212 11:10:26.072556 2681 impala-hs2-server.cc:373] CloseSession(): request=TCloseSessionReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\x04#\x89K{\x84C#\x90,\x8d\xa4\n(\x8e\x84", 02: secret (string) = "\x9e\x8d!z\x8erD\xe7\xa8\x91\n\x83\x93\xea0\x10", }, }, } I1212 11:10:26.125448 2681 status.cc:114] Session closed @ 0x11cc7af impala::Status::Status() @ 0x147e95c impala::ImpalaServer::CloseSessionInternal() @ 0x14d36a8 impala::ImpalaServer::CloseSession() @ 0x1958d62 apache::hive::service::cli::thrift::TCLIServiceProcessor::process_CloseSession() @ 0x1958348 apache::hive::service::cli::thrift::TCLIServiceProcessor::dispatchCall() @ 0x1931f95 impala::ImpalaHiveServer2ServiceProcessor::dispatchCall() @ 0x117366e apache::thrift::TDispatchProcessor::process() @ 0x27d689b apache::thrift::server::TThreadPoolServer::Task::run() @ 0x27bf109 apache::thrift::concurrency::ThreadManager::Worker::run() @ 0x133a3bd impala::ThriftThread::RunRunnable() @ 0x133bae9 boost::_mfi::mf2<>::operator()() @ 0x133b97f boost::_bi::list3<>::operator()<>() @ 0x133b6cb boost::_bi::bind_t<>::operator()() @ 0x133b5de boost::detail::function::void_function_obj_invoker0<>::invoke() @ 0x1348fbc boost::function0<>::operator()() @ 0x15eeb13 impala::Thread::SuperviseThread() @ 0x15f5aec boost::_bi::list4<>::operator()<>() @ 0x15f5a2f boost::_bi::bind_t<>::operator()() @ 0x15f598a boost::detail::thread_data<>::run() @ 0x1a54fda thread_proxy @ 0x7f284362a184 start_thread @ 0x7f284335737d (unknown) I1212 11:10:26.125466 2681 impala-server.cc:907] UnregisterQuery(): query_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:26.125478 2681 impala-server.cc:993] Cancel(): query_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:26.125489 2681 coordinator.cc:1362] Cancel() query_id=e4100828b01f01c:5a7c79e200000000 I1212 11:10:26.125504 2681 coordinator.cc:1428] CancelFragmentInstances() query_id=e4100828b01f01c:5a7c79e200000000, tried to cancel 0 fragment instances I1212 11:10:26.125665 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 28.480us 28.480us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 36.069ms 42.199ms 270 90 1.13 MB 0 I1212 11:10:26.125967 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 28.480us 28.480us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 36.069ms 42.199ms 270 90 1.13 MB 0 I1212 11:10:26.126216 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 28.480us 28.480us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 36.069ms 42.199ms 270 90 1.13 MB 0 I1212 11:10:26.126451 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 28.480us 28.480us 90 90 0 -1.00 B UNPARTITIONED 00:SCAN KUDU 3 36.069ms 42.199ms 270 90 1.13 MB 0 I1212 11:10:26.126605 2681 admission-controller.cc:538] Released query id=e4100828b01f01c:5a7c79e200000000 agg_num_running=1, agg_num_queued=0, agg_mem_reserved=32.63 MB, local_host(local_mem_admitted=3.75 GB, num_admitted_running=1, num_queued=0, backend_mem_reserved=10.21 MB) I1212 11:10:26.126647 2681 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=e4100828b01f01c:5a7c79e200000000 refcnt=2 I1212 11:10:26.131104 2681 impala-hs2-server.cc:373] CloseSession(): request=TCloseSessionReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "A\xa7\x0e\xf0\x8f?IP\xa0\xbe\x87\x95\x03\x84\xf7\xef", 02: secret (string) = ">\x13\x89\xcf\xce\x14E\xc9\xb5\xdf\x1a&\xf7\xd9o\x7f", }, }, } I1212 11:10:26.185884 2681 status.cc:114] Session closed @ 0x11cc7af impala::Status::Status() @ 0x147e95c impala::ImpalaServer::CloseSessionInternal() @ 0x14d36a8 impala::ImpalaServer::CloseSession() @ 0x1958d62 apache::hive::service::cli::thrift::TCLIServiceProcessor::process_CloseSession() @ 0x1958348 apache::hive::service::cli::thrift::TCLIServiceProcessor::dispatchCall() @ 0x1931f95 impala::ImpalaHiveServer2ServiceProcessor::dispatchCall() @ 0x117366e apache::thrift::TDispatchProcessor::process() @ 0x27d689b apache::thrift::server::TThreadPoolServer::Task::run() @ 0x27bf109 apache::thrift::concurrency::ThreadManager::Worker::run() @ 0x133a3bd impala::ThriftThread::RunRunnable() @ 0x133bae9 boost::_mfi::mf2<>::operator()() @ 0x133b97f boost::_bi::list3<>::operator()<>() @ 0x133b6cb boost::_bi::bind_t<>::operator()() @ 0x133b5de boost::detail::function::void_function_obj_invoker0<>::invoke() @ 0x1348fbc boost::function0<>::operator()() @ 0x15eeb13 impala::Thread::SuperviseThread() @ 0x15f5aec boost::_bi::list4<>::operator()<>() @ 0x15f5a2f boost::_bi::bind_t<>::operator()() @ 0x15f598a boost::detail::thread_data<>::run() @ 0x1a54fda thread_proxy @ 0x7f284362a184 start_thread @ 0x7f284335737d (unknown) I1212 11:10:26.185901 2681 impala-server.cc:907] UnregisterQuery(): query_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:10:26.185914 2681 impala-server.cc:993] Cancel(): query_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:10:26.185935 2681 coordinator.cc:1362] Cancel() query_id=25407d49fc4cde6f:d575dd6200000000 I1212 11:10:26.185948 2681 coordinator.cc:1428] CancelFragmentInstances() query_id=25407d49fc4cde6f:d575dd6200000000, tried to cancel 0 fragment instances I1212 11:10:26.186348 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 667.099ms 703.643ms 6.00M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:10:26.186645 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 667.099ms 703.643ms 6.00M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:10:26.186902 2681 coordinator.cc:1663] Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 667.099ms 703.643ms 6.00M 6.00M 94.80 MB 1.25 GB tpch_parquet.lineitem I1212 11:10:26.187115 2681 query-exec-state.cc:540] Updating session (id=50493f8ff00ea741:eff784039587bea0) with latest observed Kudu timestamp: 6068509949633155072 I1212 11:10:26.187189 2681 admission-controller.cc:538] Released query id=25407d49fc4cde6f:d575dd6200000000 agg_num_running=0, agg_num_queued=0, agg_mem_reserved=32.63 MB, local_host(local_mem_admitted=0, num_admitted_running=0, num_queued=0, backend_mem_reserved=10.21 MB) I1212 11:10:26.192246 2681 impala-hs2-server.cc:271] OpenSession(): username=mj I1212 11:10:26.192749 2681 impala-hs2-server.cc:414] ExecuteStatement(): request=TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\xac\xc5\xc1k\x1b\xbfH\xf1\x9a\x84\xb5{\xe8\xc1\xb3\x8e", 02: secret (string) = "\x1a}\xe8\x11\xbb\x9eK\xb0\xb0\xa0\x9d'\x7f\x92\xbdk", }, }, 02: statement (string) = "USE ucu3e4", 04: runAsync (bool) = false, } I1212 11:10:26.192775 2681 impala-hs2-server.cc:228] TExecuteStatementReq: TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\xac\xc5\xc1k\x1b\xbfH\xf1\x9a\x84\xb5{\xe8\xc1\xb3\x8e", 02: secret (string) = "\x1a}\xe8\x11\xbb\x9eK\xb0\xb0\xa0\x9d'\x7f\x92\xbdk", }, }, 02: statement (string) = "USE ucu3e4", 04: runAsync (bool) = false, } I1212 11:10:26.192792 2681 impala-server.cc:742] Parsed pool options: override_options_mask=1111111111111111111111111111111111111111111111111111111111111111 set_pool_mask=0000000000000000000000000000000000000000000000000000000000000000 overlay_mask=0000000000000000000000000000000000000000000000000000000000000000 I1212 11:10:26.192849 2681 impala-hs2-server.cc:261] TClientRequest.queryOptions: TQueryOptions { 01: abort_on_error (bool) = false, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 100, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, } I1212 11:10:26.195302 2681 impala-server.cc:812] Execution request: TExecRequest { 01: stmt_type (i32) = 1, 02: query_options (struct) = TQueryOptions { 01: abort_on_error (bool) = false, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 100, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 44: mt_dop (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, }, 04: catalog_op_request (struct) = TCatalogOpRequest { 01: op_type (i32) = 3, 02: use_db_params (struct) = TUseDbParams { 01: db (string) = "ucu3e4", }, }, 05: result_set_metadata (struct) = TResultSetMetadata { 01: columns (list) = list[0] { }, }, 08: access_events (set) = set[1] { TAccessEvent { 01: name (string) = "ucu3e4", 02: object_type (i32) = 2, 03: privilege (string) = "ANY", }, }, 09: analysis_warnings (list) = list[0] { }, } I1212 11:10:26.197787 2681 thread.cc:288] Started thread 14930 - query-exec-state:wait-thread I1212 11:10:26.197834 2681 impala-hs2-server.cc:486] ExecuteStatement(): return_val=TExecuteStatementResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: operationHandle (struct) = TOperationHandle { 01: operationId (struct) = THandleIdentifier { 01: guid (string) = "\xc1\xc6R\x99@>Fb\x00\x00\x00\x00\xcb\x85\xd8\xb5", 02: secret (string) = "\xc1\xc6R\x99@>Fb\x00\x00\x00\x00\xcb\x85\xd8\xb5", }, 02: operationType (i32) = 0, 03: hasResultSet (bool) = false, }, } I1212 11:10:26.198452 2681 impala-hs2-server.cc:688] CloseOperation(): query_id=62463e409952c6c1:b5d885cb00000000 I1212 11:10:26.198457 2681 impala-server.cc:907] UnregisterQuery(): query_id=62463e409952c6c1:b5d885cb00000000 I1212 11:10:26.198462 2681 impala-server.cc:993] Cancel(): query_id=62463e409952c6c1:b5d885cb00000000 I1212 11:10:26.199034 2681 impala-hs2-server.cc:414] ExecuteStatement(): request=TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\xac\xc5\xc1k\x1b\xbfH\xf1\x9a\x84\xb5{\xe8\xc1\xb3\x8e", 02: secret (string) = "\x1a}\xe8\x11\xbb\x9eK\xb0\xb0\xa0\x9d'\x7f\x92\xbdk", }, }, 02: statement (string) = "USE DEFAULT", 04: runAsync (bool) = false, } I1212 11:10:26.199074 2681 impala-hs2-server.cc:228] TExecuteStatementReq: TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\xac\xc5\xc1k\x1b\xbfH\xf1\x9a\x84\xb5{\xe8\xc1\xb3\x8e", 02: secret (string) = "\x1a}\xe8\x11\xbb\x9eK\xb0\xb0\xa0\x9d'\x7f\x92\xbdk", }, }, 02: statement (string) = "USE DEFAULT", 04: runAsync (bool) = false, } I1212 11:10:26.199091 2681 impala-server.cc:742] Parsed pool options: override_options_mask=1111111111111111111111111111111111111111111111111111111111111111 set_pool_mask=0000000000000000000000000000000000000000000000000000000000000000 overlay_mask=0000000000000000000000000000000000000000000000000000000000000000 I1212 11:10:26.199141 2681 impala-hs2-server.cc:261] TClientRequest.queryOptions: TQueryOptions { 01: abort_on_error (bool) = false, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 100, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, } I1212 11:10:26.201861 2681 impala-server.cc:812] Execution request: TExecRequest { 01: stmt_type (i32) = 1, 02: query_options (struct) = TQueryOptions { 01: abort_on_error (bool) = false, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 100, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 44: mt_dop (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, }, 04: catalog_op_request (struct) = TCatalogOpRequest { 01: op_type (i32) = 3, 02: use_db_params (struct) = TUseDbParams { 01: db (string) = "DEFAULT", }, }, 05: result_set_metadata (struct) = TResultSetMetadata { 01: columns (list) = list[0] { }, }, 08: access_events (set) = set[0] { }, 09: analysis_warnings (list) = list[0] { }, } I1212 11:10:26.214439 2681 thread.cc:288] Started thread 14932 - query-exec-state:wait-thread I1212 11:10:26.214498 2681 impala-hs2-server.cc:486] ExecuteStatement(): return_val=TExecuteStatementResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: operationHandle (struct) = TOperationHandle { 01: operationId (struct) = THandleIdentifier { 01: guid (string) = "*\xc6`\xb4G\xe2A\xe8\x00\x00\x00\x00#F\x00\xd6", 02: secret (string) = "*\xc6`\xb4G\xe2A\xe8\x00\x00\x00\x00#F\x00\xd6", }, 02: operationType (i32) = 0, 03: hasResultSet (bool) = false, }, } I1212 11:10:26.215132 2681 impala-hs2-server.cc:688] CloseOperation(): query_id=e841e247b460c62a:d600462300000000 I1212 11:10:26.215139 2681 impala-server.cc:907] UnregisterQuery(): query_id=e841e247b460c62a:d600462300000000 I1212 11:10:26.215147 2681 impala-server.cc:993] Cancel(): query_id=e841e247b460c62a:d600462300000000 I1212 11:10:26.215767 2681 impala-hs2-server.cc:414] ExecuteStatement(): request=TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\xac\xc5\xc1k\x1b\xbfH\xf1\x9a\x84\xb5{\xe8\xc1\xb3\x8e", 02: secret (string) = "\x1a}\xe8\x11\xbb\x9eK\xb0\xb0\xa0\x9d'\x7f\x92\xbdk", }, }, 02: statement (string) = "DROP DATABASE IF EXISTS ucu3e4 CASCADE", 04: runAsync (bool) = false, } I1212 11:10:26.215795 2681 impala-hs2-server.cc:228] TExecuteStatementReq: TExecuteStatementReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\xac\xc5\xc1k\x1b\xbfH\xf1\x9a\x84\xb5{\xe8\xc1\xb3\x8e", 02: secret (string) = "\x1a}\xe8\x11\xbb\x9eK\xb0\xb0\xa0\x9d'\x7f\x92\xbdk", }, }, 02: statement (string) = "DROP DATABASE IF EXISTS ucu3e4 CASCADE", 04: runAsync (bool) = false, } I1212 11:10:26.215812 2681 impala-server.cc:742] Parsed pool options: override_options_mask=1111111111111111111111111111111111111111111111111111111111111111 set_pool_mask=0000000000000000000000000000000000000000000000000000000000000000 overlay_mask=0000000000000000000000000000000000000000000000000000000000000000 I1212 11:10:26.215889 2681 impala-hs2-server.cc:261] TClientRequest.queryOptions: TQueryOptions { 01: abort_on_error (bool) = false, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 100, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, } I1212 11:10:26.218256 2681 impala-server.cc:812] Execution request: TExecRequest { 01: stmt_type (i32) = 1, 02: query_options (struct) = TQueryOptions { 01: abort_on_error (bool) = false, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, 15: hbase_caching (i32) = 0, 16: hbase_cache_blocks (bool) = false, 17: parquet_file_size (i64) = 0, 18: explain_level (i32) = 1, 19: sync_ddl (bool) = false, 23: disable_cached_reads (bool) = false, 24: disable_outermost_topn (bool) = false, 25: rm_initial_mem (i64) = 0, 26: query_timeout_s (i32) = 0, 28: appx_count_distinct (bool) = false, 29: disable_unsafe_spills (bool) = false, 31: exec_single_node_rows_threshold (i32) = 100, 32: optimize_partition_key_scans (bool) = false, 33: replica_preference (i32) = 0, 34: schedule_random_replica (bool) = false, 35: scan_node_codegen_threshold (i64) = 1800000, 36: disable_streaming_preaggregations (bool) = false, 37: runtime_filter_mode (i32) = 2, 38: runtime_bloom_filter_size (i32) = 1048576, 39: runtime_filter_wait_time_ms (i32) = 0, 40: disable_row_runtime_filtering (bool) = false, 41: max_num_runtime_filters (i32) = 10, 42: parquet_annotate_strings_utf8 (bool) = false, 43: parquet_fallback_schema_resolution (i32) = 0, 44: mt_dop (i32) = 0, 45: s3_skip_insert_staging (bool) = true, 46: runtime_filter_min_size (i32) = 1048576, 47: runtime_filter_max_size (i32) = 16777216, 48: prefetch_mode (i32) = 1, 49: strict_mode (bool) = false, 50: scratch_limit (i64) = -1, 51: enable_expr_rewrites (bool) = true, }, 04: catalog_op_request (struct) = TCatalogOpRequest { 01: op_type (i32) = 8, 07: ddl_params (struct) = TDdlExecRequest { 01: protocol_version (i32) = 0, 02: ddl_type (i32) = 9, 10: drop_db_params (struct) = TDropDbParams { 01: db (string) = "ucu3e4", 02: if_exists (bool) = true, 03: cascade (bool) = true, }, 17: header (struct) = TCatalogServiceRequestHeader { 01: requesting_user (string) = "mj", }, }, }, 05: result_set_metadata (struct) = TResultSetMetadata { 01: columns (list) = list[0] { }, }, 08: access_events (set) = set[1] { TAccessEvent { 01: name (string) = "ucu3e4", 02: object_type (i32) = 2, 03: privilege (string) = "DROP", }, }, 09: analysis_warnings (list) = list[0] { }, } I1212 11:10:26.218358 2681 client-cache.cc:46] GetClient(localhost:26000) I1212 11:10:26.218369 2681 client-cache.cc:56] GetClient(): returning cached client for localhost:26000 I1212 11:10:26.537839 2681 client-cache.cc:148] Releasing client for localhost:26000 back to cache I1212 11:10:26.545087 2681 thread.cc:288] Started thread 14956 - query-exec-state:wait-thread I1212 11:10:26.545147 2681 impala-hs2-server.cc:486] ExecuteStatement(): return_val=TExecuteStatementResp { 01: status (struct) = TStatus { 01: statusCode (i32) = 0, }, 02: operationHandle (struct) = TOperationHandle { 01: operationId (struct) = THandleIdentifier { 01: guid (string) = "4+\x82V\x84\xbfJ.\x00\x00\x00\x00-\xf4\x9f[", 02: secret (string) = "4+\x82V\x84\xbfJ.\x00\x00\x00\x00-\xf4\x9f[", }, 02: operationType (i32) = 0, 03: hasResultSet (bool) = false, }, } I1212 11:10:26.546005 2681 impala-hs2-server.cc:373] CloseSession(): request=TCloseSessionReq { 01: sessionHandle (struct) = TSessionHandle { 01: sessionId (struct) = THandleIdentifier { 01: guid (string) = "\xac\xc5\xc1k\x1b\xbfH\xf1\x9a\x84\xb5{\xe8\xc1\xb3\x8e", 02: secret (string) = "\x1a}\xe8\x11\xbb\x9eK\xb0\xb0\xa0\x9d'\x7f\x92\xbdk", }, }, } I1212 11:10:26.611441 2681 status.cc:114] Session closed @ 0x11cc7af impala::Status::Status() @ 0x147e95c impala::ImpalaServer::CloseSessionInternal() @ 0x14d36a8 impala::ImpalaServer::CloseSession() @ 0x1958d62 apache::hive::service::cli::thrift::TCLIServiceProcessor::process_CloseSession() @ 0x1958348 apache::hive::service::cli::thrift::TCLIServiceProcessor::dispatchCall() @ 0x1931f95 impala::ImpalaHiveServer2ServiceProcessor::dispatchCall() @ 0x117366e apache::thrift::TDispatchProcessor::process() @ 0x27d689b apache::thrift::server::TThreadPoolServer::Task::run() @ 0x27bf109 apache::thrift::concurrency::ThreadManager::Worker::run() @ 0x133a3bd impala::ThriftThread::RunRunnable() @ 0x133bae9 boost::_mfi::mf2<>::operator()() @ 0x133b97f boost::_bi::list3<>::operator()<>() @ 0x133b6cb boost::_bi::bind_t<>::operator()() @ 0x133b5de boost::detail::function::void_function_obj_invoker0<>::invoke() @ 0x1348fbc boost::function0<>::operator()() @ 0x15eeb13 impala::Thread::SuperviseThread() @ 0x15f5aec boost::_bi::list4<>::operator()<>() @ 0x15f5a2f boost::_bi::bind_t<>::operator()() @ 0x15f598a boost::detail::thread_data<>::run() @ 0x1a54fda thread_proxy @ 0x7f284362a184 start_thread @ 0x7f284335737d (unknown) I1212 11:10:26.611484 2681 impala-server.cc:907] UnregisterQuery(): query_id=2e4abf8456822b34:5b9ff42d00000000 I1212 11:10:26.611495 2681 impala-server.cc:993] Cancel(): query_id=2e4abf8456822b34:5b9ff42d00000000 I1212 11:10:26.612720 2615 impala-server.cc:1674] Connection from client ::ffff:127.0.0.1:46760 closed, closing 1 associated session(s) I1212 11:10:26.618371 2681 impala-server.cc:1674] Connection from client ::ffff:127.0.0.1:43399 closed, closing 5 associated session(s) I1212 11:10:26.659909 2615 status.cc:114] Session closed @ 0x11cc7af impala::Status::Status() @ 0x147e95c impala::ImpalaServer::CloseSessionInternal() @ 0x148477a impala::ImpalaServer::ConnectionEnd() @ 0x132f168 impala::ThriftServer::ThriftServerEventProcessor::deleteContext() @ 0x27d7373 apache::thrift::server::TThreadPoolServer::Task::run() @ 0x27bf109 apache::thrift::concurrency::ThreadManager::Worker::run() @ 0x133a3bd impala::ThriftThread::RunRunnable() @ 0x133bae9 boost::_mfi::mf2<>::operator()() @ 0x133b97f boost::_bi::list3<>::operator()<>() @ 0x133b6cb boost::_bi::bind_t<>::operator()() @ 0x133b5de boost::detail::function::void_function_obj_invoker0<>::invoke() @ 0x1348fbc boost::function0<>::operator()() @ 0x15eeb13 impala::Thread::SuperviseThread() @ 0x15f5aec boost::_bi::list4<>::operator()<>() @ 0x15f5a2f boost::_bi::bind_t<>::operator()() @ 0x15f598a boost::detail::thread_data<>::run() @ 0x1a54fda thread_proxy @ 0x7f284362a184 start_thread @ 0x7f284335737d (unknown) I1212 11:10:31.285907 2784 impala-server.cc:1289] Catalog topic entry deletion: DATABASE:ucu3e4 I1212 11:10:31.285939 2784 impala-server.cc:1289] Catalog topic entry deletion: TABLE:ucu3e4.lineitem I1212 11:10:51.336360 12482 thrift-util.cc:111] TSocket::write_partial() send() Broken pipe I1212 11:10:51.343284 12482 thrift-util.cc:111] TAcceptQueueServer client died: write() send(): Broken pipe I1212 11:10:51.343394 2780 thread.cc:288] Started thread 15002 - thrift-server:StatestoreSubscriber-3 I1212 11:10:51.343542 15002 thrift-util.cc:111] TSocket::write_partial() send() Broken pipe I1212 11:10:51.343585 15002 thrift-util.cc:111] TAcceptQueueServer client died: write() send(): Broken pipe I1212 11:10:51.354226 2780 thread.cc:288] Started thread 15006 - thrift-server:StatestoreSubscriber-4 I1212 11:10:59.890807 14692 kudu-scan-node.cc:324] Thread done: scanner-thread(1) I1212 11:10:59.891088 14648 query-exec-mgr.cc:103] Instance completed. instance_id=ca4e75b194e0a9f3:5cdfeeb700000003 I1212 11:10:59.891098 14648 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=ca4e75b194e0a9f3:5cdfeeb700000000 refcnt=1 I1212 11:11:03.275660 14926 kudu-scan-node.cc:324] Thread done: scanner-thread(1) I1212 11:11:03.275807 14882 query-exec-mgr.cc:103] Instance completed. instance_id=e4100828b01f01c:5a7c79e200000003 I1212 11:11:03.275813 14882 query-exec-mgr.cc:138] ReleaseQueryState(): query_id=e4100828b01f01c:5a7c79e200000000 refcnt=1