I0724 15:47:28.277457 32559 impala-beeswax-server.cc:133] query(): query=select * from rc I0724 15:47:28.277580 32559 impala-beeswax-server.cc:442] query: Query { 01: query (string) = "select * from rc", 03: configuration (list) = list[0] { }, 04: hadoop_user (string) = "mniemenm", } I0724 15:47:28.277653 32559 impala-beeswax-server.cc:454] TClientRequest.queryOptions: TQueryOptions { 01: abort_on_error (bool) = false, 02: max_errors (i32) = 0, 03: disable_codegen (bool) = false, 04: batch_size (i32) = 0, 05: num_nodes (i32) = 0, 06: max_scan_range_length (i64) = 0, 07: num_scanner_threads (i32) = 0, 08: max_io_buffers (i32) = 0, 09: allow_unsupported_formats (bool) = false, 10: default_order_by_limit (i64) = -1, 11: debug_action (string) = "", 12: mem_limit (i64) = 0, 13: abort_on_default_limit_exceeded (bool) = false, } 13/07/24 15:47:28 INFO service.Frontend: analyze query select * from rc 13/07/24 15:47:28 INFO metastore.HiveMetaStore: 1: get_table : db=default tbl=rc 13/07/24 15:47:28 INFO HiveMetaStore.audit: ugi=mniemenm ip=unknown-ip-addr cmd=get_table : db=default tbl=rc 13/07/24 15:47:28 INFO metastore.HiveMetaStore: 1: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore 13/07/24 15:47:28 INFO metastore.ObjectStore: ObjectStore, initialize called 13/07/24 15:47:28 INFO metastore.ObjectStore: Initialized ObjectStore 13/07/24 15:47:28 INFO DataNucleus.MetaData: Listener found initialisation for persistable class org.apache.hadoop.hive.metastore.model.MColumnDescriptor 13/07/24 15:47:28 INFO DataNucleus.MetaData: Listener found initialisation for persistable class org.apache.hadoop.hive.metastore.model.MSerDeInfo 13/07/24 15:47:28 INFO DataNucleus.MetaData: Listener found initialisation for persistable class org.apache.hadoop.hive.metastore.model.MStorageDescriptor 13/07/24 15:47:28 INFO DataNucleus.MetaData: Listener found initialisation for persistable class org.apache.hadoop.hive.metastore.model.MTable 13/07/24 15:47:28 INFO DataNucleus.MetaData: Listener found initialisation for persistable class org.apache.hadoop.hive.metastore.model.MFieldSchema 13/07/24 15:47:28 INFO catalog.HdfsTable: load table rc 13/07/24 15:47:28 INFO metastore.HiveMetaStore: 1: get_config_value: name=hive.exec.default.partition.name defaultValue=__HIVE_DEFAULT_PARTITION__ 13/07/24 15:47:28 INFO HiveMetaStore.audit: ugi=mniemenm ip=unknown-ip-addr cmd=get_config_value: name=hive.exec.default.partition.name defaultValue=__HIVE_DEFAULT_PARTITION__ 13/07/24 15:47:28 INFO metastore.HiveMetaStore: 1: get_fields: db=defaulttbl=rc 13/07/24 15:47:28 INFO HiveMetaStore.audit: ugi=mniemenm ip=unknown-ip-addr cmd=get_fields: db=defaulttbl=rc 13/07/24 15:47:28 INFO metastore.HiveMetaStore: 1: get_table : db=default tbl=rc 13/07/24 15:47:28 INFO HiveMetaStore.audit: ugi=mniemenm ip=unknown-ip-addr cmd=get_table : db=default tbl=rc 13/07/24 15:47:28 INFO metastore.HiveMetaStore: 1: get_column_statistics_by_table: db=default table=rc column=a 13/07/24 15:47:28 INFO HiveMetaStore.audit: ugi=mniemenm ip=unknown-ip-addr cmd=get_column_statistics_by_table: db=default table=rc column=a 13/07/24 15:47:28 INFO DataNucleus.Datastore: The class "org.apache.hadoop.hive.metastore.model.MFieldSchema" is tagged as "embedded-only" so does not have its own datastore table. 13/07/24 15:47:28 INFO DataNucleus.Datastore: The class "org.apache.hadoop.hive.metastore.model.MOrder" is tagged as "embedded-only" so does not have its own datastore table. 13/07/24 15:47:28 INFO DataNucleus.Persistence: Managing Persistence of Class : org.apache.hadoop.hive.metastore.model.MTableColumnStatistics [Table : `TAB_COL_STATS`, InheritanceStrategy : new-table] 13/07/24 15:47:28 INFO metastore.HiveMetaStore: 1: get_column_statistics_by_table: db=default table=rc column=b 13/07/24 15:47:28 INFO HiveMetaStore.audit: ugi=mniemenm ip=unknown-ip-addr cmd=get_column_statistics_by_table: db=default table=rc column=b 13/07/24 15:47:28 INFO metastore.HiveMetaStore: 1: get_partitions : db=default tbl=rc 13/07/24 15:47:28 INFO HiveMetaStore.audit: ugi=mniemenm ip=unknown-ip-addr cmd=get_partitions : db=default tbl=rc 13/07/24 15:47:28 INFO DataNucleus.Datastore: The class "org.apache.hadoop.hive.metastore.model.MFieldSchema" is tagged as "embedded-only" so does not have its own datastore table. 13/07/24 15:47:28 INFO DataNucleus.Datastore: The class "org.apache.hadoop.hive.metastore.model.MOrder" is tagged as "embedded-only" so does not have its own datastore table. 13/07/24 15:47:28 INFO DataNucleus.Persistence: Managing Persistence of Class : org.apache.hadoop.hive.metastore.model.MPartition [Table : `PARTITIONS`, InheritanceStrategy : new-table] 13/07/24 15:47:28 INFO DataNucleus.Persistence: Managing Persistence of Field : org.apache.hadoop.hive.metastore.model.MPartition.parameters [Table : `PARTITION_PARAMS`] 13/07/24 15:47:28 INFO DataNucleus.Persistence: Managing Persistence of Field : org.apache.hadoop.hive.metastore.model.MPartition.values [Table : `PARTITION_KEY_VALS`] 13/07/24 15:47:28 INFO catalog.HdfsTable: load partition block md for rc 13/07/24 15:47:28 INFO catalog.HdfsTable: loaded partition PartitionBlockMetadata{#blocks=0, #filenames=0, totalStringLen=0} 13/07/24 15:47:28 INFO catalog.HdfsTable: loaded partition PartitionBlockMetadata{#blocks=1, #filenames=1, totalStringLen=70} 13/07/24 15:47:28 INFO catalog.HdfsTable: loaded disk ids for table default.rc 13/07/24 15:47:28 INFO catalog.HdfsTable: 1 13/07/24 15:47:28 INFO catalog.HdfsTable: table #rows=-1 13/07/24 15:47:28 INFO service.Frontend: create plan 13/07/24 15:47:28 INFO planner.Planner: create single-node plan 13/07/24 15:47:28 INFO planner.HdfsScanNode: collecting partitions for table rc 13/07/24 15:47:28 INFO planner.HdfsScanNode: finalize HdfsScan: cardinality=-1 13/07/24 15:47:28 INFO planner.HdfsScanNode: finalize HdfsScan: #nodes=1 13/07/24 15:47:28 INFO planner.Planner: create plan fragments 13/07/24 15:47:28 INFO planner.Planner: memlimit=0 13/07/24 15:47:28 INFO planner.Planner: finalize plan fragments 13/07/24 15:47:28 INFO service.Frontend: get scan range locations 13/07/24 15:47:28 INFO service.Frontend: create result set metadata 13/07/24 15:47:28 INFO service.JniFrontend: PLAN FRAGMENT 0 PARTITION: UNPARTITIONED 1:EXCHANGE tuple ids: 0 PLAN FRAGMENT 1 PARTITION: RANDOM STREAM DATA SINK EXCHANGE ID: 1 UNPARTITIONED 0:SCAN HDFS table=default.rc #partitions=1 size=146B tuple ids: 0 I0724 15:47:28.851907 32559 coordinator.cc:291] Exec() query_id=34ff0bc1e0ad092:c0105d3500821490 I0724 15:47:28.852164 32559 simple-scheduler.cc:346] SimpleScheduler assignment (data->backend): (10.11.253.220:43619 -> cn220:22000) I0724 15:47:28.852205 32559 coordinator.cc:1445] Total remote scan volume = 146.00 B I0724 15:47:28.852223 32559 coordinator.cc:1447] Total local scan volume = 0.00 I0724 15:47:28.852258 32559 coordinator.cc:1458] ScanRangeAssignment: server=TNetworkAddress { 01: hostname (string) = "cn220", 02: port (i32) = 22000, } I0724 15:47:28.852293 32559 coordinator.cc:1464] node_id=0 ranges=TScanRangeParams { 01: scan_range (struct) = TScanRange { 01: hdfs_file_split (struct) = THdfsFileSplit { 01: path (string) = "hdfs://cn01-ib:8020/user/hive/warehouse/rc/000000_0", 02: offset (i64) = 0, 03: length (i64) = 146, 04: partition_id (i64) = 0, 05: file_length (i64) = 146, }, }, 02: volume_id (i32) = 0, } I0724 15:47:28.852346 32559 coordinator.cc:1243] dest for fragment 1: instance_id=34ff0bc1e0ad092:c0105d3500821491 server=cn220:22000 I0724 15:47:28.852396 32559 plan-fragment-executor.cc:74] Prepare(): query_id=34ff0bc1e0ad092:c0105d3500821490 instance_id=34ff0bc1e0ad092:c0105d3500821491 I0724 15:47:28.852443 32559 plan-fragment-executor.cc:76] params: TPlanFragmentExecParams { 01: query_id (struct) = TUniqueId { 01: hi (i64) = 238673996022468754, 02: lo (i64) = -4607079936576842608, }, 02: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 238673996022468754, 02: lo (i64) = -4607079936576842607, }, 03: per_node_scan_ranges (map) = map[0] { }, 04: per_exch_num_senders (map) = map[1] { 1 -> 1, }, 05: destinations (list) = list[0] { }, } I0724 15:47:28.859452 32559 plan-fragment-executor.cc:114] descriptor table for fragment=34ff0bc1e0ad092:c0105d3500821491 tuples: Tuple(id=0 size=40 slots=[Slot(id=0 type=STRING col=0 offset=8 null=(offset=0 mask=1)), Slot(id=1 type=STRING col=1 offset=24 null=(offset=0 mask=2))]) I0724 15:47:28.859591 32559 exchange-node.cc:50] Exch id=1 input_desc=Tuple(id=0 size=40 slots=[Slot(id=0 type=STRING col=0 offset=8 null=(offset=0 mask=1)), Slot(id=1 type=STRING col=1 offset=24 null=(offset=0 mask=2))]) output_desc=Tuple(id=0 size=40 slots=[Slot(id=0 type=STRING col=0 offset=8 null=(offset=0 mask=1)), Slot(id=1 type=STRING col=1 offset=24 null=(offset=0 mask=2))]) I0724 15:47:28.859613 32559 data-stream-mgr.cc:197] creating receiver for fragment=34ff0bc1e0ad092:c0105d3500821491, node=1 I0724 15:47:28.859678 32559 plan-fragment-executor.cc:176] plan_root= ExchangeNode(#senders=1 conjuncts=[]) I0724 15:47:28.937937 32559 coordinator.cc:394] starting 1 backends for query 34ff0bc1e0ad092:c0105d3500821490 I0724 15:47:28.938055 32559 coordinator.cc:418] Exec(): starting instance: fragment_idx=1 instance_id=34ff0bc1e0ad092:c0105d3500821492 I0724 15:47:28.938276 32708 coordinator.cc:811] making rpc: ExecPlanFragment query_id=34ff0bc1e0ad092:c0105d3500821490 instance_id=34ff0bc1e0ad092:c0105d3500821492 host=cn220:22000 I0724 15:47:28.938333 32708 client-cache.cc:44] GetClient(cn220:22000) I0724 15:47:28.938393 32708 client-cache.cc:98] CreateClient(): adding new client for cn220:22000 I0724 15:47:28.938853 32709 impala-server.cc:1467] ExecPlanFragment() instance_id=34ff0bc1e0ad092:c0105d3500821492 coord=cn220:22000 backend#=0 I0724 15:47:28.938910 32709 plan-fragment-executor.cc:74] Prepare(): query_id=34ff0bc1e0ad092:c0105d3500821490 instance_id=34ff0bc1e0ad092:c0105d3500821492 I0724 15:47:28.938989 32709 plan-fragment-executor.cc:76] params: TPlanFragmentExecParams { 01: query_id (struct) = TUniqueId { 01: hi (i64) = 238673996022468754, 02: lo (i64) = -4607079936576842608, }, 02: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 238673996022468754, 02: lo (i64) = -4607079936576842606, }, 03: per_node_scan_ranges (map) = map[1] { 0 -> list[1] { [0] = TScanRangeParams { 01: scan_range (struct) = TScanRange { 01: hdfs_file_split (struct) = THdfsFileSplit { 01: path (string) = "hdfs://cn01-ib:8020/user/hive/warehouse/rc/000000_0", 02: offset (i64) = 0, 03: length (i64) = 146, 04: partition_id (i64) = 0, 05: file_length (i64) = 146, }, }, 02: volume_id (i32) = 0, }, }, }, 04: per_exch_num_senders (map) = map[0] { }, 05: destinations (list) = list[1] { [0] = TPlanFragmentDestination { 01: fragment_instance_id (struct) = TUniqueId { 01: hi (i64) = 238673996022468754, 02: lo (i64) = -4607079936576842607, }, 02: server (struct) = TNetworkAddress { 01: hostname (string) = "cn220", 02: port (i32) = 22000, }, }, }, } I0724 15:47:28.944716 32709 plan-fragment-executor.cc:114] descriptor table for fragment=34ff0bc1e0ad092:c0105d3500821492 tuples: Tuple(id=0 size=40 slots=[Slot(id=0 type=STRING col=0 offset=8 null=(offset=0 mask=1)), Slot(id=1 type=STRING col=1 offset=24 null=(offset=0 mask=2))]) I0724 15:47:28.962899 32709 plan-fragment-executor.cc:204] Hdfs split stats (:<# splits>/) for query=34ff0bc1e0ad092:c0105d3500821490: 0:1/146.00 B I0724 15:47:28.962996 32709 plan-fragment-executor.cc:176] plan_root= conjuncts=[] I0724 15:47:29.049727 32708 client-cache.cc:120] releasing client for cn220:22000 I0724 15:47:29.049832 32710 plan-fragment-executor.cc:210] Open(): instance_id=34ff0bc1e0ad092:c0105d3500821492 I0724 15:47:29.049887 32559 coordinator.cc:716] Byte split for fragment 1 min: 146.00 B, max: 146.00 B, avg: 146.00 B, stddev: 0.00 I0724 15:47:29.049940 32559 coordinator.cc:720] data volume for ipaddress 0x4e03000: 146.00 B I0724 15:47:29.049983 32711 plan-fragment-executor.cc:287] ReportProfile(): instance_id=34ff0bc1e0ad092:c0105d3500821492 I0724 15:47:29.050212 32712 plan-fragment-executor.cc:210] Open(): instance_id=34ff0bc1e0ad092:c0105d3500821491 I0724 15:47:29.050472 32713 disk-io-mgr.cc:957] GetNext(): reader= Reader: 0xbbe8820 (state=Active sync_reader=false status_ = OK buffer_quota=4 min_buffers=4 #ready_buffers=0 #used_buffers=0 #num_buffers_in_reader=0 #num_buffers_in_disk_threads_=0 #finished_scan_ranges=0 #remaining_scan_ranges=1 #committed_ranges=0 #disk_with_ranges=1 #disks=1 0: is_on_queue=1 done=0 #num_remaining_scan_ranges=1 #in_flight_ranges=0 #unscheduled_ranges=1 #committed_ranges=0 #reading_threads=0 1: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=0 2: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=0) I0724 15:47:29.050508 32713 disk-io-mgr.cc:962] GetNext: Waiting 0xbbe8820 I0724 15:47:29.050606 32524 disk-io-mgr.cc:1666] Disk (id=0) reading for Reader: 0xbbe8820 (state=Active sync_reader=false status_ = OK buffer_quota=4 min_buffers=4 #ready_buffers=0 #used_buffers=0 #num_buffers_in_reader=0 #num_buffers_in_disk_threads_=0 #finished_scan_ranges=0 #remaining_scan_ranges=1 #committed_ranges=0 #disk_with_ranges=1 #disks=1 0: is_on_queue=0 done=0 #num_remaining_scan_ranges=1 #in_flight_ranges=0 #unscheduled_ranges=1 #committed_ranges=0 #reading_threads=1 1: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=0 2: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=0) I0724 15:47:29.051177 32559 impala-beeswax-server.cc:314] get_state(): query_id=34ff0bc1e0ad092:c0105d3500821490 I0724 15:47:29.051826 32559 impala-beeswax-server.cc:266] get_results_metadata(): query_id=34ff0bc1e0ad092:c0105d3500821490 I0724 15:47:29.052845 32559 impala-beeswax-server.cc:250] fetch(): query_id=34ff0bc1e0ad092:c0105d3500821490 fetch_size=1024 I0724 15:47:29.052904 32559 coordinator.cc:645] GetNext() query_id=34ff0bc1e0ad092:c0105d3500821490 I0724 15:47:29.052935 32559 plan-fragment-executor.cc:356] GetNext(): instance_id=34ff0bc1e0ad092:c0105d3500821491 I0724 15:47:29.052965 32559 data-stream-mgr.cc:63] wait arrival fragment_instance_id=34ff0bc1e0ad092:c0105d3500821491 node=1 I0724 15:47:29.099831 32524 disk-io-mgr.cc:1666] Disk (id=0) reading for Reader: 0xbbe8820 (state=Active sync_reader=false status_ = OK buffer_quota=4 min_buffers=4 #ready_buffers=1 #used_buffers=1 #num_buffers_in_reader=0 #num_buffers_in_disk_threads_=0 #finished_scan_ranges=0 #remaining_scan_ranges=1 #committed_ranges=0 #disk_with_ranges=1 #disks=1 0: is_on_queue=0 done=0 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=1 1: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=0 2: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=0) I0724 15:47:29.100065 32713 disk-io-mgr.cc:957] GetNext(): reader= Reader: 0xbbe8820 (state=Active sync_reader=false status_ = OK buffer_quota=8 min_buffers=4 #ready_buffers=0 #used_buffers=0 #num_buffers_in_reader=1 #num_buffers_in_disk_threads_=0 #finished_scan_ranges=1 #remaining_scan_ranges=0 #committed_ranges=0 #disk_with_ranges=0 #disks=0 0: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=0 1: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=0 2: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=0) I0724 15:47:29.100087 32713 disk-io-mgr.cc:962] GetNext: Waiting 0xbbe8820 I0724 15:47:29.100143 32717 hdfs-rcfile-scanner.cc:176] hdfs://cn01-ib:8020/user/hive/warehouse/rc/000000_0: compressed I0724 15:47:29.100183 32717 hdfs-rcfile-scanner.cc:178] org.apache.hadoop.io.compress.SnappyCodec I0724 15:47:29.100265 32524 disk-io-mgr.cc:1666] Disk (id=0) reading for Reader: 0xbbe8820 (state=Active sync_reader=false status_ = OK buffer_quota=8 min_buffers=4 #ready_buffers=0 #used_buffers=0 #num_buffers_in_reader=1 #num_buffers_in_disk_threads_=0 #finished_scan_ranges=1 #remaining_scan_ranges=1 #committed_ranges=0 #disk_with_ranges=1 #disks=1 0: is_on_queue=0 done=0 #num_remaining_scan_ranges=1 #in_flight_ranges=0 #unscheduled_ranges=1 #committed_ranges=0 #reading_threads=1 1: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=0 2: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=0) I0724 15:47:29.103093 32524 disk-io-mgr.cc:1666] Disk (id=0) reading for Reader: 0xbbe8820 (state=Active sync_reader=false status_ = OK buffer_quota=8 min_buffers=4 #ready_buffers=1 #used_buffers=1 #num_buffers_in_reader=0 #num_buffers_in_disk_threads_=0 #finished_scan_ranges=1 #remaining_scan_ranges=1 #committed_ranges=0 #disk_with_ranges=1 #disks=1 0: is_on_queue=0 done=0 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=1 1: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=0 2: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=0) I0724 15:47:29.103375 32713 disk-io-mgr.cc:957] GetNext(): reader= Reader: 0xbbe8820 (state=Active sync_reader=false status_ = OK buffer_quota=16 min_buffers=4 #ready_buffers=0 #used_buffers=0 #num_buffers_in_reader=1 #num_buffers_in_disk_threads_=0 #finished_scan_ranges=2 #remaining_scan_ranges=0 #committed_ranges=0 #disk_with_ranges=0 #disks=0 0: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=0 1: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=0 2: is_on_queue=0 done=1 #num_remaining_scan_ranges=0 #in_flight_ranges=0 #unscheduled_ranges=0 #committed_ranges=0 #reading_threads=0) I0724 15:47:29.103410 32713 disk-io-mgr.cc:962] GetNext: Waiting 0xbbe8820 I0724 15:47:29.105597 32718 status.cc:42] Decompressor: block size is too big. Data is likely corrupt. Size: 0 @ 0xdc266f (unknown) @ 0xce2cf6 (unknown) @ 0xce3357 (unknown) @ 0xeeb177 (unknown) @ 0xeea273 (unknown) @ 0xeeb31b (unknown) @ 0xf3518d (unknown) @ 0xecca59 (unknown) @ 0xedf29e (unknown) @ 0xedf164 (unknown) @ 0xedf08b (unknown) @ 0xedec98 (unknown) @ 0xf7e243 (unknown) @ 0x31cc807851 (unknown) @ 0x31cc0e890d (unknown) I0724 15:47:29.105687 32718 progress-updater.cc:46] Splits complete (node=0): 100% Complete (1 out of 1) I0724 15:47:29.105911 32710 data-stream-sender.cc:249] Channel::Close() instance_id=34ff0bc1e0ad092:c0105d3500821491 dest_node=1 #rows= 0 I0724 15:47:29.105955 32710 client-cache.cc:44] GetClient(cn220:22000) I0724 15:47:29.105980 32710 client-cache.cc:55] GetClient(): cached client for cn220:22000 I0724 15:47:29.106003 32710 data-stream-sender.cc:271] calling TransmitData to close channel I0724 15:47:29.106119 32709 impala-server.cc:1514] TransmitData(): instance_id=34ff0bc1e0ad092:c0105d3500821491 node_id=1 #rows=0 eos=true I0724 15:47:29.106168 32709 data-stream-mgr.cc:254] CloseSender(): fragment_instance_id=34ff0bc1e0ad092:c0105d3500821491, node=1 I0724 15:47:29.106196 32709 data-stream-mgr.cc:211] looking up fragment_instance_id=34ff0bc1e0ad092:c0105d3500821491, node=1 I0724 15:47:29.106225 32709 data-stream-mgr.cc:159] decremented senders: fragment_instance_id=34ff0bc1e0ad092:c0105d3500821491 node_id=1 #senders=0 I0724 15:47:29.106273 32559 exchange-node.cc:106] exch: has batch=false #rows=0 is_cancelled=false instance_id=34ff0bc1e0ad092:c0105d3500821491 I0724 15:47:29.106317 32559 plan-fragment-executor.cc:360] Finished executing fragment query_id=34ff0bc1e0ad092:c0105d3500821490 instance_id=34ff0bc1e0ad092:c0105d3500821491 I0724 15:47:29.106335 32710 client-cache.cc:120] releasing client for cn220:22000 I0724 15:47:29.106338 32559 coordinator.cc:588] Coordinator waiting for backends to finish, 1 remaining I0724 15:47:29.106439 32711 plan-fragment-executor.cc:327] exiting reporting thread: instance_id=34ff0bc1e0ad092:c0105d3500821492 I0724 15:47:29.106531 32710 client-cache.cc:44] GetClient(cn220:22000) I0724 15:47:29.106569 32710 client-cache.cc:55] GetClient(): cached client for cn220:22000 I0724 15:47:29.106991 32709 impala-server.cc:1474] ReportExecStatus() query_id=34ff0bc1e0ad092:c0105d3500821490 backend#=0 instance_id=34ff0bc1e0ad092:c0105d3500821492 done=true I0724 15:47:29.107035 32709 coordinator.cc:951] UpdateFragmentExecStatus() query_id=34ff0bc1e0ad092:c0105d3500821490 status=0 done=true I0724 15:47:29.107210 32709 coordinator.cc:992] instance_id=34ff0bc1e0ad092:c0105d3500821492 error log: Format error in record or block header at offset: 0 First error while processing: hdfs://cn01-ib:8020/user/hive/warehouse/rc/000000_0 at offset: 133 I0724 15:47:29.107245 32709 progress-updater.cc:46] Query 34ff0bc1e0ad092:c0105d3500821490 100% Complete (1 out of 1) I0724 15:47:29.107517 32709 coordinator.cc:1015] profile for query_id=34ff0bc1e0ad092:c0105d3500821490 instance_id=34ff0bc1e0ad092:c0105d3500821492 Instance 34ff0bc1e0ad092:c0105d3500821492 (host=cn220:22000):(Active: 55.681ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/146.00 B - AverageThreadTokens: 0.00 - RowsProduced: 0 CodeGen:(Active: 92.38ms, % non-child: 0.00%) - CodegenTime: 2.105ms - CompileTime: 86.431ms - LoadTime: 5.605ms - ModuleFileSize: 74.45 KB DataStreamSender (dst_id=1):(Active: 23.687us, % non-child: 0.00%) - BytesSent: 0.00 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0.00 HDFS_SCAN_NODE (id=0):(Active: 55.374ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/146.00 B Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% File Formats: RC_FILE/SNAPPY_BLOCKED:1 ExecOption: Codegen enabled: 0 out of 2 - AverageHdfsReadThreadConcurrency: 0.00 - AverageIoMgrQueueCapacity: 0.00 - AverageIoMgrQueueSize: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 292.00 B - BytesSkipped: 13.00 B - DecompressionTime: 0ns - MemoryUsed: 8.00 B - NumDisksAccessed: 1 - PerReadThreadRawHdfsThroughput: 595.67 KB/sec - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 2.545ms - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 999.0us - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 14 - TotalRawHdfsReadTime(*): 478.719us - TotalReadThroughput: 0.00 /sec I0724 15:47:29.107699 32709 coordinator.cc:1024] cumulative profile for query_id=34ff0bc1e0ad092:c0105d3500821490 Execution Profile 34ff0bc1e0ad092:c0105d3500821490:(Active: 197.932ms, % non-child: 0.00%) - FinalizationTimer: 0ns Coordinator Fragment:(Active: 53.350ms, % non-child: 0.00%) - AverageThreadTokens: 0.00 - RowsProduced: 0 CodeGen:(Active: 84.674ms, % non-child: 0.00%) - CodegenTime: 190.439us - CompileTime: 77.897ms - LoadTime: 6.775ms - ModuleFileSize: 74.45 KB EXCHANGE_NODE (id=1):(Active: 53.347ms, % non-child: 0.00%) - BytesReceived: 0.00 - ConvertRowBatchTime: 486ns - DataArrivalWaitTime: 53.278ms - DeserializeRowBatchTimer: 0ns - FirstBatchArrivalWaitTime: 0ns - MemoryUsed: 0.00 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment 1: split sizes: min: 146.00 B, max: 146.00 B, avg: 146.00 B, stddev: 0.00 Fragment 1: I0724 15:47:29.107743 32709 coordinator.cc:1040] Backend 0 completed, 0 remaining: query_id=34ff0bc1e0ad092:c0105d3500821490 I0724 15:47:29.107776 32559 coordinator.cc:593] All backends finished or error. I0724 15:47:29.107897 32710 client-cache.cc:120] releasing client for cn220:22000 I0724 15:47:29.108005 32713 hdfs-scan-node.cc:739] Disk thread done (node=0) I0724 15:47:29.108610 32559 coordinator.cc:1173] Final profile for query_id=34ff0bc1e0ad092:c0105d3500821490 Execution Profile 34ff0bc1e0ad092:c0105d3500821490:(Active: 197.932ms, % non-child: 0.00%) - FinalizationTimer: 0ns Coordinator Fragment:(Active: 53.350ms, % non-child: 0.00%) - AverageThreadTokens: 0.00 - RowsProduced: 0 CodeGen:(Active: 84.674ms, % non-child: 100.00%) - CodegenTime: 190.439us - CompileTime: 77.897ms - LoadTime: 6.775ms - ModuleFileSize: 74.45 KB EXCHANGE_NODE (id=1):(Active: 53.347ms, % non-child: 99.99%) - BytesReceived: 0.00 - ConvertRowBatchTime: 486ns - DataArrivalWaitTime: 53.278ms - DeserializeRowBatchTimer: 0ns - FirstBatchArrivalWaitTime: 0ns - MemoryUsed: 0.00 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment 1:(Active: 55.681ms, % non-child: 0.00%) split sizes: min: 146.00 B, max: 146.00 B, avg: 146.00 B, stddev: 0.00 completion times: min:58.22ms max:58.22ms mean: 58.22ms stddev:0ns execution rates: min:2.46 KB/sec max:2.46 KB/sec mean:2.46 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - RowsProduced: 0 CodeGen:(Active: 92.38ms, % non-child: 100.00%) - CodegenTime: 2.105ms - CompileTime: 86.431ms - LoadTime: 5.605ms - ModuleFileSize: 74.45 KB DataStreamSender (dst_id=1):(Active: 23.687us, % non-child: 0.04%) - BytesSent: 0.00 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0.00 HDFS_SCAN_NODE (id=0):(Active: 55.374ms, % non-child: 99.45%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageIoMgrQueueCapacity: 0.00 - AverageIoMgrQueueSize: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 292.00 B - BytesSkipped: 13.00 B - DecompressionTime: 0ns - MemoryUsed: 8.00 B - NumDisksAccessed: 1 - PerReadThreadRawHdfsThroughput: 595.67 KB/sec - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 2.545ms - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 999.0us - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 14 - TotalRawHdfsReadTime(*): 478.719us - TotalReadThroughput: 0.00 /sec Fragment 1: Instance 34ff0bc1e0ad092:c0105d3500821492 (host=cn220:22000):(Active: 55.681ms, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/146.00 B - AverageThreadTokens: 0.00 - RowsProduced: 0 CodeGen:(Active: 92.38ms, % non-child: 100.00%) - CodegenTime: 2.105ms - CompileTime: 86.431ms - LoadTime: 5.605ms - ModuleFileSize: 74.45 KB DataStreamSender (dst_id=1):(Active: 23.687us, % non-child: 0.04%) - BytesSent: 0.00 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0.00 HDFS_SCAN_NODE (id=0):(Active: 55.374ms, % non-child: 99.45%) Hdfs split stats (:<# splits>/): 0:1/146.00 B Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% File Formats: RC_FILE/SNAPPY_BLOCKED:1 ExecOption: Codegen enabled: 0 out of 2 - AverageHdfsReadThreadConcurrency: 0.00 - AverageIoMgrQueueCapacity: 0.00 - AverageIoMgrQueueSize: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 292.00 B - BytesSkipped: 13.00 B - DecompressionTime: 0ns - MemoryUsed: 8.00 B - NumDisksAccessed: 1 - PerReadThreadRawHdfsThroughput: 595.67 KB/sec - RowsRead: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 2.545ms - MaterializeTupleTime(*): 0ns - ScannerThreadsSysTime: 999.0us - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 14 - TotalRawHdfsReadTime(*): 478.719us - TotalReadThroughput: 0.00 /sec I0724 15:47:29.108664 32559 impala-beeswax-server.cc:253] fetch result: #results=0 has_more=false I0724 15:47:29.109460 32559 impala-beeswax-server.cc:301] close(): query_id=34ff0bc1e0ad092:c0105d3500821490 I0724 15:47:29.109493 32559 impala-server.cc:1023] UnregisterQuery(): query_id=34ff0bc1e0ad092:c0105d3500821490 I0724 15:47:29.109522 32559 impala-server.cc:1315] Cancel(): query_id=34ff0bc1e0ad092:c0105d3500821490 I0724 15:47:29.114972 32559 data-stream-mgr.cc:274] DeregisterRecvr(): fragment_instance_id=34ff0bc1e0ad092:c0105d3500821491, node=1 I0724 15:47:29.115017 32559 data-stream-mgr.cc:170] cancelled stream: fragment_instance_id_=34ff0bc1e0ad092:c0105d3500821491 node_id=1