Query (id=0c480a423d817907:24a7839a00000000) Summary Session ID: b7453bdbf3d0ff00:5126c6a67845448a Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2021-11-25 15:02:11.973516000 End Time: 2021-11-25 15:02:12.037890000 Query Type: DML Query State: EXCEPTION Query Status: TableLoadingException: Error loading metadata for table: some_table CAUSED BY: MetaException: Object with id "" is managed by a different persistence manager Impala Version: impalad version 3.2.0-cdh6.3.2 RELEASE (build 1bb9836227301b839a32c6bc230e35439d5984ac) User: some_user Connected User: some_user Delegated User: Network Address: 10.79.85.158:48058 Default Db: default Sql Statement: -- job_name: some_job -- op_id: some_job-1637852340-475mq INSERT INTO some_table (source_job_name, output_database, table_name, data_last_updated_on_UTC) VALUES ('value1','value3','value2', CAST('2021-11-25 15:02:11.811938' as timestamp)) Coordinator: some-sever.com:22000 Query Options (set by configuration): REQUEST_POOL=root,SCRATCH_LIMIT=107374182400,EXEC_TIME_LIMIT_S=3600 Query Options (set by configuration and planner): NUM_NODES=1,NUM_SCANNER_THREADS=1,REQUEST_POOL=root,RUNTIME_FILTER_MODE=0,MT_DOP=0,SCRATCH_LIMIT=107374182400,EXEC_TIME_LIMIT_S=3600 Plan: ---------------- Max Per-Host Resource Reservation: Memory=0B Threads=1 Per-Host Resource Estimates: Memory=10MB Codegen disabled by planner Analyzed query: SELECT 'value1', 'value3', 'value2', TIMESTAMP '2021-11-25 15:02:11.811938000' UNION SELECT 'value1', 'value3', 'value2', TIMESTAMP '2021-11-25 15:02:11.811938000' F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=52B mem-reservation=0B thread-reservation=1 WRITE TO HDFS [some_table, OVERWRITE=false] | partitions=1 | mem-estimate=52B mem-reservation=0B thread-reservation=0 | 00:UNION constant-operands=1 mem-estimate=0B mem-reservation=0B thread-reservation=0 tuple-ids=0 row-size=52B cardinality=1 in pipelines: ---------------- Estimated Per-Host Mem: 10485760 Per Host Min Memory Reservation: some-sever.com:22000(0) Request Pool: root Admission result: Admitted immediately Cluster Memory Admitted: 2.00 GB ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------- F00:HDFS WRITER 1 31.395ms 31.395ms 50.00 KB 52.00 B 00:UNION 1 159.358us 159.358us 1 1 0 0 Errors: - AdmissionControlTimeSinceLastUpdate: 44ms (44000000) - ComputeScanRangeAssignmentTimer: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalTime: 0ns (0) Query Compilation Metadata of all 1 tables cached: 2ms (2953827) Analysis finished: 4ms (4951144) Value transfer graph computed: 4ms (4968813) Single node plan created: 5ms (5003115) Distributed plan created: 5ms (5024152) Lineage info computed: 5ms (5064449) Planning finished: 11ms (11317162) Query Timeline Query submitted: 33.90us (33900) Planning finished: 11ms (11892971) Submit for admission: 12ms (12584751) Completed admission: 12ms (12780789) Ready to start on 1 backends: 12ms (12878377) All 1 execution backends (1 fragment instances) started: 13ms (13828137) Last row fetched: 64ms (64319374) Released admission control resources: 64ms (64368779) DML data written: 64ms (64700856) Request finished: 20.56s (20556809362) Unregister query: 20.69s (20689150531) Frontend - CatalogFetch.ColumnStats.Misses: 4 (4) - CatalogFetch.ColumnStats.Requests: 4 (4) - CatalogFetch.ColumnStats.Time: 0 (0) - CatalogFetch.Config.Hits: 1 (1) - CatalogFetch.Config.Requests: 1 (1) - CatalogFetch.Config.Time: 0 (0) - CatalogFetch.DatabaseList.Hits: 1 (1) - CatalogFetch.DatabaseList.Requests: 1 (1) - CatalogFetch.DatabaseList.Time: 0 (0) - CatalogFetch.PartitionLists.Misses: 1 (1) - CatalogFetch.PartitionLists.Requests: 1 (1) - CatalogFetch.PartitionLists.Time: 0 (0) - CatalogFetch.Partitions.Hits: 2 (2) - CatalogFetch.Partitions.Misses: 1 (1) - CatalogFetch.Partitions.Requests: 3 (3) - CatalogFetch.Partitions.Time: 5 (5) - CatalogFetch.RPCs.Bytes: 105.2 KiB (107739) - CatalogFetch.RPCs.Requests: 4 (4) - CatalogFetch.RPCs.Time: 2 (2) - CatalogFetch.TableNames.Hits: 2 (2) - CatalogFetch.TableNames.Requests: 2 (2) - CatalogFetch.TableNames.Time: 0 (0) - CatalogFetch.Tables.Misses: 1 (1) - CatalogFetch.Tables.Requests: 1 (1) - CatalogFetch.Tables.Time: 0 (0) - InactiveTotalTime: 0ns (0) - TotalTime: 0ns (0) ImpalaServer - ClientFetchWaitTimer: 0ns (0) - InactiveTotalTime: 0ns (0) - MetastoreUpdateTimer: 20.49s (20492099351) - RowMaterializationTimer: 0ns (0) - TotalTime: 0ns (0) Execution Profile 0c480a423d817907:24a7839a00000000 Backend startup latencies: Count: 1, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms Slowest backend to start up: some-sever.com:22000 Per Node Peak Memory Usage: some-sever.com:22000(217.00 KB) Per Node Bytes Read: some-sever.com:22000(0) Per Node User Time: some-sever.com:22000(2.604ms) Per Node System Time: some-sever.com:22000(0.000ns) DML Stats: Partition: Default NumModifiedRows: 1 BytesWritten: 100.00 B - ExchangeScanRatio: 0.00 (0.0) - FiltersReceived: 0 (0) - FinalizationTimer: 17ms (17462437) - FileDeletionTimer: 2ms (2521732) - FileMoveTimer: 2ms (2096476) - Overwrite/PartitionCreationTimer: 10ms (10398587) - InactiveTotalTime: 0ns (0) - InnerNodeSelectivityRatio: 0.00 (0.0) - NumBackends: 1 (1) - NumFragmentInstances: 1 (1) - NumFragments: 1 (1) - TotalBytesRead: 0 B (0) - TotalBytesSent: 0 B (0) - TotalCpuTime: 2ms (2604000) - TotalInnerBytesSent: 0 B (0) - TotalScanBytesSent: 0 B (0) - TotalTime: 39ms (39278597) Per Node Profiles some-sever.com:22000 - InactiveTotalTime: 0ns (0) - ScratchBytesRead: 0 B (0) - ScratchBytesWritten: 0 B (0) - ScratchFileUsedBytes: 0 B (0) - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0ns (0) - TotalReadBlockTime: 0ns (0) - TotalTime: 0ns (0) Averaged Fragment F00 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:32.938ms max:32.938ms mean: 32.938ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 (1.0) - BloomFilterBytes: 0 B (0) - ExchangeScanRatio: 0.00 (0.0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 217.0 KiB (222208) - PeakReservation: 0 B (0) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 217.0 KiB (222208) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0ns (0) - TotalNetworkSendTime: 0ns (0) - TotalStorageWaitTime: 0ns (0) - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 31ms (31522849) - TotalThreadsSysTime: 0ns (0) - TotalThreadsUserTime: 2ms (2604000) - TotalThreadsVoluntaryContextSwitches: 16 (16) - TotalTime: 31ms (31773513) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 0 B (0) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 0 B (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 31ms (31509790) - ExecTreeExecTime: 132.28us (132281) - InactiveTotalTime: 0ns (0) - OpenTime: 23.56us (23556) - ExecTreeOpenTime: 5.11us (5105) - PrepareTime: 187.58us (187583) - ExecTreePrepareTime: 25.39us (25387) - TotalTime: 0ns (0) HdfsTableSink - BytesWritten: 100 B (100) - CompressTimer: 0ns (0) - EncodeTimer: 25.16us (25161) - FilesCreated: 1 (1) - FinalizePartitionFileTimer: 21ms (21935583) - HdfsWriteTimer: 20.83us (20833) - InactiveTotalTime: 0ns (0) - PartitionsCreated: 1 (1) - PeakMemoryUsage: 50.0 KiB (51200) - RowsInserted: 1 (1) - TmpFileCreateTimer: 9ms (9350625) - TotalTime: 31ms (31395718) UNION_NODE (id=0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 0 B (0) - RowsReturned: 1 (1) - RowsReturnedRate: 6275 per second (6275) - TotalTime: 159.36us (159358) Fragment F00 Instance 0c480a423d817907:24a7839a00000000 (host=some-sever.com:22000) Last report received time: 2021-11-25 15:02:12.020 - AverageThreadTokens: 1.00 (1.0) - BloomFilterBytes: 0 B (0) - ExchangeScanRatio: 0.00 (0.0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 217.0 KiB (222208) - PeakReservation: 0 B (0) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 217.0 KiB (222208) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0ns (0) - TotalNetworkSendTime: 0ns (0) - TotalStorageWaitTime: 0ns (0) - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 31ms (31522849) - TotalThreadsSysTime: 0ns (0) - TotalThreadsUserTime: 2ms (2604000) - TotalThreadsVoluntaryContextSwitches: 16 (16) - TotalTime: 31ms (31773513) Fragment Instance Lifecycle Event Timeline Prepare Finished: 597.56us (597564) Open Finished: 623.30us (623303) First Batch Produced: 757.10us (757102) First Batch Sent: 10ms (10176416) ExecInternal Finished: 32ms (32265433) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 0 B (0) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 0 B (0) - SystemAllocTime: 0ns (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 31ms (31509790) - ExecTreeExecTime: 132.28us (132281) - InactiveTotalTime: 0ns (0) - OpenTime: 23.56us (23556) - ExecTreeOpenTime: 5.11us (5105) - PrepareTime: 187.58us (187583) - ExecTreePrepareTime: 25.39us (25387) - TotalTime: 0ns (0) HdfsTableSink - BytesWritten: 100 B (100) - CompressTimer: 0ns (0) - EncodeTimer: 25.16us (25161) - FilesCreated: 1 (1) - FinalizePartitionFileTimer: 21ms (21935583) - HdfsWriteTimer: 20.83us (20833) - InactiveTotalTime: 0ns (0) - PartitionsCreated: 1 (1) - PeakMemoryUsage: 50.0 KiB (51200) - RowsInserted: 1 (1) - TmpFileCreateTimer: 9ms (9350625) - TotalTime: 31ms (31395718) UNION_NODE (id=0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 0 B (0) - RowsReturned: 1 (1) - RowsReturnedRate: 6275 per second (6275) - TotalTime: 159.36us (159358) Node Lifecycle Event Timeline Open Started: 603.38us (603383) Open Finished: 606.11us (606111) First Batch Requested: 625.52us (625522) First Batch Returned: 754.32us (754323) Last Batch Returned: 754.86us (754855) Closed: 32ms (32252532)