[CLOUDSTACK-4301] ceph:KVM:create volume from snapshot failing with Runtime exception

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 4.2.0
• Component/s: Snapshot
• Security Level: Public (Anyone can view this level - this is the default.)
• Assignee: Unassigned
• Reporter: sadhu suresh
• Created: 13/Aug/13 17:49
• Updated: 21/Aug/13 10:53
• Resolved: 14/Aug/13 11:37

Description

1.deploy a vm on ceph enabled cluster
2.once its successful,perform snapshot on root volume
3.Create a volume form above snapshot

Actual result:
Cretae volume failed with Runtime exception,where as volume form snapshot based on nfs successful.

2013-08-13 18:30:36,818 DEBUG [cloud.api.ApiServlet] (catalina-exec-23:null) ===END=== 10.150.19.243 – GET command=createVolume&response=json&sessionkey=3oaouwLLGveZlrYIn0zpMe4e394%3D&snapshotid=1ef97700-2242-471f-8997-107d1d464bfc&name=volfromsnapshot&_=1376413347691
2013-08-13 18:30:36,956 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-28:job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ]) Executing org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd for job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ]
2013-08-13 18:30:37,077 DEBUG [storage.allocator.LocalStoragePoolAllocator] (Job-Executor-28:job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ]) LocalStoragePoolAllocator trying to find storage pool to fit the vm
2013-08-13 18:30:37,078 DEBUG [storage.allocator.ClusterScopeStoragePoolAllocator] (Job-Executor-28:job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ]) ClusterScopeStoragePoolAllocator looking for storage pool
2013-08-13 18:30:37,078 DEBUG [storage.allocator.ClusterScopeStoragePoolAllocator] (Job-Executor-28:job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ]) Looking for pools in dc: 1 pod:1 cluster:null having tags:[RBD]
2013-08-13 18:30:37,519 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-28:job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ]) Checking if storage pool is suitable, name: null ,poolId: 20
2013-08-13 18:30:37,525 DEBUG [cloud.storage.StorageManagerImpl] (Job-Executor-28:job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ]) Checking pool 20 for storage, totalSize: 150248366080, usedBytes: 10848067775, usedPct: 0.07220090346422754, disable threshold: 0.85
2013-08-13 18:30:37,545 DEBUG [cloud.storage.StorageManagerImpl] (Job-Executor-28:job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ]) Checking pool: 20 for volume allocation [Vol[86|vm=null|DATADISK]], maxSize : 150248366080, totalAllocatedSize : 54760833024, askingSize : 8589934592, allocated disable threshold: 0.85
2013-08-13 18:30:37,545 DEBUG [storage.allocator.ClusterScopeStoragePoolAllocator] (Job-Executor-28:job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ]) FirstFitStoragePoolAllocator returning 1 suitable storage pools
2013-08-13 18:30:37,548 DEBUG [allocator.impl.UserConcentratedAllocator] (Job-Executor-28:job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ]) There are no pods with enough memory/CPU capacity in zone zone111
2013-08-13 18:30:37,945 DEBUG [storage.motion.AncientDataMotionStrategy] (Job-Executor-28:job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ]) copyAsync inspecting src type SNAPSHOT copyAsync inspecting dest type VOLUME
2013-08-13 18:30:37,970 DEBUG [agent.transport.Request] (Job-Executor-28:job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ]) Seq 7-1066226129: Sending { Cmd , MgmtId: 7296881000534, via: 7, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/2/85/cc526c4f-2545-4008-8f19-8d04eceec569","volume":{"uuid":"a541ed42-d0e6-441f-95ed-1fbfe4ff70e7","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8e7c6fb5-c4d7-38f9-9cb1-d34d3bba4957","id":20,"poolType":"RBD","host":"10.147.41.3","path":"cloudstack","port":6789}},"name":"ROOT-59","size":8589934592,"path":"aa49ad5b-17a3-44a5-b09b-dbd3d301ab98","volumeId":85,"vmName":"i-2-59-VM","accountId":2,"format":"QCOW2","id":85,"hypervisorType":"KVM"},"dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.147.28.7/export/home/sadhu/asf/sec/","_role":"Image"}},"vmName":"i-2-59-VM","name":"VM232_ROOT-59_20130813222445","hypervisorType":"KVM","id":12}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"ca08e6a0-e090-4144-aa4a-6f239dc68bdc","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8e7c6fb5-c4d7-38f9-9cb1-d34d3bba4957","id":20,"poolType":"RBD","host":"10.147.41.3","path":"cloudstack","port":6789}},"name":"volfromsnapshot","size":8589934592,"volumeId":86,"accountId":2,"format":"QCOW2","id":86,"hypervisorType":"None"}},"executeInSequence":false,"wait":10800}}] }
2013-08-13 18:30:38,772 DEBUG [agent.transport.Request] (AgentManager-Handler-4:null) Seq 7-1066226129: Processing: { Ans: , MgmtId: 7296881000534, via: 7, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"com.cloud.utils.exception.CloudRuntimeException: Failed to copy /mnt/0c35efaa-abd6-3058-8ca5-6149e45f2660/cc526c4f-2545-4008-8f19-8d04eceec569 to 271b56c5-dd25-4ad1-ba98-a4db4c304f0f","wait":0}}] }
2013-08-13 18:30:38,772 DEBUG [agent.transport.Request] (Job-Executor-28:job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ]) Seq 7-1066226129: Received: { Ans: , MgmtId: 7296881000534, via: 7, Ver: v1, Flags: 10,

{ CopyCmdAnswer } }
2013-08-13 18:30:38,883 WARN [storage.datastore.ObjectInDataStoreManagerImpl] (Job-Executor-28:job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ]) Unsupported data object (VOLUME, org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@46392540)
2013-08-13 18:30:38,904 DEBUG [cloud.storage.VolumeManagerImpl] (Job-Executor-28:job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ]) Failed to create volume from snapshot:com.cloud.utils.exception.CloudRuntimeException: Failed to copy /mnt/0c35efaa-abd6-3058-8ca5-6149e45f2660/cc526c4f-2545-4008-8f19-8d04eceec569 to 271b56c5-dd25-4ad1-ba98-a4db4c304f0f
2013-08-13 18:30:38,904 DEBUG [cloud.storage.VolumeManagerImpl] (Job-Executor-28:job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ]) Failed to create volume: 86
com.cloud.utils.exception.CloudRuntimeException: Failed to create volume from snapshot:com.cloud.utils.exception.CloudRuntimeException: Failed to copy /mnt/0c35efaa-abd6-3058-8ca5-6149e45f2660/cc526c4f-2545-4008-8f19-8d04eceec569 to 271b56c5-dd25-4ad1-ba98-a4db4c304f0f
at com.cloud.storage.VolumeManagerImpl.createVolumeFromSnapshot(VolumeManagerImpl.java:558)
at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at com.cloud.storage.VolumeManagerImpl.createVolumeFromSnapshot(VolumeManagerImpl.java:603)
at com.cloud.storage.VolumeManagerImpl.createVolume(VolumeManagerImpl.java:1047)
at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at com.cloud.storage.VolumeManagerImpl.createVolume(VolumeManagerImpl.java:183)
at org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd.execute(CreateVolumeCmd.java:189)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)
2013-08-13 18:30:38,929 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-28:job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ]) Complete async job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ], jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Failed to create a volume
2013-08-13 18:30:39,302 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM
2013-08-13 18:30:39,558 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 1 is ready to launch console proxy
2013-08-13 18:30:39,968 DEBUG [cloud.api.ApiServlet] (catalina-exec-1:null) ===START=== 10.150.19.243 – GET command=queryAsyncJobResult&jobId=caf62cd4-513c-4c91-9512-767adcd604d5&response=json&sessionkey=3oaouwLLGveZlrYIn0zpMe4e394%3D&_=1376413350985
2013-08-13 18:30:39,982 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-1:null) Async job-231 = [ caf62cd4-513c-4c91-9512-767adcd604d5 ] completed
2013-08-13 18:30:39,989 DEBUG [cloud.api.ApiServlet] (catalina-exec-1:null) ===END=== 10.150.19.243 – GET command=queryAsyncJobResult&jobId=caf62cd4-513c-4c91-9512-767adcd604d5&response=json&sessionkey=3oaouwLLGveZlrYIn0zpMe4e394%3D&_=1376413350985
2013-08-13 18:30:40,494 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 3 routers to update status.
2013-08-13 18:30:40,496 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
2013-08-13 18:30:40,648 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 3 routers to update status.
2013-08-13 18:30:40,650 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
2013-08-13 18:30:45,085 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-12:null) SeqA 10-15790: Processing Seq 10-15790: { Cmd , MgmtId: -1, via: 10, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":39,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2013-08-13 18:30:45,090 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-12:null) SeqA 10-15790: Sending Seq 10-15790: { Ans: , MgmtId: 7296881000534, via: 10, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2013-08-13 18:30:46,198 DEBUG [cloud.server.StatsCollector] (StatsCollector-1:null) HostStatsCollector is running...
2013-08-13 18:30:46,390 DEBUG [agent.transport.Request] (AgentManager-Handler-2:null) Seq 7-1066226130: Processing: { Ans: , MgmtId: 7296881000534, via: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":false,"details":"empty String","wait":0}}] }
2013-08-13 18:30:46,390 DEBUG [agent.transport.Request] (StatsCollector-1:null) Seq 7-1066226130: Re


Agent log:

013-08-13 22:32:24,501 TRACE [utils.nio.Link] (Agent-Selector:null) Done with packet: 1380
2013-08-13 22:32:24,501 TRACE [utils.nio.NioConnection] (Agent-Selector:null) Keys Done Processing.
2013-08-13 22:32:24,502 DEBUG [cloud.agent.Agent] (agentRequest-Handler-1:null) Request:Seq 7-1066226129: { Cmd , MgmtId: 7296881000534, via: 7, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/2/85/cc526c4f-2545-4008-8f19-8d04eceec569","volume":{"uuid":"a541ed42-d0e6-441f-95ed-1fbfe4ff70e7","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8e7c6fb5-c4d7-38f9-9cb1-d34d3bba4957","id":20,"poolType":"RBD","host":"10.147.41.3","path":"cloudstack","port":6789}},"name":"ROOT-59","size":8589934592,"path":"aa49ad5b-17a3-44a5-b09b-dbd3d301ab98","volumeId":85,"vmName":"i-2-59-VM","accountId":2,"format":"QCOW2","id":85,"hypervisorType":"KVM"},"dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.147.28.7/export/home/sadhu/asf/sec/","_role":"Image"}},"vmName":"i-2-59-VM","name":"VM232_ROOT-59_20130813222445","hypervisorType":"KVM","id":12}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"ca08e6a0-e090-4144-aa4a-6f239dc68bdc","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8e7c6fb5-c4d7-38f9-9cb1-d34d3bba4957","id":20,"poolType":"RBD","host":"10.147.41.3","path":"cloudstack","port":6789}},"name":"volfromsnapshot","size":8589934592,"volumeId":86,"accountId":2,"format":"QCOW2","id":86,"hypervisorType":"None"}},"executeInSequence":false,"contextMap":{},"wait":10800}}] }
2013-08-13 22:32:24,502 DEBUG [cloud.agent.Agent] (agentRequest-Handler-1:null) Processing command: org.apache.cloudstack.storage.command.CopyCommand
2013-08-13 22:32:24,504 DEBUG [kvm.storage.LibvirtStorageAdaptor] (agentRequest-Handler-1:null) createStoragePool didn't find existing running pool: org.libvirt.LibvirtException: Storage pool not found: no storage pool with matching uuid ^L5磌�0X��aI�_&`, need to create it
2013-08-13 22:32:24,504 DEBUG [kvm.storage.LibvirtStorageAdaptor] (agentRequest-Handler-1:null) Didn't find an existing storage pool 0c35efaa-abd6-3058-8ca5-6149e45f2660 by UUID, checking for pools with duplicate paths
2013-08-13 22:32:24,506 DEBUG [kvm.storage.LibvirtStorageAdaptor] (agentRequest-Handler-1:null) Checking path of existing pool 8e7c6fb5-c4d7-38f9-9cb1-d34d3bba4957 against pool we want to create
2013-08-13 22:32:24,509 DEBUG [kvm.storage.LibvirtStorageAdaptor] (agentRequest-Handler-1:null) Checking path of existing pool 93fe4250-25c7-3a09-aee3-1bb6edb31bc4 against pool we want to create
2013-08-13 22:32:24,511 DEBUG [kvm.storage.LibvirtStorageAdaptor] (agentRequest-Handler-1:null) Checking path of existing pool 1e18839d-55e2-3e0a-8510-ec50dd2b598d against pool we want to create
2013-08-13 22:32:24,514 DEBUG [kvm.storage.LibvirtStorageAdaptor] (agentRequest-Handler-1:null) Checking path of existing pool c05ba1c9-b225-3664-bd2a-fa79c59a2f01 against pool we want to create
2013-08-13 22:32:24,516 DEBUG [kvm.storage.LibvirtStorageAdaptor] (agentRequest-Handler-1:null) Checking path of existing pool 348c52a1-49e8-3ad4-b485-adf5e0ebe13b against pool we want to create
2013-08-13 22:32:24,518 DEBUG [kvm.storage.LibvirtStorageAdaptor] (agentRequest-Handler-1:null) Attempting to create storage pool 0c35efaa-abd6-3058-8ca5-6149e45f2660
2013-08-13 22:32:24,519 DEBUG [kvm.storage.LibvirtStorageAdaptor] (agentRequest-Handler-1:null) <pool type='netfs'>
<name>0c35efaa-abd6-3058-8ca5-6149e45f2660</name>
<uuid>0c35efaa-abd6-3058-8ca5-6149e45f2660</uuid>
<source>
<host name='10.147.28.7'/>
<dir path='/export/home/sadhu/asf/sec/snapshots/2/85'/>
</source>
<target>
<path>/mnt/0c35efaa-abd6-3058-8ca5-6149e45f2660</path>
</target>



management log:

013-08-13 18:40:41,786 DEBUG [agent.transport.Request] (Job-Executor-29:job-232 = [ 50127204-107e-4a13-b40c-6f8206db8508 ]) Seq 7-1066226194: Sending { Cmd , MgmtId: 7296881000534, via: 7, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/2/83/177b537e-ff43-481a-9aa3-fe047912ef6b","volume":{"uuid":"4db10e74-d6b0-4d4f-ba5e-b2a6e43230d0","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8e7c6fb5-c4d7-38f9-9cb1-d34d3bba4957","id":20,"poolType":"RBD","host":"10.147.41.3","path":"cloudstack","port":6789}},"name":"ROOT-60","size":1073741824,"path":"8fd80a05-0160-45b0-a322-1146f4df5325","volumeId":83,"vmName":"i-2-60-VM","accountId":2,"format":"QCOW2","id":83,"hypervisorType":"KVM"},"dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.147.28.7/export/home/sadhu/asf/sec/","_role":"Image"}},"vmName":"i-2-60-VM","name":"vmfromISo_ROOT-60_20130813220812","hypervisorType":"KVM","id":10}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"d809999c-947c-4d9d-81c5-7de30214cc72","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8e7c6fb5-c4d7-38f9-9cb1-d34d3bba4957","id":20,"poolType":"RBD","host":"10.147.41.3","path":"cloudstack","port":6789}},"name":"vvvvv form snao","size":1073741824,"volumeId":87,"accountId":2,"format":"QCOW2","id":87,"hypervisorType":"None"}},"executeInSequence":false,"wait":10800}}] }
2013-08-13 18:40:42,229 DEBUG [agent.transport.Request] (AgentManager-Handler-14:null) Seq 7-1066226194: Processing: { Ans: , MgmtId: 7296881000534, via: 7, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"com.cloud.utils.exception.CloudRuntimeException: Failed to copy /mnt/1d1c68d2-f2e0-31df-97b5-5f28f2c86253/177b537e-ff43-481a-9aa3-fe047912ef6b to 9b9e61c9-bdb0-4829-9e26-18173e28fc1a","wait":0}}] }
2013-08-13 18:40:42,229 DEBUG [agent.transport.Request] (Job-Executor-29:job-232 = [ 50127204-107e-4a13-b40c-6f8206db8508 ]) Seq 7-1066226194: Received: { Ans: , MgmtId: 7296881000534, via: 7, Ver: v1, Flags: 10, { CopyCmdAnswer }

}
2013-08-13 18:40:42,242 WARN [storage.datastore.ObjectInDataStoreManagerImpl] (Job-Executor-29:job-232 = [ 50127204-107e-4a13-b40c-6f8206db8508 ]) Unsupported data object (VOLUME, org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@7ec5edf0)
2013-08-13 18:40:42,261 DEBUG [cloud.storage.VolumeManagerImpl] (Job-Executor-29:job-232 = [ 50127204-107e-4a13-b40c-6f8206db8508 ]) Failed to create volume from snapshot:com.cloud.utils.exception.CloudRuntimeException: Failed to copy /mnt/1d1c68d2-f2e0-31df-97b5-5f28f2c86253/177b537e-ff43-481a-9aa3-fe047912ef6b to 9b9e61c9-bdb0-4829-9e26-18173e28fc1a
2013-08-13 18:40:42,262 DEBUG [cloud.storage.VolumeManagerImpl] (Job-Executor-29:job-232 = [ 50127204-107e-4a13-b40c-6f8206db8508 ]) Failed to create volume: 87
com.cloud.utils.exception.CloudRuntimeException: Failed to create volume from snapshot:com.cloud.utils.exception.CloudRuntimeException: Failed to copy /mnt/1d1c68d2-f2e0-31df-97b5-5f28f2c86253/177b537e-ff43-481a-9aa3-fe047912ef6b to 9b9e61c9-bdb0-4829-9e26-18173e28fc1a
at com.cloud.storage.VolumeManagerImpl.createVolumeFromSnapshot(VolumeManagerImpl.java:558)
at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at com.cloud.storage.VolumeManagerImpl.createVolumeFromSnapshot(VolumeManagerImpl.java:603)
at com.cloud.storage.VolumeManagerImpl.createVolume(VolumeManagerImpl.java:1047)
at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at com.cloud.storage.VolumeManagerImpl.createVolume(VolumeManagerImpl.java:183)
at org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd.execute(CreateVolumeCmd.java:189)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)
2013-08-13 18:40:42,285 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-29:job-232 = [ 50127204-107e-4a13-b40c-6f8206db8508 ]) Complete async job-232 = [ 50127204-107e-4a13-b40c-6f8206db8508 ], jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Failed to create a volume
2013-08-13 18:40:44,349 DEBUG [cloud.api.ApiServlet] (catalina-exec-15:null) ===START=== 10.150.19.243 – GET command=queryAsyncJobResult&jobId=50127204-107e-4a13-b40c-6f8206db8508&response=json&sessionkey=3oaouwLLGveZlrYIn0zpMe4e394%3D&_=1376413955349

mysql> select id,job_cmd,job_status,job_result from async_job where id in (230,231,232,233,234)\G;

• • • • • • • • • • • • • • • • • • • • • • • • • • • 1. row ***************************

id: 230
job_cmd: org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd
job_status: 1
job_result: org.apache.cloudstack.api.response.SnapshotResponse/snapshot/

{"id":"1ef97700-2242-471f-8997-107d1d464bfc","account":"admin","domainid":"a707b316-fe1d-11e2-9c5b-06a2f0000056","domain":"ROOT","snapshottype":"MANUAL","volumeid":"a541ed42-d0e6-441f-95ed-1fbfe4ff70e7","volumename":"ROOT-59","volumetype":"ROOT","created":"2013-08-13T18:24:45-0400","name":"VM232_ROOT-59_20130813222445","intervaltype":"MANUAL","state":"BackedUp","tags":[]}

• • • • • • • • • • • • • • • • • • • • • • • • • • • 2. row ***************************
                                                      id: 231
                                                      job_cmd: org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd
                                                      job_status: 2
                                                      job_result: org.apache.cloudstack.api.response.ExceptionResponse/null/ {"uuidList":[],"errorcode":530,"errortext":"Failed to create a volume"}
                                                    • 3. row ***************************
                                                      id: 232
                                                      job_cmd: org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd
                                                      job_status: 2
                                                      job_result: org.apache.cloudstack.api.response.ExceptionResponse/null/ {"uuidList":[],"errorcode":530,"errortext":"Failed to create a volume"}
                                                    • 4. row ***************************
                                                      id: 233
                                                      job_cmd: org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd
                                                      job_status: 1
                                                      job_result: org.apache.cloudstack.api.response.SnapshotResponse/snapshot/ {"id":"419d03c5-c5f4-4ffb-8214-1fde944d0397","account":"admin","domainid":"a707b316-fe1d-11e2-9c5b-06a2f0000056","domain":"ROOT","snapshottype":"MANUAL","volumeid":"8dbb197b-903c-4dd6-8870-7cb535ff7313","volumename":"ROOT-57","volumetype":"ROOT","created":"2013-08-13T18:41:46-0400","name":"normal_ROOT-57_20130813224146","intervaltype":"MANUAL","state":"BackedUp","tags":[]}
                                                    • 5. row ***************************
                                                      id: 234
                                                      job_cmd: org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd
                                                      job_status: 1
                                                      job_result: org.apache.cloudstack.api.response.VolumeResponse/volume/ {"id":"aad8868a-ae4d-467f-bf35-e0346da531c1","name":"volfromhhhhhhh","zoneid":"6ec00b45-7913-4095-944b-d0fa16adb84a","zonename":"zone111","type":"DATADISK","size":1599209472,"created":"2013-08-13T18:46:39-0400","state":"Ready","account":"admin","domainid":"a707b316-fe1d-11e2-9c5b-06a2f0000056","domain":"ROOT","storagetype":"shared","hypervisor":"KVM","diskofferingid":"95a4090d-5b0a-408b-9907-6d9ad1ae10e3","diskofferingname":"Small Instance","diskofferingdisplaytext":"Small Instance","storage":"rbd","snapshotid":"419d03c5-c5f4-4ffb-8214-1fde944d0397","destroyed":false,"isextractable":true,"tags":[],"displayvolume":true,"jobid":"11df89c7-410c-42b1-b62e-2c6c3dc49c41","jobstatus":0}

                                                      5 rows in set (0.00 sec)

ERROR:
No query specified

Issue Links

• is related to: CLOUDSTACK-4114 RBD volumes have format QCOW2 in the database