CloudStack
  1. CloudStack
  2. CLOUDSTACK-1200

Unknown column 'vm_instance.disk_offering_id' in table vm_instance, db exception shown in MS log

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Cannot Reproduce
    • Affects Version/s: 4.1.0
    • Fix Version/s: 4.1.0
    • Component/s: Management Server
    • Security Level: Public (Anyone can view this level - this is the default.)
    • Labels:
      None
    • Environment:
      CentOS 6.3


      368d5a1ea597c612e050613e13c95687bc0992c2

      Description

      Step 1 : Created new build from 4.1 branch
      Step 2 : Install and configure MS server

      You can see below exception log also in error dialog displayed in UI

      2013-02-07 16:54:36,464 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Skip capacity scan due to there is no Primary Storage UPintenance mode
      2013-02-07 16:54:40,115 ERROR [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Fail to complete the CheckRouterTask!
      com.cloud.utils.exception.CloudRuntimeException: DB Exception on: com.mysql.jdbc.JDBC4PreparedStatement@67b9238a: SELECT vm_instance.id, vm_instance.name, vm_instance.vnc_password, vm_instance.proxy_id, vm_instance.proxy_assign_time, vm_instance.state, vm_instance.private_ip_address, vm_instance.instance_name, vm_instance.vm_template_id, vm_instance.guest_os_id, vm_instance.host_id, vm_instance.last_host_id, vm_instance.pod_id, vm_instance.private_mac_address, vm_instance.data_center_id, vm_instance.vm_type, vm_instance.ha_enabled, vm_instance.limit_cpu_use, vm_instance.update_count, vm_instance.created, vm_instance.removed, vm_instance.update_time, vm_instance.domain_id, vm_instance.account_id, vm_instance.service_offering_id, vm_instance.reservation_id, vm_instance.hypervisor_type, vm_instance.uuid, vm_instance.disk_offering_id, domain_router.element_id, domain_router.public_ip_address, domain_router.public_mac_address, domain_router.public_netmask, domain_router.is_redundant_router, domain_router.priority, domain_router.is_priority_bumpup, domain_router.redundant_state, domain_router.stop_pending, domain_router.role, domain_router.template_version, domain_router.scripts_version, domain_router.vpc_id FROM domain_router INNER JOIN vm_instance ON domain_router.id=vm_instance.id INNER JOIN router_network_ref ON domain_router.id=router_network_ref.router_id WHERE vm_instance.type='DomainRouter' AND vm_instance.removed IS NULL AND (router_network_ref.guest_type = 'Isolated' )
      at com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:412)
      at com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:347)
      at com.cloud.utils.db.GenericDaoBase.listIncludingRemovedBy(GenericDaoBase.java:899)
      at com.cloud.utils.db.GenericDaoBase.listBy(GenericDaoBase.java:876)
      at com.cloud.utils.db.GenericDaoBase.listBy(GenericDaoBase.java:889)
      at com.cloud.vm.dao.DomainRouterDaoImpl.listIsolatedByHostId(DomainRouterDaoImpl.java:213)
      at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
      at org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689)
      at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
      at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80)
      at com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionContextBuilder.java:37)
      at sun.reflect.GeneratedMethodAccessor35.invoke(Unknown Source)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:616)
      at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621)
      at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610)
      at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65)
      at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
      at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90)
      at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
      at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622)
      at com.cloud.network.router.VirtualNetworkApplianceManagerImpl$CheckRouterTask.run(VirtualNetworkApplianceManagerImpl.java:1295)

      in db i cannot see the cloumn vm_instance.disk_offering_id

      mysql> desc vm_instance;
      -----------------------------------------------------------+

      Field Type Null Key Default Extra

      -----------------------------------------------------------+

      id bigint(20) unsigned NO PRI NULL  
      name varchar(255) NO   NULL  
      uuid varchar(40) YES UNI NULL  
      instance_name varchar(255) NO   NULL  
      state varchar(32) NO MUL NULL  
      desired_state varchar(32) YES   NULL  
      vm_template_id bigint(20) unsigned YES MUL NULL  
      guest_os_id bigint(20) unsigned NO   NULL  
      private_mac_address varchar(17) YES   NULL  
      private_ip_address char(40) YES   NULL  
      pod_id bigint(20) unsigned YES MUL NULL  
      data_center_id bigint(20) unsigned NO MUL NULL  
      host_id bigint(20) unsigned YES MUL NULL  
      last_host_id bigint(20) unsigned YES MUL NULL  
      proxy_id bigint(20) unsigned YES   NULL  
      proxy_assign_time datetime YES   NULL  
      vnc_password varchar(255) NO   NULL  
      ha_enabled tinyint(1) NO   0  
      limit_cpu_use tinyint(1) unsigned NO   0  
      update_count bigint(20) unsigned NO MUL 0  
      update_time datetime YES MUL NULL  
      created datetime NO   NULL  
      removed datetime YES MUL NULL  
      type varchar(32) NO MUL NULL  
      vm_type varchar(32) NO   NULL  
      account_id bigint(20) unsigned NO MUL NULL  
      domain_id bigint(20) unsigned NO   NULL  
      service_offering_id bigint(20) unsigned NO MUL NULL  
      reservation_id char(40) YES   NULL  
      hypervisor_type char(32) YES   NULL  

      -----------------------------------------------------------+
      30 rows in set (0.03 sec)

        Activity

        Hide
        Sudha Ponnaganti added a comment -

        Reported through automation. Since then not seen this issue. Closing it

        Show
        Sudha Ponnaganti added a comment - Reported through automation. Since then not seen this issue. Closing it
        Hide
        Rohit Yadav added a comment -

        While I'll work on CLOUDSTACK-1019 to make cloud-setup-databases use DatabaseCreator. The old cloud-setup-databases has been fixed on both 4.1 and master, please build from latest 4.1/master.

        Show
        Rohit Yadav added a comment - While I'll work on CLOUDSTACK-1019 to make cloud-setup-databases use DatabaseCreator. The old cloud-setup-databases has been fixed on both 4.1 and master, please build from latest 4.1/master.
        Hide
        Rohit Yadav added a comment -

        Issue to fix cloud-setup-database so it uses DatabaseCreator: CLOUDSTACK-1019

        Show
        Rohit Yadav added a comment - Issue to fix cloud-setup-database so it uses DatabaseCreator: CLOUDSTACK-1019
        Hide
        Rohit Yadav added a comment -

        In my setup, (did deploydb failed for you due to CLOUDSTACK-1181, I just fixed it) I see disk_offering_id table in cloud.vm_instance. When you run deploydb, goto developer/pom.xml and add an argument -v or --verbose at the end of args in the deploydb profile.

        Resolving as cannot reproduce, please check and reopen if needed or close after qa. Thanks.

        In my case, it did ran 4.1-new-db-schema.sql, see:

        ========> Processing SQL file at /Bhaisaab/Work/apache-cloudstack/developer/target/db/4.1-new-db-schema.sql
        2013-02-11 12:23:52,560 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – Licensed to the Apache Software Foundation (ASF) under one
        2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – or more contributor license agreements. See the NOTICE file
        2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – distributed with this work for additional information
        2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – regarding copyright ownership. The ASF licenses this file
        2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – to you under the Apache License, Version 2.0 (the
        2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – "License"); you may not use this file except in compliance
        2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – with the License. You may obtain a copy of the License at
        2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main()
        2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main()http://www.apache.org/licenses/LICENSE-2.0
        2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main()
        2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – Unless required by applicable law or agreed to in writing,
        2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – software distributed under the License is distributed on an
        2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
        2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – KIND, either express or implied. See the License for the
        2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – specific language governing permissions and limitations
        2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – under the License.
        2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_template add image_data_store_id bigint unsigned
        2013-02-11 12:23:52,572 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_template add size bigint unsigned
        2013-02-11 12:23:52,589 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_template add state varchar(255)
        2013-02-11 12:23:52,600 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_template add update_count bigint unsigned
        2013-02-11 12:23:52,618 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_template add updated datetime
        2013-02-11 12:23:52,630 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table storage_pool add storage_provider_id bigint unsigned
        2013-02-11 12:23:52,648 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table storage_pool add scope varchar(255)
        2013-02-11 12:23:52,668 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table storage_pool modify id bigint unsigned AUTO_INCREMENT UNIQUE NOT NULL
        2013-02-11 12:23:52,677 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table template_spool_ref add state varchar(255)
        2013-02-11 12:23:52,698 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table template_spool_ref add update_count bigint unsigned
        2013-02-11 12:23:52,718 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table volumes add disk_type varchar(255)
        2013-02-11 12:23:52,738 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table volumes drop foreign key `fk_volumes__account_id`
        2013-02-11 12:23:52,750 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_instance add column disk_offering_id bigint unsigned
        2013-02-11 12:23:52,762 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_instance add column cpu int(10) unsigned
        2013-02-11 12:23:52,779 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_instance add column ram bigint unsigned
        2013-02-11 12:23:52,799 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_instance add column owner varchar(255)
        2013-02-11 12:23:52,810 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_instance add column speed int(10) unsigned
        2013-02-11 12:23:52,832 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_instance add column host_name varchar(255)
        2013-02-11 12:23:52,844 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_instance add column display_name varchar(255)
        2013-02-11 12:23:52,859 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table data_center add column owner varchar(255)
        2013-02-11 12:23:52,870 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table data_center add column created datetime COMMENT 'date created'
        2013-02-11 12:23:52,889 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table data_center add column lastUpdated datetime COMMENT 'last updated'
        2013-02-11 12:23:52,909 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table data_center add column engine_state varchar(32) NOT NULL DEFAULT 'Disabled' COMMENT 'the engine state of the zone'
        2013-02-11 12:23:52,989 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table host add column owner varchar(255)
        2013-02-11 12:23:53,009 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table host add column lastUpdated datetime COMMENT 'last updated'
        2013-02-11 12:23:53,029 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table host add column engine_state varchar(32) NOT NULL DEFAULT 'Disabled' COMMENT 'the engine state of the zone'
        2013-02-11 12:23:53,040 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table cluster add column owner varchar(255)
        2013-02-11 12:23:53,058 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table cluster add column created datetime COMMENT 'date created'
        2013-02-11 12:23:53,078 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table cluster add column lastUpdated datetime COMMENT 'last updated'
        2013-02-11 12:23:53,089 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table cluster add column engine_state varchar(32) NOT NULL DEFAULT 'Disabled' COMMENT 'the engine state of the zone'
        2013-02-11 12:23:53,108 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() CREATE TABLE `cloud`.`object_datastore_ref` ( `id` bigint unsigned NOT NULL auto_increment, `datastore_id` bigint unsigned NOT NULL, `datastore_role` varchar(255) NOT NULL, `object_id` bigint unsigned NOT NULL, `object_type` varchar(255) NOT NULL, `created` DATETIME NOT NULL, `last_updated` DATETIME, `job_id` varchar(255), `download_pct` int(10) unsigned, `download_state` varchar(255), `error_str` varchar(255), `local_path` varchar(255), `install_path` varchar(255), `size` bigint unsigned COMMENT 'the size of the template on the pool', `state` varchar(255) NOT NULL, `update_count` bigint unsigned NOT NULL, `updated` DATETIME, PRIMARY KEY (`id`) ) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=utf8
        2013-02-11 12:23:53,117 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() CREATE TABLE `cloud`.`data_store_provider` ( `id` bigint unsigned NOT NULL AUTO_INCREMENT COMMENT 'id', `name` varchar(255) NOT NULL COMMENT 'name of primary data store provider', `uuid` varchar(255) NOT NULL COMMENT 'uuid of primary data store provider', PRIMARY KEY(`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8
        2013-02-11 12:23:53,125 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() CREATE TABLE `cloud`.`image_data_store` ( `id` bigint unsigned NOT NULL AUTO_INCREMENT COMMENT 'id', `name` varchar(255) NOT NULL COMMENT 'name of data store', `image_provider_id` bigint unsigned NOT NULL COMMENT 'id of image_data_store_provider', `protocol` varchar(255) NOT NULL COMMENT 'protocol of data store', `data_center_id` bigint unsigned COMMENT 'datacenter id of data store', `scope` varchar(255) COMMENT 'scope of data store', `uuid` varchar(255) COMMENT 'uuid of data store', PRIMARY KEY(`id`), CONSTRAINT `fk_tags__image_data_store_provider_id` FOREIGN KEY(`image_provider_id`) REFERENCES `data_store_provider`(`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8
        2013-02-11 12:23:53,133 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() CREATE TABLE `cloud`.`vm_compute_tags` ( `id` bigint unsigned NOT NULL AUTO_INCREMENT COMMENT 'id', `vm_id` bigint unsigned NOT NULL COMMENT 'vm id', `compute_tag` varchar(255) NOT NULL COMMENT 'name of tag', PRIMARY KEY(`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8
        2013-02-11 12:23:53,141 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() CREATE TABLE `cloud`.`vm_root_disk_tags` ( `id` bigint unsigned NOT NULL AUTO_INCREMENT COMMENT 'id', `vm_id` bigint unsigned NOT NULL COMMENT 'vm id', `root_disk_tag` varchar(255) NOT NULL COMMENT 'name of tag', PRIMARY KEY(`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8
        2013-02-11 12:23:53,148 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() CREATE TABLE `cloud`.`vm_network_map` ( `id` bigint unsigned NOT NULL AUTO_INCREMENT COMMENT 'id', `vm_id` bigint unsigned NOT NULL COMMENT 'vm id', `network_id` bigint unsigned NOT NULL COMMENT 'network id', PRIMARY KEY(`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8
        2013-02-11 12:23:53,156 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() CREATE TABLE `cloud`.`vm_reservation` ( `id` bigint unsigned NOT NULL AUTO_INCREMENT COMMENT 'id', `uuid` varchar(40) NOT NULL COMMENT 'reservation id', `vm_id` bigint unsigned NOT NULL COMMENT 'vm id', `data_center_id` bigint unsigned NOT NULL COMMENT 'zone id', `pod_id` bigint unsigned NOT NULL COMMENT 'pod id', `cluster_id` bigint unsigned NOT NULL COMMENT 'cluster id', `host_id` bigint unsigned NOT NULL COMMENT 'host id', `created` datetime COMMENT 'date created', `removed` datetime COMMENT 'date removed if not null', CONSTRAINT `uc_vm_reservation__uuid` UNIQUE (`uuid`), PRIMARY KEY(`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8
        2013-02-11 12:23:53,164 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() CREATE TABLE `cloud`.`volume_reservation` ( `id` bigint unsigned NOT NULL AUTO_INCREMENT COMMENT 'id', `vm_reservation_id` bigint unsigned NOT NULL COMMENT 'id of the vm reservation', `vm_id` bigint unsigned NOT NULL COMMENT 'vm id', `volume_id` bigint unsigned NOT NULL COMMENT 'volume id', `pool_id` bigint unsigned NOT NULL COMMENT 'pool assigned to the volume', CONSTRAINT `fk_vm_pool_reservation__vm_reservation_id` FOREIGN KEY (`vm_reservation_id`) REFERENCES `vm_reservation`(`id`) ON DELETE CASCADE, PRIMARY KEY(`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8

        Also, the table description:

        mysql> desc vm_instance;
        -----------------------------------------------------------+

        Field Type Null Key Default Extra

        -----------------------------------------------------------+

        id bigint(20) unsigned NO PRI NULL  
        name varchar(255) NO   NULL  
        uuid varchar(40) YES UNI NULL  
        instance_name varchar(255) NO   NULL  
        state varchar(32) NO MUL NULL  
        desired_state varchar(32) YES   NULL  
        vm_template_id bigint(20) unsigned YES MUL NULL  
        guest_os_id bigint(20) unsigned NO   NULL  
        private_mac_address varchar(17) YES   NULL  
        private_ip_address char(40) YES   NULL  
        pod_id bigint(20) unsigned YES MUL NULL  
        data_center_id bigint(20) unsigned NO MUL NULL  
        host_id bigint(20) unsigned YES MUL NULL  
        last_host_id bigint(20) unsigned YES MUL NULL  
        proxy_id bigint(20) unsigned YES   NULL  
        proxy_assign_time datetime YES   NULL  
        vnc_password varchar(255) NO   NULL  
        ha_enabled tinyint(1) NO   0  
        limit_cpu_use tinyint(1) unsigned NO   0  
        update_count bigint(20) unsigned NO MUL 0  
        update_time datetime YES MUL NULL  
        created datetime NO   NULL  
        removed datetime YES MUL NULL  
        type varchar(32) NO MUL NULL  
        vm_type varchar(32) NO   NULL  
        account_id bigint(20) unsigned NO MUL NULL  
        domain_id bigint(20) unsigned NO   NULL  
        service_offering_id bigint(20) unsigned NO MUL NULL  
        reservation_id char(40) YES   NULL  
        hypervisor_type char(32) YES   NULL  
        disk_offering_id bigint(20) unsigned YES   NULL  
        cpu int(10) unsigned YES   NULL  
        ram bigint(20) unsigned YES   NULL  
        owner varchar(255) YES   NULL  
        speed int(10) unsigned YES   NULL  
        host_name varchar(255) YES   NULL  
        display_name varchar(255) YES   NULL  

        -----------------------------------------------------------+
        37 rows in set (0.11 sec)

        Show
        Rohit Yadav added a comment - In my setup, (did deploydb failed for you due to CLOUDSTACK-1181 , I just fixed it) I see disk_offering_id table in cloud.vm_instance. When you run deploydb, goto developer/pom.xml and add an argument -v or --verbose at the end of args in the deploydb profile. Resolving as cannot reproduce, please check and reopen if needed or close after qa. Thanks. In my case, it did ran 4.1-new-db-schema.sql, see: ========> Processing SQL file at /Bhaisaab/Work/apache-cloudstack/developer/target/db/4.1-new-db-schema.sql 2013-02-11 12:23:52,560 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – Licensed to the Apache Software Foundation (ASF) under one 2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – or more contributor license agreements. See the NOTICE file 2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – distributed with this work for additional information 2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – regarding copyright ownership. The ASF licenses this file 2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – to you under the Apache License, Version 2.0 (the 2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – "License"); you may not use this file except in compliance 2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – with the License. You may obtain a copy of the License at 2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – 2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – http://www.apache.org/licenses/LICENSE-2.0 2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – 2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – Unless required by applicable law or agreed to in writing, 2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – software distributed under the License is distributed on an 2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY 2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – KIND, either express or implied. See the License for the 2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – specific language governing permissions and limitations 2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() – under the License. 2013-02-11 12:23:52,561 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_template add image_data_store_id bigint unsigned 2013-02-11 12:23:52,572 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_template add size bigint unsigned 2013-02-11 12:23:52,589 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_template add state varchar(255) 2013-02-11 12:23:52,600 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_template add update_count bigint unsigned 2013-02-11 12:23:52,618 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_template add updated datetime 2013-02-11 12:23:52,630 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table storage_pool add storage_provider_id bigint unsigned 2013-02-11 12:23:52,648 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table storage_pool add scope varchar(255) 2013-02-11 12:23:52,668 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table storage_pool modify id bigint unsigned AUTO_INCREMENT UNIQUE NOT NULL 2013-02-11 12:23:52,677 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table template_spool_ref add state varchar(255) 2013-02-11 12:23:52,698 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table template_spool_ref add update_count bigint unsigned 2013-02-11 12:23:52,718 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table volumes add disk_type varchar(255) 2013-02-11 12:23:52,738 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table volumes drop foreign key `fk_volumes__account_id` 2013-02-11 12:23:52,750 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_instance add column disk_offering_id bigint unsigned 2013-02-11 12:23:52,762 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_instance add column cpu int(10) unsigned 2013-02-11 12:23:52,779 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_instance add column ram bigint unsigned 2013-02-11 12:23:52,799 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_instance add column owner varchar(255) 2013-02-11 12:23:52,810 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_instance add column speed int(10) unsigned 2013-02-11 12:23:52,832 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_instance add column host_name varchar(255) 2013-02-11 12:23:52,844 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table vm_instance add column display_name varchar(255) 2013-02-11 12:23:52,859 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table data_center add column owner varchar(255) 2013-02-11 12:23:52,870 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table data_center add column created datetime COMMENT 'date created' 2013-02-11 12:23:52,889 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table data_center add column lastUpdated datetime COMMENT 'last updated' 2013-02-11 12:23:52,909 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table data_center add column engine_state varchar(32) NOT NULL DEFAULT 'Disabled' COMMENT 'the engine state of the zone' 2013-02-11 12:23:52,989 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table host add column owner varchar(255) 2013-02-11 12:23:53,009 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table host add column lastUpdated datetime COMMENT 'last updated' 2013-02-11 12:23:53,029 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table host add column engine_state varchar(32) NOT NULL DEFAULT 'Disabled' COMMENT 'the engine state of the zone' 2013-02-11 12:23:53,040 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table cluster add column owner varchar(255) 2013-02-11 12:23:53,058 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table cluster add column created datetime COMMENT 'date created' 2013-02-11 12:23:53,078 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table cluster add column lastUpdated datetime COMMENT 'last updated' 2013-02-11 12:23:53,089 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() alter table cluster add column engine_state varchar(32) NOT NULL DEFAULT 'Disabled' COMMENT 'the engine state of the zone' 2013-02-11 12:23:53,108 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() CREATE TABLE `cloud`.`object_datastore_ref` ( `id` bigint unsigned NOT NULL auto_increment, `datastore_id` bigint unsigned NOT NULL, `datastore_role` varchar(255) NOT NULL, `object_id` bigint unsigned NOT NULL, `object_type` varchar(255) NOT NULL, `created` DATETIME NOT NULL, `last_updated` DATETIME, `job_id` varchar(255), `download_pct` int(10) unsigned, `download_state` varchar(255), `error_str` varchar(255), `local_path` varchar(255), `install_path` varchar(255), `size` bigint unsigned COMMENT 'the size of the template on the pool', `state` varchar(255) NOT NULL, `update_count` bigint unsigned NOT NULL, `updated` DATETIME, PRIMARY KEY (`id`) ) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=utf8 2013-02-11 12:23:53,117 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() CREATE TABLE `cloud`.`data_store_provider` ( `id` bigint unsigned NOT NULL AUTO_INCREMENT COMMENT 'id', `name` varchar(255) NOT NULL COMMENT 'name of primary data store provider', `uuid` varchar(255) NOT NULL COMMENT 'uuid of primary data store provider', PRIMARY KEY(`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8 2013-02-11 12:23:53,125 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() CREATE TABLE `cloud`.`image_data_store` ( `id` bigint unsigned NOT NULL AUTO_INCREMENT COMMENT 'id', `name` varchar(255) NOT NULL COMMENT 'name of data store', `image_provider_id` bigint unsigned NOT NULL COMMENT 'id of image_data_store_provider', `protocol` varchar(255) NOT NULL COMMENT 'protocol of data store', `data_center_id` bigint unsigned COMMENT 'datacenter id of data store', `scope` varchar(255) COMMENT 'scope of data store', `uuid` varchar(255) COMMENT 'uuid of data store', PRIMARY KEY(`id`), CONSTRAINT `fk_tags__image_data_store_provider_id` FOREIGN KEY(`image_provider_id`) REFERENCES `data_store_provider`(`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8 2013-02-11 12:23:53,133 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() CREATE TABLE `cloud`.`vm_compute_tags` ( `id` bigint unsigned NOT NULL AUTO_INCREMENT COMMENT 'id', `vm_id` bigint unsigned NOT NULL COMMENT 'vm id', `compute_tag` varchar(255) NOT NULL COMMENT 'name of tag', PRIMARY KEY(`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8 2013-02-11 12:23:53,141 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() CREATE TABLE `cloud`.`vm_root_disk_tags` ( `id` bigint unsigned NOT NULL AUTO_INCREMENT COMMENT 'id', `vm_id` bigint unsigned NOT NULL COMMENT 'vm id', `root_disk_tag` varchar(255) NOT NULL COMMENT 'name of tag', PRIMARY KEY(`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8 2013-02-11 12:23:53,148 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() CREATE TABLE `cloud`.`vm_network_map` ( `id` bigint unsigned NOT NULL AUTO_INCREMENT COMMENT 'id', `vm_id` bigint unsigned NOT NULL COMMENT 'vm id', `network_id` bigint unsigned NOT NULL COMMENT 'network id', PRIMARY KEY(`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8 2013-02-11 12:23:53,156 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() CREATE TABLE `cloud`.`vm_reservation` ( `id` bigint unsigned NOT NULL AUTO_INCREMENT COMMENT 'id', `uuid` varchar(40) NOT NULL COMMENT 'reservation id', `vm_id` bigint unsigned NOT NULL COMMENT 'vm id', `data_center_id` bigint unsigned NOT NULL COMMENT 'zone id', `pod_id` bigint unsigned NOT NULL COMMENT 'pod id', `cluster_id` bigint unsigned NOT NULL COMMENT 'cluster id', `host_id` bigint unsigned NOT NULL COMMENT 'host id', `created` datetime COMMENT 'date created', `removed` datetime COMMENT 'date removed if not null', CONSTRAINT `uc_vm_reservation__uuid` UNIQUE (`uuid`), PRIMARY KEY(`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8 2013-02-11 12:23:53,164 DEBUG [utils.db.ScriptRunner] (com.cloud.upgrade.DatabaseCreator.main() CREATE TABLE `cloud`.`volume_reservation` ( `id` bigint unsigned NOT NULL AUTO_INCREMENT COMMENT 'id', `vm_reservation_id` bigint unsigned NOT NULL COMMENT 'id of the vm reservation', `vm_id` bigint unsigned NOT NULL COMMENT 'vm id', `volume_id` bigint unsigned NOT NULL COMMENT 'volume id', `pool_id` bigint unsigned NOT NULL COMMENT 'pool assigned to the volume', CONSTRAINT `fk_vm_pool_reservation__vm_reservation_id` FOREIGN KEY (`vm_reservation_id`) REFERENCES `vm_reservation`(`id`) ON DELETE CASCADE, PRIMARY KEY(`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8 Also, the table description: mysql> desc vm_instance; -------------------- ------------------- ---- --- ------- ------+ Field Type Null Key Default Extra -------------------- ------------------- ---- --- ------- ------+ id bigint(20) unsigned NO PRI NULL   name varchar(255) NO   NULL   uuid varchar(40) YES UNI NULL   instance_name varchar(255) NO   NULL   state varchar(32) NO MUL NULL   desired_state varchar(32) YES   NULL   vm_template_id bigint(20) unsigned YES MUL NULL   guest_os_id bigint(20) unsigned NO   NULL   private_mac_address varchar(17) YES   NULL   private_ip_address char(40) YES   NULL   pod_id bigint(20) unsigned YES MUL NULL   data_center_id bigint(20) unsigned NO MUL NULL   host_id bigint(20) unsigned YES MUL NULL   last_host_id bigint(20) unsigned YES MUL NULL   proxy_id bigint(20) unsigned YES   NULL   proxy_assign_time datetime YES   NULL   vnc_password varchar(255) NO   NULL   ha_enabled tinyint(1) NO   0   limit_cpu_use tinyint(1) unsigned NO   0   update_count bigint(20) unsigned NO MUL 0   update_time datetime YES MUL NULL   created datetime NO   NULL   removed datetime YES MUL NULL   type varchar(32) NO MUL NULL   vm_type varchar(32) NO   NULL   account_id bigint(20) unsigned NO MUL NULL   domain_id bigint(20) unsigned NO   NULL   service_offering_id bigint(20) unsigned NO MUL NULL   reservation_id char(40) YES   NULL   hypervisor_type char(32) YES   NULL   disk_offering_id bigint(20) unsigned YES   NULL   cpu int(10) unsigned YES   NULL   ram bigint(20) unsigned YES   NULL   owner varchar(255) YES   NULL   speed int(10) unsigned YES   NULL   host_name varchar(255) YES   NULL   display_name varchar(255) YES   NULL   -------------------- ------------------- ---- --- ------- ------+ 37 rows in set (0.11 sec)
        Hide
        Prachi Damle added a comment -

        The need of storing disk_offering_id in vm_instance arises because cloud-engine is now relaying the createVM call from UserVmManager to VirtualMachineManager. This property is needed to send the required disk offerings to VirtualMachineManager API.

        However if we do this refactorig mentioned here: https://issues.apache.org/jira/browse/CLOUDSTACK-1217
        then we dont need the disk_offerin_ig property any more.

        So after fixing https://issues.apache.org/jira/browse/CLOUDSTACK-1217, I will remove the disk_offering_id. Till then we will keep this in the schema.
        -------------------------------

        The bug mentions that the column is not found in the database. This is a issue with deployDB and db upgrade step. Assigning to Rohit to take a look.

        The issue is 4.1-new-db-schema.sql is not being run. Root cause is that in create-schema.sql we insert the version to be 4.1 :

        INSERT INTO `version` (`version`, `updated`, `step`) VALUES('4.1.0', now(), 'Complete');

        So db upgarde does not run the 4.1 script since it finds that the version is already 4.1.

        Show
        Prachi Damle added a comment - The need of storing disk_offering_id in vm_instance arises because cloud-engine is now relaying the createVM call from UserVmManager to VirtualMachineManager. This property is needed to send the required disk offerings to VirtualMachineManager API. However if we do this refactorig mentioned here: https://issues.apache.org/jira/browse/CLOUDSTACK-1217 then we dont need the disk_offerin_ig property any more. So after fixing https://issues.apache.org/jira/browse/CLOUDSTACK-1217 , I will remove the disk_offering_id. Till then we will keep this in the schema. ------------------------------- The bug mentions that the column is not found in the database. This is a issue with deployDB and db upgrade step. Assigning to Rohit to take a look. The issue is 4.1-new-db-schema.sql is not being run. Root cause is that in create-schema.sql we insert the version to be 4.1 : INSERT INTO `version` (`version`, `updated`, `step`) VALUES('4.1.0', now(), 'Complete'); So db upgarde does not run the 4.1 script since it finds that the version is already 4.1.
        Hide
        Alex Huang added a comment -

        First we shouldn't have the disk_offering_id in vm_instance because servicer_offering_id is the same as the disk_offering_id for the root disk. Service offering includes the root disk offering. Assigning this to Prachi to update that.

        Second, we switched to use the same create-schema and then upgrade to create a brand new schema. This may not have been updated in the create-database scripts yet. So Prachi, after you update this, please assign to Rohit to make sure the new createdatabase process is being run in a production deployment.

        Show
        Alex Huang added a comment - First we shouldn't have the disk_offering_id in vm_instance because servicer_offering_id is the same as the disk_offering_id for the root disk. Service offering includes the root disk offering. Assigning this to Prachi to update that. Second, we switched to use the same create-schema and then upgrade to create a brand new schema. This may not have been updated in the create-database scripts yet. So Prachi, after you update this, please assign to Rohit to make sure the new createdatabase process is being run in a production deployment.

          People

          • Assignee:
            Rohit Yadav
            Reporter:
            Rayees Namathponnan
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development