Whirr
  1. Whirr
  2. WHIRR-363

ComputeCache redundantly creates ComputeServiceContexts

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.6.0
    • Fix Version/s: 0.6.0
    • Component/s: None
    • Labels:
      None

      Description

      Previously, ComputeCache used a stringified Key to ensure we don't create another ComputeService for the same provider. At some point, Key was modified to use both a string and a commons configuration object. Since commons configuration doesn't implement hashCode in a predictable way, the ComputeCache creates a new ComputeServiceContext each time it is used. Since we don't log or test this, it was easy to miss.

      Adding a simple log statement inside ComputeCache shows this:

      2011-08-13 12:29:22,532 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Starting up cluster...
      2011-08-13 12:29:37,760 INFO [org.apache.whirr.service.ComputeCache] (main) created new ComputeServiceContext [id=aws-ec2, endpoint=https://ec2.us-east-1.amazonaws.com, apiVersion=2010-06-15, identity=067PW7Z9P0FNH7JDPE82, iso3166Codes=[US-VA, US-CA, IE, SG, JP-13]]
      2011-08-13 12:29:46,115 INFO [org.apache.whirr.service.ComputeCache] (main) created new ComputeServiceContext [id=aws-ec2, endpoint=https://ec2.us-east-1.amazonaws.com, apiVersion=2010-06-15, identity=067PW7Z9P0FNH7JDPE82, iso3166Codes=[US-VA, US-CA, IE, SG, JP-13]]
      2011-08-13 12:29:46,118 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Bootstrapping cluster
      -snip-

      1. ComputeCache.java
        7 kB
        Adrian Cole
      2. ComputeCache.java
        7 kB
        Adrian Cole
      3. WHIRR-363.patch
        6 kB
        Andrei Savu

        Issue Links

          Activity

          Hide
          Andrei Savu added a comment -

          Good catch Adrian. I've just committed this.

          Show
          Andrei Savu added a comment - Good catch Adrian. I've just committed this.
          Hide
          Andrei Savu added a comment - - edited

          Created a patch for this change. Tested with ZooKeeper on cloudservers.

          It seems like the ZooKeeper integration tests are consistently failing in trunk on EC2. I will look into that in another issue.

          Show
          Andrei Savu added a comment - - edited Created a patch for this change. Tested with ZooKeeper on cloudservers. It seems like the ZooKeeper integration tests are consistently failing in trunk on EC2. I will look into that in another issue.
          Hide
          Adrian Cole added a comment -

          tested against a vcloud provider (Bluelock) to show that properties like endpoint pass through properly

          whirr.provider=vcloud
          whirr.identity=acole@Jclouds
          whirr.credential=XXXXXXX
          jclouds.vcloud.iso3166-codes=US-IN
          jclouds.vcloud.endpoint=https://zone01.bluelock.com/api
          jclouds.vcloud.defaults.network=internet01-.*

          Note supporting Bluelock would take a little work as their OS image doesn't work out of the box with our scripts. The point of this test is to ensure that the properties relating to ComputeCache pass through correctly, which the following shows.

          2011-08-13 14:26:00,624 INFO [org.apache.whirr.service.ComputeCache] (main) created new ComputeServiceContext [id=vcloud, endpoint=https://zone01.bluelock.com/api, apiVersion=1.0, identity=acole@Jclouds, iso3166Codes=[US-IN]]
          2011-08-13 14:26:00,627 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Bootstrapping cluster
          2011-08-13 14:26:00,628 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Configuring template
          2011-08-13 14:26:19,787 INFO [org.apache.whirr.actions.NodeStarter] (pool-3-thread-2) Starting 2 node(s) with roles [zookeeper]
          2011-08-13 14:30:39,906 INFO [org.apache.whirr.actions.NodeStarter] (pool-3-thread-2) Nodes started: [[id=https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204765156, providerId=https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204765156, group=zkclustertest, name=zkclustertest-70f, location=[id=https://zone01.bluelock.com/api/v1.0/vdc/480447969, scope=ZONE, description=Cluster01-Jclouds, parent=https://zone01.bluelock.com/api/v1.0/org/1484502809, iso3166Codes=[], metadata={}], uri=https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204765156, imageId=null, os=[osType=UBUNTU_64, arch=null, description=Ubuntu Linux (64-bit), family=ubuntu, is64Bit=true, name=Ubuntu 64-Bit, version=], state=RUNNING, loginPort=22, hostname=null, privateAddresses=[], publicAddresses=[173.240.109.131], hardware=[id=https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204765156, providerId=https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204765156, name=zkclustertest-70f, processors=[[cores=1.0, speed=1.0]], ram=512, volumes=[[id=0, type=LOCAL, size=30.0, device=null, durable=true, isBootDevice=true]], supportsImage=idEquals(https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204765156), tags=[]], loginUser=root, userMetadata={}, tags=[]], [id=https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204314172, providerId=https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204314172, group=zkclustertest, name=zkclustertest-78e, location=[id=https://zone01.bluelock.com/api/v1.0/vdc/480447969, scope=ZONE, description=Cluster01-Jclouds, parent=https://zone01.bluelock.com/api/v1.0/org/1484502809, iso3166Codes=[], metadata={}], uri=https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204314172, imageId=null, os=[osType=UBUNTU_64, arch=null, description=Ubuntu Linux (64-bit), family=ubuntu, is64Bit=true, name=Ubuntu 64-Bit, version=], state=RUNNING, loginPort=22, hostname=null, privateAddresses=[], publicAddresses=[173.240.109.106], hardware=[id=https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204314172, providerId=https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204314172, name=zkclustertest-78e, processors=[[cores=1.0, speed=1.0]], ram=512, volumes=[[id=0, type=LOCAL, size=30.0, device=null, durable=true, isBootDevice=true]], supportsImage=idEquals(https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204314172), tags=[]], loginUser=root, userMetadata={}, tags=[]]]
          2011-08-13 14:30:39,907 INFO [org.apache.whirr.actions.DestroyClusterAction] (main) Destroying zkclustertest cluster
          2011-08-13 14:31:06,812 INFO [org.apache.whirr.actions.DestroyClusterAction] (main) Cluster zkclustertest destroyed

          Show
          Adrian Cole added a comment - tested against a vcloud provider (Bluelock) to show that properties like endpoint pass through properly whirr.provider=vcloud whirr.identity=acole@Jclouds whirr.credential=XXXXXXX jclouds.vcloud.iso3166-codes=US-IN jclouds.vcloud.endpoint= https://zone01.bluelock.com/api jclouds.vcloud.defaults.network=internet01-.* Note supporting Bluelock would take a little work as their OS image doesn't work out of the box with our scripts. The point of this test is to ensure that the properties relating to ComputeCache pass through correctly, which the following shows. 2011-08-13 14:26:00,624 INFO [org.apache.whirr.service.ComputeCache] (main) created new ComputeServiceContext [id=vcloud, endpoint= https://zone01.bluelock.com/api , apiVersion=1.0, identity=acole@Jclouds, iso3166Codes= [US-IN] ] 2011-08-13 14:26:00,627 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Bootstrapping cluster 2011-08-13 14:26:00,628 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Configuring template 2011-08-13 14:26:19,787 INFO [org.apache.whirr.actions.NodeStarter] (pool-3-thread-2) Starting 2 node(s) with roles [zookeeper] 2011-08-13 14:30:39,906 INFO [org.apache.whirr.actions.NodeStarter] (pool-3-thread-2) Nodes started: [[id= https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204765156 , providerId= https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204765156 , group=zkclustertest, name=zkclustertest-70f, location=[id= https://zone01.bluelock.com/api/v1.0/vdc/480447969 , scope=ZONE, description=Cluster01-Jclouds, parent= https://zone01.bluelock.com/api/v1.0/org/1484502809 , iso3166Codes=[], metadata={}], uri= https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204765156 , imageId=null, os= [osType=UBUNTU_64, arch=null, description=Ubuntu Linux (64-bit), family=ubuntu, is64Bit=true, name=Ubuntu 64-Bit, version=] , state=RUNNING, loginPort=22, hostname=null, privateAddresses=[], publicAddresses= [173.240.109.131] , hardware=[id= https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204765156 , providerId= https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204765156 , name=zkclustertest-70f, processors=[ [cores=1.0, speed=1.0] ], ram=512, volumes=[ [id=0, type=LOCAL, size=30.0, device=null, durable=true, isBootDevice=true] ], supportsImage=idEquals( https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204765156 ), tags=[]], loginUser=root, userMetadata={}, tags=[]], [id= https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204314172 , providerId= https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204314172 , group=zkclustertest, name=zkclustertest-78e, location=[id= https://zone01.bluelock.com/api/v1.0/vdc/480447969 , scope=ZONE, description=Cluster01-Jclouds, parent= https://zone01.bluelock.com/api/v1.0/org/1484502809 , iso3166Codes=[], metadata={}], uri= https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204314172 , imageId=null, os= [osType=UBUNTU_64, arch=null, description=Ubuntu Linux (64-bit), family=ubuntu, is64Bit=true, name=Ubuntu 64-Bit, version=] , state=RUNNING, loginPort=22, hostname=null, privateAddresses=[], publicAddresses= [173.240.109.106] , hardware=[id= https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204314172 , providerId= https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204314172 , name=zkclustertest-78e, processors=[ [cores=1.0, speed=1.0] ], ram=512, volumes=[ [id=0, type=LOCAL, size=30.0, device=null, durable=true, isBootDevice=true] ], supportsImage=idEquals( https://zone01.bluelock.com/api/v1.0/vApp/vapp-1204314172 ), tags=[]], loginUser=root, userMetadata={}, tags=[]]] 2011-08-13 14:30:39,907 INFO [org.apache.whirr.actions.DestroyClusterAction] (main) Destroying zkclustertest cluster 2011-08-13 14:31:06,812 INFO [org.apache.whirr.actions.DestroyClusterAction] (main) Cluster zkclustertest destroyed
          Hide
          Adrian Cole added a comment -

          new version of the patch that handles private clouds like vcloud correctly

          Show
          Adrian Cole added a comment - new version of the patch that handles private clouds like vcloud correctly
          Hide
          Adrian Cole added a comment -

          tested on HBase090ServiceTest using -Dwhirr.test.provider=aws-ec2 -Dwhirr.test.identity=XXXX -Dwhirr.test.credential=XXXX

          2011-08-13 12:36:57,374 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Starting up cluster...
          2011-08-13 12:37:15,616 INFO [org.apache.whirr.service.ComputeCache] (main) created new ComputeServiceContext [id=aws-ec2, endpoint=https://ec2.us-east-1.amazonaws.com, apiVersion=2010-06-15, identity=067PW7Z9P0FNH7JDPE82, iso3166Codes=[US-VA, US-CA, IE, SG, JP-13]]
          2011-08-13 12:37:15,638 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Bootstrapping cluster
          2011-08-13 12:37:15,642 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Configuring template
          2011-08-13 12:38:38,344 INFO [org.apache.whirr.actions.NodeStarter] (pool-3-thread-2) Starting 1 node(s) with roles [hadoop-datanode, hadoop-tasktracker, hbase-regionserver]
          2011-08-13 12:38:38,354 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Configuring template
          2011-08-13 12:40:30,377 INFO [org.apache.whirr.actions.NodeStarter] (pool-3-thread-4) Starting 1 node(s) with roles [hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver]
          2011-08-13 12:43:55,473 INFO [org.apache.whirr.actions.NodeStarter] (pool-3-thread-4) Nodes started: [[id=us-east-1/i-eb662b8a, providerId=i-eb662b8a, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-04-65-A8, privateAddresses=[10.240.106.86], publicAddresses=[50.19.194.241], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-2cf23e46, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]]
          2011-08-13 12:44:15,955 INFO [org.apache.whirr.actions.NodeStarter] (pool-3-thread-2) Nodes started: [[id=us-east-1/i-71662b10, providerId=i-71662b10, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=ip-10-72-102-239, privateAddresses=[10.72.102.239], publicAddresses=[50.16.76.89], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-88f13de2, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]]
          2011-08-13 12:44:17,080 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.19.194.241, privateIp=10.240.106.86, id=us-east-1/i-eb662b8a, nodeMetadata=[id=us-east-1/i-eb662b8a, providerId=i-eb662b8a, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-04-65-A8, privateAddresses=[10.240.106.86], publicAddresses=[50.19.194.241], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-2cf23e46, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [50070, 50030] for [93.158.79.70/32]
          2011-08-13 12:44:21,505 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.19.194.241, privateIp=10.240.106.86, id=us-east-1/i-eb662b8a, nodeMetadata=[id=us-east-1/i-eb662b8a, providerId=i-eb662b8a, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-04-65-A8, privateAddresses=[10.240.106.86], publicAddresses=[50.19.194.241], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-2cf23e46, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [8020, 8021] for [50.19.194.241/32]
          2011-08-13 12:44:23,121 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.19.194.241, privateIp=10.240.106.86, id=us-east-1/i-eb662b8a, nodeMetadata=[id=us-east-1/i-eb662b8a, providerId=i-eb662b8a, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-04-65-A8, privateAddresses=[10.240.106.86], publicAddresses=[50.19.194.241], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-2cf23e46, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [2181] for [93.158.79.70/32]
          2011-08-13 12:44:23,650 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Authorizing firewall
          2011-08-13 12:44:24,247 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.19.194.241, privateIp=10.240.106.86, id=us-east-1/i-eb662b8a, nodeMetadata=[id=us-east-1/i-eb662b8a, providerId=i-eb662b8a, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-04-65-A8, privateAddresses=[10.240.106.86], publicAddresses=[50.19.194.241], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-2cf23e46, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [60010, 60000] for [93.158.79.70/32]
          2011-08-13 12:44:26,066 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.19.194.241, privateIp=10.240.106.86, id=us-east-1/i-eb662b8a, nodeMetadata=[id=us-east-1/i-eb662b8a, providerId=i-eb662b8a, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-04-65-A8, privateAddresses=[10.240.106.86], publicAddresses=[50.19.194.241], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-2cf23e46, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [9090] for [93.158.79.70/32]
          2011-08-13 12:44:27,166 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.19.194.241, privateIp=10.240.106.86, id=us-east-1/i-eb662b8a, nodeMetadata=[id=us-east-1/i-eb662b8a, providerId=i-eb662b8a, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-04-65-A8, privateAddresses=[10.240.106.86], publicAddresses=[50.19.194.241], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-2cf23e46, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [60030, 60020] for [93.158.79.70/32]
          2011-08-13 12:44:27,899 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Running configuration script
          2011-08-13 12:45:01,012 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Configuration script run completed
          2011-08-13 12:45:01,017 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Running configuration script
          2011-08-13 12:45:40,906 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Configuration script run completed
          2011-08-13 12:45:40,906 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Completed configuration of hbaseclustertest
          2011-08-13 12:45:40,906 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Namenode web UI available at http://ec2-50-19-194-241.compute-1.amazonaws.com:50070
          2011-08-13 12:45:40,906 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Jobtracker web UI available at http://ec2-50-19-194-241.compute-1.amazonaws.com:50030
          2011-08-13 12:45:40,907 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Wrote Hadoop site file /Users/adriancole/.whirr/hbaseclustertest/hadoop-site.xml
          2011-08-13 12:45:40,948 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Wrote Hadoop proxy script /Users/adriancole/.whirr/hbaseclustertest/hadoop-proxy.sh
          2011-08-13 12:45:40,948 INFO [org.apache.whirr.service.zookeeper.ZooKeeperClusterActionHandler] (main) Completed configuration of hbaseclustertest
          2011-08-13 12:45:40,948 INFO [org.apache.whirr.service.zookeeper.ZooKeeperClusterActionHandler] (main) Hosts: ec2-50-19-194-241.compute-1.amazonaws.com:2181
          2011-08-13 12:45:40,948 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Completed configuration of hbaseclustertest
          2011-08-13 12:45:40,949 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Web UI available at http://ec2-50-19-194-241.compute-1.amazonaws.com
          2011-08-13 12:45:40,949 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Wrote HBase site file /Users/adriancole/.whirr/hbaseclustertest/hbase-site.xml
          2011-08-13 12:45:40,965 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Wrote HBase proxy script /Users/adriancole/.whirr/hbaseclustertest/hbase-proxy.sh
          2011-08-13 12:45:41,465 INFO [org.apache.whirr.service.FileClusterStateStore] (main) Wrote instances file /Users/adriancole/.whirr/hbaseclustertest/instances
          2011-08-13 12:45:41,525 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Waiting for master...
          2011-08-13 12:45:42,179 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Connected to thrift server.
          2011-08-13 12:45:42,179 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Waiting for .META. table...
          Warning: Permanently added 'ec2-50-19-194-241.compute-1.amazonaws.com,50.19.194.241' (RSA) to the list of known hosts.

          2011-08-13 12:45:46,794 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Master reported in. Continuing.
          2011-08-13 12:45:51,806 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Shutting down cluster...
          2011-08-13 12:45:51,809 INFO [org.apache.whirr.actions.DestroyClusterAction] (main) Destroying hbaseclustertest cluster
          2011-08-13 12:46:32,775 INFO [org.apache.whirr.actions.DestroyClusterAction] (main) Cluster hbaseclustertest destroyed

          Show
          Adrian Cole added a comment - tested on HBase090ServiceTest using -Dwhirr.test.provider=aws-ec2 -Dwhirr.test.identity=XXXX -Dwhirr.test.credential=XXXX 2011-08-13 12:36:57,374 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Starting up cluster... 2011-08-13 12:37:15,616 INFO [org.apache.whirr.service.ComputeCache] (main) created new ComputeServiceContext [id=aws-ec2, endpoint= https://ec2.us-east-1.amazonaws.com , apiVersion=2010-06-15, identity=067PW7Z9P0FNH7JDPE82, iso3166Codes= [US-VA, US-CA, IE, SG, JP-13] ] 2011-08-13 12:37:15,638 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Bootstrapping cluster 2011-08-13 12:37:15,642 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Configuring template 2011-08-13 12:38:38,344 INFO [org.apache.whirr.actions.NodeStarter] (pool-3-thread-2) Starting 1 node(s) with roles [hadoop-datanode, hadoop-tasktracker, hbase-regionserver] 2011-08-13 12:38:38,354 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Configuring template 2011-08-13 12:40:30,377 INFO [org.apache.whirr.actions.NodeStarter] (pool-3-thread-4) Starting 1 node(s) with roles [hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver] 2011-08-13 12:43:55,473 INFO [org.apache.whirr.actions.NodeStarter] (pool-3-thread-4) Nodes started: [[id=us-east-1/i-eb662b8a, providerId=i-eb662b8a, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes= [US-VA] , metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os= [name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS] , state=RUNNING, loginPort=22, hostname=domU-12-31-39-04-65-A8, privateAddresses= [10.240.106.86] , publicAddresses= [50.19.194.241] , hardware=[id=m1.large, providerId=m1.large, name=null, processors=[ [cores=2.0, speed=2.0] ], ram=7680, volumes=[ [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false] , [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false] , [id=vol-2cf23e46, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true] ], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]] 2011-08-13 12:44:15,955 INFO [org.apache.whirr.actions.NodeStarter] (pool-3-thread-2) Nodes started: [[id=us-east-1/i-71662b10, providerId=i-71662b10, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes= [US-VA] , metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os= [name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS] , state=RUNNING, loginPort=22, hostname=ip-10-72-102-239, privateAddresses= [10.72.102.239] , publicAddresses= [50.16.76.89] , hardware=[id=m1.large, providerId=m1.large, name=null, processors=[ [cores=2.0, speed=2.0] ], ram=7680, volumes=[ [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false] , [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false] , [id=vol-88f13de2, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true] ], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]] 2011-08-13 12:44:17,080 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles= [hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver] , publicIp=50.19.194.241, privateIp=10.240.106.86, id=us-east-1/i-eb662b8a, nodeMetadata=[id=us-east-1/i-eb662b8a, providerId=i-eb662b8a, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes= [US-VA] , metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os= [name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS] , state=RUNNING, loginPort=22, hostname=domU-12-31-39-04-65-A8, privateAddresses= [10.240.106.86] , publicAddresses= [50.19.194.241] , hardware=[id=m1.large, providerId=m1.large, name=null, processors=[ [cores=2.0, speed=2.0] ], ram=7680, volumes=[ [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false] , [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false] , [id=vol-2cf23e46, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true] ], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [50070, 50030] for [93.158.79.70/32] 2011-08-13 12:44:21,505 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles= [hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver] , publicIp=50.19.194.241, privateIp=10.240.106.86, id=us-east-1/i-eb662b8a, nodeMetadata=[id=us-east-1/i-eb662b8a, providerId=i-eb662b8a, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes= [US-VA] , metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os= [name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS] , state=RUNNING, loginPort=22, hostname=domU-12-31-39-04-65-A8, privateAddresses= [10.240.106.86] , publicAddresses= [50.19.194.241] , hardware=[id=m1.large, providerId=m1.large, name=null, processors=[ [cores=2.0, speed=2.0] ], ram=7680, volumes=[ [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false] , [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false] , [id=vol-2cf23e46, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true] ], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [8020, 8021] for [50.19.194.241/32] 2011-08-13 12:44:23,121 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles= [hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver] , publicIp=50.19.194.241, privateIp=10.240.106.86, id=us-east-1/i-eb662b8a, nodeMetadata=[id=us-east-1/i-eb662b8a, providerId=i-eb662b8a, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes= [US-VA] , metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os= [name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS] , state=RUNNING, loginPort=22, hostname=domU-12-31-39-04-65-A8, privateAddresses= [10.240.106.86] , publicAddresses= [50.19.194.241] , hardware=[id=m1.large, providerId=m1.large, name=null, processors=[ [cores=2.0, speed=2.0] ], ram=7680, volumes=[ [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false] , [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false] , [id=vol-2cf23e46, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true] ], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [2181] for [93.158.79.70/32] 2011-08-13 12:44:23,650 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Authorizing firewall 2011-08-13 12:44:24,247 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles= [hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver] , publicIp=50.19.194.241, privateIp=10.240.106.86, id=us-east-1/i-eb662b8a, nodeMetadata=[id=us-east-1/i-eb662b8a, providerId=i-eb662b8a, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes= [US-VA] , metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os= [name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS] , state=RUNNING, loginPort=22, hostname=domU-12-31-39-04-65-A8, privateAddresses= [10.240.106.86] , publicAddresses= [50.19.194.241] , hardware=[id=m1.large, providerId=m1.large, name=null, processors=[ [cores=2.0, speed=2.0] ], ram=7680, volumes=[ [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false] , [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false] , [id=vol-2cf23e46, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true] ], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [60010, 60000] for [93.158.79.70/32] 2011-08-13 12:44:26,066 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles= [hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver] , publicIp=50.19.194.241, privateIp=10.240.106.86, id=us-east-1/i-eb662b8a, nodeMetadata=[id=us-east-1/i-eb662b8a, providerId=i-eb662b8a, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes= [US-VA] , metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os= [name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS] , state=RUNNING, loginPort=22, hostname=domU-12-31-39-04-65-A8, privateAddresses= [10.240.106.86] , publicAddresses= [50.19.194.241] , hardware=[id=m1.large, providerId=m1.large, name=null, processors=[ [cores=2.0, speed=2.0] ], ram=7680, volumes=[ [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false] , [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false] , [id=vol-2cf23e46, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true] ], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [9090] for [93.158.79.70/32] 2011-08-13 12:44:27,166 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles= [hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver] , publicIp=50.19.194.241, privateIp=10.240.106.86, id=us-east-1/i-eb662b8a, nodeMetadata=[id=us-east-1/i-eb662b8a, providerId=i-eb662b8a, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes= [US-VA] , metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os= [name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS] , state=RUNNING, loginPort=22, hostname=domU-12-31-39-04-65-A8, privateAddresses= [10.240.106.86] , publicAddresses= [50.19.194.241] , hardware=[id=m1.large, providerId=m1.large, name=null, processors=[ [cores=2.0, speed=2.0] ], ram=7680, volumes=[ [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false] , [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false] , [id=vol-2cf23e46, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true] ], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [60030, 60020] for [93.158.79.70/32] 2011-08-13 12:44:27,899 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Running configuration script 2011-08-13 12:45:01,012 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Configuration script run completed 2011-08-13 12:45:01,017 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Running configuration script 2011-08-13 12:45:40,906 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Configuration script run completed 2011-08-13 12:45:40,906 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Completed configuration of hbaseclustertest 2011-08-13 12:45:40,906 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Namenode web UI available at http://ec2-50-19-194-241.compute-1.amazonaws.com:50070 2011-08-13 12:45:40,906 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Jobtracker web UI available at http://ec2-50-19-194-241.compute-1.amazonaws.com:50030 2011-08-13 12:45:40,907 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Wrote Hadoop site file /Users/adriancole/.whirr/hbaseclustertest/hadoop-site.xml 2011-08-13 12:45:40,948 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Wrote Hadoop proxy script /Users/adriancole/.whirr/hbaseclustertest/hadoop-proxy.sh 2011-08-13 12:45:40,948 INFO [org.apache.whirr.service.zookeeper.ZooKeeperClusterActionHandler] (main) Completed configuration of hbaseclustertest 2011-08-13 12:45:40,948 INFO [org.apache.whirr.service.zookeeper.ZooKeeperClusterActionHandler] (main) Hosts: ec2-50-19-194-241.compute-1.amazonaws.com:2181 2011-08-13 12:45:40,948 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Completed configuration of hbaseclustertest 2011-08-13 12:45:40,949 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Web UI available at http://ec2-50-19-194-241.compute-1.amazonaws.com 2011-08-13 12:45:40,949 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Wrote HBase site file /Users/adriancole/.whirr/hbaseclustertest/hbase-site.xml 2011-08-13 12:45:40,965 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Wrote HBase proxy script /Users/adriancole/.whirr/hbaseclustertest/hbase-proxy.sh 2011-08-13 12:45:41,465 INFO [org.apache.whirr.service.FileClusterStateStore] (main) Wrote instances file /Users/adriancole/.whirr/hbaseclustertest/instances 2011-08-13 12:45:41,525 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Waiting for master... 2011-08-13 12:45:42,179 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Connected to thrift server. 2011-08-13 12:45:42,179 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Waiting for .META. table... Warning: Permanently added 'ec2-50-19-194-241.compute-1.amazonaws.com,50.19.194.241' (RSA) to the list of known hosts. 2011-08-13 12:45:46,794 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Master reported in. Continuing. 2011-08-13 12:45:51,806 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Shutting down cluster... 2011-08-13 12:45:51,809 INFO [org.apache.whirr.actions.DestroyClusterAction] (main) Destroying hbaseclustertest cluster 2011-08-13 12:46:32,775 INFO [org.apache.whirr.actions.DestroyClusterAction] (main) Cluster hbaseclustertest destroyed
          Hide
          Adrian Cole added a comment -

          tested with hbase and note no redundant contexts are created:

          2011-08-13 12:36:57,374 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Starting up cluster...
          2011-08-13 12:37:15,616 INFO [org.apache.whirr.service.ComputeCache] (main) created new ComputeServiceContext [id=aws-ec2, endpoint=https://ec2.us-east-1.amazonaws.com, apiVersion=2010-06-15, identity=067PW7Z9P0FNH7JDPE82, iso3166Codes=[US-VA, US-CA, IE, SG, JP-13]]
          2011-08-13 12:37:15,638 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Bootstrapping cluster
          -snip-

          Show
          Adrian Cole added a comment - tested with hbase and note no redundant contexts are created: 2011-08-13 12:36:57,374 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Starting up cluster... 2011-08-13 12:37:15,616 INFO [org.apache.whirr.service.ComputeCache] (main) created new ComputeServiceContext [id=aws-ec2, endpoint= https://ec2.us-east-1.amazonaws.com , apiVersion=2010-06-15, identity=067PW7Z9P0FNH7JDPE82, iso3166Codes= [US-VA, US-CA, IE, SG, JP-13] ] 2011-08-13 12:37:15,638 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Bootstrapping cluster - snip -
          Hide
          Adrian Cole added a comment -

          save as the following once WHIRR-361 is applied
          ./core/src/main/java/org/apache/whirr/service/ComputeCache.java

          Show
          Adrian Cole added a comment - save as the following once WHIRR-361 is applied ./core/src/main/java/org/apache/whirr/service/ComputeCache.java

            People

            • Assignee:
              Adrian Cole
              Reporter:
              Adrian Cole
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 1h
                1h
                Remaining:
                Remaining Estimate - 1h
                1h
                Logged:
                Time Spent - Not Specified
                Not Specified

                  Development