Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.6.0
    • Fix Version/s: 0.6.0
    • Component/s: core
    • Labels:
      None

      Description

      jclouds 1.1.0 includes many features interesting to whirr including: a new provider (greenhousedata-element-vcloud), hostname support on nodes, stabilized ssh via the new sshj driver, new ec2 ingress rule syntax that allows you to specify group + port combinations, and templateBuilder parameter to prefer S3-backed amis.

        Issue Links

          Activity

          Hide
          Andrei Savu added a comment -

          I've just committed this. Thanks Adrian! Hadoop integration tests pass on cloudservers.

          Show
          Andrei Savu added a comment - I've just committed this. Thanks Adrian! Hadoop integration tests pass on cloudservers.
          Hide
          Adrian Cole added a comment -
          Show
          Adrian Cole added a comment - here's a full overview: http://code.google.com/p/jclouds/wiki/ReleaseNotes110
          Hide
          Adrian Cole added a comment -

          patch is available and tested in aws-ec2

          Show
          Adrian Cole added a comment - patch is available and tested in aws-ec2
          Hide
          Adrian Cole added a comment -

          tested with HBase090ServiceTest

          2011-08-05 12:04:15,953 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Starting up cluster...
          2011-08-05 12:04:27,215 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Bootstrapping cluster
          2011-08-05 12:04:28,803 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Configuring template
          2011-08-05 12:04:35,784 INFO [org.apache.whirr.actions.NodeStarter] (pool-5-thread-2) Starting 1 node(s) with roles [hadoop-datanode, hadoop-tasktracker, hbase-regionserver]
          2011-08-05 12:04:37,411 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Configuring template
          2011-08-05 12:04:44,015 INFO [org.apache.whirr.actions.NodeStarter] (pool-5-thread-4) Starting 1 node(s) with roles [hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver]
          2011-08-05 12:09:40,804 INFO [org.apache.whirr.actions.NodeStarter] (pool-5-thread-2) Nodes started: [[id=us-east-1/i-87bcd9e6, providerId=i-87bcd9e6, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-04-2D-81, privateAddresses=[10.240.50.111], publicAddresses=[50.19.163.65], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-b42addde, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]]
          2011-08-05 12:10:15,690 INFO [org.apache.whirr.actions.NodeStarter] (pool-5-thread-4) Nodes started: [[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses=[10.206.17.156], publicAddresses=[50.17.126.6], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]]
          2011-08-05 12:10:22,008 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses=[10.206.17.156], publicAddresses=[50.17.126.6], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [50070, 50030] for [129.215.2.125/32]
          2011-08-05 12:10:22,431 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses=[10.206.17.156], publicAddresses=[50.17.126.6], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [8020, 8021] for [50.17.126.6/32]
          2011-08-05 12:10:22,967 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses=[10.206.17.156], publicAddresses=[50.17.126.6], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [2181] for [129.215.2.125/32]
          2011-08-05 12:10:23,175 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Authorizing firewall
          2011-08-05 12:10:23,265 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses=[10.206.17.156], publicAddresses=[50.17.126.6], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [60010, 60000] for [129.215.2.125/32]
          2011-08-05 12:10:23,732 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses=[10.206.17.156], publicAddresses=[50.17.126.6], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [9090] for [129.215.2.125/32]
          2011-08-05 12:10:26,976 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses=[10.206.17.156], publicAddresses=[50.17.126.6], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [60030, 60020] for [129.215.2.125/32]
          2011-08-05 12:10:29,036 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Running configuration script
          2011-08-05 12:10:49,802 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Configuration script run completed
          2011-08-05 12:10:53,871 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Running configuration script
          2011-08-05 12:11:15,020 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Configuration script run completed
          2011-08-05 12:11:15,020 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Completed configuration of hbaseclustertest
          2011-08-05 12:11:15,020 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Namenode web UI available at http://ec2-50-17-126-6.compute-1.amazonaws.com:50070
          2011-08-05 12:11:15,020 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Jobtracker web UI available at http://ec2-50-17-126-6.compute-1.amazonaws.com:50030
          2011-08-05 12:11:15,039 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Wrote Hadoop site file /Users/adriancole/.whirr/hbaseclustertest/hadoop-site.xml
          2011-08-05 12:11:15,042 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Wrote Hadoop proxy script /Users/adriancole/.whirr/hbaseclustertest/hadoop-proxy.sh
          2011-08-05 12:11:15,042 INFO [org.apache.whirr.service.zookeeper.ZooKeeperClusterActionHandler] (main) Completed configuration of hbaseclustertest
          2011-08-05 12:11:15,042 INFO [org.apache.whirr.service.zookeeper.ZooKeeperClusterActionHandler] (main) Hosts: ec2-50-17-126-6.compute-1.amazonaws.com:2181
          2011-08-05 12:11:15,042 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Completed configuration of hbaseclustertest
          2011-08-05 12:11:15,042 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Web UI available at http://ec2-50-17-126-6.compute-1.amazonaws.com
          2011-08-05 12:11:15,043 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Wrote HBase site file /Users/adriancole/.whirr/hbaseclustertest/hbase-site.xml
          2011-08-05 12:11:15,043 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Wrote HBase proxy script /Users/adriancole/.whirr/hbaseclustertest/hbase-proxy.sh
          2011-08-05 12:11:15,236 INFO [org.apache.whirr.service.FileClusterStateStore] (main) Wrote instances file /Users/adriancole/.whirr/hbaseclustertest/instances
          2011-08-05 12:11:15,313 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Waiting for master...
          .Warning: Permanently added 'ec2-50-17-126-6.compute-1.amazonaws.com,50.17.126.6' (RSA) to the list of known hosts.
          2011-08-05 12:11:16,569 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Connected to thrift server.
          2011-08-05 12:11:16,570 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Waiting for .META. table...

          2011-08-05 12:11:22,779 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Master reported in. Continuing.
          2011-08-05 12:11:25,273 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Shutting down cluster...
          2011-08-05 12:11:25,276 INFO [org.apache.whirr.actions.DestroyClusterAction] (main) Destroying hbaseclustertest cluster
          2011-08-05 12:11:54,428 INFO [org.apache.whirr.actions.DestroyClusterAction] (main) Cluster hbaseclustertest destroyed

          Show
          Adrian Cole added a comment - tested with HBase090ServiceTest 2011-08-05 12:04:15,953 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Starting up cluster... 2011-08-05 12:04:27,215 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Bootstrapping cluster 2011-08-05 12:04:28,803 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Configuring template 2011-08-05 12:04:35,784 INFO [org.apache.whirr.actions.NodeStarter] (pool-5-thread-2) Starting 1 node(s) with roles [hadoop-datanode, hadoop-tasktracker, hbase-regionserver] 2011-08-05 12:04:37,411 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Configuring template 2011-08-05 12:04:44,015 INFO [org.apache.whirr.actions.NodeStarter] (pool-5-thread-4) Starting 1 node(s) with roles [hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver] 2011-08-05 12:09:40,804 INFO [org.apache.whirr.actions.NodeStarter] (pool-5-thread-2) Nodes started: [[id=us-east-1/i-87bcd9e6, providerId=i-87bcd9e6, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes= [US-VA] , metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os= [name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS] , state=RUNNING, loginPort=22, hostname=domU-12-31-39-04-2D-81, privateAddresses= [10.240.50.111] , publicAddresses= [50.19.163.65] , hardware=[id=m1.large, providerId=m1.large, name=null, processors=[ [cores=2.0, speed=2.0] ], ram=7680, volumes=[ [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false] , [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false] , [id=vol-b42addde, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true] ], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]] 2011-08-05 12:10:15,690 INFO [org.apache.whirr.actions.NodeStarter] (pool-5-thread-4) Nodes started: [[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes= [US-VA] , metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os= [name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS] , state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses= [10.206.17.156] , publicAddresses= [50.17.126.6] , hardware=[id=m1.large, providerId=m1.large, name=null, processors=[ [cores=2.0, speed=2.0] ], ram=7680, volumes=[ [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false] , [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false] , [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true] ], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]] 2011-08-05 12:10:22,008 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles= [hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver] , publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes= [US-VA] , metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os= [name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS] , state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses= [10.206.17.156] , publicAddresses= [50.17.126.6] , hardware=[id=m1.large, providerId=m1.large, name=null, processors=[ [cores=2.0, speed=2.0] ], ram=7680, volumes=[ [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false] , [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false] , [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true] ], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [50070, 50030] for [129.215.2.125/32] 2011-08-05 12:10:22,431 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles= [hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver] , publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes= [US-VA] , metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os= [name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS] , state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses= [10.206.17.156] , publicAddresses= [50.17.126.6] , hardware=[id=m1.large, providerId=m1.large, name=null, processors=[ [cores=2.0, speed=2.0] ], ram=7680, volumes=[ [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false] , [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false] , [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true] ], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [8020, 8021] for [50.17.126.6/32] 2011-08-05 12:10:22,967 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles= [hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver] , publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes= [US-VA] , metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os= [name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS] , state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses= [10.206.17.156] , publicAddresses= [50.17.126.6] , hardware=[id=m1.large, providerId=m1.large, name=null, processors=[ [cores=2.0, speed=2.0] ], ram=7680, volumes=[ [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false] , [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false] , [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true] ], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [2181] for [129.215.2.125/32] 2011-08-05 12:10:23,175 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Authorizing firewall 2011-08-05 12:10:23,265 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles= [hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver] , publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes= [US-VA] , metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os= [name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS] , state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses= [10.206.17.156] , publicAddresses= [50.17.126.6] , hardware=[id=m1.large, providerId=m1.large, name=null, processors=[ [cores=2.0, speed=2.0] ], ram=7680, volumes=[ [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false] , [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false] , [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true] ], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [60010, 60000] for [129.215.2.125/32] 2011-08-05 12:10:23,732 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles= [hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver] , publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes= [US-VA] , metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os= [name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS] , state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses= [10.206.17.156] , publicAddresses= [50.17.126.6] , hardware=[id=m1.large, providerId=m1.large, name=null, processors=[ [cores=2.0, speed=2.0] ], ram=7680, volumes=[ [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false] , [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false] , [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true] ], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [9090] for [129.215.2.125/32] 2011-08-05 12:10:26,976 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles= [hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver] , publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes= [US-VA] , metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os= [name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS] , state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses= [10.206.17.156] , publicAddresses= [50.17.126.6] , hardware=[id=m1.large, providerId=m1.large, name=null, processors=[ [cores=2.0, speed=2.0] ], ram=7680, volumes=[ [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false] , [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false] , [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true] ], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [60030, 60020] for [129.215.2.125/32] 2011-08-05 12:10:29,036 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Running configuration script 2011-08-05 12:10:49,802 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Configuration script run completed 2011-08-05 12:10:53,871 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Running configuration script 2011-08-05 12:11:15,020 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Configuration script run completed 2011-08-05 12:11:15,020 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Completed configuration of hbaseclustertest 2011-08-05 12:11:15,020 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Namenode web UI available at http://ec2-50-17-126-6.compute-1.amazonaws.com:50070 2011-08-05 12:11:15,020 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Jobtracker web UI available at http://ec2-50-17-126-6.compute-1.amazonaws.com:50030 2011-08-05 12:11:15,039 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Wrote Hadoop site file /Users/adriancole/.whirr/hbaseclustertest/hadoop-site.xml 2011-08-05 12:11:15,042 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Wrote Hadoop proxy script /Users/adriancole/.whirr/hbaseclustertest/hadoop-proxy.sh 2011-08-05 12:11:15,042 INFO [org.apache.whirr.service.zookeeper.ZooKeeperClusterActionHandler] (main) Completed configuration of hbaseclustertest 2011-08-05 12:11:15,042 INFO [org.apache.whirr.service.zookeeper.ZooKeeperClusterActionHandler] (main) Hosts: ec2-50-17-126-6.compute-1.amazonaws.com:2181 2011-08-05 12:11:15,042 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Completed configuration of hbaseclustertest 2011-08-05 12:11:15,042 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Web UI available at http://ec2-50-17-126-6.compute-1.amazonaws.com 2011-08-05 12:11:15,043 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Wrote HBase site file /Users/adriancole/.whirr/hbaseclustertest/hbase-site.xml 2011-08-05 12:11:15,043 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Wrote HBase proxy script /Users/adriancole/.whirr/hbaseclustertest/hbase-proxy.sh 2011-08-05 12:11:15,236 INFO [org.apache.whirr.service.FileClusterStateStore] (main) Wrote instances file /Users/adriancole/.whirr/hbaseclustertest/instances 2011-08-05 12:11:15,313 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Waiting for master... .Warning: Permanently added 'ec2-50-17-126-6.compute-1.amazonaws.com,50.17.126.6' (RSA) to the list of known hosts. 2011-08-05 12:11:16,569 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Connected to thrift server. 2011-08-05 12:11:16,570 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Waiting for .META. table... 2011-08-05 12:11:22,779 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Master reported in. Continuing. 2011-08-05 12:11:25,273 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Shutting down cluster... 2011-08-05 12:11:25,276 INFO [org.apache.whirr.actions.DestroyClusterAction] (main) Destroying hbaseclustertest cluster 2011-08-05 12:11:54,428 INFO [org.apache.whirr.actions.DestroyClusterAction] (main) Cluster hbaseclustertest destroyed

            People

            • Assignee:
              Adrian Cole
              Reporter:
              Adrian Cole
            • Votes:
              1 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 1h
                1h
                Remaining:
                Remaining Estimate - 1h
                1h
                Logged:
                Time Spent - Not Specified
                Not Specified

                  Development