Details
Major Description
I'm having a critical issue while creating an ec2 cluster , here is the input command and output i got :
./spark-ec2 -i ~/amazonhdp.pem -k amazonhdp -s 4 -t m1.small launch hadoopi
Setting up security groups...
Creating security group hadoopi-master
Creating security group hadoopi-slaves
ERROR:boto:400 Bad Request
ERROR:boto:<?xml version="1.0" encoding="UTF-8"?>
<Response><Errors><Error><Code>InvalidGroup.NotFound</Code><Message>The security group 'sg-2ec1b84b' does not exist</Message></Error></Errors><RequestID>6554c7a8-f68a-4032-ad63-65106e2de9b3</RequestID></Response>
Traceback (most recent call last):
File "./spark_ec2.py", line 856, in <module>
main()
File "./spark_ec2.py", line 848, in main
real_main()
File "./spark_ec2.py", line 731, in real_main
conn, opts, cluster_name)
File "./spark_ec2.py", line 252, in launch_cluster
master_group.authorize('tcp', 50030, 50030, '0.0.0.0/0')
File "/opt/spark-1.0.1-bin-hadoop2/ec2/third_party/boto-2.4.1.zip/boto-2.4.1/boto/ec2/securitygroup.py", line 184, in authorize
File "/opt/spark-1.0.1-bin-hadoop2/ec2/third_party/boto-2.4.1.zip/boto-2.4.1/boto/ec2/connection.py", line 2181, in authorize_security_group
File "/opt/spark-1.0.1-bin-hadoop2/ec2/third_party/boto-2.4.1.zip/boto-2.4.1/boto/connection.py", line 944, in get_status
boto.exception.EC2ResponseError: EC2ResponseError: 400 Bad Request
<?xml version="1.0" encoding="UTF-8"?>
<Response><Errors><Error><Code>InvalidGroup.NotFound</Code><Message>The security group 'sg-2ec1b84b' does not exist</Message></Error></Errors><RequestID>6554c7a8-f68a-4032-ad63-65106e2de9b3</RequestID></Response>
Attachments
Issue Links
- duplicates
-
SPARK-3405 EC2 cluster creation on VPC
-
- Resolved
-