3,045
edits
Changes
From Genome Analysis Wiki
Jump to navigationJump to searchno edit summary
*** If you need help setting up your AWS credentials, see: [[AWS Credentials]]
*** If you need help setting up your AWS credentials, see: [[AWS Credentials]]
You can skip the cluster start section if you want.
''' Troubleshooting: ''' When I tried this, the <code>starcluster start mycluster</code> step failed similar to:
* http://star.mit.edu/cluster/mlarchives/2425.html
* So I followed the suggestions there and at https://github.com/jtriley/StarCluster/issues/455:
*# <pre>$ sudo pip uninstall boto</pre>
*# <pre>$ sudo easy_install boto==2.32.0</pre>
*#* I was having trouble with pip install, but found that easy_install worked
* I had to force terminate mycluster after a failed start:
** <pre> starcluster terminate -f mycluster</pre>
* Then I was able to successfully start my cluster
''' Don't forget to terminate your cluster:'''
starcluster terminate mycluster
== StarCluster and GotCloud ==
By default, StarCluster expects a configuration file in ~/.starcluster/config.
* StarCluster will create a model file for you
Ensure your StarCluster configuration file is set for your usage.
* General AWS Settings:
[aws info]
aws_access_key_id = #your aws access key id here
aws_secret_access_key = #your secret aws access key here
aws_user_id = #your 12-digit aws user id here
* You should have set these in [[#Getting Started With StarCluster|Getting Started With StarCluster]] above (quickstart guide and AWS Credentials) .
'''GotCloud settings:'''
* You may want to Create a new cluster description for running GotCloud (or you can use smallcluster)
* Use the GotCloud AMIs:
MASTER_IMAGE_ID = ami-6ae65e02
NODE_IMAGE_ID = ami-3393a45a
* We do not recommend running GotCloud on machines with less than 4MB of memory
[[GotCloud: AMIs]]
=== Run GotCloud Demo Using StarCluster ===
Be sure to set:
MASTER_IMAGE_ID = ami-6ae65e02
NODE_IMAGE_ID = ami-3393a45a
#Create a new cluster section in your configuration file: <code>~/.starcluster/config</code>
#* Add the following to the end of the configuration file:
#*: <pre>[cluster gccluster] KEYNAME = mykey CLUSTER_SIZE = 4 CLUSTER_USER = sgeadmin CLUSTER_SHELL = bash MASTER_IMAGE_ID = ami-6ae65e02 NODE_IMAGE_ID = ami-3393a45a NODE_INSTANCE_TYPE = m3.large</pre>
# Start the cluster:
# <pre>starcluster start -c gccluster mycluster</pre>
#* Alternatively, you can change the default template at the start of the configuration file in the <code>[global]</code> section to gccluster: <code>DEFAULT_TEMPLATE=gccluster</code>
# Logon to the cluster as ubuntu:
#* <pre>starcluster sshmaster -u ubuntu mycluster</pre>
# Run GotCloud snpcall
#* <pre>gotcloud snpcall --conf example/test.conf --outdir output --numjobs 8 --batchtype sgei</pre>
# Run GotCloud indell
#* <pre>gotcloud snpcall --conf example/test.conf --outdir output --numjobs 8 --batchtype sgei</pre>
# Terminate the cluster
#* <pre>starcluster terminate mycluster</pre>
== Old Instructions==
'''StarCluster Configuration Example'''
'''StarCluster Configuration Example'''
