3,045
edits
Changes
From Genome Analysis Wiki
Jump to navigationJump to search→StarCluster and GotCloud
* You should have set these in [[#Getting Started With StarCluster|Getting Started With StarCluster]] above (quickstart guide and AWS Credentials) .
* You should have set these in [[#Getting Started With StarCluster|Getting Started With StarCluster]] above (quickstart guide and AWS Credentials) .
=== Using GotCloud On StarCluster ===
* You may want to Create a new cluster description for running GotCloud (or you can use smallcluster)
==== StarCluster Config Settings ====
* Use the GotCloud AMIs:
* You may want to create a new cluster section for running GotCloud (or you can use smallcluster) in your configuration file: <code>~/.starcluster/config</code>
** You can call it anything you want, for example, <pre>gccluster</pre>
** Example:
* We do not recommend running GotCloud on machines with less than 4MB of memory
**: <pre>[cluster gccluster] KEYNAME = mykey CLUSTER_SIZE = 4 CLUSTER_USER = sgeadmin CLUSTER_SHELL = bash MASTER_IMAGE_ID = ami-6ae65e02 NODE_IMAGE_ID = ami-3393a45a NODE_INSTANCE_TYPE = m3.large</pre>
*** Set <code>KEYNAME</code> to the key you want to use
*** Set <code>CLUSTER_SIZE</code> to the number of nodes you want to start up (this may be different than 4)
*** Set <code>CLUSTER_USER</code> to add additional users, like <code>sgeadmin</code>
*** Set <code>CLUSTER_SHELL</code> to define the shell you want to use, like <code>bash</code>
*** Set <code>MASTER_IMAGE_ID</code> to the latest GotCloud AMI, see: [[GotCloud: AMIs]]
*** Set <code>NODE_IMAGE_ID</code> to a StarCluster <code>ubuntu x86_64</code> AMI
*** Set <code>NODE_INSTANCE_TYPE</code> to the type of instances you want to start in your cluster
**** See http://aws.amazon.com/ec2/pricing/ for instance descriptions and prices
**** We do not recommend running GotCloud on machines with less than 4MB of memory
** The <code>CLUSTER_SIZE</code> * CPUs in <code>NODE_INSTANCE_TYPE</code> = the number of jobs you can run concurrently in GotCloud
==== Running GotCloud on StarCluster ====
* When Running GotCloud:
** Set the cluster/batch type in either configuration or on the command line:
*** In Configuration:
***: <pre>BATCH_TYPE = sgei</pre>
*** On the command-line:
***: <pre>--batchtype sgei</pre>
** Set the number of jobs to run:
**: <pre>--numjobs #</pre>
*** Replace number with the number of concurrent jobs you want to run (probably <code>CLUSTER_SIZE</code> * CPUs in <code>NODE_INSTANCE_TYPE</code>)
=== Run GotCloud Demo Using StarCluster ===
=== Run GotCloud Demo Using StarCluster ===
# Terminate the cluster
# Terminate the cluster
#* <pre>starcluster terminate mycluster</pre>
#* <pre>starcluster terminate mycluster</pre>
== Monitor Cluster Usage ==
== Monitor Cluster Usage ==
