From Genome Analysis Wiki
Jump to navigationJump to search
1,622 bytes added
, 11:22, 31 October 2014
Line 72: |
Line 72: |
| * You should have set these in [[#Getting Started With StarCluster|Getting Started With StarCluster]] above (quickstart guide and AWS Credentials) . | | * You should have set these in [[#Getting Started With StarCluster|Getting Started With StarCluster]] above (quickstart guide and AWS Credentials) . |
| | | |
− | '''GotCloud settings:'''
| + | === Using GotCloud On StarCluster === |
− | * You may want to Create a new cluster description for running GotCloud (or you can use smallcluster) | + | ==== StarCluster Config Settings ==== |
− | * Use the GotCloud AMIs: | + | * You may want to create a new cluster section for running GotCloud (or you can use smallcluster) in your configuration file: <code>~/.starcluster/config</code> |
− | MASTER_IMAGE_ID = ami-6ae65e02
| + | ** You can call it anything you want, for example, <pre>gccluster</pre> |
− | NODE_IMAGE_ID = ami-3393a45a
| + | ** Example: |
− | * We do not recommend running GotCloud on machines with less than 4MB of memory | + | **: <pre>[cluster gccluster] KEYNAME = mykey CLUSTER_SIZE = 4 CLUSTER_USER = sgeadmin CLUSTER_SHELL = bash MASTER_IMAGE_ID = ami-6ae65e02 NODE_IMAGE_ID = ami-3393a45a NODE_INSTANCE_TYPE = m3.large</pre> |
| + | *** Set <code>KEYNAME</code> to the key you want to use |
| + | *** Set <code>CLUSTER_SIZE</code> to the number of nodes you want to start up (this may be different than 4) |
| + | *** Set <code>CLUSTER_USER</code> to add additional users, like <code>sgeadmin</code> |
| + | *** Set <code>CLUSTER_SHELL</code> to define the shell you want to use, like <code>bash</code> |
| + | *** Set <code>MASTER_IMAGE_ID</code> to the latest GotCloud AMI, see: [[GotCloud: AMIs]] |
| + | *** Set <code>NODE_IMAGE_ID</code> to a StarCluster <code>ubuntu x86_64</code> AMI |
| + | *** Set <code>NODE_INSTANCE_TYPE</code> to the type of instances you want to start in your cluster |
| + | **** See http://aws.amazon.com/ec2/pricing/ for instance descriptions and prices |
| + | **** We do not recommend running GotCloud on machines with less than 4MB of memory |
| + | ** The <code>CLUSTER_SIZE</code> * CPUs in <code>NODE_INSTANCE_TYPE</code> = the number of jobs you can run concurrently in GotCloud |
| + | |
| + | ==== Running GotCloud on StarCluster ==== |
| + | * When Running GotCloud: |
| + | ** Set the cluster/batch type in either configuration or on the command line: |
| + | *** In Configuration: |
| + | ***: <pre>BATCH_TYPE = sgei</pre> |
| + | *** On the command-line: |
| + | ***: <pre>--batchtype sgei</pre> |
| + | ** Set the number of jobs to run: |
| + | **: <pre>--numjobs #</pre> |
| + | *** Replace number with the number of concurrent jobs you want to run (probably <code>CLUSTER_SIZE</code> * CPUs in <code>NODE_INSTANCE_TYPE</code>) |
| | | |
− | [[GotCloud: AMIs]]
| |
| | | |
| === Run GotCloud Demo Using StarCluster === | | === Run GotCloud Demo Using StarCluster === |
Line 113: |
Line 133: |
| # Terminate the cluster | | # Terminate the cluster |
| #* <pre>starcluster terminate mycluster</pre> | | #* <pre>starcluster terminate mycluster</pre> |
− |
| |
| | | |
| == Monitor Cluster Usage == | | == Monitor Cluster Usage == |