Changes

From Genome Analysis Wiki
Jump to navigationJump to search

Creating an AMI on EC2 (view source)

Revision as of 13:29, 10 October 2014

438 bytes removed ,  13:29, 10 October 2014
no edit summary
Line 21: Line 21:  
## Enter in the search box: <code>starcluster-base-ubuntu</code>
 
## Enter in the search box: <code>starcluster-base-ubuntu</code>
 
## Select: <code>starcluster-base-ubuntu-12.04-x86_64 - ami-765b3e1f</code>
 
## Select: <code>starcluster-base-ubuntu-12.04-x86_64 - ami-765b3e1f</code>
−
# Select the Instance Type: <code>Micro t1.micro</code>
+
# Select the Instance Type: <code>Compute optimized c3.2xlarge</code>
−
#* Since we are just using this instance to setup the system, pick the smallest/cheapest machine.
+
#* You can use a smaller/cheaper machine - I originaly used t1.micro, but I found things go so much faster with a larger machine.
 
# Click: <code>Review and Launch</code>
 
# Click: <code>Review and Launch</code>
 
## Select: <code>Make General Purpose (SSD) the boot volume for this instance.</code>
 
## Select: <code>Make General Purpose (SSD) the boot volume for this instance.</code>
Line 39: Line 39:  
# Get the latest version of GotCloud:
 
# Get the latest version of GotCloud:
 
#* Multiples ways to do this, one way is to do:
 
#* Multiples ways to do this, one way is to do:
−
#*# <code>git clone https://github.com/statgen/gotcloud.git gc_src</code>
+
#*# <code>sudo git clone https://github.com/statgen/gotcloud.git</code>
 
# Download cmake (required to build premo)
 
# Download cmake (required to build premo)
 
#*<code>sudo apt-get update</code>
 
#*<code>sudo apt-get update</code>
Line 45: Line 45:  
#*<code>sudo apt-get install cmake</code>
 
#*<code>sudo apt-get install cmake</code>
 
## Build the source (if you obtained the source code).
 
## Build the source (if you obtained the source code).
−
### <code>cd gc_src/src</code>
+
### <code>cd gotcloud/src</code>
−
### <code>make</code>
+
### <code>sudo make</code>
−
### <code>cd ..</code>
+
###* Specify <code>-j #</code> based on the number of CPUs your instance has, if more than 1
−
## Generate the installation.
  −
### <code>cd gc_src/</code>
  −
### <code>./debian/makedeb.sh bin =</code>
   
### <code>cd</code>
 
### <code>cd</code>
−
# Install: <code>sudo dpkg -i gc_src/gotcloud-bin_1.14.3_amd64.deb</code>
  −
# Move installation to home so will be on all nodes: <code>sudo mv /usr/local/gotcloud .</code>
  −
# Remove source: <code>rm -rf gc_src/</code> (required since not enough storage space.)
   
# Get the reference files
 
# Get the reference files
 
## wget ftp://anonymous@share.sph.umich.edu/gotcloud/ref/h37-db135-v3.tgz
 
## wget ftp://anonymous@share.sph.umich.edu/gotcloud/ref/h37-db135-v3.tgz
Line 60: Line 54:  
# Move reference to gotcloud directory: <code>sudo mv gotcloud.ref gotcloud</code>
 
# Move reference to gotcloud directory: <code>sudo mv gotcloud.ref gotcloud</code>
 
# Remove tar file: <code>rm h37-db135-v3.tgz</code>
 
# Remove tar file: <code>rm h37-db135-v3.tgz</code>
−
# Add aliases for GotCloud and tabix: vi .bash_aliases
+
# Set the paths, by updating .profile: <code>vi .profile</code>
−
## <code>alias gotcloud='/home/ubuntu/gotcloud/bin/gotcloud'</code>
+
#* <code>i</code>
−
## <code>alias tabix='/home/ubuntu/gotcloud/bin/tabix'</code>
+
#: <pre>if [ -d "$HOME/gotcloud" ] ; then&#10;    PATH="$HOME/gotcloud:$PATH"&#10;fi&#10;if [ -d "$HOME/gotcloud/bin" ] ; then&#10;    PATH="$HOME/gotcloud/bin:$PATH"&#10;fi&#10;if [ -d "$HOME/gotcloud/scripts" ] ; then&#10;    PATH="$HOME/gotcloud/scripts:$PATH"&#10;fi</pre>
 +
#* <code>ESC</code>
 +
#* <code>:q</code>
   −
  −
== Create Image ==
   
== Create the AMI ==
 
== Create the AMI ==
   Line 83: Line 77:  
Your new AMI should look pretty much like this:
 
Your new AMI should look pretty much like this:
   −
<code>
+
 
−
  AMI: Ubuntu Cloud Guest AMI ID ami-3d4ff254 (x86_64)
+
== Update the GotCloud AMI ==
−
  Name: Ubuntu Server 12.04.1 LTS
+
# Start an instance of the current GotCloud AMI  
−
  Description: Ubuntu Server 12.04.1 LTS with support available from Canonical (http://www.ubuntu.com/cloud/services).
+
#* Suggest an instance with some CPU so you can parallelize the "make" call.
−
  Number of Instances: 1
+
# Login as ubuntu
−
  Availability Zone: No Preference
+
# <code>cd gotcloud</code>
−
  Instance Type: Micro (t1.micro)
+
# <code>sudo git pull</code>
−
  Instance Class: On Demand Edit Instance Details
+
# <code>cd gotcloud/src</code>
−
  EBS-Optimized: No
+
# <code>sudo make</code>
−
  Monitoring: Disabled Termination Protection: Disabled
+
#* Specify <code>-j #</code> based on the number of CPUs your instance has
−
  Tenancy: Default
+
# <code>cd</code>
−
  Kernel ID: Use Default Shutdown Behavior: Stop
+
 
−
  RAM Disk ID: Use Default
  −
  Network Interfaces:
  −
  Secondary IP Addresses:
  −
  User Data:
  −
  IAM Role: Edit Advanced Details
  −
  Key Pair Name: CSG Edit Key Pair
  −
  Security Group(s): sg-a098e9c8 Edit Firewall
  −
</code>
      
== Set Up Swap Space ==
 
== Set Up Swap Space ==
Retrieved from "http://genome.sph.umich.edu/wiki/Special:MobileDiff/11705"

Navigation menu