Creating a Snapshot on EC2

From Genome Analysis Wiki
Revision as of 11:31, 16 April 2013 by Terry Gliedt (talk | contribs)
Jump to navigationJump to search

Back to parent: GotCloud


The following are notes taken when creating a Snapshot of a volume where the GotCloud software and data are installed.

Create an Instance with a Master GotCloud Volume 

 Login to https://console.aws.amazon.com/ec2       # EC2 Management Console

Pay attention to the region you are using, at least for now it seems any StarCluster activity must be in us-west-2.

Launch a new instance which we will use to set up the software and ultimately save it as an AMI. Your instance can use any memory size (t1.micro is fine), but should be running Ubuntu Server 12.04.1 LTS 64 bit. The root volume size does not matter either.

Create a volume to serve as the GotCloud master volume if you do not already have one. The volume size should be 20G at the moment. Be sure the zone is the same as the one for the instance you just launched/created. The volume should be based on 'No Snapshot'. Once it is created, attach it to the instance you have launched and mount it it /gotcloud.

Install the Software

Follow the instructions to install a Debian package debian package Run the tests to be sure everything is OK. This installs files in /usr/local/gotcloud and these need to be copied to the snapshot disk. 

 cd /gotcloud
 rm -rf bin scripts test      # Remove old GotCloud
 sudo rsync -av /usr/local/gotcloud/* /gotcloud
 sudo chown -R ubuntu.ubuntu bin scripts test release_version.txt

Even though the references are not part of the distribution, you cannot do anything useful without references, so get them and make them available in /gotcloud 

 cd /mnt                     # Because the *.tar.gz will be too big for /home
 sudo wget share.sph.umich.edu:gotcloud/CHANGETHIS.tar.gz 
 cd /gotcloud
 sudo tar xzf /mnt/CHANGETHIS.tar.gz
 sudo chown -R ubuntu.ubuntu gotcloud.ref
 sudo chmod 0755 gotcloud.ref
 chmod 0644 gotcloud.ref/*
 ls -la ref
 sudo rm -f /mnt/CHANGETHIS.tar.gz    # if no error
 cd /gotcloud/examples/umakeRef
 ln -s /gotcloud/ref/hs37d5.fa .

Create the SnapShot

In your browser at the EC2 Management Console choose Elastic Block Storage -> Volumes. Find the volume for current master you created above. Choose Actions -> Create Snapshot. 

 Name:  GotCloud Distribution
 Description:  CSG GotCloud files from UMICH
 Note snapshot name  e.g. snap-9e782bb8

Now make the name of this snapshot available to the user population. In your Unix terminal, get the snapshots.txt file, update it and make it available: 

 wget share.sph.umich.edu:gotcloud/snapshots.txt
 vi snapshots.txt   # Replace snapshot id with new one
 scp snapshots.txt gotcloud@share.sph.umich.edu:

Retrieved from "http://genome.sph.umich.edu/w/index.php?title=Creating_a_Snapshot_on_EC2&oldid=7094"