Difference between revisions of "GotCloud"

From Genome Analysis Wiki
Jump to navigationJump to search
Line 1: Line 1:
Either pipeline can be run on a single machine or on a cluster of machines.
+
= Genomes on the Cloud (GotCloud)=
 +
 
 +
To handle the increasing volume of next generation sequencing and genotyping data, we created and developed software pipelines called '''Genomes on the Cloud (GotCloud)''' for:
 +
*Mapping
 +
*Variant Calling
 +
Key Features:
 +
*Scalable to tens of thousands of samples
 +
*Robust against unexpected system failure using GNU make
 +
*Massively parallel, can run hundreds of jobs
 +
*Easy to use - Automates series of configurable steps
 +
*Available on Amazon Web Services (AWS) Elastic Compute Cloud (EC2)
 +
*Run on local machines/clusters
 +
*Available via Debian Packages
 +
 
 +
 
 
The following describes the use of this software with the Amazon Web Services (https://aws.amazon.com/),
 
The following describes the use of this software with the Amazon Web Services (https://aws.amazon.com/),
but you can just as easily use it on your own machine(s) by just installing it.
+
but you can just as easily use the pipelines on your own machine(s) by just installing them.
  
 +
 +
== AWS Specific Setup ==
 
'''Preparation in AWS'''
 
'''Preparation in AWS'''
  
Line 9: Line 25:
 
* Notes on sequence data preparation in [[Amazon Storage|Amazon Storage]].
 
* Notes on sequence data preparation in [[Amazon Storage|Amazon Storage]].
  
'''Install the Software'''
+
'''Resources / Cost'''
 +
 
 +
* [[AWS Rresources|AWS Resources]]
 +
 
 +
'''Development Notes'''
 +
 
 +
* [[Creating an AMI on EC2]]
 +
* [[Mount S3 Volume]]
 +
 
 +
== General Usage ==
 +
 
 +
'''Install the Software (for AWS or a local machine)'''
  
 
* Installing the software as a [[Pipeline Debian Package|debian package]]
 
* Installing the software as a [[Pipeline Debian Package|debian package]]
Line 18: Line 45:
 
* [[Alignment Pipeline]]  
 
* [[Alignment Pipeline]]  
 
* [[Variant Calling Pipeline (UMAKE)]]
 
* [[Variant Calling Pipeline (UMAKE)]]
 
'''Resources / Cost'''
 
 
* [[AWS Rresources|AWS Resources]]
 
 
 
 
'''Development Notes'''
 
 
* [[Creating an AMI on EC2]]
 
* [[Mount S3 Volume]]
 

Revision as of 14:45, 5 November 2012

Genomes on the Cloud (GotCloud)

To handle the increasing volume of next generation sequencing and genotyping data, we created and developed software pipelines called Genomes on the Cloud (GotCloud) for:

  • Mapping
  • Variant Calling

Key Features:

  • Scalable to tens of thousands of samples
  • Robust against unexpected system failure using GNU make
  • Massively parallel, can run hundreds of jobs
  • Easy to use - Automates series of configurable steps
  • Available on Amazon Web Services (AWS) Elastic Compute Cloud (EC2)
  • Run on local machines/clusters
  • Available via Debian Packages


The following describes the use of this software with the Amazon Web Services (https://aws.amazon.com/), but you can just as easily use the pipelines on your own machine(s) by just installing them.


AWS Specific Setup

Preparation in AWS

Resources / Cost

Development Notes

General Usage

Install the Software (for AWS or a local machine)

Run the Software