Changes

From Genome Analysis Wiki
Jump to navigationJump to search
752 bytes added ,  18:27, 3 January 2014
Line 1: Line 1: −
[[Category:BamUtil|convert]]
+
<br>
[[Category:BAM Software]]
  −
[[Category:Software]]
     −
= Overview of the <code>convert</code> function of <code>bamUtil</code> =
+
= Overview of the <code>convert</code> function of <code>bamUtil</code> =
The <code>convert</code> option on the [[bamUtil]] executable reads a SAM/BAM file and writes it as a SAM/BAM file.
     −
The executable converts the input file into the format of the output file.
+
The <code>convert</code> option on the [[BamUtil]] executable reads a SAM/BAM file and writes it as a SAM/BAM file.  
   −
It has options to allow for the conversion of the sequence to/from '=' from/to the actual bases by using the reference sequence.
+
The executable converts the input file into the format of the output file.  
   −
If you want to convert a BAM file to a SAM file, just call:
+
It has options to allow for the conversion of the sequence to/from '=' from/to the actual bases by using the reference sequence.  
<pathToExe>/bam --in <bamFile>.bam --out <newSamFile>.sam
  −
Don't forget to put in the paths to the executable and your test files.
     −
= Parameters =
+
It also has an option to left shift indels in the CIGARs before writing the output file.
<pre>
+
 
    Required Parameters:
+
If you want to convert a BAM file to a SAM file, just call:
        --in       : the SAM/BAM file to be read
+
 
        --out       : the SAM/BAM file to be written
+
&lt;pathToExe&gt;/bam --in &lt;bamFile&gt;.bam --out &lt;newSamFile&gt;.sam
    Optional Parameters:
+
 
--refFile   : reference file name
+
Don't forget to put in the paths to the executable and your test files.
        --noeof     : do not expect an EOF block on a bam file.
+
 
        --params   : print the parameter settings
+
 
        --recover   : attempt to recover the input bam file.
+
= Usage  =
    Optional Sequence Parameters (only specify one):
+
 
--seqOrig  : Leave the sequence as is (default & used if reference is not specified).
+
./bam convert --in <inputFile> --out <outputFile.sam/bam/ubam (ubam is uncompressed bam)> [--refFile <reference filename>] [--useBases|--useEquals|--useOrigSeq] [--lshift] [--noeof] [--params]
--seqBases  : Convert any '=' in the sequence to the appropriate base using the reference (requires --ref).
+
 
--seqEquals : Convert any bases that match the reference to '=' (requires --ref).
+
 
 +
= Parameters =
 +
<pre> Required Parameters:
 +
--in         : the SAM/BAM file to be read
 +
--out       : the SAM/BAM file to be written
 +
Optional Parameters:
 +
--refFile   : reference file name
 +
--lshift    : left shift indels when writing records
 +
--noeof     : do not expect an EOF block on a bam file
 +
--params     : print the parameter settings
 +
--recover   : attempt error recovery while reading a bam file
 +
Optional Sequence Parameters (only specify one):
 +
--useOrigSeq : Leave the sequence as is (default & used if reference is not specified)
 +
--useBases  : Convert any '=' in the sequence to the appropriate base using the reference (requires --refFile)
 +
--useEquals  : Convert any bases that match the reference to '=' (requires --refFile)
 
</pre>
 
</pre>
 +
{{PhoneHomeParamDesc}}
 +
 +
== Required Parameters==
 +
{{InBAMInputFile}}
 +
{{OutBAMOutputFile}}
 +
 +
== Optional Parameters ==
 +
{{refFile}}
 +
 +
=== Left Shift Indels in the CIGAR (<code>--lshift</code>) ===
 +
 +
Left shift indels as far as they can go in the read.
 +
 +
{{noeofBGZFParameter}}
 +
{{paramsParameter}}
 +
 +
=== Recover a corrupted BAM file (<code>--recover</code>) ===
 +
 +
See [[#BAM File Recovery |BAM File Recovery]].
   −
== Sequence Representation Parameters ==
+
== Sequence Representation Parameters (<code>--useOrigSeq</code>, <code>--useBases</code>, <code>--useEquals</code>, <code>--refFile</code>) ==
The sequence parameters options specify how to represent the sequence if the reference is specified (refFile option). If the reference is not specified or seqOrig is specified, no modifications are made to the sequence. If the reference and seqBases is specified, any matches between the sequence and the reference are represented in the sequence as the appropriate base. If the reference and seqEquals is specified, any matches between the sequence and the reference are represented in the sequence as '='.
+
 
 +
The sequence parameters options specify how to represent the sequence if the reference is specified (refFile option).  
 +
 
 +
If the reference is not specified or useOrigSeq is specified, no modifications are made to the sequence.  
 +
 
 +
If the reference and useBases is specified, any matches between the sequence and the reference are represented in the sequence as the appropriate base.  
 +
 
 +
If the reference and useEquals is specified, any matches between the sequence and the reference are represented in the sequence as '='.  
 +
 
 +
=== Examples  ===
   −
=== Examples ===
   
  ExtendedCigar: SSMMMDDMMMIMNNNMPMSSS
 
  ExtendedCigar: SSMMMDDMMMIMNNNMPMSSS
 
  Sequence:      AATAA  CTAGA  T AGGG
 
  Sequence:      AATAA  CTAGA  T AGGG
Line 62: Line 98:  
  Sequence with Equals: AA======G===GGG
 
  Sequence with Equals: AA======G===GGG
   −
= BAM File Recovery =
+
{{PhoneHomeParameters}}
   −
A BAM file that has been corrupted or truncated due to a copy or disk problem can often be partially recovered.
+
= BAM File Recovery  =
   −
Both the BGZF format and binary BAM format have enough information to scan forward and resynchronize the input data.  While some data will be lost, substantial recovery can often be done.
+
A BAM file that has been corrupted or truncated due to a copy or disk problem can often be partially recovered.  
   −
When a file has bad blocks in it, normal copy commands (cp) will truncate the file at the point of disk read failure. To recover the maximum amount of data possible, use the dd command with the conv=noerror option.
+
Both the BGZF format and binary BAM format have enough information to scan forward and resynchronize the input data. While some data will be lost, substantial recovery can often be done.  
   −
So a normal use case for recovery would look this this:
+
When a file has bad blocks in it, normal copy commands (cp) will truncate the file at the point of disk read failure. To recover the maximum amount of data possible, use the dd command with the conv=noerror option.
   −
<pre>
+
So a normal use case for recovery would look this this:
# dd if=brokenbamfile.bam of=/tmp/brokenbamfile1.bam conv=noerror bs=4k
+
<pre># dd if=brokenbamfile.bam of=/tmp/brokenbamfile1.bam conv=noerror bs=4k
 
# bam convert --recover --in /tmp/brokenbamfile1.bam --out /tmp/brokenbamfilerecovered.bam
 
# bam convert --recover --in /tmp/brokenbamfile1.bam --out /tmp/brokenbamfilerecovered.bam
</pre>
+
</pre>  
 +
Note, you will of course need to output the result file to a known good filesystem.
   −
Note, you will of course need to output the result file to a known good filesystem.
+
Currently, no statistics are printed as far as how many BAM records are recovered, but subsequent tests can readily be done on the resulting file to determine the quality of recovery.  
   −
Currently, no statistics are printed as far as how many BAM records are recovered, but subsequent tests can readily be done on the resulting file to determine the quality of recovery.
+
In real cases, we have recovered better than 94% of reads from a set of severely damaged files (numerous 64K chunks of a RAID were lost), and better than 99.9% recovery from a moderately damaged file (3 disk pages were corrupt).  
   −
In real cases, we have recovered better than 94% of reads from a set of severely damaged files (numerous 64K chunks of a RAID were lost), and better than 99.9% recovery from a moderately damaged file (3 disk pages were corrupt).
     −
= Usage =
+
= Return Value  =
./bam convert --in <inputFile> --out <outputFile.sam/bam/ubam (ubam is uncompressed bam)> [--refFile <reference filename>] [--seqBases|--seqEquals|--seqOrig] [--recovery] [--noeof] [--params]
     −
= Return Value =
+
Returns the SamStatus for the reads/writes (0 for success, non-0 for failure).
Returns the SamStatus for the reads/writes.
     −
= Example Output =
+
= Example Output =
<pre>
+
<pre>Number of records read = 10
Number of records read = 10
   
Number of records written = 10
 
Number of records written = 10
</pre>
+
</pre>  
 +
[[Category:BamUtil|convert]] [[Category:BAM_Software]] [[Category:Software]]

Navigation menu