Open main menu

Genome Analysis Wiki β

Changes

BamUtil: stats

8,556 bytes added, 15:59, 24 August 2017
BaseQC (--pBaseQC and --cBaseQC and --baseSum)
= Overview of the <code>stats</code> function of <code>bamUtil</code> =
The <code>stats</code> option on the [[BamUtil]] executable generates the specified statistics on a SAM/BAM file. == Troubleshooting ==See [[BamUtil:_FAQ#BamUtil:_stats|BamUtil: FAQ -> BamUtil: stats]] for troubleshooting help.
= Usage =
<pre>
./bam stats --in <inputFile> [--basic] [--qual] [--phred] [--baseQC pBaseQC <outputFileName>] [--cBaseQC <outputFileName>] [--maxNumReads <maxNum>][--unmapped] [--bamIndex <bamIndexFile>] [--regionList <regFileName>] [--minMapQual requiredFlags <minMapQintegerRequiredFlags>] [--dbsnp excludeFlags <dbsnpFileintegerExcludeFlags>] [--sumStatsnoeof] [--params] [--withinRegion] [--baseSum] [--noeofbufferSize <buffSize>] [--minMapQual <minMapQ>] [--paramsdbsnp <dbsnpFile>]</pre>  
= Parameters =
<pre>
Required Parameters: --in : the SAM/BAM file to calculate stats for Types of Statistics that can be generated: --basic : Turn on basic statistic generation --qual : Generate a count for each quality (displayed as non-phred quality) --phred : Generate a count for each quality (displayed as phred quality) --baseQC pBaseQC : Write per base statistics as Percentages to the specified file. (use - for stdout) pBaseQC & cBaseQC cannot both be specified. --cBaseQC : Write per base statistics as Counts to the specified file. (use - for stdout) pBaseQC & cBaseQC cannot both be specified. Optional Parameters: --maxNumReads : Maximum number of reads to process Defaults to -1 to indicate all reads. --unmapped : Only process unmapped reads (requires a bamIndex file) --bamIndex : The path/name of the bam index file (if required and not specified, uses the --in value + ".bai") --regionList : File containing the regions to be processed chr<tab>start_pos<tab>end<pos>end_pos. Positions are 0 based and the end_pos is not included in the region. Uses bamIndex. --minMapQual excludeFlags : The minimum mapping quality for filtering reads in Skip any records with any of the specified flags set (specify an integer representation of the baseQC stats.flags) --dbsnp requiredFlags : The dbSnp file Only process records with all of the specified flags set (specify an integer representation of positions to exclude from baseQC analysis.the flags) --noeof : Do not expect an EOF block on a bam file. --params : Print the parameter settings. Optional phred/qual Only Parameters: --withinRegion : Only count qualities if they fall within regions specified. Only applicable if regionList is also specified. Optional Base QC BaseQC Only Parameters: --baseSum : Print an overall summary of the baseQC for the file to stderr. --bufferSize : Size of the pileup buffer for calculating the BaseQC parameters. Default: 1024 --sumStats minMapQual : Alternate summary outputThe minimum mapping quality for filtering reads in the baseQC stats. --dbsnp : The dbSnp file of positions to exclude from baseQC analysis.
</pre>
For all types {{PhoneHomeParamDesc}} == Required Parameters == {{inBAMInputFile}} == Optional Parameters ===== Maximum number of reads to process(<code>--maxNumReads</code>) ===Use <code>--maxNumReads</code> followed by a number to indicate the maximum number of statisticsreads to process before exiting. By default, it is set to -1 to indicate all reads should be processed. === Only Process Unmapped Reads (<code>--unmapped</code>) ===Use <code>--unmapped</code> to process only unmapped reads. This parameter requires [[#Bam Index File (--bamIndex)|<code>--bamIndex</code>]]. {{BamIndex}} === Only Process Certain Regions (<code>--regionList</code>) ===Use <code>--regionList</code> followed by the filename to process only the regions specified in the file. The positions in the bam file used are specified one per line with the following format: <nowiki>chr<tab>start_pos<tab>end_pos.</nowiki> Positions are 0 based and the end_pos is specified by not included in the region. This parameter requires [[#Bam Index File (--bamIndex)|<code>--inbamIndex</code>]].
The optional parameters are also used for all types === Exclude Flags (<code>--excludeFlags</code>) ===Use <code>--excludeFlags</code> followed by an integer representation of statisticsthe flags to only process reads with any of the specified flags set.
=== Required Flags (<code>--requiredFlags</code>) ===
Use <code>--requiredFlags</code> followed by an integer representation of the flags to only process records with all of the specified flags set.
== Types of Statistics ==
=== Basic (<code>--basic</code>) ===
Prints summary statistics for the file:
*BasesInMappedReads - # of bases in reads marked mapped in the flag
=== Qual/Phred (<code>--phred</code> and <code>--qual</code>) ===
Prints a count of the number of times each quality value appears in the fileto stderr.
*<code>phred</code> Displays Quality as phred integers [0-93]
*<code>qual</code> Displays Quality as non-phred integers (phred + 33) [33-126]
<br> By default, these counts include all qualities in the BAM file. To exclude unmapped reads and soft clips, use --excludeFlags 4.
== BaseQC To only include records that overlap a set of regions, use --regionList and specify a bed file with the regions. ==If a read overlaps the region, all qualities will be counted even if those bases do not fall in the region. If you only want to count qualities that fall within the region, also specify --withinRegion. Without excluding unmapped reads, it will include soft clips that overlap the region.
The ==== Optional Phred/Qual Only Parameters ========= Within Region (<code>--withinRegion</code>) =====Use <code>baseQC--withinRegion</code> option generates with [[#Qual/Phred (--phred and --qual)|<code>--phred</code> or <code>--qual</code>]] options to only count qualities if they fall within the following statistics: regions specified using [[#Only Process Certain Regions (--regionList)|<code>--regionList</code>]] (only applicable if [[#Only Process Certain Regions (--regionList)|<code>--regionList</code>]] is also specified).
A read spans a position if the read starts at or before the position, ends at or after the position === BaseQC (<code>--pBaseQC</code> and the position is not a clip. CIGAR operations allowed for the position are M<code>--cBaseQC</Xcode> and <code>--baseSum</code>) ===/D/N. If the CIGAR is '*', only numbers for the specified reference position are incremented.
Currently there is no special The <code>pBaseQC</code> and <code>cBaseQC</code> options generate per base statistics. Only one of these two options can be specified. They write statistics generated for each position to the file specified after the option (use <code>-</code> to write to STDOUT). They use the same logic to exclude positionsfor calculating statistics, but <code>pBaseQC</reads where code> writes the reference base is 'N' or statistics as percentages, and <code>cBaseQC</code> writes them as counts. The order of the read base is 'N'statistics are also different.
The <brcode> baseSum</code> option can be used with either <code>pBaseQC</code> or <code>cBaseQC</code> or on its own. <code>baseSum</code> generates a summary of the per position statistics and writes it to stderr. It calculates the per position base statistics even if they will not be written anywhere (neither <code>pBaseQC</code> nor <code>cBaseQC</code> are specified).
=== BaseQC Output ===
There All three options use the same logic for calculating the statistics:* A read spans a position if the read starts at or before the position, ends at or after the position and the position is not a clip. CIGAR operations allowed for the position are two output options M/X/=/D/N. If the CIGAR is '*', only numbers for BaseQCthe specified reference position are incremented.*Currently there is no special logic to exclude positions/reads where the reference base is 'N' or the read base is 'N'.
#[[#Percentage-Based Output Format|Percentage-Based Output Format]]#[[#Count-Based Output Format|Count-Based Output Format]]<br>
==== Percentage-Based Output Format (<code>--pBaseQC</code>) ====
Order/Descriptions:
This output does not include a MapQual255 count.
 
===== Sample Output =====
1 10024 10025 14 12 85.714 39 30 76.923 51.282 25.641 51.282 84.615 38.462 15.385 15.385 11.000 21
</pre>
  ==== Count-Based Output Format (<code>--cBaseQC</code>) ====
Order/Descriptions:
{|border=1
|}
==== Summary of per Position Statistics (<code>--baseSum</code>) ====
Use <code>--baseSum</code> to print an overall summary of the baseQC for the file to stderr.
 
This option can be used with or without <code>--pBaseQC</code> and <code>--cBaseQC</code>
 
The values are tab delimited. First there is a header line describing the summary. The next line has the Means, and the last line has the Standard Deviations.
 
{|border=1
! Field !! Description !!style="width: 80px"| Excludes Duplicates, QC Failures !!style="width: 80px"| Excludes Unmapped !!style="width: 80px"| Excludes MapQual = 255 !!style="width: 80px"| Excludes Below Min MapQual !!style="width: 80px"| Excludes CIGAR Deletions, Skips
|-
| TotalReads || # of reads that span this position || || || || ||
|-
| Dups || # of reads marked duplicate in the flag || || || || ||
|-
| QCFail || # of reads marked QC failure in the flag || || || || ||
|-
| Mapped || # of reads marked mapped in the flag || align="center"|X || align="center"|X || || ||
|-
| Paired || # of reads marked paired in the flag || align="center"|X || align="center"|X || || ||
|-
| ProperPaired || # of reads marked paired AND proper paired in the flag || align="center"|X || align="center"|X || || ||
|-
| ZeroMapQual || # of reads that have a Mapping Quality of 0 || align="center"|X || align="center"|X || || ||
|-
| MapQual&lt;10(%) || # of reads that have a Mapping Quality &lt; 10 || align="center"|X || align="center"|X || || ||
|-
| MapQual255 || # of reads that have a Mapping Quality = 255 || align="center"|X || align="center"|X || || ||
|-
| PassMapQual || # of reads that have a Mapping Quality &gt;= a minimum Mapping Quality || align="center"|X || align="center"|X || || ||
|-
| AverageMapQuality || sum of included mapping qualities / AverageMapQualCount || align="center"|X || align="center"|X || align="center"|X || ||
|-
| AverageMapQualCount || # of mapping qualities in AverageMapQuality || align="center"|X || align="center"|X || align="center"|X ||
|- ||
| Depth || # of reads that are mapped with acceptable Mapping Quality, and are not duplicates or QC failures || align="center"|X || align="center"|X || align="center"|X || align="center"|X || align="center"|X
|-
| Q20Bases || # of bases at this position with a base quality (from the read) of Q20 or higher || align="center"|X || align="center"|X || align="center"|X || align="center"|X || align="center"|X
|-
|}
 
 
===== Sample Output =====
<pre>
Summary of Pileup Stats (1st Row is Mean, 2nd Row is Standard Deviation)
TotalReads Dups QCFail Mapped Paired ProperPaired ZeroMapQual MapQual<10 MapQual255 PassMapQual AverageMapQuality AverageMapQualCount
Depth Q20Bases
14.307692 1.846154 1.846154 8.769231 7.846154 0.923077 2.923077 5.846154 0.000000 2.923077 11.000000 8.769231 2.076923 1.153846
17.670053 2.882307 2.882307 9.038380 7.603137 1.441153 3.012793 6.025586 0.000000 3.012793 0.000000 9.038380 2.841993 1.993579
</pre>
 
==== Optional BaseQC Only Parameters ====
===== Pileup Buffer Size (<code>--bufferSize</code>) =====
Use the <code>--bufferSize</code> option followed by the size of the pileup buffer to use for [[BaseQC (--pBaseQC and --cBaseQC and --baseSum)|baseQC]] stats.
 
===== Minimum Mapping Quality (<code>--minMapQual</code>) =====
Use the <code>--minMapQual</code> option followed by the minimum mapping quality for filtering reads in the [[BaseQC (--pBaseQC and --cBaseQC and --baseSum)|baseQC]] stats.
 
===== DBSNP File (<code>--dbsnp</code>) =====
Use the <code>--dbsnp</code> option followed by the name of the dbsnp file to specify the positions to exclude from [[BaseQC (--pBaseQC and --cBaseQC and --baseSum)|baseQC]] analysis.
 
{{PhoneHomeParameters}}
 
= Return Value =
0 on Success, non-0 on failure
[[Category:BamUtil|stats]] [[Category:BAM_Software]] [[Category:Software]]