SAM Validation Criteria: Difference between revisions
From Genome Analysis Wiki
Jump to navigationJump to search
No edit summary |
|||
| (5 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
'''NOTE: Not all validation Criteria has been listed here, and not all listed here have been implemented (Implemented checks are marked green.)''' | |||
=== SAM Header Validation Rules === | === SAM Header Validation Rules === | ||
TODO | TODO | ||
| Line 65: | Line 67: | ||
|style="background-color:red;"| | |style="background-color:red;"| | ||
|style="background-color:red;"| | |style="background-color:red;"| | ||
|- | |||
| Header has X-lines or fewer (or a max number of SQ lines (this was a problem once of a file with a crazy number of header lines) | |||
|style="background-color:red;"| | |||
|style="background-color:red;"| | |||
|style="background-color:red;"| | |||
|style="background-color:red;"| | |||
|} | |} | ||
| Line 159: | Line 163: | ||
|style="background-color:red;"| | |style="background-color:red;"| | ||
|style="background-color:red;"| | |style="background-color:red;"| | ||
|style="background-color:red;"| | |||
|- | |||
| CIGAR string matches the length of SEQ if both are not "*" | |||
|style="background-color:green;"| | |||
|style="background-color:green;"| | |||
|style="background-color:green;"| | |||
|style="background-color:red;"| | |style="background-color:red;"| | ||
|- | |- | ||
| Line 215: | Line 225: | ||
|style="background-color:red;"| | |style="background-color:red;"| | ||
|- | |- | ||
| If QUAL | | If QUAL and SEQ are not “*” they are the same length. | ||
|style="background-color: | |style="background-color:green;"| | ||
|style="background-color:red;"| | |style="background-color:red;"| | ||
|style="background-color:green;"| | |||
|style="background-color:red;"| | |style="background-color:red;"| | ||
|- | |- | ||
Latest revision as of 15:51, 27 August 2010
NOTE: Not all validation Criteria has been listed here, and not all listed here have been implemented (Implemented checks are marked green.)
SAM Header Validation Rules
TODO
| Validation Criteria | Implemented | Tested | ||
|---|---|---|---|---|
| SAM | BAM | SAM | BAM | |
| All Required Fields are set | ||||
| If HD line is there, VN is also there. | ||||
| HD/VN is not in valid format /^[0-9]+\.[0-9]+$/ | ||||
| HD/SO is a valid value (unsorted, queryname, coordinate) | ||||
| SQ/SN all SQ lines have a unique SN field | ||||
| SQ/LN is in the range [1, (2^29) -1] | ||||
| SQ/LN is not a number | ||||
| RG/ID all RG lines have a unique ID field | ||||
| RG/PL is a valid value (ILLUMINA, SOLID, LS454, HELICOS, PACBIO) | ||||
| Header has X-lines or fewer (or a max number of SQ lines (this was a problem once of a file with a crazy number of header lines) | ||||
SAM Alignment Validation
| Validation Criteria | Implemented | Tested | ||
|---|---|---|---|---|
| SAM | BAM | SAM | BAM | |
| QNAME.Length() > 0 and <= 254 | ||||
| QNAME is valid: [!-?A-~] (printable characters minus space and '@') This is a new regular expression | ||||
| FLAG is an integer [0-9]+ | N/A: just interpret the bits as an int. | N/A: just interpret the bits as an int. | ||
| FLAG is [0, (2^16)-1] | Parse Error since it will be written into a 16 bit field. | N/A: only a 16 bit field | N/A: only a 16 bit field | |
| RNAME does not contain [ \t\n\r@=] | ||||
| RNAME is found in an SQ header record if there are any SQs in the header. | ||||
| Reference Name length does not match specified length. | N/A: reference name length is in BAM format only | N/A: reference name length is in BAM format only | ||
| Reference ID is in range of the number of references | N/A: rID is in BAM format only | N/A: rID is in BAM format only | ||
| POS is an integer [0-9]+ | N/A: just interpret the bits as an int. | N/A: just interpret the bits as an int. | ||
| POS is [0, (2^29)-1] | Parse Error if it can't fit in the 32 bit field, other out of range is a validation error. | |||
| MAPQ is an integer [0-9]+ | N/A: just interpret the bits as an int. | N/A: just interpret the bits as an int. | ||
| MAPQ is [0, (2^8)-1] | Parse Error since it will be written into an 8 bit field. | N/A: only a 8 bit field | N/A: only a 8 bit field | |
| CIGAR ([0-9]+[MIDNSHP])+|\* | ||||
| CIGAR string matches the length of SEQ if both are not "*" | ||||
| MRNM does not contain [ \t\n\r@] ('=' means it is the same as RNAME) | ||||
| If SQ is in the header RNAME & MRNM (if not “=”) must be in SQ. | ||||
| MPOS is an integer [0-9]+ | ||||
| MPOS is [0, (2^29)-1] | ||||
| ISIZE is an integer -?[0-9]+ | ||||
| ISIZE is [-(2^29), 2^29] | ||||
| SEQ is [acgtnACGTN.=]+|\* | ||||
| If SEQ is * then QUAL is * | ||||
| QUAL is [!-~]+|* → dec 33 – 126 or dec 42 (which is in 32-126) (for BAM, it is between [0,93]) | ||||
| If QUAL and SEQ are not “*” they are the same length. | ||||
| TAG is [A-Z][A-Z0-9] | ||||
| A TAG only appears once per alignment | ||||
| VTYPE is [AifZH] for SAM and [AcCsSiIfZH] for BAM | ||||
| VALUE does NOT contain [\t\n\r] | ||||
| For VTYPE = “A”, VALUE is a printable character | ||||
| For VTYPE = “i”, VALUE is a signed 32-bit integer. | ||||
| For VTYPE = “f”, VALUE is a single-precision float. | ||||
| For VTYPE = “Z”, VALUE is a printable string. | ||||
| For VTYPE = “H”, VALUE is a Hex string. | ||||
| For TAG = E2, length should be the same as the Read Length | ||||
| For TAG = E2, each base should be different than the read Base (unless 'N') | ||||
| For TAG = U2, length should be the same as the Read Length | ||||
NOTE: There are other TAG Validations that can be done. They will come later.
NOTE: There may be other BAM Validations that can be done. They will come later.
Consider may want to validate the cigar string against the read length...
Other Read Validation
| Validation Criteria | Implemented | Tested | ||
|---|---|---|---|---|
| SAM | BAM | SAM | BAM | |
| If specified to check sort order (either based on SO flag or user specifies coordinate or query name). | ||||
SAM Questions
- Comment says: “If the mapping position of the query is not available, RNAME and CIGAR are set as “*”, and POS and MAPQ as 0.” Is it all or nothing? Can some be set to “*”/0 but not all?
- Same question for MRNM = “*” and MPOS & ISIZE = 0
- Comment says: “The name of a pair/read is required to be unique in the SAM file, but one pair/read may appear multiple times in different alignment records, representing multiple or split hits.” - Is there anything here that needs to be validated???