ATAC-seq on primary keratinocytes in day 0.0 of differentiation
Pipeline version: v1.4.2
Report generated at 2019-07-16 13:31:57
Paired-end: [True, True]
Pipeline type: ATAC-Seq
Genome: hg38_google.tsv
Peak caller: MACS2
Alignment
Flagstat (raw BAM)
rep1 (PE)
rep2 (PE)
Total
576473539
739416534
Total(QC-failed)
0
0
Dupes
0
0
Dupes(QC-failed)
0
0
Mapped
574328804
738217348
Mapped(QC-failed)
0
0
% Mapped
99.6300
99.8400
Paired
276305638
338971378
Paired(QC-failed)
0
0
Read1
138152819
169485689
Read1(QC-failed)
0
0
Read2
138152819
169485689
Read2(QC-failed)
0
0
Properly Paired
242145586
298823586
Properly Paired(QC-failed)
0
0
% Properly Paired
87.6400
88.1600
With itself
273774038
337183440
With itself(QC-failed)
0
0
Singletons
386865
588752
Singletons(QC-failed)
0
0
% Singleton
0.1400
0.1700
Diff. Chroms
209673
290550
Diff. Chroms (QC-failed)
0
0
Marking duplicates (filtered BAM)
Filtered out (samtools view -F 1804):
read unmapped (0x4)
mate unmapped (0x8, for paired-end)
"
not primary alignment (0x100)
read fails platform/vendor quality checks (0x200)
read is PCR or optical duplicate (0x400)
rep1 (PE)
rep2 (PE)
Unpaired Reads
0
0
Paired Reads
88122254
105427549
Unmapped Reads
0
0
Unpaired Dupes
0
0
Paired Dupes
22623276
20176431
Paired Opt. Dupes
642560
907390
% Dupes/100
0.2567
0.1914
Library complexity (filtered non-mito BAM)
rep1 (PE)
rep2 (PE)
Total Reads (Pairs)
83912684
99281933
Distinct Reads (Pairs)
64423966
83759127
One Read (Pair)
50177239
72137004
Two Reads (Pairs)
11061894
9758709
NRF = Distinct/Total
0.7678
0.8436
PBC1 = OnePair/Distinct
0.7789
0.8612
PBC2 = OnePair/TwoPair
4.5360
7.3921
Mitochondrial reads are filtered out.
NRF (non redundant fraction)
PBC1 (PCR Bottleneck coefficient 1)
PBC2 (PCR Bottleneck coefficient 2)
PBC1 is the primary measure. Provisionally
0-0.5 is severe bottlenecking
0.5-0.8 is moderate bottlenecking
0.8-0.9 is mild bottlenecking
0.9-1.0 is no bottlenecking
Flagstat (filtered/deduped BAM)
Filtered and duplicates removed
rep1 (PE)
rep2 (PE)
Total
130997956
170502236
Total(QC-failed)
0
0
Dupes
0
0
Dupes(QC-failed)
0
0
Mapped
130997956
170502236
Mapped(QC-failed)
0
0
% Mapped
100.0000
100.0000
Paired
130997956
170502236
Paired(QC-failed)
0
0
Read1
65498978
85251118
Read1(QC-failed)
0
0
Read2
65498978
85251118
Read2(QC-failed)
0
0
Properly Paired
130997956
170502236
Properly Paired(QC-failed)
0
0
% Properly Paired
100.0000
100.0000
With itself
130997956
170502236
With itself(QC-failed)
0
0
Singletons
0
0
Singletons(QC-failed)
0
0
% Singleton
0.0000
0.0000
Diff. Chroms
0
0
Diff. Chroms (QC-failed)
0
0
Peak calling
IDR (Irreproducible Discovery Rate) plots
Reproducibility QC and peak detection statistics
The number of peaks is capped at 300K for peak-caller MACS2
overlap
IDR
Nt
271142
194344
N1
262006
174428
N2
265492
184698
Np
276280
199429
N optimal
276280
199429
N conservative
271142
194344
Optimal Set
ppr
ppr
Conservative Set
rep1-rep2
rep1-rep2
Rescue Ratio
1.0189
1.0262
Self Consistency Ratio
1.0133
1.0589
Reproducibility
pass
pass
Overlapping peaks
N1: Replicate 1 self-consistent overlapping peaks (comparing two pseudoreplicates generated by subsampling Rep1 reads)
N2: Replicate 2 self-consistent overlapping peaks (comparing two pseudoreplicates generated by subsampling Rep2 reads)
Nt: True Replicate consisten overlapping peaks (comparing true replicates Rep1 vs Rep2 )
Np: Pooled-pseudoreplicate consistent overlapping peaks (comparing two pseudoreplicates generated by subsampling pooled reads from Rep1 and Rep2 )
Self-consistency Ratio: max(N1,N2) / min (N1,N2)
Rescue Ratio: max(Np,Nt) / min (Np,Nt)
Reproducibility Test: If Self-consistency Ratio >2 AND Rescue Ratio > 2, then 'Fail' else 'Pass'
IDR (Irreproducible Discovery Rate) peaks
N1: Replicate 1 self-consistent IDR 0.05 peaks (comparing two pseudoreplicates generated by subsampling Rep1 reads)
N2: Replicate 2 self-consistent IDR 0.05 peaks (comparing two pseudoreplicates generated by subsampling Rep2 reads)
Nt: True Replicate consistent IDR 0.05 peaks (comparing true replicates Rep1 vs Rep2 )
Np: Pooled-pseudoreplicate consistent IDR 0.05 peaks (comparing two pseudoreplicates generated by subsampling pooled reads from Rep1 and Rep2 )
Self-consistency Ratio: max(N1,N2) / min (N1,N2)
Rescue Ratio: max(Np,Nt) / min (Np,Nt)
Reproducibility Test: If Self-consistency Ratio >2 AND Rescue Ratio > 2, then 'Fail' else 'Pass'
Enrichment
Strand cross-correlation measures
Performed on subsampled reads (25M)
rep1
rep2
Reads
25000000
25000000
Est. Fragment Len.
0
0
Corr. Est. Fragment Len.
0.3949
0.3776
Phantom Peak
70
75
Corr. Phantom Peak
0.3367
0.3303
Argmin. Corr.
1500
1500
Min. Corr.
0.1905
0.2008
NSC
2.0725
1.8805
RSC
1.3984
1.3655
NOTE1: For SE datasets, reads from replicates are randomly subsampled.
NOTE2: For PE datasets, the first end of each read-pair is selected and the reads are then randomly subsampled.
Normalized strand cross-correlation coefficient (NSC) = col9 in outFile
Relative strand cross-correlation coefficient (RSC) = col10 in outFile
Estimated fragment length = col3 in outFile, take the top value
Fraction of reads in overlapping peaks
rep1-rep2
rep1-pr
rep2-pr
ppr
Fraction of Reads in Peak
0.3580
0.3699
0.3395
0.3603
ppr: Overlapping peaks comparing pooled pseudo replicates
rep1-pr: Overlapping peaks comparing pseudoreplicates from replicate 1
rep2-pr: Overlapping peaks comparing pseudoreplicates from replicate 2
repi-repj: Overlapping peaks comparing true replicates (rep i vs. rep j)
Fraction of reads in IDR peaks
rep1-rep2
rep1-pr
rep2-pr
ppr
Fraction of Reads in Peak
0.3161
0.3189
0.2959
0.3200
ppr: IDR peaks comparing pooled pseudo replicates
rep1-pr: IDR peaks comparing pseudoreplicates from replicate 1
rep2-pr: IDR peaks comparing pseudoreplicates from replicate 2
repi-repj: IDR peaks comparing true replicates (rep i vs. rep j)
Read count after removing mitochondrial reads (final read count)
130,997,956
Note that all these read counts are determined using 'samtools view' - as such,
these are all reads found in the file, whether one end of a pair or a single
end read. In other words, if your file is paired end, then you should divide
these counts by two. Each step follows the previous step; for example, the
duplicate reads were removed after reads were removed for low mapping quality.
This bar chart also shows the filtering process and where the reads were lost
over the process. Note that each step is sequential - as such, there may
have been more mitochondrial reads which were already filtered because of
high duplication or low mapping quality. Note that all these read counts are
determined using 'samtools view' - as such, these are all reads found in
the file, whether one end of a pair or a single end read. In other words,
if your file is paired end, then you should divide these counts by two.
Alignment statistics
Bowtie alignment log
138152819 reads; of these:
138152819 (100.00%) were paired; of these:
17080026 (12.36%) aligned concordantly 0 times
75296892 (54.50%) aligned concordantly exactly 1 time
45775901 (33.13%) aligned concordantly >1 times
----
17080026 pairs aligned concordantly 0 times; of these:
13825615 (80.95%) aligned discordantly 1 time
----
3254411 pairs aligned 0 times concordantly or discordantly; of these:
6508822 mates make up the pairs; of these:
2144735 (32.95%) aligned 0 times
452748 (6.96%) aligned exactly 1 time
3911339 (60.09%) aligned >1 times
99.22% overall alignment rate
Samtools flagstat
576473539 + 0 in total (QC-passed reads + QC-failed reads)
300167901 + 0 secondary
0 + 0 supplementary
0 + 0 duplicates
574328804 + 0 mapped (99.63%:-nan%)
276305638 + 0 paired in sequencing
138152819 + 0 read1
138152819 + 0 read2
242145586 + 0 properly paired (87.64%:-nan%)
273774038 + 0 with itself and mate mapped
386865 + 0 singletons (0.14%:-nan%)
756774 + 0 with mate mapped to a different chr
209673 + 0 with mate mapped to a different chr (mapQ>=5)
Note that the flagstat command counts alignments, not reads. please
use the read counts table to get accurate counts of reads at each
stage of the pipeline.
Filtering statistics
Mapping quality > q30 (out of total)
230,224,388
0.833
Duplicates (after filtering)
22,623,276
0.257
Mitochondrial reads (out of total)
19,474,557
0.034
Duplicates that are mitochondrial (out of all dups)
6,617,292
0.146
Final reads (after all filters)
130,997,956
0.474
Mapping quality refers to the quality of the read being aligned to that
particular location in the genome. A standard quality score is > 30.
Duplications are often due to PCR duplication rather than two unique reads
mapping to the same location. High duplication is an indication of poor
libraries. Mitochondrial reads are often high in chromatin accessibility
assays because the mitochondrial genome is very open. A high mitochondrial
fraction is an indication of poor libraries. Based on prior experience, a
final read fraction above 0.70 is a good library.
Library complexity statistics
ENCODE library complexity metrics
Metric
Result
NRF
0.76775 out of range [0.8, inf]
PBC1
0.77886 out of range [0.8, inf]
PBC2
4.536044 - OK
The non-redundant fraction (NRF) is the fraction of non-redundant mapped reads
in a dataset; it is the ratio between the number of positions in the genome
that uniquely mapped reads map to and the total number of uniquely mappable
reads. The NRF should be > 0.8. The PBC1 is the ratio of genomic locations
with EXACTLY one read pair over the genomic locations with AT LEAST one read
pair. PBC1 is the primary measure, and the PBC1 should be close to 1.
Provisionally 0-0.5 is severe bottlenecking, 0.5-0.8 is moderate bottlenecking,
0.8-0.9 is mild bottlenecking, and 0.9-1.0 is no bottlenecking. The PBC2 is
the ratio of genomic locations with EXACTLY one read pair over the genomic
locations with EXACTLY two read pairs. The PBC2 should be significantly
greater than 1.
Picard EstimateLibraryComplexity
218,626,965
Yield prediction
Preseq performs a yield prediction by subsampling the reads, calculating the
number of distinct reads, and then extrapolating out to see where the
expected number of distinct reads no longer increases. The confidence interval
gives a gauge as to the validity of the yield predictions.
Fragment length statistics
Metric
Result
Fraction of reads in NFR
0.502667213295 - OK
NFR / mono-nuc reads
1.64013857555 out of range [2.5, inf]
Presence of NFR peak
OK
Presence of Mono-Nuc peak
OK
Presence of Di-Nuc peak
OK
Open chromatin assays show distinct fragment length enrichments, as the cut
sites are only in open chromatin and not in nucleosomes. As such, peaks
representing different n-nucleosomal (ex mono-nucleosomal, di-nucleosomal)
fragment lengths will arise. Good libraries will show these peaks in a
fragment length distribution and will show specific peak ratios.
Peak statistics
Metric
Result
Naive overlap peaks
276280 - OK
IDR peaks
199429 - OK
Naive overlap peak file statistics
Min size
73.0
25 percentile
291.0
50 percentile (median)
514.0
75 percentile
797.0
Max size
3287.0
Mean
585.392912987
IDR peak file statistics
Min size
73.0
25 percentile
419.0
50 percentile (median)
632.0
75 percentile
894.0
Max size
3287.0
Mean
685.315034423
For a good ATAC-seq experiment in human, you expect to get 100k-200k peaks
for a specific cell type.
Sequence quality metrics
GC bias
Open chromatin assays are known to have significant GC bias. Please take this
into consideration as necessary.
Annotation-based quality metrics
Enrichment plots (TSS)
Open chromatin assays should show enrichment in open chromatin sites, such as
TSS's. An average TSS enrichment in human (hg19) is above 6. A strong TSS enrichment is
above 10. For other references please see https://www.encodeproject.org/atac-seq/
Annotated genomic region enrichments
Fraction of reads in universal DHS regions
62,416,237
0.483
Fraction of reads in blacklist regions
1,946
0.000
Fraction of reads in promoter regions
20,876,818
0.162
Fraction of reads in enhancer regions
52,561,389
0.407
Fraction of reads in called peak regions
41,196,412
0.319
Signal to noise can be assessed by considering whether reads are falling into
known open regions (such as DHS regions) or not. A high fraction of reads
should fall into the universal (across cell type) DHS set. A small fraction
should fall into the blacklist regions. A high set (though not all) should
fall into the promoter regions. A high set (though not all) should fall into
the enhancer regions. The promoter regions should not take up all reads, as
it is known that there is a bias for promoters in open chromatin assays.
Comparison to Roadmap DNase
This bar chart shows the correlation between the Roadmap DNase samples to
your sample, when the signal in the universal DNase peak region sets are
compared. The closer the sample is in signal distribution in the regions
to your sample, the higher the correlation.
Read count after removing mitochondrial reads (final read count)
170,502,236
Note that all these read counts are determined using 'samtools view' - as such,
these are all reads found in the file, whether one end of a pair or a single
end read. In other words, if your file is paired end, then you should divide
these counts by two. Each step follows the previous step; for example, the
duplicate reads were removed after reads were removed for low mapping quality.
This bar chart also shows the filtering process and where the reads were lost
over the process. Note that each step is sequential - as such, there may
have been more mitochondrial reads which were already filtered because of
high duplication or low mapping quality. Note that all these read counts are
determined using 'samtools view' - as such, these are all reads found in
the file, whether one end of a pair or a single end read. In other words,
if your file is paired end, then you should divide these counts by two.
Alignment statistics
Bowtie alignment log
169485689 reads; of these:
169485689 (100.00%) were paired; of these:
20073896 (11.84%) aligned concordantly 0 times
88534373 (52.24%) aligned concordantly exactly 1 time
60877420 (35.92%) aligned concordantly >1 times
----
20073896 pairs aligned concordantly 0 times; of these:
16513261 (82.26%) aligned discordantly 1 time
----
3560635 pairs aligned 0 times concordantly or discordantly; of these:
7121270 mates make up the pairs; of these:
1199186 (16.84%) aligned 0 times
630984 (8.86%) aligned exactly 1 time
5291100 (74.30%) aligned >1 times
99.65% overall alignment rate
Samtools flagstat
739416534 + 0 in total (QC-passed reads + QC-failed reads)
400445156 + 0 secondary
0 + 0 supplementary
0 + 0 duplicates
738217348 + 0 mapped (99.84%:-nan%)
338971378 + 0 paired in sequencing
169485689 + 0 read1
169485689 + 0 read2
298823586 + 0 properly paired (88.16%:-nan%)
337183440 + 0 with itself and mate mapped
588752 + 0 singletons (0.17%:-nan%)
1069062 + 0 with mate mapped to a different chr
290550 + 0 with mate mapped to a different chr (mapQ>=5)
Note that the flagstat command counts alignments, not reads. please
use the read counts table to get accurate counts of reads at each
stage of the pipeline.
Filtering statistics
Mapping quality > q30 (out of total)
276,338,606
0.815
Duplicates (after filtering)
20,176,431
0.191
Mitochondrial reads (out of total)
28,112,577
0.038
Duplicates that are mitochondrial (out of all dups)
10,082,178
0.250
Final reads (after all filters)
170,502,236
0.503
Mapping quality refers to the quality of the read being aligned to that
particular location in the genome. A standard quality score is > 30.
Duplications are often due to PCR duplication rather than two unique reads
mapping to the same location. High duplication is an indication of poor
libraries. Mitochondrial reads are often high in chromatin accessibility
assays because the mitochondrial genome is very open. A high mitochondrial
fraction is an indication of poor libraries. Based on prior experience, a
final read fraction above 0.70 is a good library.
Library complexity statistics
ENCODE library complexity metrics
Metric
Result
NRF
0.843649 - OK
PBC1
0.861244 - OK
PBC2
7.392064 - OK
The non-redundant fraction (NRF) is the fraction of non-redundant mapped reads
in a dataset; it is the ratio between the number of positions in the genome
that uniquely mapped reads map to and the total number of uniquely mappable
reads. The NRF should be > 0.8. The PBC1 is the ratio of genomic locations
with EXACTLY one read pair over the genomic locations with AT LEAST one read
pair. PBC1 is the primary measure, and the PBC1 should be close to 1.
Provisionally 0-0.5 is severe bottlenecking, 0.5-0.8 is moderate bottlenecking,
0.8-0.9 is mild bottlenecking, and 0.9-1.0 is no bottlenecking. The PBC2 is
the ratio of genomic locations with EXACTLY one read pair over the genomic
locations with EXACTLY two read pairs. The PBC2 should be significantly
greater than 1.
Picard EstimateLibraryComplexity
367,870,336
Yield prediction
Preseq performs a yield prediction by subsampling the reads, calculating the
number of distinct reads, and then extrapolating out to see where the
expected number of distinct reads no longer increases. The confidence interval
gives a gauge as to the validity of the yield predictions.
Fragment length statistics
Metric
Result
Fraction of reads in NFR
0.558274761995 - OK
NFR / mono-nuc reads
1.99516853611 out of range [2.5, inf]
Presence of NFR peak
OK
Presence of Mono-Nuc peak
OK
Presence of Di-Nuc peak
OK
Open chromatin assays show distinct fragment length enrichments, as the cut
sites are only in open chromatin and not in nucleosomes. As such, peaks
representing different n-nucleosomal (ex mono-nucleosomal, di-nucleosomal)
fragment lengths will arise. Good libraries will show these peaks in a
fragment length distribution and will show specific peak ratios.
Peak statistics
Metric
Result
Naive overlap peaks
276280 - OK
IDR peaks
199429 - OK
Naive overlap peak file statistics
Min size
73.0
25 percentile
291.0
50 percentile (median)
514.0
75 percentile
797.0
Max size
3287.0
Mean
585.392912987
IDR peak file statistics
Min size
73.0
25 percentile
419.0
50 percentile (median)
632.0
75 percentile
894.0
Max size
3287.0
Mean
685.315034423
For a good ATAC-seq experiment in human, you expect to get 100k-200k peaks
for a specific cell type.
Sequence quality metrics
GC bias
Open chromatin assays are known to have significant GC bias. Please take this
into consideration as necessary.
Annotation-based quality metrics
Enrichment plots (TSS)
Open chromatin assays should show enrichment in open chromatin sites, such as
TSS's. An average TSS enrichment in human (hg19) is above 6. A strong TSS enrichment is
above 10. For other references please see https://www.encodeproject.org/atac-seq/
Annotated genomic region enrichments
Fraction of reads in universal DHS regions
75,774,611
0.450
Fraction of reads in blacklist regions
2,366
0.000
Fraction of reads in promoter regions
24,906,360
0.148
Fraction of reads in enhancer regions
66,060,635
0.393
Fraction of reads in called peak regions
49,800,995
0.296
Signal to noise can be assessed by considering whether reads are falling into
known open regions (such as DHS regions) or not. A high fraction of reads
should fall into the universal (across cell type) DHS set. A small fraction
should fall into the blacklist regions. A high set (though not all) should
fall into the promoter regions. A high set (though not all) should fall into
the enhancer regions. The promoter regions should not take up all reads, as
it is known that there is a bias for promoters in open chromatin assays.
Comparison to Roadmap DNase
This bar chart shows the correlation between the Roadmap DNase samples to
your sample, when the signal in the universal DNase peak region sets are
compared. The closer the sample is in signal distribution in the regions
to your sample, the higher the correlation.