Title: yiuwong_rtt109_YPGE_1

Report generated at Mon Sep 10 15:11:31 PDT 2018

Command line arguments

-out_dir ../tc2018/yiuwong_rtt109_YPGE_1 -species saccer3 -fastq1_1 yiuwong_rtt109_YPGE_1_R1_001.fastq.gz -fastq1_2 yiuwong_rtt109_YPGE_1_R2_001.fastq.gz -nth 4

Pipeline version

Latest git commit SHA1: 895743e5d9f674f8aeca1987ad1226edd2eee27b (Thu Sep 6 15:46:23 2018)


Directories and files
Expand all   Collapse all
FilesPath
Raw reads
Replicate 1
Fastq 1 (4M) /users/annashch/data2018/yiuwong_rtt109_YPGE_1_R1_001.fastq.gz
Fastq 2 (4M) /users/annashch/data2018/yiuwong_rtt109_YPGE_1_R2_001.fastq.gz
Alignment
Replicate 1
Bam (9M) ./align/rep1/yiuwong_rtt109_YPGE_1_R1_001.PE2SE.bam
Filtered & deduped bam (5M) ./align/rep1/yiuwong_rtt109_YPGE_1_R1_001.PE2SE.nodup.bam
Tag-align ./align/rep1/yiuwong_rtt109_YPGE_1_R1_001.PE2SE.nodup.tn5.tagAlign.gz
Pseudo-replicates
Replicate 1
Pseudo-replicate 1
Tag-align ./align/pseudo_reps/rep1/pr1/yiuwong_rtt109_YPGE_1_R1_001.PE2SE.nodup.tn5.pr1.tagAlign.gz
Pseudo-replicate 2
Tag-align ./align/pseudo_reps/rep1/pr2/yiuwong_rtt109_YPGE_1_R1_001.PE2SE.nodup.tn5.pr2.tagAlign.gz
Signal tracks
MACS2
Replicate 1
P-value ./signal/macs2/rep1/yiuwong_rtt109_YPGE_1_R1_001.PE2SE.nodup.tn5.pf.pval.signal.bigwig
Fold enrichment ./signal/macs2/rep1/yiuwong_rtt109_YPGE_1_R1_001.PE2SE.nodup.tn5.pf.fc.signal.bigwig
Peaks
MACS2
Replicate 1
Narrow peak (p-val thresh=0.01) ./peak/macs2/rep1/yiuwong_rtt109_YPGE_1_R1_001.PE2SE.nodup.tn5.pf.pval0.01.300K.narrowPeak.gz
Pseudo-replicates
Replicate 1
Pseudo-replicate 1
Narrow peak ./peak/macs2/pseudo_reps/rep1/pr1/yiuwong_rtt109_YPGE_1_R1_001.PE2SE.nodup.tn5.pr1.pf.pval0.01.300K.narrowPeak.gz
Pseudo-replicate 2
Narrow peak ./peak/macs2/pseudo_reps/rep1/pr2/yiuwong_rtt109_YPGE_1_R1_001.PE2SE.nodup.tn5.pr2.pf.pval0.01.300K.narrowPeak.gz
Naive overlap
Pseudo-replicates
Replicate 1
Narrow peak ./peak/macs2/overlap/pseudo_reps/rep1/yiuwong_rtt109_YPGE_1_rep1-pr.naive_overlap.narrowPeak.gz
Optimal set
Overlapping peak ./peak/macs2/overlap/optimal_set/yiuwong_rtt109_YPGE_1_rep1-pr.naive_overlap.narrowPeak.gz
Conservative set
Overlapping peak ./peak/macs2/overlap/conservative_set/yiuwong_rtt109_YPGE_1_rep1-pr.naive_overlap.narrowPeak.gz
QC and logs
Replicate 1
Filtered flagstat log ./qc/rep1/yiuwong_rtt109_YPGE_1_R1_001.PE2SE.nodup.flagstat.qc
Bowtie2 map. log ./qc/rep1/yiuwong_rtt109_YPGE_1_R1_001.PE2SE.align.log
Dedup. log ./qc/rep1/yiuwong_rtt109_YPGE_1_R1_001.PE2SE.dup.qc
Bowtie2 map. flagstat log ./qc/rep1/yiuwong_rtt109_YPGE_1_R1_001.PE2SE.flagstat.qc
PBC log ./qc/rep1/yiuwong_rtt109_YPGE_1_R1_001.PE2SE.nodup.pbc.qc
Cross-corr. plot ./qc/rep1/yiuwong_rtt109_YPGE_1_R1_001.PE2SE.nodup.tn5.no_chrM.25M.R1.cc.plot.pdf
Naive overlap
Naive overlap QC log ./qc/yiuwong_rtt109_YPGE_1_peak_overlap_final.qc
Pseudo-replicates
Replicate 1
FRiP ./peak/macs2/overlap/pseudo_reps/rep1/yiuwong_rtt109_YPGE_1_rep1-pr.naive_overlap.narrowPeak.FRiP.qc

Visualization (add -url_base [URL_ROOT_DIR_FOR_OUT_DIR] to the command line.)
Visualize  JSON (datahub)



Workflow diagram (g./b. peak : gapped/broad peak from MACS2, n. peak : narrow peak from MACS2, r. peak : relaxed peak from SPP)


Flagstat (raw) QC
Total9967950
Total(QC-failed)0
Dupes0
Dupes(QC-failed)0
Mapped9595578
Mapped(QC-failed)0
% Mapped96.26
Paired9967950
Paired(QC-failed)0
Read14983975
Read1(QC-failed)0
Read24983975
Read2(QC-failed)0
Properly Paired9516068
Properly Paired(QC-failed)0
% Properly Paired95.47
With itself9582720
With itself(QC-failed)0
Singletons12858
Singletons(QC-failed)0
% Singleton0.13
Diff. Chroms1326
Diff. Chroms (QC-failed)0
Dup. QC
Unpaired Reads0
Paired Reads2961708
Unmapped Reads0
Unpaired Dupes0
Paired Dupes298970
Paired Opt. Dupes54007
% Dupes/1000.100945
Flagstat (filtered) QC
Total5325476
Total(QC-failed)0
Dupes0
Dupes(QC-failed)0
Mapped5325476
Mapped(QC-failed)0
% Mapped100.00
Paired5325476
Paired(QC-failed)0
Read12662738
Read1(QC-failed)0
Read22662738
Read2(QC-failed)0
Properly Paired5325476
Properly Paired(QC-failed)0
% Properly Paired100.00
With itself5325476
With itself(QC-failed)0
Singletons0
Singletons(QC-failed)0
% Singleton0.00
Diff. Chroms0
Diff. Chroms (QC-failed)0
Library Complexity QC
Total Read Pairs2695552
Distinct Read Pairs2496816
One Read Pair2360543
Two Read Pairs114915
NRF = Distinct/Total0.926273
PBC1 = OnePair/Distinct0.945421
PBC2 = OnePair/TwoPair20.541644

NRF (non redundant fraction)
PBC1 (PCR Bottleneck coefficient 1)
PBC2 (PCR Bottleneck coefficient 2)
PBC1 is the primary measure. Provisionally

  • 0-0.5 is severe bottlenecking
  • 0.5-0.8 is moderate bottlenecking
  • 0.8-0.9 is mild bottlenecking
  • 0.9-1.0 is no bottlenecking

Enrichment QC (strand cross-correlation measures)
Reads2493733
Est. Fragment Len.0
Corr. Est. Fragment Len.0.885879935757028
Phantom Peak40
Corr. Phantom Peak0.8260795
Argmin. Corr.1500
Min. Corr.0.7784211
NSC1.138047
RSC2.254774

NOTE: One end of each read-pair is randomly selected and the reads are then randomly subsampled to a max of 25M

  • Normalized strand cross-correlation coefficient (NSC) = col9 in outFile
  • Relative strand cross-correlation coefficient (RSC) = col10 in outFile
  • Estimated fragment length = col3 in outFile, take the top value


rep1
 
Number of peaks
rep14223
rep1-pr13652
rep1-pr23632

  • ppr1: Raw peaks called on the first pooled pseudoreplicates
  • ppr2: Raw peaks called on the second pooled pseudoreplicates
  • repi: Raw peaks called on true replicate i
  • repi-pr1 : Raw peaks called on the first pseudoreplicate from replicate i
  • repi-pr2 : Raw peaks called on the second pseudoreplicates from replicate i
  • overlap : Overlapped peaks (filtered if blacklist exists)


Enrichment QC (Fraction of reads in overlapping peaks)
Fraction of Reads in Peak0.342885

  • ppr: Overlapping peaks comparing pooled pseudo replicates
  • rep1-pr: Overlapping peaks comparing pseudoreplicates from replicate 1
  • rep2-pr: Overlapping peaks comparing pseudoreplicates from replicate 2
  • repi-repj: Overlapping peaks comparing true replicates (rep i vs. rep j)


Reproducibility QC and Peak Detection Statistics (Overlapping peaks)
Nt0
N13289
N20
Np0
N optimal3289
N conservative3289
Optimal Setself_pseudo_rep_rep1
Conservative Setself_pseudo_rep_rep1
Rescue Ratio0.0
Self Consistency Ratio1.0
Reproducibility Testpass

  • N1: Replicate 1 self-consistent overlapping peaks (comparing two pseudoreplicates generated by subsampling Rep1 reads)
  • N2: Replicate 2 self-consistent overlapping peaks (comparing two pseudoreplicates generated by subsampling Rep2 reads)
  • Nt: True Replicate consisten overlapping peaks (comparing true replicates Rep1 vs Rep2 )
  • Np: Pooled-pseudoreplicate consistent overlapping peaks (comparing two pseudoreplicates generated by subsampling pooled reads from Rep1 and Rep2 )
  • Self-consistency Ratio: max(N1,N2) / min (N1,N2)
  • Rescue Ratio: max(Np,Nt) / min (Np,Nt)
  • Reproducibility Test: If Self-consistency Ratio >2 AND Rescue Ratio > 2, then 'Fail' else 'Pass'