| Task | Execution | Time | Dependencies | Task program, Errors, StdOut / StdErr |
| Num | 1 | | ID | task.postalign_bed.xcor_rep1.line_205.id_10 | | Name | xcor rep1 | | Thread | thread_41 | | PID | 3435 | | | OK | true | | Exit Code | 0 | | Retries | | | State | FINISHED | | Dep. | OK | | Cpus | 3 | | Mem | | | | Start | 2016-11-03 16:52:26 | | End | 2016-11-03 17:11:24 | | Elapsed | 00:18:58 | | Timeout | 00:00:-1 | | Wall Timeout | 100 days | | | Input files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/rep1/SRR836476.nodup.15M.tagAlign.gz
| | Output files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/qc/rep1/SRR836476.nodup.15M.cc.qc
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/qc/rep1/SRR836476.nodup.15M.cc.plot.pdf
| | Dependencies | | |
# SYS command. line 207
if [[ -f $(which conda) && $(conda env list | grep aquas_chipseq | wc -l) != "0" ]]; then source activate aquas_chipseq; fi; export PATH=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/.:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/modules:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/utils:${PATH}:/bin:/usr/bin:/usr/local/bin:${HOME}/.bds; set -o pipefail; STARTTIME=$(date +%s); renice -n 10 $$
# SYS command. line 210
if [[ $(which run_spp_nodups.R 2> /dev/null | wc -l || echo) == "1" ]]; then RUN_SPP=$(which run_spp_nodups.R); \
else RUN_SPP=$(which run_spp.R); \
fi
# SYS command. line 216
Rscript ${RUN_SPP} -rf \
-c=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/rep1/SRR836476.nodup.15M.tagAlign.gz -p=3 \
-filtchr=chrM -savp=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/qc/rep1/SRR836476.nodup.15M.cc.plot.pdf -out=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/qc/rep1/SRR836476.nodup.15M.cc.qc
# SYS command. line 219
sed -r 's/,[^\t]+//g' /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/qc/rep1/SRR836476.nodup.15M.cc.qc > /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/qc/rep1/SRR836476.nodup.15M.cc.qc.tmp
# SYS command. line 220
mv /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/qc/rep1/SRR836476.nodup.15M.cc.qc.tmp /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/qc/rep1/SRR836476.nodup.15M.cc.qc
# SYS command. line 222
TASKTIME=$[$(date +%s)-${STARTTIME}]; if [ ${TASKTIME} -lt 60 ]; then echo "Waiting for $[60-${TASKTIME}] seconds."; sleep $[60-${TASKTIME}]; fi
--------------------Stdout--------------------
47099 (process ID) old priority 0, new priority 10
################
ChIP data: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/rep1/SRR836476.nodup.15M.tagAlign.gz
Control data: NA
strandshift(min): -500
strandshift(step): 5
strandshift(max) 1500
user-defined peak shift NA
exclusion(min): 10
exclusion(max): NaN
num parallel nodes: 3
FDR threshold: 0.01
NumPeaks Threshold: NA
Output Directory: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/rep1
narrowPeak output file name: NA
regionPeak output file name: NA
Rdata filename: NA
plot pdf filename: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/qc/rep1/SRR836476.nodup.15M.cc.plot.pdf
result filename: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/qc/rep1/SRR836476.nodup.15M.cc.qc
Overwrite files?: TRUE
Decompressing ChIP file
Reading ChIP tagAlign/BAM file /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/rep1/SRR836476.nodup.15M.tagAlign.gz
opened /tmp/3435.1.q/RtmpNS9vf9/SRR836476.nodup.15M.tagAlignb8ab58f30a77
done. read 15000000 fragments
ChIP data read length 50
[1] TRUE
Calculating peak characteristics
Minimum cross-correlation value 0.1970262
Minimum cross-correlation shift 1500
Top 3 cross-correlation values 0.22037438738129,0.210299181554119,0.209992836793278
Top 3 estimates for fragment length 110,305,315
Window half size 600
Phantom peak location 55
Phantom peak Correlation 0.216482
Normalized Strand cross-correlation coefficient (NSC) 1.118503
Relative Strand Cross correlation Coefficient (RSC) 1.200061
Phantom Peak Quality Tag 1
null device
1
--------------------Stderr--------------------
discarding /software/miniconda3/bin from PATH
prepending /software/miniconda3/envs/aquas_chipseq/bin to PATH
Loading required package: caTools
|
| Num | 2 | | ID | task.callpeak_spp.spp_rep1.line_54.id_11 | | Name | spp rep1 | | Thread | thread_Root | | PID | 3525 | | | OK | true | | Exit Code | 0 | | Retries | | | State | FINISHED | | Dep. | OK | | Cpus | | | Mem | | | | Start | 2016-11-03 17:11:26 | | End | 2016-11-05 17:26:35 | | Elapsed | 2 days 00:15:09 | | Timeout | 00:00:-1 | | Wall Timeout | 100 days | | | Input files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/rep1/SRR836476.nodup.tagAlign.gz
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/ctl1/r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.gz
| | Output files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.ccscore
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.pdf
| | Dependencies | | |
# SYS command. line 56
if [[ -f $(which conda) && $(conda env list | grep aquas_chipseq | wc -l) != "0" ]]; then source activate aquas_chipseq; fi; export PATH=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/.:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/modules:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/utils:${PATH}:/bin:/usr/bin:/usr/local/bin:${HOME}/.bds; set -o pipefail; STARTTIME=$(date +%s); renice -n 10 $$
# SYS command. line 59
if [ $(which run_spp_nodups.R 2> /dev/null | wc -l || echo) == "1" ]; then RUN_SPP=$(which run_spp_nodups.R); \
else RUN_SPP=$(which run_spp.R); \
fi
# SYS command. line 63
Rscript ${RUN_SPP} -c=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/rep1/SRR836476.nodup.tagAlign.gz -p=1 -i=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/ctl1/r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.gz \
-npeak=300000 -odir=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1 -speak=110 -savr -savp -rf -out=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.ccscore
# SYS command. line 67
zcat /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign_VS_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz | awk 'BEGIN{OFS="\t"}{ if ($2<0) $2=0; print $1,int($2),int($3),$4,$5,$6,$7,$8,$9,$10;}' | gzip -f -c > /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz
# SYS command. line 69
rm -f /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign_VS_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz
# SYS command. line 71
mv /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign.pdf /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.pdf
# SYS command. line 74
if [ $(zcat /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz | wc -l ) == "0" ]; then rm -f /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz; fi
# SYS command. line 77
if [ ! -f /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz ]; then error_in_spp_output_peak_does_not_exist; fi
# SYS command. line 79
TASKTIME=$[$(date +%s)-${STARTTIME}]; if [ ${TASKTIME} -lt 60 ]; then echo "Waiting for $[60-${TASKTIME}] seconds."; sleep $[60-${TASKTIME}]; fi
--------------------Stdout--------------------
15379 (process ID) old priority 0, new priority 10
################
ChIP data: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/rep1/SRR836476.nodup.tagAlign.gz
Control data: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/ctl1/r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.gz
strandshift(min): -500
strandshift(step): 5
strandshift(max) 1500
user-defined peak shift 110
exclusion(min): 10
exclusion(max): NaN
num parallel nodes: 1
FDR threshold: 0.01
NumPeaks Threshold: 3e+05
Output Directory: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1
narrowPeak output file name: NA
regionPeak output file name: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign_VS_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak
Rdata filename: NA
plot pdf filename: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign.pdf
result filename: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.ccscore
Overwrite files?: TRUE
Decompressing ChIP file
Decompressing control file
Reading ChIP tagAlign/BAM file /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/rep1/SRR836476.nodup.tagAlign.gz
opened /tmp/3525.1.amd.q/Rtmp0Jc6tk/SRR836476.nodup.tagAlign49d6383ff354
done. read 24529518 fragments
ChIP data read length 50
[1] TRUE
Reading Control tagAlign/BAM file /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/ctl1/r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.gz
opened /tmp/3525.1.amd.q/Rtmp0Jc6tk/r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign49d62d681987
done. read 3384182 fragments
Control data read length 50
Calculating peak characteristics
Minimum cross-correlation value 0.281884
Minimum cross-correlation shift 1500
Top 3 cross-correlation values 0.315083504244831
Top 3 estimates for fragment length 110
Window half size 600
Phantom peak location 55
Phantom peak Correlation 0.3096947
Normalized Strand cross-correlation coefficient (NSC) 1.117777
Relative Strand Cross correlation Coefficient (RSC) 1.193768
Phantom Peak Quality Tag 1
null device
1
Removing read stacks
Finding peaks
finding background exclusion regions ... done
determining peaks on provided 1 control datasets:
using reversed signal for FDR calculations
bg.weight= 0.1490712 excluding systematic background anomalies ... done
determining peaks on real data:
bg.weight= 6.708205 excluding systematic background anomalies ... done
calculating statistical thresholds
FDR 0.99 threshold= 2.000009
Detected 1576036 peaks
--------------------Stderr--------------------
discarding /software/miniconda3/bin from PATH
prepending /software/miniconda3/envs/aquas_chipseq/bin to PATH
Loading required package: caTools
There were 41 warnings (use warnings() to see them)
|
| Num | 3 | | ID | task.callpeak_spp.spp_rep1_pr1.line_54.id_12 | | Name | spp rep1-pr1 | | Thread | thread_Root | | PID | 3526 | | | OK | true | | Exit Code | 0 | | Retries | | | State | FINISHED | | Dep. | OK | | Cpus | | | Mem | | | | Start | 2016-11-03 17:11:27 | | End | 2016-11-05 14:25:57 | | Elapsed | 1 day 21:14:29 | | Timeout | 00:00:-1 | | Wall Timeout | 100 days | | | Input files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign.gz
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/ctl1/r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.gz
| | Output files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.ccscore
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.pdf
| | Dependencies | | |
# SYS command. line 56
if [[ -f $(which conda) && $(conda env list | grep aquas_chipseq | wc -l) != "0" ]]; then source activate aquas_chipseq; fi; export PATH=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/.:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/modules:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/utils:${PATH}:/bin:/usr/bin:/usr/local/bin:${HOME}/.bds; set -o pipefail; STARTTIME=$(date +%s); renice -n 10 $$
# SYS command. line 59
if [ $(which run_spp_nodups.R 2> /dev/null | wc -l || echo) == "1" ]; then RUN_SPP=$(which run_spp_nodups.R); \
else RUN_SPP=$(which run_spp.R); \
fi
# SYS command. line 63
Rscript ${RUN_SPP} -c=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign.gz -p=1 -i=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/ctl1/r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.gz \
-npeak=300000 -odir=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1 -speak=110 -savr -savp -rf -out=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.ccscore
# SYS command. line 67
zcat /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign_VS_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz | awk 'BEGIN{OFS="\t"}{ if ($2<0) $2=0; print $1,int($2),int($3),$4,$5,$6,$7,$8,$9,$10;}' | gzip -f -c > /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz
# SYS command. line 69
rm -f /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign_VS_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz
# SYS command. line 71
mv /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign.pdf /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.pdf
# SYS command. line 74
if [ $(zcat /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz | wc -l ) == "0" ]; then rm -f /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz; fi
# SYS command. line 77
if [ ! -f /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz ]; then error_in_spp_output_peak_does_not_exist; fi
# SYS command. line 79
TASKTIME=$[$(date +%s)-${STARTTIME}]; if [ ${TASKTIME} -lt 60 ]; then echo "Waiting for $[60-${TASKTIME}] seconds."; sleep $[60-${TASKTIME}]; fi
--------------------Stdout--------------------
14883 (process ID) old priority 0, new priority 10
################
ChIP data: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign.gz
Control data: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/ctl1/r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.gz
strandshift(min): -500
strandshift(step): 5
strandshift(max) 1500
user-defined peak shift 110
exclusion(min): 10
exclusion(max): NaN
num parallel nodes: 1
FDR threshold: 0.01
NumPeaks Threshold: 3e+05
Output Directory: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1
narrowPeak output file name: NA
regionPeak output file name: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign_VS_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak
Rdata filename: NA
plot pdf filename: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign.pdf
result filename: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.ccscore
Overwrite files?: TRUE
Decompressing ChIP file
Decompressing control file
Reading ChIP tagAlign/BAM file /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign.gz
opened /tmp/3526.1.amd.q/RtmpvPgb5q/SRR836476.nodup.pr1.tagAlign46a030790a43
done. read 12264759 fragments
ChIP data read length 50
[1] TRUE
Reading Control tagAlign/BAM file /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/ctl1/r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.gz
opened /tmp/3526.1.amd.q/RtmpvPgb5q/r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign46a06e1dfcbe
done. read 3384182 fragments
Control data read length 50
Calculating peak characteristics
Minimum cross-correlation value 0.1680577
Minimum cross-correlation shift 1500
Top 3 cross-correlation values 0.187700942339671
Top 3 estimates for fragment length 110
Window half size 605
Phantom peak location 55
Phantom peak Correlation 0.1845444
Normalized Strand cross-correlation coefficient (NSC) 1.116884
Relative Strand Cross correlation Coefficient (RSC) 1.19146
Phantom Peak Quality Tag 1
null device
1
Removing read stacks
Finding peaks
finding background exclusion regions ... done
determining peaks on provided 1 control datasets:
using reversed signal for FDR calculations
bg.weight= 0.2954014 excluding systematic background anomalies ... done
determining peaks on real data:
bg.weight= 3.385224 excluding systematic background anomalies ... done
calculating statistical thresholds
FDR 0.99 threshold= 2.000061
Detected 816729 peaks
--------------------Stderr--------------------
discarding /software/miniconda3/bin from PATH
prepending /software/miniconda3/envs/aquas_chipseq/bin to PATH
Loading required package: caTools
There were 50 or more warnings (use warnings() to see the first 50)
|
| Num | 4 | | ID | task.callpeak_spp.spp_rep1_pr2.line_54.id_13 | | Name | spp rep1-pr2 | | Thread | thread_Root | | PID | 3527 | | | OK | true | | Exit Code | 0 | | Retries | | | State | FINISHED | | Dep. | OK | | Cpus | | | Mem | | | | Start | 2016-11-03 17:11:28 | | End | 2016-11-05 15:12:20 | | Elapsed | 1 day 22:00:52 | | Timeout | 00:00:-1 | | Wall Timeout | 100 days | | | Input files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign.gz
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/ctl1/r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.gz
| | Output files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.ccscore
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.pdf
| | Dependencies | | |
# SYS command. line 56
if [[ -f $(which conda) && $(conda env list | grep aquas_chipseq | wc -l) != "0" ]]; then source activate aquas_chipseq; fi; export PATH=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/.:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/modules:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/utils:${PATH}:/bin:/usr/bin:/usr/local/bin:${HOME}/.bds; set -o pipefail; STARTTIME=$(date +%s); renice -n 10 $$
# SYS command. line 59
if [ $(which run_spp_nodups.R 2> /dev/null | wc -l || echo) == "1" ]; then RUN_SPP=$(which run_spp_nodups.R); \
else RUN_SPP=$(which run_spp.R); \
fi
# SYS command. line 63
Rscript ${RUN_SPP} -c=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign.gz -p=1 -i=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/ctl1/r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.gz \
-npeak=300000 -odir=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2 -speak=110 -savr -savp -rf -out=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.ccscore
# SYS command. line 67
zcat /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign_VS_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz | awk 'BEGIN{OFS="\t"}{ if ($2<0) $2=0; print $1,int($2),int($3),$4,$5,$6,$7,$8,$9,$10;}' | gzip -f -c > /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz
# SYS command. line 69
rm -f /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign_VS_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz
# SYS command. line 71
mv /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign.pdf /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.pdf
# SYS command. line 74
if [ $(zcat /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz | wc -l ) == "0" ]; then rm -f /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz; fi
# SYS command. line 77
if [ ! -f /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz ]; then error_in_spp_output_peak_does_not_exist; fi
# SYS command. line 79
TASKTIME=$[$(date +%s)-${STARTTIME}]; if [ ${TASKTIME} -lt 60 ]; then echo "Waiting for $[60-${TASKTIME}] seconds."; sleep $[60-${TASKTIME}]; fi
--------------------Stdout--------------------
15294 (process ID) old priority 0, new priority 10
################
ChIP data: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign.gz
Control data: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/ctl1/r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.gz
strandshift(min): -500
strandshift(step): 5
strandshift(max) 1500
user-defined peak shift 110
exclusion(min): 10
exclusion(max): NaN
num parallel nodes: 1
FDR threshold: 0.01
NumPeaks Threshold: 3e+05
Output Directory: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2
narrowPeak output file name: NA
regionPeak output file name: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign_VS_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak
Rdata filename: NA
plot pdf filename: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign.pdf
result filename: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.ccscore
Overwrite files?: TRUE
Decompressing ChIP file
Decompressing control file
Reading ChIP tagAlign/BAM file /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign.gz
opened /tmp/3527.1.amd.q/RtmpEyYNYf/SRR836476.nodup.pr2.tagAlign49632a45b0b0
done. read 12264759 fragments
ChIP data read length 50
[1] TRUE
Reading Control tagAlign/BAM file /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/align/ctl1/r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.gz
opened /tmp/3527.1.amd.q/RtmpEyYNYf/r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign49635fa93bd6
done. read 3384182 fragments
Control data read length 50
Calculating peak characteristics
Minimum cross-correlation value 0.1681639
Minimum cross-correlation shift 1500
Top 3 cross-correlation values 0.188198758407865
Top 3 estimates for fragment length 110
Window half size 610
Phantom peak location 55
Phantom peak Correlation 0.1848882
Normalized Strand cross-correlation coefficient (NSC) 1.119139
Relative Strand Cross correlation Coefficient (RSC) 1.197947
Phantom Peak Quality Tag 1
null device
1
Removing read stacks
Finding peaks
finding background exclusion regions ... done
determining peaks on provided 1 control datasets:
using reversed signal for FDR calculations
bg.weight= 0.2955492 excluding systematic background anomalies ... done
determining peaks on real data:
bg.weight= 3.383531 excluding systematic background anomalies ... done
calculating statistical thresholds
FDR 0.99 threshold= 2.000394
Detected 818189 peaks
--------------------Stderr--------------------
discarding /software/miniconda3/bin from PATH
prepending /software/miniconda3/envs/aquas_chipseq/bin to PATH
Loading required package: caTools
There were 30 warnings (use warnings() to see them)
|
| Num | 5 | | ID | task.callpeak_naive_overlap.naive_overlap_thresh.line_32.id_14 | | Name | naive_overlap_thresh | | Thread | thread_Root | | PID | 4155 | | | OK | true | | Exit Code | 0 | | Retries | | | State | FINISHED | | Dep. | OK | | Cpus | | | Mem | | | | Start | 2016-11-05 17:26:36 | | End | 2016-11-05 17:27:43 | | Elapsed | 00:01:07 | | Timeout | 01:00:00 | | Wall Timeout | 100 days | | | Input files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz
| | Output files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/SPP/overlap/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.naive_overlap.regionPeak.gz
| | Dependencies | | |
# SYS command. line 34
if [[ -f $(which conda) && $(conda env list | grep aquas_chipseq | wc -l) != "0" ]]; then source activate aquas_chipseq; fi; export PATH=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/.:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/modules:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/utils:${PATH}:/bin:/usr/bin:/usr/local/bin:${HOME}/.bds; set -o pipefail; STARTTIME=$(date +%s); renice -n 10 $$
# SYS command. line 37
intersectBed -wo -a <(zcat -f /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz) -b <(zcat -f /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz) | \
awk 'BEGIN{FS="\t";OFS="\t"} {s1=$3-$2; s2=$13-$12; if (($21/s1 >= 0.5) || ($21/s2 >= 0.5)) {print $0}}' | cut -f 1-10 | sort | uniq | \
intersectBed -wo -a stdin -b <(zcat -f /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz) | \
awk 'BEGIN{FS="\t";OFS="\t"} {s1=$3-$2; s2=$13-$12; if (($21/s1 >= 0.5) || ($21/s2 >= 0.5)) {print $0}}' | cut -f 1-10 | sort | uniq | gzip -c > /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/SPP/overlap/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.PooledInRep1AndRep2.regionPeak.gz
# SYS command. line 43
zcat /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/SPP/overlap/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.PooledInRep1AndRep2.regionPeak.gz | sort | uniq | gzip -c > /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/SPP/overlap/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.naive_overlap.regionPeak.gz
# SYS command. line 45
rm -f /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/SPP/overlap/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.PooledInRep1AndRep2.regionPeak.gz
# SYS command. line 47
TASKTIME=$[$(date +%s)-${STARTTIME}]; if [ ${TASKTIME} -lt 60 ]; then echo "Waiting for $[60-${TASKTIME}] seconds."; sleep $[60-${TASKTIME}]; fi
--------------------Stdout--------------------
19761 (process ID) old priority 0, new priority 10
Waiting for 52 seconds.
--------------------Stderr--------------------
discarding /software/miniconda3/bin from PATH
prepending /software/miniconda3/envs/aquas_chipseq/bin to PATH
***** WARNING: File /dev/fd/62 has inconsistent naming convention for record:
GL456359.1 19286 19890 . 0 . 41.1513061843439 -1 1.12564222754662 302
***** WARNING: File /dev/fd/62 has inconsistent naming convention for record:
GL456359.1 19286 19890 . 0 . 41.1513061843439 -1 1.12564222754662 302
***** WARNING: File /dev/fd/63 has inconsistent naming convention for record:
GL456359.1 19286 19896 . 0 . 37.243105218637 -1 1.11046897792141 305
***** WARNING: File /dev/fd/63 has inconsistent naming convention for record:
GL456359.1 19286 19896 . 0 . 37.243105218637 -1 1.11046897792141 305
|
| Num | 6 | | ID | task.callpeak_idr.idr2_rep1_pr.line_70.id_15 | | Name | idr2 rep1-pr | | Thread | thread_Root | | PID | 4156 | | | OK | true | | Exit Code | 0 | | Retries | | | State | FINISHED | | Dep. | OK | | Cpus | | | Mem | | | | Start | 2016-11-05 17:27:44 | | End | 2016-11-05 17:34:41 | | Elapsed | 00:06:56 | | Timeout | 00:00:-1 | | Wall Timeout | 100 days | | | Input files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz
| | Output files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.IDR0.05.narrowPeak.gz
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.unthresholded-peaks.txt.png
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.unthresholded-peaks.txt.gz
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.IDR0.05.12-col.bed.gz
| | Dependencies | | |
# SYS command. line 72
if [[ -f $(which conda) && $(conda env list | grep aquas_chipseq_py3 | wc -l) != "0" ]]; then source activate aquas_chipseq_py3; fi; export PATH=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/.:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/modules:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/utils:${PATH}:/bin:/usr/bin:/usr/local/bin:${HOME}/.bds; set -o pipefail; STARTTIME=$(date +%s); renice -n 10 $$
# SYS command. line 74
idr --samples /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr1/SRR836476.nodup.pr1.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/pseudo_reps/rep1/pr2/SRR836476.nodup.pr2.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz --peak-list /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/spp/rep1/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.regionPeak.gz --input-file-type narrowPeak \
--output-file /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.unthresholded-peaks.txt --rank signal.value --soft-idr-threshold 0.05 \
--plot --use-best-multisummit-IDR
# SYS command. line 78
idr_thresh_transformed=$(awk -v p=0.05 'BEGIN{print -log(p)/log(10)}')
# SYS command. line 81
awk 'BEGIN{OFS="\t"} $12>='"${idr_thresh_transformed}"' {if ($2<0) $2=0; print $1,$2,$3,$4,$5,$6,$7,$8,$9,$10,$11,$12,"0"}' /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.unthresholded-peaks.txt \
| sort | uniq | sort -k7n,7n | gzip -c > /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.IDR0.05.13-col.bed.gz
# SYS command. line 84
zcat /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.IDR0.05.13-col.bed.gz | awk 'BEGIN{OFS="\t"} {print $1,$2,$3,$4,$5,$6,$7,$8,$9,$10}' | gzip -c > /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.IDR0.05.narrowPeak.gz
# SYS command. line 85
zcat /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.IDR0.05.13-col.bed.gz | awk 'BEGIN{OFS="\t"} {print $1,$2,$3,$4,$5,$6,$7,$8,$9,$10,$11,$12}' | gzip -c > /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.IDR0.05.12-col.bed.gz
# SYS command. line 87
echo
# SYS command. line 88
echo
# SYS command. line 89
echo
# SYS command. line 91
gzip -f /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.unthresholded-peaks.txt
# SYS command. line 92
rm -f /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.IDR0.05.13-col.bed.gz /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.IDR0.05.filt.13-col.bed.gz
# SYS command. line 94
TASKTIME=$[$(date +%s)-${STARTTIME}]; if [ ${TASKTIME} -lt 60 ]; then echo "Waiting for $[60-${TASKTIME}] seconds."; sleep $[60-${TASKTIME}]; fi
--------------------Stdout--------------------
19935 (process ID) old priority 0, new priority 10
--------------------Stderr--------------------
discarding /software/miniconda3/bin from PATH
prepending /software/miniconda3/envs/aquas_chipseq_py3/bin to PATH
Initial parameter values: [0.10 1.00 0.20 0.50]
Final parameter values: [1.26 0.95 0.58 0.40]
Number of reported peaks - 154123/154123 (100.0%)
Number of peaks passing IDR cutoff of 0.05 - 24994/154123 (16.2%)
|
| Num | 7 | | ID | task.callpeak_idr.idr_final_qc.line_205.id_18 | | Name | idr final qc | | Thread | thread_Root | | PID | 4157 | | | OK | true | | Exit Code | 0 | | Retries | | | State | FINISHED | | Dep. | OK | | Cpus | | | Mem | | | | Start | 2016-11-05 17:34:42 | | End | 2016-11-05 17:35:58 | | Elapsed | 00:01:16 | | Timeout | 00:00:-1 | | Wall Timeout | 100 days | | | Input files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.IDR0.05.narrowPeak.gz
| | Output files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/qc/SRR836476_IDR_final.qc
| | Dependencies | | |
# SYS command. line 207
if [[ -f $(which conda) && $(conda env list | grep aquas_chipseq | wc -l) != "0" ]]; then source activate aquas_chipseq; fi; export PATH=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/.:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/modules:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/utils:${PATH}:/bin:/usr/bin:/usr/local/bin:${HOME}/.bds; set -o pipefail; STARTTIME=$(date +%s); renice -n 10 $$
# SYS command. line 209
echo -e "Nt\tN1 ""Np\tconservative_set\toptimal_set\trescue_ratio\tself_consistency_ratio\treproducibility" > /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/qc/SRR836476_IDR_final.qc
# SYS command. line 210
echo -e "0\t24864 ""0\tN/A\tN/A\tNaN\t1.0\t1" >> /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/qc/SRR836476_IDR_final.qc
# SYS command. line 212
TASKTIME=$[$(date +%s)-${STARTTIME}]; if [ ${TASKTIME} -lt 60 ]; then echo "Waiting for $[60-${TASKTIME}] seconds."; sleep $[60-${TASKTIME}]; fi
--------------------Stdout--------------------
20539 (process ID) old priority 0, new priority 10
Waiting for 60 seconds.
--------------------Stderr--------------------
discarding /software/miniconda3/bin from PATH
prepending /software/miniconda3/envs/aquas_chipseq/bin to PATH
|
| Num | 8 | | ID | task.report.peak2hammock.line_357.id_19 | | Name | peak2hammock | | Thread | thread_Root | | PID | 20677 | | | OK | true | | Exit Code | 0 | | Retries | | | State | FINISHED | | Dep. | OK | | Cpus | | | Mem | | | | Start | 2016-11-05 17:35:59 | | End | 2016-11-05 17:36:03 | | Elapsed | 00:00:04 | | Timeout | 00:00:-1 | | Wall Timeout | 100 days | | | Input files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/SPP/overlap/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.naive_overlap.regionPeak.gz
| | Output files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/SPP/overlap/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.naive_overlap.regionPeak.hammock.gz
| | Dependencies | | |
# SYS command. line 359
if [[ -f $(which conda) && $(conda env list | grep aquas_chipseq | wc -l) != "0" ]]; then source activate aquas_chipseq; fi; export PATH=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/.:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/modules:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/utils:${PATH}:/bin:/usr/bin:/usr/local/bin:${HOME}/.bds; set -o pipefail; STARTTIME=$(date +%s); renice -n 10 $$
# SYS command. line 360
zcat /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/SPP/overlap/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.naive_overlap.regionPeak.gz | sed '/^\(chr\)/!d' | sort -k1,1V -k2,2n > /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/SPP/overlap/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.naive_overlap.regionPeak.tmp
# SYS command. line 362
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/utils/narrowpeak.py /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/SPP/overlap/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.naive_overlap.regionPeak.tmp /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/SPP/overlap/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.naive_overlap.regionPeak.hammock
# SYS command. line 363
rm -f /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/SPP/overlap/SRR836476.nodup.tagAlign_x_r120621A_l1i7_aB180__wt__bioBirAonly.nodup.tagAlign.naive_overlap.regionPeak.tmp
--------------------Stdout--------------------
20681 (process ID) old priority 0, new priority 10
--------------------Stderr--------------------
discarding /software/miniconda3/bin from PATH
prepending /software/miniconda3/envs/aquas_chipseq/bin to PATH
|
| Num | 9 | | ID | task.report.peak2hammock.line_357.id_20 | | Name | peak2hammock | | Thread | thread_Root | | PID | 20764 | | | OK | true | | Exit Code | 0 | | Retries | | | State | FINISHED | | Dep. | OK | | Cpus | | | Mem | | | | Start | 2016-11-05 17:36:04 | | End | 2016-11-05 17:36:06 | | Elapsed | 00:00:02 | | Timeout | 00:00:-1 | | Wall Timeout | 100 days | | | Input files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.IDR0.05.12-col.bed.gz
| | Output files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.IDR0.05.12-col.bed.hammock.gz
| | Dependencies | | |
# SYS command. line 359
if [[ -f $(which conda) && $(conda env list | grep aquas_chipseq | wc -l) != "0" ]]; then source activate aquas_chipseq; fi; export PATH=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/.:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/modules:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/utils:${PATH}:/bin:/usr/bin:/usr/local/bin:${HOME}/.bds; set -o pipefail; STARTTIME=$(date +%s); renice -n 10 $$
# SYS command. line 360
zcat /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.IDR0.05.12-col.bed.gz | sed '/^\(chr\)/!d' | sort -k1,1V -k2,2n > /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.IDR0.05.12-col.bed.tmp
# SYS command. line 362
/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/utils/narrowpeak.py /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.IDR0.05.12-col.bed.tmp /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.IDR0.05.12-col.bed.hammock
# SYS command. line 363
rm -f /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/peak/idr/pseudo_reps/rep1/SRR836476_rep1-pr.IDR0.05.12-col.bed.tmp
--------------------Stdout--------------------
20768 (process ID) old priority 0, new priority 10
--------------------Stderr--------------------
discarding /software/miniconda3/bin from PATH
prepending /software/miniconda3/envs/aquas_chipseq/bin to PATH
|
| Num | 10 | | ID | task.graphviz.report.line_97.id_21 | | Name | report | | Thread | thread_Root | | PID | 20878 | | | OK | true | | Exit Code | 0 | | Retries | | | State | FINISHED | | Dep. | OK | | Cpus | | | Mem | | | | Start | 2016-11-05 17:36:07 | | End | 2016-11-05 17:36:09 | | Elapsed | 00:00:01 | | Timeout | 00:00:-1 | | Wall Timeout | 100 days | | | Input files | | | Output files | | | Dependencies | | |
# SYS command. line 98
if [[ -f $(which conda) && $(conda env list | grep aquas_chipseq | wc -l) != "0" ]]; then source activate aquas_chipseq; fi; export PATH=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/.:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/modules:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/utils:${PATH}:/bin:/usr/bin:/usr/local/bin:${HOME}/.bds; set -o pipefail; STARTTIME=$(date +%s); renice -n 10 $$
# SYS command. line 99
dot -Tsvg /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/report/SRR836476_workflow.dot > /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/report/SRR836476_workflow.svg 2> /dev/null || echo "svg: /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/report/SRR836476_workflow.svg" # to suppress dot font error (exit code=1)
--------------------Stdout--------------------
20884 (process ID) old priority 0, new priority 10
--------------------Stderr--------------------
discarding /software/miniconda3/bin from PATH
prepending /software/miniconda3/envs/aquas_chipseq/bin to PATH
|
| Num | 11 | | ID | task.report.pdf2png.line_324.id_26 | | Name | pdf2png | | Thread | thread_Root | | PID | 20883 | | | OK | true | | Exit Code | 0 | | Retries | | | State | FINISHED | | Dep. | OK | | Cpus | | | Mem | | | | Start | 2016-11-05 17:36:07 | | End | 2016-11-05 17:36:09 | | Elapsed | 00:00:01 | | Timeout | 00:00:-1 | | Wall Timeout | 100 days | | | Input files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/qc/rep1/SRR836476.nodup.15M.cc.plot.pdf
| | Output files | /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/qc/rep1/SRR836476.nodup.15M.cc.plot.png
| | Dependencies | | |
# SYS command. line 325
if [[ -f $(which conda) && $(conda env list | grep aquas_chipseq | wc -l) != "0" ]]; then source activate aquas_chipseq; fi; export PATH=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/.:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/modules:/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/src/TF_chipseq_pipeline/utils:${PATH}:/bin:/usr/bin:/usr/local/bin:${HOME}/.bds; set -o pipefail; STARTTIME=$(date +%s); renice -n 10 $$
# SYS command. line 326
gs -dFirstPage=1 -dLastPage=1 -dTextAlphaBits=4 -dGraphicsAlphaBits=4 -r110x110 \
-dUseCropBox -dQUIET -dSAFER -dBATCH -dNOPAUSE -dNOPROMPT -sDEVICE=png16m \
-sOutputFile=/srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/qc/rep1/SRR836476.nodup.15M.cc.plot.png \
-r144 /srv/scratch/shared/surya/imk1/TFBindingPredictionProject/MouseMutantData/SRR836476/out/qc/rep1/SRR836476.nodup.15M.cc.plot.pdf
--------------------Stdout--------------------
20892 (process ID) old priority 0, new priority 10
--------------------Stderr--------------------
discarding /software/miniconda3/bin from PATH
prepending /software/miniconda3/envs/aquas_chipseq/bin to PATH
|