Script file	/users/pangwei/bds_atac/atac.bds
Program ID	atac.bds.20160512_211413_781
Start time	2016-05-12 21:14:13
Run time	01:13:44.444
Tasks executed	6
Tasks failed	2
Tasks failed names	dedup_bam_PE rep2 dedup_bam_PE rep1
Arguments*	[-out_dir, /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4, -num_rep, 2, -fastq1_1, /srv/scratch/pangwei/mesoderm/data/ATACseq/ATAC3/ATAC3-trimmed-pair1.fastq.gz, -fastq1_2, /srv/scratch/pangwei/mesoderm/data/ATACseq/ATAC3/ATAC3-trimmed-pair2.fastq.gz, -fastq2_1, /srv/scratch/pangwei/mesoderm/data/ATACseq/ATAC4/ATAC4-trimmed-pair1.fastq.gz, -fastq2_2, /srv/scratch/pangwei/mesoderm/data/ATACseq/ATAC4/ATAC4-trimmed-pair2.fastq.gz, -subsample, 17500000, -true_rep, -species, hg19]
System*	local
Cpus*	1
Exit value	1

Thread ID	Parent	Tasks
thread_Root	None
thread_20	thread_Root	atac.bds.20160512_211413_781_parallel_20/task.align_etc.trim_adapters_PE_rep1.line_57.id_6 atac.bds.20160512_211413_781_parallel_20/task.align_bowtie2.bowtie2_PE_rep1.line_133.id_10 atac.bds.20160512_211413_781_parallel_20/task.postalign_bam.dedup_bam_PE_rep1.line_215.id_11
thread_21	thread_Root	atac.bds.20160512_211413_781_parallel_21/task.align_etc.trim_adapters_PE_rep2.line_57.id_7 atac.bds.20160512_211413_781_parallel_21/task.align_bowtie2.bowtie2_PE_rep2.line_133.id_8 atac.bds.20160512_211413_781_parallel_21/task.postalign_bam.dedup_bam_PE_rep2.line_215.id_9

Task details

Task

Execution

Time

Dependencies

Task program, Errors, StdOut / StdErr

Num	1
ID	task.align_etc.trim_adapters_PE_rep1.line_57.id_6
Name	trim_adapters_PE rep1
Thread	thread_20
PID	29502

OK	true
Exit Code	0
Retries
State	FINISHED
Dep.	OK
Cpus	1
Mem

Start	2016-05-12 21:14:14
End	2016-05-12 22:27:55
Elapsed	01:13:41
Timeout	00:00:-1
Wall Timeout	100 days

Input files	/srv/scratch/pangwei/mesoderm/data/ATACseq/ATAC3/ATAC3-trimmed-pair1.fastq.gz /srv/scratch/pangwei/mesoderm/data/ATACseq/ATAC3/ATAC3-trimmed-pair2.fastq.gz
Output files	/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.fastq.gz /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair2.trim.fastq.gz
Dependencies

 
# SYS command. line 59

 if [[ -f $(which activate) ]]; then source activate bds_atac; fi;  export PATH=/users/pangwei/bds_atac/.:/users/pangwei/bds_atac/modules:/users/pangwei/bds_atac/utils:${PATH}:/bin:/usr/bin:/usr/local/bin:${HOME}/.bds;

# SYS command. line 61

 cd /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1

# SYS command. line 62

 $(which trimAdapters.py) -a /srv/scratch/pangwei/mesoderm/data/ATACseq/ATAC3/ATAC3-trimmed-pair1.fastq.gz -b /srv/scratch/pangwei/mesoderm/data/ATACseq/ATAC3/ATAC3-trimmed-pair2.fastq.gz

# SYS command. line 63

 gzip /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.fastq

# SYS command. line 64

 gzip /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair2.trim.fastq

   
--------------------Stdout--------------------
ATAC3-trimmed-pair1.trim.fastq
ATAC3-trimmed-pair2.trim.fastq

 
--------------------Stderr--------------------
44200906 sequences total
16609715 sequences trimmed with 0 mismatches
1370893 sequences trimmed with 1 mismatch
22 mean number of bases trimmed for reads requiring trimming

Num	2
ID	task.align_etc.trim_adapters_PE_rep2.line_57.id_7
Name	trim_adapters_PE rep2
Thread	thread_21
PID	29508

OK	true
Exit Code	0
Retries
State	FINISHED
Dep.	OK
Cpus	1
Mem

Start	2016-05-12 21:14:15
End	2016-05-12 22:09:41
Elapsed	00:55:26
Timeout	00:00:-1
Wall Timeout	100 days

Input files	/srv/scratch/pangwei/mesoderm/data/ATACseq/ATAC4/ATAC4-trimmed-pair1.fastq.gz /srv/scratch/pangwei/mesoderm/data/ATACseq/ATAC4/ATAC4-trimmed-pair2.fastq.gz
Output files	/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.fastq.gz /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair2.trim.fastq.gz
Dependencies

 
# SYS command. line 59

 if [[ -f $(which activate) ]]; then source activate bds_atac; fi;  export PATH=/users/pangwei/bds_atac/.:/users/pangwei/bds_atac/modules:/users/pangwei/bds_atac/utils:${PATH}:/bin:/usr/bin:/usr/local/bin:${HOME}/.bds;

# SYS command. line 61

 cd /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2

# SYS command. line 62

 $(which trimAdapters.py) -a /srv/scratch/pangwei/mesoderm/data/ATACseq/ATAC4/ATAC4-trimmed-pair1.fastq.gz -b /srv/scratch/pangwei/mesoderm/data/ATACseq/ATAC4/ATAC4-trimmed-pair2.fastq.gz

# SYS command. line 63

 gzip /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.fastq

# SYS command. line 64

 gzip /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair2.trim.fastq

   
--------------------Stdout--------------------
ATAC4-trimmed-pair1.trim.fastq
ATAC4-trimmed-pair2.trim.fastq

 
--------------------Stderr--------------------
33358080 sequences total
13345996 sequences trimmed with 0 mismatches
1175060 sequences trimmed with 1 mismatch
19 mean number of bases trimmed for reads requiring trimming

Num	3
ID	task.align_bowtie2.bowtie2_PE_rep2.line_133.id_8
Name	bowtie2_PE rep2
Thread	thread_21
PID	37438

OK	true
Exit Code	0
Retries
State	FINISHED
Dep.	OK
Cpus	2
Mem

Start	2016-05-12 22:09:42
End	2016-05-12 22:09:42
Elapsed	00:00:00
Timeout	00:00:-1
Wall Timeout	100 days

Input files	/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.fastq.gz /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair2.trim.fastq.gz
Output files	/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.bam /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep2/ATAC4-trimmed-pair1.trim.PE2SE.align.log
Dependencies

 
# SYS command. line 135

 if [[ -f $(which activate) ]]; then source activate bds_atac; fi;  export PATH=/users/pangwei/bds_atac/.:/users/pangwei/bds_atac/modules:/users/pangwei/bds_atac/utils:${PATH}:/bin:/usr/bin:/usr/local/bin:${HOME}/.bds;

# SYS command. line 139

 bowtie2  -X2000 --mm --threads 2 -x /mnt/data/annotations/indexes/bowtie2_indexes/bowtie2/ENCODEHg19_male \
			-1 /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.fastq.gz -2 /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair2.trim.fastq.gz 2>/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep2/ATAC4-trimmed-pair1.trim.PE2SE.align.log | samtools view -bS - | samtools sort - /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE

# SYS command. line 142

 samtools index /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.bam

Num	4
ID	task.postalign_bam.dedup_bam_PE_rep2.line_215.id_9
Name	dedup_bam_PE rep2
Thread	thread_21
PID	37453

OK	false
Exit Code	1
Retries
State	ERROR
Dep.	ERROR
Cpus	1
Mem

Start	2016-05-12 22:09:43
End	2016-05-12 22:09:43
Elapsed	00:00:00
Timeout	00:00:-1
Wall Timeout	100 days

Input files	/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.bam
Output files	/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.nodup.bam /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep2/ATAC4-trimmed-pair1.trim.PE2SE.dup.qc /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep2/ATAC4-trimmed-pair1.trim.PE2SE.nodup.flagstat.qc /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep2/ATAC4-trimmed-pair1.trim.PE2SE.nodup.pbc.qc
Dependencies

 
# SYS command. line 217

 if [[ -f $(which activate) ]]; then source activate bds_atac; fi;  export PATH=/users/pangwei/bds_atac/.:/users/pangwei/bds_atac/modules:/users/pangwei/bds_atac/utils:${PATH}:/bin:/usr/bin:/usr/local/bin:${HOME}/.bds;

# SYS command. line 228

 echo

# SYS command. line 229

 samtools view -F 1804 -f 2 -q 30 -u /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.bam | samtools sort -n - /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.dupmark

# SYS command. line 230

 echo

# SYS command. line 237

 samtools fixmate -r /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.dupmark.bam /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.dupmark.bam.fixmate.bam

# SYS command. line 238

 samtools view -F 1804 -f 2 -u /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.dupmark.bam.fixmate.bam | samtools sort - /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.filt

# SYS command. line 239

 rm -f /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.dupmark.bam.fixmate.bam

# SYS command. line 243

 export _JAVA_OPTIONS="-Xms256M -Xmx4G -XX:ParallelGCThreads=1"

# SYS command. line 244

 export MAX_JAVA_MEM="12G"

# SYS command. line 247

 if [ -f ${PICARDROOT}/MarkDuplicates.jar ]; then \
			java -Xmx4G -jar ${PICARDROOT}/MarkDuplicates.jar \
				INPUT="/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.filt.bam" OUTPUT="/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.dupmark.bam" \
				METRICS_FILE="/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep2/ATAC4-trimmed-pair1.trim.PE2SE.dup.qc" VALIDATION_STRINGENCY=LENIENT \
				ASSUME_SORTED=true REMOVE_DUPLICATES=false; \
			else \
			java -Xmx4G -jar ${PICARDROOT}/picard.jar MarkDuplicates \
				INPUT="/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.filt.bam" OUTPUT="/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.dupmark.bam" \
				METRICS_FILE="/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep2/ATAC4-trimmed-pair1.trim.PE2SE.dup.qc" VALIDATION_STRINGENCY=LENIENT \
				ASSUME_SORTED=true REMOVE_DUPLICATES=false; \
			fi

# SYS command. line 265

 mv /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.dupmark.bam /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.filt.bam

# SYS command. line 267

 samtools view -F 1804 -f 2 -b /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.filt.bam > /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.nodup.bam

# SYS command. line 269

 samtools index /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.nodup.bam

# SYS command. line 271

 if [ "/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.nodup.bam.bai" != "/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.nodup.bai" ]; then \
			cp /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.nodup.bam.bai /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.nodup.bai; \
			fi

# SYS command. line 275

 samtools flagstat /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.nodup.bam > /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep2/ATAC4-trimmed-pair1.trim.PE2SE.nodup.flagstat.qc

# SYS command. line 286

 samtools sort -n /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.filt.bam /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.filt.bam.tmp

# SYS command. line 287

 bedtools bamtobed -bedpe -i /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.filt.bam.tmp.bam | \
			awk 'BEGIN{OFS="\t"}{print $1,$2,$4,$6,$9,$10}' | \
			grep -v 'chrM' | sort | uniq -c | \
			awk 'BEGIN{mt=0;m0=0;m1=0;m2=0} ($1==1){m1=m1+1} ($1==2){m2=m2+1} {m0=m0+1} {mt=mt+$1} END{printf "%d\t%d\t%d\t%d\t%f\t%f\t%f\n",mt,m0,m1,m2,m0/mt,m1/m0,m1/m2}' > /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep2/ATAC4-trimmed-pair1.trim.PE2SE.nodup.pbc.qc

# SYS command. line 291

 rm /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.filt.bam.tmp.bam

# SYS command. line 293

 rm -f /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.filt.bam

# SYS command. line 294

 rm -f /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep2/ATAC4-trimmed-pair1.trim.PE2SE.dupmark.bam

   
--------------------Stdout--------------------



 
--------------------Stderr--------------------
Error: Unable to access jarfile /picard.jar

Num	5
ID	task.align_bowtie2.bowtie2_PE_rep1.line_133.id_10
Name	bowtie2_PE rep1
Thread	thread_20
PID	41520

OK	true
Exit Code	0
Retries
State	FINISHED
Dep.	OK
Cpus	2
Mem

Start	2016-05-12 22:27:56
End	2016-05-12 22:27:56
Elapsed	00:00:00
Timeout	00:00:-1
Wall Timeout	100 days

Input files	/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.fastq.gz /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair2.trim.fastq.gz
Output files	/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.bam /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep1/ATAC3-trimmed-pair1.trim.PE2SE.align.log
Dependencies

 
# SYS command. line 135

 if [[ -f $(which activate) ]]; then source activate bds_atac; fi;  export PATH=/users/pangwei/bds_atac/.:/users/pangwei/bds_atac/modules:/users/pangwei/bds_atac/utils:${PATH}:/bin:/usr/bin:/usr/local/bin:${HOME}/.bds;

# SYS command. line 139

 bowtie2  -X2000 --mm --threads 2 -x /mnt/data/annotations/indexes/bowtie2_indexes/bowtie2/ENCODEHg19_male \
			-1 /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.fastq.gz -2 /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair2.trim.fastq.gz 2>/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep1/ATAC3-trimmed-pair1.trim.PE2SE.align.log | samtools view -bS - | samtools sort - /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE

# SYS command. line 142

 samtools index /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.bam

Num	6
ID	task.postalign_bam.dedup_bam_PE_rep1.line_215.id_11
Name	dedup_bam_PE rep1
Thread	thread_20
PID	41536

OK	false
Exit Code	1
Retries
State	ERROR
Dep.	ERROR
Cpus	1
Mem

Start	2016-05-12 22:27:57
End	2016-05-12 22:27:57
Elapsed	00:00:00
Timeout	00:00:-1
Wall Timeout	100 days

Input files	/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.bam
Output files	/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.nodup.bam /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep1/ATAC3-trimmed-pair1.trim.PE2SE.dup.qc /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep1/ATAC3-trimmed-pair1.trim.PE2SE.nodup.flagstat.qc /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep1/ATAC3-trimmed-pair1.trim.PE2SE.nodup.pbc.qc
Dependencies

 
# SYS command. line 217

 if [[ -f $(which activate) ]]; then source activate bds_atac; fi;  export PATH=/users/pangwei/bds_atac/.:/users/pangwei/bds_atac/modules:/users/pangwei/bds_atac/utils:${PATH}:/bin:/usr/bin:/usr/local/bin:${HOME}/.bds;

# SYS command. line 228

 echo

# SYS command. line 229

 samtools view -F 1804 -f 2 -q 30 -u /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.bam | samtools sort -n - /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.dupmark

# SYS command. line 230

 echo

# SYS command. line 237

 samtools fixmate -r /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.dupmark.bam /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.dupmark.bam.fixmate.bam

# SYS command. line 238

 samtools view -F 1804 -f 2 -u /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.dupmark.bam.fixmate.bam | samtools sort - /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.filt

# SYS command. line 239

 rm -f /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.dupmark.bam.fixmate.bam

# SYS command. line 243

 export _JAVA_OPTIONS="-Xms256M -Xmx4G -XX:ParallelGCThreads=1"

# SYS command. line 244

 export MAX_JAVA_MEM="12G"

# SYS command. line 247

 if [ -f ${PICARDROOT}/MarkDuplicates.jar ]; then \
			java -Xmx4G -jar ${PICARDROOT}/MarkDuplicates.jar \
				INPUT="/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.filt.bam" OUTPUT="/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.dupmark.bam" \
				METRICS_FILE="/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep1/ATAC3-trimmed-pair1.trim.PE2SE.dup.qc" VALIDATION_STRINGENCY=LENIENT \
				ASSUME_SORTED=true REMOVE_DUPLICATES=false; \
			else \
			java -Xmx4G -jar ${PICARDROOT}/picard.jar MarkDuplicates \
				INPUT="/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.filt.bam" OUTPUT="/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.dupmark.bam" \
				METRICS_FILE="/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep1/ATAC3-trimmed-pair1.trim.PE2SE.dup.qc" VALIDATION_STRINGENCY=LENIENT \
				ASSUME_SORTED=true REMOVE_DUPLICATES=false; \
			fi

# SYS command. line 265

 mv /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.dupmark.bam /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.filt.bam

# SYS command. line 267

 samtools view -F 1804 -f 2 -b /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.filt.bam > /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.nodup.bam

# SYS command. line 269

 samtools index /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.nodup.bam

# SYS command. line 271

 if [ "/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.nodup.bam.bai" != "/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.nodup.bai" ]; then \
			cp /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.nodup.bam.bai /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.nodup.bai; \
			fi

# SYS command. line 275

 samtools flagstat /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.nodup.bam > /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep1/ATAC3-trimmed-pair1.trim.PE2SE.nodup.flagstat.qc

# SYS command. line 286

 samtools sort -n /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.filt.bam /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.filt.bam.tmp

# SYS command. line 287

 bedtools bamtobed -bedpe -i /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.filt.bam.tmp.bam | \
			awk 'BEGIN{OFS="\t"}{print $1,$2,$4,$6,$9,$10}' | \
			grep -v 'chrM' | sort | uniq -c | \
			awk 'BEGIN{mt=0;m0=0;m1=0;m2=0} ($1==1){m1=m1+1} ($1==2){m2=m2+1} {m0=m0+1} {mt=mt+$1} END{printf "%d\t%d\t%d\t%d\t%f\t%f\t%f\n",mt,m0,m1,m2,m0/mt,m1/m0,m1/m2}' > /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/qc/rep1/ATAC3-trimmed-pair1.trim.PE2SE.nodup.pbc.qc

# SYS command. line 291

 rm /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.filt.bam.tmp.bam

# SYS command. line 293

 rm -f /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.filt.bam

# SYS command. line 294

 rm -f /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4/align/rep1/ATAC3-trimmed-pair1.trim.PE2SE.dupmark.bam

   
--------------------Stdout--------------------



 
--------------------Stderr--------------------
Error: Unable to access jarfile /picard.jar

Type	Name	Value
string	_	/usr/bin/bds
string	_LMFILES_	/software/modulefiles/modsappsdir/modsappsdir:/software/modulefiles/samtools/1.2:/software/modulefiles/bedtools/2.23.0:/software/modulefiles/rsem/1.2.21
string	_ZSH_TMUX_FIXED_CONFIG	/users/pangwei/.oh-my-zsh/plugins/tmux/tmux.extra.conf
bool	allowEmpty	false
string[]	args	[-out_dir, /srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata/ATAC3+4, -num_rep, 2, -fastq1_1, /srv/scratch/pangwei/mesoderm/data/ATACseq/ATAC3/ATAC3-trimmed-pair1.fastq.gz, -fastq1_2, /srv/scratch/pangwei/mesoderm/data/ATACseq/ATAC3/ATAC3-trimmed-pair2.fastq.gz, -fastq2_1, /srv/scratch/pangwei/mesoderm/data/ATACseq/ATAC4/ATAC4-trimmed-pair1.fastq.gz, -fastq2_2, /srv/scratch/pangwei/mesoderm/data/ATACseq/ATAC4/ATAC4-trimmed-pair2.fastq.gz, -subsample, 17500000, -true_rep, -species, hg19]
string	C_INCLUDE_PATH	/software/samtools/samtools-1.2/include/htslib
bool	canFail	false
int	cpus	1
int	cpusLocal	48
int	day	86400
real	E	2.718281828459045
int	G	1073741824
string	HOME	/users/pangwei/
int	hour	3600
int	K	1024
string	LANG	en_US.UTF-8
string	LC_CTYPE	en_US.UTF-8
string	LD_LIBRARY_PATH	/software/samtools/samtools-1.2/lib:/usr/local/cudnn-3/lib64/:/usr/local/cudnn-3/lib64/:/usr/local/cudnn-3/lib64/
string	LESS	-R
string	LOADEDMODULES	modsappsdir/modsappsdir:samtools/1.2:bedtools/2.23.0:rsem/1.2.21
string	LOGNAME	pangwei
string	LSCOLORS	Gxfxcxdxbxegedabagacad
int	M	1048576
string	MAIL	/var/mail/pangwei
string	MANPATH	/software/samtools/samtools-1.2/share/man:/usr/share/man
int	mem	-1
int	minute	60
string	MODULE_VERSION	3.2.10
string	MODULE_VERSION_STACK	3.2.10
string	MODULEPATH	/usr/local/Modules/versions\t\t\t\t:/usr/local/Modules/$MODULE_VERSION/modulefiles\t:/modules/\t\t\t\t:/software/modulefiles
string	MODULESAPPSDIR	/software
string	MODULESHOME	/software/env_module/3.2.10
string	node
string	OLDPWD	/users/pangwei/stemcells/mesoderm
int	P	1125899906842624
string	PAGER	less
string	PATH	/software/RSEM/rsem-1.2.21/:/software/bedtools/2.23.0/bin:/software/samtools/samtools-1.2/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
real	PI	3.141592653589793
string	ppwd	/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata
string	programName	atac.bds
string	programPath	/users/pangwei/bds_atac/atac.bds
string	PWD	/srv/scratch/pangwei/mesoderm/bulk-atac/output-hg19-scidata
string	PYTHONPATH	/home/jisraeli/src/caffe_atac/python/:/users/pangwei/stemcells:/home/jisraeli/src/caffe_atac/python/:/users/pangwei/stemcells:/home/jisraeli/src/caffe_atac/python/:/users/pangwei/stemcells:
string	queue
int	retry	0
string	SAMTOOLS_HOME	/software/samtools/samtools-1.2/bin
string	SHELL	/usr/bin/zsh
string	SHLVL	2
string	SSH_AUTH_SOCK	/tmp/ssh-IlORC0e3BL/agent.16261
string	SSH_CLIENT	171.65.76.244 36245 22
string	SSH_CONNECTION	171.65.76.244 40480 171.65.76.236 22
string	SSH_TTY	/dev/pts/0
string	system	local
int	T	1099511627776
string	TERM	screen
string	THEANO_FLAGS	device=gpu6,floatX=float32,warn_float64=warn,optimizer_excluding=cudnn
int	timeout	-1
string	TMUX	/tmp/tmux-1077/default,106699,2
string	TMUX_PANE	%2
string	USER	pangwei
string	UTIL_SCRIPTS_DIR	/users/pangwei/av_scripts
int	walltimeout	8640000
int	week	604800
string	WWW	/srv/www/kundaje/pangwei
string	XDG_RUNTIME_DIR	/run/user/1077
string	XDG_SESSION_ID	1907
string	ZSH	/users/pangwei//.oh-my-zsh
string	ZSH_TMUX_TERM	screen

BigDataScript report: atac.bds

Timeline

Task Graph

Parallel (threads) details

Task details

Global scope