BSMAP-methatio-methykit workflow

In [12]:
#Setting Variables
#file ID
fid="M3_sept"
#where is bsmap
bsmap="/Users/Shared/Apps/bsmap-2.73/"
#fastq files location R1 location
R1="/Volumes/web/trilobite/Crassostrea_gigas_HTSdata/batterbox/BiGo_Larvae/filtered_BS_CgM3_GATCAG_L007_R1.fastq.gz"
#genome file 
genome="/Volumes/web/whale/ensembl/ftp.ensemblgenomes.org/pub/release-21/metazoa/fasta/crassostrea_gigas/dna/Crassostrea_gigas.GCA_000297895.1.21.dna_sm.genome.fa"
#location of sqlshare python client tools
spt="/Users/Mackenzie/sqlshare-pythonclient/tools/"
In [5]:
cd /Volumes/web/Mollusk/bs_larvae_exp/
/Volumes/web/Mollusk/bs_larvae_exp

In [6]:
mkdir {fid}
In [7]:
cd {fid}
/Volumes/web/Mollusk/bs_larvae_exp/M3_sept

In [8]:
!{bsmap}bsmap -a {R1} -d {genome} -o bsmap_out.sam -p 1

BSMAP v2.73
Start at:  Thu Feb 13 09:17:43 2014

Input reference file: /Volumes/web/whale/ensembl/ftp.ensemblgenomes.org/pub/release-21/metazoa/fasta/crassostrea_gigas/dna/Crassostrea_gigas.GCA_000297895.1.21.dna_sm.genome.fa 	(format: FASTA)
Load in 7658 db seqs, total size 557717710 bp. 9 secs passed
total_kmers: 43046721
Create seed table. 26 secs passed
max number of mismatches: read_length * 8% 	max gap size: 0
kmer cut-off ratio:5e-07
max multi-hits: 100	max Ns: 5	seed size: 16	index interval: 4
quality cutoff: 0	base quality char: '!'
min fragment size:28	max fragemt size:500
start from read #1	end at read #4294967295
additional alignment: T in reads => C in reference
mapping strand: ++,-+
Single-end alignment(1 threads)
Input read file: /Volumes/web/trilobite/Crassostrea_gigas_HTSdata/batterbox/BiGo_Larvae/filtered_BS_CgM3_GATCAG_L007_R1.fastq.gz 	(format: gzipped FASTQ)
Output file: bsmap_out.sam	 (format: SAM)
Thread #0: 	50000 reads finished. 31 secs passed
Thread #0: 	100000 reads finished. 39 secs passed
Thread #0: 	150000 reads finished. 45 secs passed
Thread #0: 	200000 reads finished. 50 secs passed
Thread #0: 	250000 reads finished. 54 secs passed
Thread #0: 	300000 reads finished. 59 secs passed
Thread #0: 	350000 reads finished. 64 secs passed
Thread #0: 	400000 reads finished. 69 secs passed
Thread #0: 	450000 reads finished. 73 secs passed
Thread #0: 	500000 reads finished. 78 secs passed
Thread #0: 	550000 reads finished. 83 secs passed
Thread #0: 	600000 reads finished. 88 secs passed
Thread #0: 	650000 reads finished. 93 secs passed
Thread #0: 	700000 reads finished. 97 secs passed
Thread #0: 	750000 reads finished. 103 secs passed
Thread #0: 	800000 reads finished. 108 secs passed
Thread #0: 	850000 reads finished. 113 secs passed
Thread #0: 	900000 reads finished. 119 secs passed
Thread #0: 	950000 reads finished. 124 secs passed
Thread #0: 	1000000 reads finished. 129 secs passed
Thread #0: 	1050000 reads finished. 134 secs passed
Thread #0: 	1100000 reads finished. 139 secs passed
Thread #0: 	1150000 reads finished. 144 secs passed
Thread #0: 	1200000 reads finished. 149 secs passed
Thread #0: 	1250000 reads finished. 154 secs passed
Thread #0: 	1300000 reads finished. 159 secs passed
Thread #0: 	1350000 reads finished. 164 secs passed
Thread #0: 	1400000 reads finished. 169 secs passed
Thread #0: 	1450000 reads finished. 174 secs passed
Thread #0: 	1500000 reads finished. 179 secs passed
Thread #0: 	1550000 reads finished. 185 secs passed
Thread #0: 	1600000 reads finished. 190 secs passed
Thread #0: 	1650000 reads finished. 195 secs passed
Thread #0: 	1700000 reads finished. 200 secs passed
Thread #0: 	1750000 reads finished. 205 secs passed
Thread #0: 	1800000 reads finished. 210 secs passed
Thread #0: 	1850000 reads finished. 214 secs passed
Thread #0: 	1900000 reads finished. 219 secs passed
Thread #0: 	1950000 reads finished. 225 secs passed
Thread #0: 	2000000 reads finished. 230 secs passed
Thread #0: 	2050000 reads finished. 235 secs passed
Thread #0: 	2100000 reads finished. 240 secs passed
Thread #0: 	2150000 reads finished. 244 secs passed
Thread #0: 	2200000 reads finished. 249 secs passed
Thread #0: 	2250000 reads finished. 254 secs passed
Thread #0: 	2300000 reads finished. 259 secs passed
Thread #0: 	2350000 reads finished. 264 secs passed
Thread #0: 	2400000 reads finished. 268 secs passed
Thread #0: 	2450000 reads finished. 273 secs passed
Thread #0: 	2500000 reads finished. 278 secs passed
Thread #0: 	2550000 reads finished. 285 secs passed
Thread #0: 	2600000 reads finished. 289 secs passed
Thread #0: 	2650000 reads finished. 294 secs passed
Thread #0: 	2700000 reads finished. 299 secs passed
Thread #0: 	2750000 reads finished. 304 secs passed
Thread #0: 	2800000 reads finished. 308 secs passed
Thread #0: 	2850000 reads finished. 313 secs passed
Thread #0: 	2900000 reads finished. 318 secs passed
Thread #0: 	2950000 reads finished. 323 secs passed
Thread #0: 	3000000 reads finished. 328 secs passed
Thread #0: 	3050000 reads finished. 333 secs passed
Thread #0: 	3100000 reads finished. 337 secs passed
Thread #0: 	3150000 reads finished. 342 secs passed
Thread #0: 	3200000 reads finished. 347 secs passed
Thread #0: 	3250000 reads finished. 351 secs passed
Thread #0: 	3300000 reads finished. 356 secs passed
Thread #0: 	3350000 reads finished. 361 secs passed
Thread #0: 	3400000 reads finished. 366 secs passed
Thread #0: 	3450000 reads finished. 370 secs passed
Thread #0: 	3500000 reads finished. 376 secs passed
Thread #0: 	3550000 reads finished. 381 secs passed
Thread #0: 	3600000 reads finished. 386 secs passed
Thread #0: 	3650000 reads finished. 391 secs passed
Thread #0: 	3700000 reads finished. 395 secs passed
Thread #0: 	3750000 reads finished. 400 secs passed
Thread #0: 	3800000 reads finished. 405 secs passed
Thread #0: 	3850000 reads finished. 410 secs passed
Thread #0: 	3900000 reads finished. 415 secs passed
Thread #0: 	3950000 reads finished. 420 secs passed
Thread #0: 	4000000 reads finished. 425 secs passed
Thread #0: 	4050000 reads finished. 430 secs passed
Thread #0: 	4100000 reads finished. 434 secs passed
Thread #0: 	4150000 reads finished. 439 secs passed
Thread #0: 	4200000 reads finished. 444 secs passed
Thread #0: 	4250000 reads finished. 449 secs passed
Thread #0: 	4300000 reads finished. 454 secs passed
Thread #0: 	4350000 reads finished. 459 secs passed
Thread #0: 	4400000 reads finished. 464 secs passed
Thread #0: 	4450000 reads finished. 468 secs passed
Thread #0: 	4500000 reads finished. 473 secs passed
Thread #0: 	4550000 reads finished. 478 secs passed
Thread #0: 	4600000 reads finished. 483 secs passed
Thread #0: 	4650000 reads finished. 488 secs passed
Thread #0: 	4700000 reads finished. 493 secs passed
Thread #0: 	4750000 reads finished. 497 secs passed
Thread #0: 	4800000 reads finished. 502 secs passed
Thread #0: 	4850000 reads finished. 507 secs passed
Thread #0: 	4900000 reads finished. 512 secs passed
Thread #0: 	4950000 reads finished. 517 secs passed
Thread #0: 	5000000 reads finished. 522 secs passed
Thread #0: 	5050000 reads finished. 526 secs passed
Thread #0: 	5100000 reads finished. 531 secs passed
Thread #0: 	5150000 reads finished. 536 secs passed
Thread #0: 	5200000 reads finished. 540 secs passed
Thread #0: 	5250000 reads finished. 545 secs passed
Thread #0: 	5300000 reads finished. 550 secs passed
Thread #0: 	5350000 reads finished. 554 secs passed
Thread #0: 	5400000 reads finished. 559 secs passed
Thread #0: 	5450000 reads finished. 564 secs passed
Thread #0: 	5500000 reads finished. 568 secs passed
Thread #0: 	5526741 reads finished. 571 secs passed
Total number of aligned reads: 4022325 (73%)
Done.
Finished at Thu Feb 13 09:27:14 2014
Total time consumed:  571 secs

In [10]:
!python {bsmap}methratio.py -d {genome} -u -z -g -o methratio_out.txt -s {bsmap}samtools bsmap_out.sam
@ Thu Feb 13 13:45:56 2014: reading reference /Volumes/web/whale/ensembl/ftp.ensemblgenomes.org/pub/release-21/metazoa/fasta/crassostrea_gigas/dna/Crassostrea_gigas.GCA_000297895.1.21.dna_sm.genome.fa ...
^CTraceback (most recent call last):
  File "/Users/Shared/Apps/bsmap-2.73/methratio.py", line 94, in <module>
    for line in open(options.reffile):
KeyboardInterrupt


In [13]:
!python {spt}singleupload.py -u che625@washington.edu -p 5234162537ce6a35236569c28ab62f65 -d _methratio{fid} methratio_out.txt 
processing chunk line 0 to 1864860 (2.2326631546 s elapsed)
pushing methratio_out.txt...
parsing 2B092B49...
processing chunk line 1864860 to 3656610 (401.574553013 s elapsed)
pushing methratio_out.txt...
parsing F91E970C...
processing chunk line 3656610 to 5451296 (699.631419182 s elapsed)
pushing methratio_out.txt...
parsing A6B25BD9...
processing chunk line 5451296 to 7244812 (980.836714983 s elapsed)
pushing methratio_out.txt...
parsing 0A5EEFB7...
processing chunk line 7244812 to 9037880 (1226.75746298 s elapsed)
pushing methratio_out.txt...
parsing C65AEBA5...
processing chunk line 9037880 to 10843373 (1728.21139216 s elapsed)
pushing methratio_out.txt...
parsing F8E569B2...
processing chunk line 10843373 to 12656405 (2328.37247801 s elapsed)
pushing methratio_out.txt...
parsing E8CA62B9...
processing chunk line 12656405 to 14453957 (2899.61369395 s elapsed)
pushing methratio_out.txt...
parsing 9289F401...
processing chunk line 14453957 to 16238039 (3645.15049815 s elapsed)
pushing methratio_out.txt...
parsing 8F0F3982...
processing chunk line 16238039 to 18006797 (4434.78791118 s elapsed)
pushing methratio_out.txt...
parsing 6A1DEBCD...
processing chunk line 18006797 to 19804843 (5184.47866297 s elapsed)
pushing methratio_out.txt...
parsing 3E525B36...
processing chunk line 19804843 to 21626263 (5830.93550014 s elapsed)
pushing methratio_out.txt...
parsing 3D183E0B...
processing chunk line 21626263 to 23447898 (6340.31959796 s elapsed)
pushing methratio_out.txt...
parsing DE9B69FA...
processing chunk line 23447898 to 25097338 (6847.25946617 s elapsed)
pushing methratio_out.txt...
parsing E42EB8FA...
finished _methratioM3_sept

In []: