{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "## Use taxonomic read classifications from MEGAN6 to extract day and treatment Phylum-specific FastQs from Arthropoda and Alveolata" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "TODAY'S DATE:\n", "Mon Apr 13 11:34:06 PDT 2020\n", "------------\n", "\n", "Distributor ID:\tUbuntu\n", "Description:\tUbuntu 16.04.6 LTS\n", "Release:\t16.04\n", "Codename:\txenial\n", "\n", "------------\n", "HOSTNAME: \n", "swoose\n", "\n", "------------\n", "Computer Specs:\n", "\n", "Architecture: x86_64\n", "CPU op-mode(s): 32-bit, 64-bit\n", "Byte Order: Little Endian\n", "CPU(s): 24\n", "On-line CPU(s) list: 0-23\n", "Thread(s) per core: 2\n", "Core(s) per socket: 6\n", "Socket(s): 2\n", "NUMA node(s): 1\n", "Vendor ID: GenuineIntel\n", "CPU family: 6\n", "Model: 44\n", "Model name: Intel(R) Xeon(R) CPU X5670 @ 2.93GHz\n", "Stepping: 2\n", "CPU MHz: 2925.931\n", "BogoMIPS: 5851.96\n", "Virtualization: VT-x\n", "L1d cache: 32K\n", "L1i cache: 32K\n", "L2 cache: 256K\n", "L3 cache: 12288K\n", "NUMA node0 CPU(s): 0-23\n", "Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 popcnt aes lahf_lm epb ssbd ibrs ibpb stibp kaiser tpr_shadow vnmi flexpriority ept vpid dtherm ida arat flush_l1d\n", "\n", "------------\n", "\n", "Memory Specs\n", "\n", " total used free shared buff/cache available\n", "Mem: 70G 2.3G 405M 642M 68G 67G\n", "Swap: 4.7G 1.0G 3.7G\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "No LSB modules are available.\n" ] } ], "source": [ "%%bash\n", "echo \"TODAY'S DATE:\"\n", "date\n", "echo \"------------\"\n", "echo \"\"\n", "#Display operating system info\n", "lsb_release -a\n", "echo \"\"\n", "echo \"------------\"\n", "echo \"HOSTNAME: \"; hostname \n", "echo \"\"\n", "echo \"------------\"\n", "echo \"Computer Specs:\"\n", "echo \"\"\n", "lscpu\n", "echo \"\"\n", "echo \"------------\"\n", "echo \"\"\n", "echo \"Memory Specs\"\n", "echo \"\"\n", "free -mh" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Set variables" ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "env: crab_data=/home/sam/data/C_bairdi/RNAseq\n", "env: hemat_data=/home/sam/data/Hematodinium/RNAseq\n", "env: wd=/home/sam/analyses\n", "env: line=------------------------------------------------------------------------\n", "env: seqtk=/home/sam/programs/seqtk-1.3/seqtk\n" ] } ], "source": [ "# Set data directories\n", "%env crab_data=/home/sam/data/C_bairdi/RNAseq\n", "%env hemat_data=/home/sam/data/Hematodinium/RNAseq\n", "%env wd=/home/sam/analyses\n", "%env line=------------------------------------------------------------------------\n", "\n", "# Programs\n", "%env seqtk=/home/sam/programs/seqtk-1.3/seqtk" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "#### Input data are here:\n", "\n", "FastAs:\n", "- https://gannet.fish.washington.edu/Atumefaciens/20200114_cbai_MEGAN_read_extractions/\n", "\n", "- https://gannet.fish.washington.edu/Atumefaciens/20200323_cbai_MEGAN_read_extractions/\n", "\n", "Trimmed-FastQs:\n", "\n", "- https://gannet.fish.washington.edu/Atumefaciens/20191218_cbai_fastp_RNAseq_trimming/\n", "\n", "- https://gannet.fish.washington.edu/Atumefaciens/20200318_cbai_RNAseq_fastp_trimming/" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Extract phylum-specific reads from trimmed FastQ files\n", "\n", "\n", "Use FastA IDs from MEGAN6 taxonomic read extraction FastAs to pull out appropriate reads from each phylum (Arthropoda and Alveolata). This is performed because MEGAN6 strips paired read ID after the first space. As such, the resulting read extractions using MEGAN end up with a FastA file containing two reads with identicial headers. Not sure if this will cause any downstream issues (i.e. with Trinity) where paired end data is used, so playing it safe and using the truncated IDs to pull FastQs with complete sequence headers for use in subsequent data wrangling." ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Printing array values:\n", "\n", "[132]=infected,D9,ambient\n", "[178]=infected,D9,ambient\n", "[445]=infected,D26,cold\n", "[359]=infected,D12,ambient\n", "[254]=infected,D12,cold\n", "[173]=infected,D9,warm\n", "[151]=infected,D9,cold\n", "[329776]=infected,D26,\n", "[329777]=uninfected,D26,\n", "[485]=infected,D26,ambient\n", "[329774]=infected,D12,\n", "[329775]=uninfected,D12,\n", "[481]=infected,D26,ambient\n", "[427]=uninfected,D26,cold\n", "[425]=uninfected,D26,cold\n", "[272]=infected,D12,warm\n", "[113]=uninfected,D9,cold\n", "[73]=uninfected,D9,cold\n", "[72]=infected,D9,warm\n", "[294]=infected,D12,warm\n", "[463]=infected,D26,ambient\n", "[118]=infected,D9,ambient\n", "[127]=infected,D9,warm\n", "[334]=infected,D12,ambient\n", "[280]=infected,D12,warm\n", "[221]=uninfected,D12,cold\n", "[349]=infected,D12,ambient\n", "[222]=uninfected,D12,cold\n", "\n", "------------------------------------------------------------------------\n", "\n", "\n", "Finished with FastA ID extraction.\n", "\n", "Moving on to read extractions...\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/113_R1_001.fastp-trim.202003184225.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.113.D9.uninfected.cold.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/118_R1_001.fastp-trim.202003184931.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.118.D9.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/127_R1_001.fastp-trim.202003185538.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.127.D9.infected.warm.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/132_R1_001.fastp-trim.202003180140.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.132.D9.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/151_R1_001.fastp-trim.202003180619.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.151.D9.infected.cold.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/173_R1_001.fastp-trim.202003181159.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.173.D9.infected.warm.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/178_R1_001.fastp-trim.202003181815.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.178.D9.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/221_R1_001.fastp-trim.202003182309.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.221.D12.uninfected.cold.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/222_R1_001.fastp-trim.202003182800.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.222.D12.uninfected.cold.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/254_R1_001.fastp-trim.202003184228.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.254.D12.infected.cold.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/272_R1_001.fastp-trim.202003184536.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.272.D12.infected.warm.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/280_R1_001.fastp-trim.202003185124.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.280.D12.infected.warm.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/294_R1_001.fastp-trim.202003180701.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.294.D12.infected.warm.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/329774_S1_L001_R1_001.fastp-trim.201912184855.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.329774.D12.infected.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/329774_S1_L002_R1_001.fastp-trim.201912185239.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.329774.D12.infected.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/329775_S2_L001_R1_001.fastp-trim.201912185554.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.329775.D12.uninfected.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/329775_S2_L002_R1_001.fastp-trim.201912185856.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.329775.D12.uninfected.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/329776_S3_L001_R1_001.fastp-trim.201912180142.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.329776.D26.infected.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/329776_S3_L002_R1_001.fastp-trim.201912180540.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.329776.D26.infected.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/329777_S4_L001_R1_001.fastp-trim.201912180900.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.329777.D26.uninfected.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/329777_S4_L002_R1_001.fastp-trim.201912181245.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.329777.D26.uninfected.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/334_R1_001.fastp-trim.202003181149.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.334.D12.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/349_R1_001.fastp-trim.202003181609.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.349.D12.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/359_R1_001.fastp-trim.202003182247.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.359.D12.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/425_R1_001.fastp-trim.202003182722.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.425.D26.uninfected.cold.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/427_R1_001.fastp-trim.202003184618.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.427.D26.uninfected.cold.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/445_R1_001.fastp-trim.202003185018.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.445.D26.infected.cold.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/463_R1_001.fastp-trim.202003185732.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.463.D26.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/481_R1_001.fastp-trim.202003180047.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.481.D26.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/485_R1_001.fastp-trim.202003181245.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.485.D26.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/72_R1_001.fastp-trim.202003181709.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.72.D9.infected.warm.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/C_bairdi/RNAseq/73_R1_001.fastp-trim.202003182229.fq.gz.\n", "\n", "Writing R1 reads to 20200413.C_bairdi.73.D9.uninfected.cold.megan_R1.fq\n", "\n", "\n", "\n", "Done with R1 read extractions\n", "\n", "------------------------------------------------------------------------\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/113_R2_001.fastp-trim.202003184225.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.113.D9.uninfected.cold.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/118_R2_001.fastp-trim.202003184931.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.118.D9.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/127_R2_001.fastp-trim.202003185538.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.127.D9.infected.warm.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/132_R2_001.fastp-trim.202003180140.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.132.D9.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/151_R2_001.fastp-trim.202003180619.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.151.D9.infected.cold.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/173_R2_001.fastp-trim.202003181159.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.173.D9.infected.warm.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/178_R2_001.fastp-trim.202003181815.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.178.D9.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/221_R2_001.fastp-trim.202003182309.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.221.D12.uninfected.cold.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/222_R2_001.fastp-trim.202003182800.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.222.D12.uninfected.cold.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/254_R2_001.fastp-trim.202003184228.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.254.D12.infected.cold.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/272_R2_001.fastp-trim.202003184536.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.272.D12.infected.warm.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/280_R2_001.fastp-trim.202003185124.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.280.D12.infected.warm.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/294_R2_001.fastp-trim.202003180701.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.294.D12.infected.warm.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/329774_S1_L001_R2_001.fastp-trim.201912184855.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.329774.D12.infected.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/329774_S1_L002_R2_001.fastp-trim.201912185239.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.329774.D12.infected.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/329775_S2_L001_R2_001.fastp-trim.201912185554.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.329775.D12.uninfected.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/329775_S2_L002_R2_001.fastp-trim.201912185856.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.329775.D12.uninfected.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/329776_S3_L001_R2_001.fastp-trim.201912180142.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.329776.D26.infected.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/329776_S3_L002_R2_001.fastp-trim.201912180540.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.329776.D26.infected.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/329777_S4_L001_R2_001.fastp-trim.201912180900.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.329777.D26.uninfected.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/329777_S4_L002_R2_001.fastp-trim.201912181245.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.329777.D26.uninfected.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/334_R2_001.fastp-trim.202003181149.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.334.D12.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/349_R2_001.fastp-trim.202003181609.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.349.D12.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/359_R2_001.fastp-trim.202003182247.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.359.D12.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/425_R2_001.fastp-trim.202003182722.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.425.D26.uninfected.cold.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/427_R2_001.fastp-trim.202003184618.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.427.D26.uninfected.cold.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/445_R2_001.fastp-trim.202003185018.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.445.D26.infected.cold.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/463_R2_001.fastp-trim.202003185732.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.463.D26.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/481_R2_001.fastp-trim.202003180047.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.481.D26.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/485_R2_001.fastp-trim.202003181245.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.485.D26.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/72_R2_001.fastp-trim.202003181709.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.72.D9.infected.warm.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/C_bairdi/RNAseq/73_R2_001.fastp-trim.202003182229.fq.gz.\n", "\n", "Writing R2 reads to 20200413.C_bairdi.73.D9.uninfected.cold.megan_R2.fq\n", "\n", "\n", "------------------------------------------------------------------------\n", "\n", "/home/sam/analyses/20200413_C_bairdi_megan_reads\n", "total 27G\n", "-rw-rw-r-- 1 sam sam 758M Apr 21 10:59 20200413.C_bairdi.113.D9.uninfected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 758M Apr 21 12:11 20200413.C_bairdi.113.D9.uninfected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 473M Apr 21 11:02 20200413.C_bairdi.118.D9.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 473M Apr 21 12:13 20200413.C_bairdi.118.D9.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 769M Apr 21 11:04 20200413.C_bairdi.127.D9.infected.warm.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 769M Apr 21 12:15 20200413.C_bairdi.127.D9.infected.warm.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 584M Apr 21 11:07 20200413.C_bairdi.132.D9.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 584M Apr 21 12:18 20200413.C_bairdi.132.D9.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 1.5G Apr 21 11:09 20200413.C_bairdi.151.D9.infected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 1.5G Apr 21 12:20 20200413.C_bairdi.151.D9.infected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 481M Apr 21 11:12 20200413.C_bairdi.173.D9.infected.warm.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 481M Apr 21 12:23 20200413.C_bairdi.173.D9.infected.warm.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 1.1G Apr 21 11:14 20200413.C_bairdi.178.D9.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 1.1G Apr 21 12:25 20200413.C_bairdi.178.D9.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 873M Apr 21 11:17 20200413.C_bairdi.221.D12.uninfected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 874M Apr 21 12:28 20200413.C_bairdi.221.D12.uninfected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 458M Apr 21 11:20 20200413.C_bairdi.222.D12.uninfected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 458M Apr 21 12:31 20200413.C_bairdi.222.D12.uninfected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 667M Apr 21 11:22 20200413.C_bairdi.254.D12.infected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 667M Apr 21 12:33 20200413.C_bairdi.254.D12.infected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 128M Apr 21 11:24 20200413.C_bairdi.272.D12.infected.warm.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 128M Apr 21 12:35 20200413.C_bairdi.272.D12.infected.warm.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 275M Apr 21 11:27 20200413.C_bairdi.280.D12.infected.warm.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 275M Apr 21 12:38 20200413.C_bairdi.280.D12.infected.warm.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 1.1G Apr 21 11:30 20200413.C_bairdi.294.D12.infected.warm.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 1.1G Apr 21 12:41 20200413.C_bairdi.294.D12.infected.warm.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 11:30 20200413.C_bairdi.329774.D12.infected.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 12:41 20200413.C_bairdi.329774.D12.infected.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 11:33 20200413.C_bairdi.329775.D12.uninfected.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 12:44 20200413.C_bairdi.329775.D12.uninfected.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 11:36 20200413.C_bairdi.329776.D26.infected.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 12:48 20200413.C_bairdi.329776.D26.infected.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 11:40 20200413.C_bairdi.329777.D26.uninfected.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 12:52 20200413.C_bairdi.329777.D26.uninfected.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 372M Apr 21 11:45 20200413.C_bairdi.334.D12.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 372M Apr 21 12:58 20200413.C_bairdi.334.D12.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 31M Apr 21 11:47 20200413.C_bairdi.349.D12.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 31M Apr 21 13:00 20200413.C_bairdi.349.D12.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 1.1G Apr 21 11:50 20200413.C_bairdi.359.D12.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 1.1G Apr 21 13:02 20200413.C_bairdi.359.D12.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 26M Apr 21 11:53 20200413.C_bairdi.425.D26.uninfected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 26M Apr 21 13:06 20200413.C_bairdi.425.D26.uninfected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 19M Apr 21 11:55 20200413.C_bairdi.427.D26.uninfected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 19M Apr 21 13:07 20200413.C_bairdi.427.D26.uninfected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 847M Apr 21 11:57 20200413.C_bairdi.445.D26.infected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 847M Apr 21 13:10 20200413.C_bairdi.445.D26.infected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 9.6M Apr 21 11:59 20200413.C_bairdi.463.D26.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 9.5M Apr 21 13:12 20200413.C_bairdi.463.D26.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 443M Apr 21 12:02 20200413.C_bairdi.481.D26.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 443M Apr 21 13:15 20200413.C_bairdi.481.D26.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 575M Apr 21 12:04 20200413.C_bairdi.485.D26.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 575M Apr 21 13:17 20200413.C_bairdi.485.D26.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 499M Apr 21 12:07 20200413.C_bairdi.72.D9.infected.warm.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 499M Apr 21 13:19 20200413.C_bairdi.72.D9.infected.warm.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 32M Apr 21 12:09 20200413.C_bairdi.73.D9.uninfected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 32M Apr 21 13:21 20200413.C_bairdi.73.D9.uninfected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 1.7G Apr 21 10:57 20200413.C_bairdi.seqtk.read_id.list\n", "-rw-rw-r-- 1 sam sam 1.7K Apr 21 10:32 fasta-list.txt\n", "\n", "------------------------------------------------------------------------\n", "\n", "\n", "Finished with FastA ID extraction.\n", "\n", "Moving on to read extractions...\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/113_R1_001.fastp-trim.202003184225.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.113.D9.uninfected.cold.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/118_R1_001.fastp-trim.202003184931.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.118.D9.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/127_R1_001.fastp-trim.202003185538.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.127.D9.infected.warm.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/132_R1_001.fastp-trim.202003180140.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.132.D9.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/151_R1_001.fastp-trim.202003180619.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.151.D9.infected.cold.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/173_R1_001.fastp-trim.202003181159.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.173.D9.infected.warm.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/178_R1_001.fastp-trim.202003181815.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.178.D9.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/221_R1_001.fastp-trim.202003182309.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.221.D12.uninfected.cold.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/222_R1_001.fastp-trim.202003182800.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.222.D12.uninfected.cold.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/254_R1_001.fastp-trim.202003184228.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.254.D12.infected.cold.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/272_R1_001.fastp-trim.202003184536.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.272.D12.infected.warm.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/280_R1_001.fastp-trim.202003185124.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.280.D12.infected.warm.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/294_R1_001.fastp-trim.202003180701.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.294.D12.infected.warm.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/329774_S1_L001_R1_001.fastp-trim.201912184855.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.329774.D12.infected.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/329774_S1_L002_R1_001.fastp-trim.201912185239.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.329774.D12.infected.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/329775_S2_L001_R1_001.fastp-trim.201912185554.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.329775.D12.uninfected.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/329775_S2_L002_R1_001.fastp-trim.201912185856.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.329775.D12.uninfected.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/329776_S3_L001_R1_001.fastp-trim.201912180142.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.329776.D26.infected.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/329776_S3_L002_R1_001.fastp-trim.201912180540.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.329776.D26.infected.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/329777_S4_L001_R1_001.fastp-trim.201912180900.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.329777.D26.uninfected.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/329777_S4_L002_R1_001.fastp-trim.201912181245.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.329777.D26.uninfected.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/334_R1_001.fastp-trim.202003181149.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.334.D12.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/349_R1_001.fastp-trim.202003181609.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.349.D12.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/359_R1_001.fastp-trim.202003182247.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.359.D12.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/380821_S2_L001_R1_001.fastp-trim.202004143925.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.380821...megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/380821_S2_L002_R1_001.fastp-trim.202004144145.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.380821...megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/380823_S4_L001_R1_001.fastp-trim.202004144852.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.380823...megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/380823_S4_L002_R1_001.fastp-trim.202004145106.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.380823...megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/380825_S6_L001_R1_001.fastp-trim.202004145835.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.380825...megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/380825_S6_L002_R1_001.fastp-trim.202004140109.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.380825...megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/425_R1_001.fastp-trim.202003182722.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.425.D26.uninfected.cold.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/427_R1_001.fastp-trim.202003184618.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.427.D26.uninfected.cold.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/445_R1_001.fastp-trim.202003185018.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.445.D26.infected.cold.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/463_R1_001.fastp-trim.202003185732.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.463.D26.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/481_R1_001.fastp-trim.202003180047.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.481.D26.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/485_R1_001.fastp-trim.202003181245.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.485.D26.infected.ambient.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/72_R1_001.fastp-trim.202003181709.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.72.D9.infected.warm.megan_R1.fq\n", "\n", "\n", "Extracting R1 reads from /home/sam/data/Hematodinium/RNAseq/73_R1_001.fastp-trim.202003182229.fq.gz.\n", "\n", "Writing R1 reads to 20200413.Hematodinium.73.D9.uninfected.cold.megan_R1.fq\n", "\n", "\n", "\n", "Done with R1 read extractions\n", "\n", "------------------------------------------------------------------------\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/113_R2_001.fastp-trim.202003184225.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.113.D9.uninfected.cold.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/118_R2_001.fastp-trim.202003184931.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.118.D9.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/127_R2_001.fastp-trim.202003185538.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.127.D9.infected.warm.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/132_R2_001.fastp-trim.202003180140.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.132.D9.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/151_R2_001.fastp-trim.202003180619.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.151.D9.infected.cold.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/173_R2_001.fastp-trim.202003181159.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.173.D9.infected.warm.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/178_R2_001.fastp-trim.202003181815.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.178.D9.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/221_R2_001.fastp-trim.202003182309.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.221.D12.uninfected.cold.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/222_R2_001.fastp-trim.202003182800.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.222.D12.uninfected.cold.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/254_R2_001.fastp-trim.202003184228.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.254.D12.infected.cold.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/272_R2_001.fastp-trim.202003184536.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.272.D12.infected.warm.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/280_R2_001.fastp-trim.202003185124.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.280.D12.infected.warm.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/294_R2_001.fastp-trim.202003180701.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.294.D12.infected.warm.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/329774_S1_L001_R2_001.fastp-trim.201912184855.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.329774.D12.infected.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/329774_S1_L002_R2_001.fastp-trim.201912185239.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.329774.D12.infected.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/329775_S2_L001_R2_001.fastp-trim.201912185554.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.329775.D12.uninfected.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/329775_S2_L002_R2_001.fastp-trim.201912185856.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.329775.D12.uninfected.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/329776_S3_L001_R2_001.fastp-trim.201912180142.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.329776.D26.infected.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/329776_S3_L002_R2_001.fastp-trim.201912180540.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.329776.D26.infected.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/329777_S4_L001_R2_001.fastp-trim.201912180900.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.329777.D26.uninfected.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/329777_S4_L002_R2_001.fastp-trim.201912181245.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.329777.D26.uninfected.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/334_R2_001.fastp-trim.202003181149.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.334.D12.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/349_R2_001.fastp-trim.202003181609.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.349.D12.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/359_R2_001.fastp-trim.202003182247.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.359.D12.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/380821_S2_L001_R2_001.fastp-trim.202004143925.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.380821...megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/380821_S2_L002_R2_001.fastp-trim.202004144145.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.380821...megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/380823_S4_L001_R2_001.fastp-trim.202004144852.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.380823...megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/380823_S4_L002_R2_001.fastp-trim.202004145106.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.380823...megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/380825_S6_L001_R2_001.fastp-trim.202004145835.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.380825...megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/380825_S6_L002_R2_001.fastp-trim.202004140109.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.380825...megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/425_R2_001.fastp-trim.202003182722.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.425.D26.uninfected.cold.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/427_R2_001.fastp-trim.202003184618.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.427.D26.uninfected.cold.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/445_R2_001.fastp-trim.202003185018.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.445.D26.infected.cold.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/463_R2_001.fastp-trim.202003185732.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.463.D26.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/481_R2_001.fastp-trim.202003180047.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.481.D26.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/485_R2_001.fastp-trim.202003181245.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.485.D26.infected.ambient.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/72_R2_001.fastp-trim.202003181709.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.72.D9.infected.warm.megan_R2.fq\n", "\n", "\n", "Extracting R2 reads from /home/sam/data/Hematodinium/RNAseq/73_R2_001.fastp-trim.202003182229.fq.gz.\n", "\n", "Writing R2 reads to 20200413.Hematodinium.73.D9.uninfected.cold.megan_R2.fq\n", "\n", "\n", "------------------------------------------------------------------------\n", "\n", "/home/sam/analyses/20200413_Hematodinium_megan_reads\n", "total 936M\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:21 20200413.Hematodinium.113.D9.uninfected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:52 20200413.Hematodinium.113.D9.uninfected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:22 20200413.Hematodinium.118.D9.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:53 20200413.Hematodinium.118.D9.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:23 20200413.Hematodinium.127.D9.infected.warm.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:53 20200413.Hematodinium.127.D9.infected.warm.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 18M Apr 21 13:25 20200413.Hematodinium.132.D9.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 18M Apr 21 13:55 20200413.Hematodinium.132.D9.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:25 20200413.Hematodinium.151.D9.infected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:55 20200413.Hematodinium.151.D9.infected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:26 20200413.Hematodinium.173.D9.infected.warm.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:56 20200413.Hematodinium.173.D9.infected.warm.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 1.5M Apr 21 13:28 20200413.Hematodinium.178.D9.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 1.5M Apr 21 13:58 20200413.Hematodinium.178.D9.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:28 20200413.Hematodinium.221.D12.uninfected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:58 20200413.Hematodinium.221.D12.uninfected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:29 20200413.Hematodinium.222.D12.uninfected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:59 20200413.Hematodinium.222.D12.uninfected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:30 20200413.Hematodinium.254.D12.infected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:01 20200413.Hematodinium.254.D12.infected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:31 20200413.Hematodinium.272.D12.infected.warm.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:01 20200413.Hematodinium.272.D12.infected.warm.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:31 20200413.Hematodinium.280.D12.infected.warm.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:02 20200413.Hematodinium.280.D12.infected.warm.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:33 20200413.Hematodinium.294.D12.infected.warm.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:04 20200413.Hematodinium.294.D12.infected.warm.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 188M Apr 21 13:36 20200413.Hematodinium.329774.D12.infected.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 188M Apr 21 14:06 20200413.Hematodinium.329774.D12.infected.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:36 20200413.Hematodinium.329775.D12.uninfected.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:06 20200413.Hematodinium.329775.D12.uninfected.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 170M Apr 21 13:38 20200413.Hematodinium.329776.D26.infected.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 170M Apr 21 14:09 20200413.Hematodinium.329776.D26.infected.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:38 20200413.Hematodinium.329777.D26.uninfected.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:09 20200413.Hematodinium.329777.D26.uninfected.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:40 20200413.Hematodinium.334.D12.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:11 20200413.Hematodinium.334.D12.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 7.9M Apr 21 13:41 20200413.Hematodinium.349.D12.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 7.9M Apr 21 14:13 20200413.Hematodinium.349.D12.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:41 20200413.Hematodinium.359.D12.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:13 20200413.Hematodinium.359.D12.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:42 20200413.Hematodinium.380821...megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:14 20200413.Hematodinium.380821...megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:43 20200413.Hematodinium.380823...megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:14 20200413.Hematodinium.380823...megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:44 20200413.Hematodinium.380825...megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:15 20200413.Hematodinium.380825...megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:44 20200413.Hematodinium.425.D26.uninfected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:15 20200413.Hematodinium.425.D26.uninfected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:46 20200413.Hematodinium.427.D26.uninfected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:17 20200413.Hematodinium.427.D26.uninfected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:46 20200413.Hematodinium.445.D26.infected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:18 20200413.Hematodinium.445.D26.infected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:47 20200413.Hematodinium.463.D26.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:19 20200413.Hematodinium.463.D26.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:48 20200413.Hematodinium.481.D26.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:19 20200413.Hematodinium.481.D26.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 49M Apr 21 13:50 20200413.Hematodinium.485.D26.infected.ambient.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 49M Apr 21 14:22 20200413.Hematodinium.485.D26.infected.ambient.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:50 20200413.Hematodinium.72.D9.infected.warm.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:22 20200413.Hematodinium.72.D9.infected.warm.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 13:51 20200413.Hematodinium.73.D9.uninfected.cold.megan_R1.fq\n", "-rw-rw-r-- 1 sam sam 0 Apr 21 14:22 20200413.Hematodinium.73.D9.uninfected.cold.megan_R2.fq\n", "-rw-rw-r-- 1 sam sam 74M Apr 21 13:21 20200413.Hematodinium.seqtk.read_id.list\n", "-rw-rw-r-- 1 sam sam 534 Apr 21 13:21 fasta-list.txt\n", "\n", "------------------------------------------------------------------------\n", "\n" ] } ], "source": [ "%%bash\n", "\n", "timestamp=\"20200413\"\n", "\n", "# Create associative arrays\n", "# NOTE: These will require Bash >4.0\n", "\n", "## Infection status\n", "declare -A inf_status_array\n", "## Sampling day\n", "declare -A sample_day_array\n", "## Sample temperature array\n", "declare -A sample_temp_array\n", "\n", "# Create sample list\n", "{\n", "echo \"113_D9_uninfected_cold\"\n", "echo \"118_D9_infected_ambient\"\n", "echo \"127_D9_infected_warm\"\n", "echo \"132_D9_infected_ambient\"\n", "echo \"151_D9_infected_cold\"\n", "echo \"173_D9_infected_warm\"\n", "echo \"178_D9_infected_ambient\"\n", "echo \"221_D12_uninfected_cold\"\n", "echo \"222_D12_uninfected_cold\"\n", "echo \"254_D12_infected_cold\"\n", "echo \"272_D12_infected_warm\"\n", "echo \"280_D12_infected_warm\"\n", "echo \"294_D12_infected_warm\"\n", "echo \"334_D12_infected_ambient\"\n", "echo \"349_D12_infected_ambient\"\n", "echo \"359_D12_infected_ambient\"\n", "echo \"425_D26_uninfected_cold\"\n", "echo \"427_D26_uninfected_cold\"\n", "echo \"445_D26_infected_cold\"\n", "echo \"463_D26_infected_ambient\"\n", "echo \"481_D26_infected_ambient\"\n", "echo \"485_D26_infected_ambient\"\n", "echo \"72_D9_infected_warm\"\n", "echo \"73_D9_uninfected_cold\"\n", "echo \"329774_D12_infected\"\n", "echo \"329775_D12_uninfected\"\n", "echo \"329776_D26_infected\"\n", "echo \"329777_D26_uninfected\"\n", "} >> crab-sample-list.txt\n", "\n", "\n", "# Populate arrays\n", "# Uses underscore as internal field separator (IFS)\n", "# Reads each field in as a variable name (e.g. sampl)\n", "while IFS=\"_\" read -r sample day infection temp\n", "do\n", " inf_status_array[$sample]=$infection\n", " sample_day_array[$sample]=$day\n", " sample_temp_array[$sample]=$temp\n", "done < crab-sample-list.txt\n", "\n", "# Remove the sample list file\n", "rm crab-sample-list.txt\n", "\n", "# Check the arrays\n", "\n", "echo \"Printing array values:\"\n", "echo \"\"\n", "\n", "for key in \"${!inf_status_array[@]}\"\n", "do\n", " printf \"[%s]=%s,%s,%s\\n\" \\\n", " \"$key\" \\\n", " \"${inf_status_array[$key]}\" \\\n", " \"${sample_day_array[$key]}\" \\\n", " \"${sample_temp_array[$key]}\"\n", "done\n", "\n", "echo \"\"\n", "echo \"${line}\"\n", "echo \"\"\n", "\n", "for directory in ${crab_data} ${hemat_data}\n", "do\n", "\t# Get species name\n", "\tspecies=$(echo \"${directory}\" | awk -F\"/\" '{print $5}')\n", " \n", " # Make new directory and change to that directory (\"$_\" means use previous command's argument)\n", " mkdir --parents \"${wd}\"/\"${timestamp}\"_\"${species}\"_megan_reads \\\n", " && cd \"$_\" || exit\n", "\n", "\t# Set seqtk list filename\n", "\tseqtk_list=${timestamp}.${species}.seqtk.read_id.list\n", "\n", "\t# Set output FastQ filenames\n", " prefix=${timestamp}.${species}\n", " R1_suffix=megan_R1.fq\n", " R2_suffix=megan_R2.fq\n", "\n", "\t######################################################\n", "\t# Create FastA IDs list to use for sequence extraction\n", "\t######################################################\n", " for fasta in \"${directory}\"/*.fasta\n", "\tdo\n", " echo \"${fasta}\" >> fasta-list.txt\n", " done\n", " \n", " for fasta in \"${directory}\"/*.fasta\n", "\tdo\n", " grep \">\" \"${fasta}\" | awk 'sub(/^>/, \"\")'\n", "\tdone | sort -u >> \"${seqtk_list}\"\n", " \n", " \n", " echo \"\"\n", " echo \"Finished with FastA ID extraction.\"\n", " echo \"\"\n", " echo \"Moving on to read extractions...\" \n", " echo \"\"\n", " echo \"\"\n", " \n", " \n", " ######################################################\n", "\t# Extract corresponding R1 and R2 reads using seqtk FastA ID list\n", " ######################################################\n", "\tfor fastq in \"${directory}\"/*R1*.gz\n", " do\n", " # Strip path from filename\n", " fastq_nopath=${fastq##*/}\n", " \n", " # Get sample ID from FastQ filename\n", " sample=$(echo \"${fastq_nopath}\" | awk -F \"_\" '{print $1}')\n", "\n", " # Ignore sample 304428 - it's a general pool of various sample types\n", " if [ \"${sample}\" != \"304428\" ]\n", " then\n", "\n", " # Pull infection status, sample day and temp from associative arrays\n", " inf_status=${inf_status_array[$sample]}\n", " sample_day=${sample_day_array[$sample]}\n", " temp=${sample_temp_array[$sample]}\n", " \n", " # Set output filename\n", " ## Does not set temp value in filename when the temp value is empty in array\n", " if [[ ${sample_temp_array[$sample]} ]]; then\n", " R1_out=\"${prefix}.${sample}.${sample_day}.${inf_status}.${temp}.${R1_suffix}\"\n", " else\n", " R1_out=\"${prefix}.${sample}.${sample_day}.${inf_status}.${R1_suffix}\"\n", " fi\n", " \n", " \n", " echo \"Extracting R1 reads from ${fastq}.\"\n", " echo \"\"\n", " echo \"Writing R1 reads to ${R1_out}\"\n", " echo \"\"\n", " echo \"\"\n", " \n", " # Use seqtk to pull out desired FastQ reads\n", " \t ${seqtk} subseq \"${fastq}\" \"${seqtk_list}\" >> \"${R1_out}\"\n", " fi\n", " done\n", " \n", " echo \"\"\n", " echo \"Done with R1 read extractions\"\n", " echo \"\"\n", " echo \"${line}\"\n", " echo \"\"\n", "\n", "\tfor fastq in \"${directory}\"/*R2*.gz\n", "\tdo\n", " # Strip path from filename\n", " fastq_nopath=${fastq##*/}\n", " \n", " # Get sample ID from FastQ filename\n", " sample=$(echo \"${fastq_nopath}\" | awk -F \"_\" '{print $1}')\n", "\n", "\t # Ignore sample 304428 - it's a general pool of various sample types\n", " if [ \"${sample}\" != \"304428\" ]\n", " then\n", "\t\t\t\n", " # Pull infection status and sample day from associative array \n", " inf_status=${inf_status_array[$sample]}\n", " sample_day=${sample_day_array[$sample]}\n", " temp=${sample_temp_array[$sample]}\n", " \n", " # Set output filename\n", " ## Does not set temp value in filename when the temp value is empty in array\n", " if [[ ${sample_temp_array[$sample]} ]]; then\n", " R2_out=\"${prefix}.${sample}.${sample_day}.${inf_status}.${temp}.${R2_suffix}\"\n", " else\n", " R2_out=\"${prefix}.${sample}.${sample_day}.${inf_status}.${R2_suffix}\"\n", " fi\n", " \n", " echo \"Extracting R2 reads from ${fastq}.\"\n", " echo \"\"\n", " echo \"Writing R2 reads to ${R2_out}\"\n", " echo \"\"\n", " echo \"\"\n", " \n", " \t ${seqtk} subseq \"${fastq}\" \"${seqtk_list}\" >> \"${R2_out}\"\n", " fi\n", "\tdone\n", " \n", " echo \"${line}\"\n", " echo \"\"\n", " # Print working directory and list files\n", " pwd\n", "\tls -lh\n", " echo \"\"\n", " echo \"${line}\"\n", " echo \"\"\n", "done\n" ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [] } ], "metadata": { "kernelspec": { "display_name": "Python 3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.6.10" } }, "nbformat": 4, "nbformat_minor": 4 }