Sam:LabNotes/Microbiome-new/2011-4-25: Difference between revisions

From ZhangLabWiki
Jump to navigation Jump to search
>Sam Chiang
>Sam Chiang
Line 11: Line 11:
*Test if Nextra library generate more no-hit or contamination then standard Illumina library.
*Test if Nextra library generate more no-hit or contamination then standard Illumina library.
**Compare the taxonomic distribution on (1)raw reads (2) failed-to-align reads
**Compare the taxonomic distribution on (1)raw reads (2) failed-to-align reads
*'''NOTE: Since I didn't use the same source of the amplified MDA sample to generate Ill and NX library for a side-by-side comparison, it is not convincing to judge which library construction protocol is "cleaner". However if the different is on the abundance of the "no hit", then it is not due to the contamination issue.
*'''NOTE: Since I didn't use the same source of the amplified MDA sample to generate Ill and NX library for a side-by-side comparison, it is not convincing to judge which library construction protocol is "cleaner". However if the different is located on the "no hit" catagory, then it is possible not due to the contamination issue or could be due to the low-sequencing quality or lack of NCBI-nt reference.


==Results==
==Results==

Revision as of 23:51, 3 May 2011

Taxonomic analysis on proportioned raw reads and failed-to-align(bowtie) reads on E.coli SAG Illumina and Nextera libraries

Background

  • Since the blastn + MEGAN works very well on failed-to-align reads taxonomic analysis (Test did on E.coli SAG Nextera library). I am planing to extend the same method to characterize the raw reads.
    • Compare the the results with the result from bowtie mapping, then quantify how many false negative E.coli reads are mis-called by bowtie mapping.
  • Also, I will compare the different sampling size (10,000 reads vs. 1000 reads) and see if there is bias existed due to my sampling threshold.

Objectives

  • Analyze the taxonomic distribution on raw reads for E.coli SAGs Ill and NX library data. Compare the conclusion with bowtie's conclusion.
  • Test if 10000-read sample's conclusion is different from 1000-read sampling.
  • Test if Nextra library generate more no-hit or contamination then standard Illumina library.
    • Compare the taxonomic distribution on (1)raw reads (2) failed-to-align reads
  • NOTE: Since I didn't use the same source of the amplified MDA sample to generate Ill and NX library for a side-by-side comparison, it is not convincing to judge which library construction protocol is "cleaner". However if the different is located on the "no hit" catagory, then it is possible not due to the contamination issue or could be due to the low-sequencing quality or lack of NCBI-nt reference.

Results

Procedures

  • Sample 1M reads from raw reads and failed-to-align reads for both Ecoli SAG Illumina (101123_HL083_s4_Ecoli_IllLib) and Nextera(110120_HL087_s4_Ecoli_NexLib) sequencing data.
    • Using the new perl script: fastq-data-sampler-v2-hc
samchiang@genemapster:~/Scripts$ perl fastq-data-sampler-v2-hc /media/disk-1/samchiang/Raw-Read-Complete/101123_HL083/HC-MDA-Ecoli-SAGs-Ind1to8-PE/s_4_1and2_ID2.txt /media/disk-1/samchiang/Raw-Read-Complete/101123_HL083/HC-MDA-Ecoli-SAGs-Ind1to8-PE/s_4_1and2_ID2.1Mreads 1000000 &
  • Deposit the sampled 10,000 reads(fastq) into galaxy server.
    • Use the workflow "Failed2align_1m_reads_analysis_new-v3-042311" to
  1. Original 1M reads to construct boxplot using quality score
  2. Random sampling 10,000 reads, extracted as fasta file.
  3. Random sampling 1,000 reads, extracted as fasta file.
  • Perform the blastn (against nt database) using the sampled 10,000 and 1,000 reads (fasta format).
samchiang@genemapster:/media/disk-2/ncbi-blast-2.2.23+/bin$ ./legacy_blast.pl blastall -i /media/disk-1/samchiang/Sub_tests_folder_imp/6_10000reads_subset_analysis/Ecoli_SAG_Ill_failed-to-aligned-reads/fasta_sequences_10000reads/Ecoli_SAG_ILL_failed_10000read.ID1.fa.fasta  -d /media/disk-2/data/nt -K 1 -m 0 -a 4 -v 1 -b 1 -o /media/disk-1/samchiang/Sub_tests_folder_imp/6_10000reads_subset_analysis/Ecoli_SAG_Ill_failed-to-aligned-reads/fasta_sequences_10000reads/Ecoli_SAG_ILL_failed_10000read.ID1.fa.blastn.txt --p /media/disk-2/ncbi-blast-2.2.23+/bin/blastn &
  • Using MEGAN to parse blastn results and draw the pie-chart.
  • Using MEGAN "compare" function is easier to interpret all of the results generated.
  1. Import all of the .rma files (MEGAN output format)for comparison
  2. Use normalized count setting.
  3. Select the most specific node on taxa rank for plotting.
  4. Plot the result in stacked bar chart and present in % ratio.

Results

  • I also did 16 samples MEGAN analysis using 10,000 reads to check if there any bias due to the sampling size. The results suggest that the bias variation is within 1~3%. Sampling 1,000 reads or 10,000 drew very similar taxonomic conclusions.
Previous bowtie mapping results summary 
File:050311 Ecoli SAG bowtie mapping summary.png
1000reads BLASTn + MEGAN results
File:Ecoli SAG raw 1000reads all ILL labeled.png

File:Ecoli SAG raw 1000reads all NX labeled.png

File:Ecoli SAG failed2align 1000reads all ILL labeled.png

File:Ecoli SAG failed2align 1000reads all NX labeled.png