G. Paolella Napoli, 18/12/ 2007 1 G. Paolella High performance computing per lannotazione e il mining di genomi interi.

Presentazione sul tema: "G. Paolella Napoli, 18/12/ 2007 1 G. Paolella High performance computing per lannotazione e il mining di genomi interi."— Transcript della presentazione:

1 G. Paolella Napoli, 18/12/ 2007 1 G. Paolella High performance computing per lannotazione e il mining di genomi interi

2 G. Paolella Napoli, 18/12/ 2007 2 DG-CST 1022 genes related to genetically transmitted disease

3 G. Paolella Napoli, 18/12/ 2007 3 CST Identificazione e caratterizzazione di sequenze nucleotidiche conservate tra uomo e topo (CSTs) in altre specie. H. Sapiens M. Musculus CSTs CST identificate in geni associati a malattie: 64.495. Analisi da effettuare mediante BLAST contro altri genomi (ratto, cane, scimmia, pollo, etc).

4 G. Paolella Napoli, 18/12/ 2007 4 KinWeb 500 genes coding for human protein kinases

5 G. Paolella Napoli, 18/12/ 2007 5 (a) (b) (c) (d) (e) KinWeb DB

6 G. Paolella Napoli, 18/12/ 2007 6 Pipeline units

7 G. Paolella Napoli, 18/12/ 2007 7 Assemble … Contigs Scaffolds … geneA tRNA promoprAoprB geneCluster A Annotation High throughput sequencing

8 G. Paolella Napoli, 18/12/ 2007 8 Sequencing At CEINGE, Nonomuraea sequencing genome project by 454 FLX is in progress

9 G. Paolella Napoli, 18/12/ 2007 9 Annotation

10 G. Paolella Napoli, 18/12/ 2007 10 Identification of genes and other genetic elements. Protein functional annotation. Cellular process annotation. Identification of ORFs, tRNAs, rRNAs Scanning for signals, such as promoters and microRNAs Identification of operons and gene clusters Comparison with known genomes/proteins Identification of orthologs and paralogs Characterization of protein domains Reconstruction of complete metabolic pathways … Annotation Steps

11 G. Paolella Napoli, 18/12/ 2007 11 Stem Loop Structure (SLS) Protein and coding genes Forward strand Reverse strand E. coli k12 ERIC Rib (BIME family) SLS in Bacteria

12 G. Paolella Napoli, 18/12/ 2007 12 Identification of SLSs in bacterial genomes real shuffled

13 G. Paolella Napoli, 18/12/ 2007 13 Blast e-value Markov clustering (MCL) X SLSs BLAST all vs all Clustering by sequence similarity

14 G. Paolella Napoli, 18/12/ 2007 14 RESULTS Folding probability Clustered SLSsSLSsRandom sequences p = probability that the Minimum Free Energy (MFE) of a given sequence is equal to a distribution of MFE computed with random sequences. (RANDFOLD)

15 G. Paolella Napoli, 18/12/ 2007 15 RESULTS Grouping clusters 137- 39= 98 clusters manual refinement 92 families

16 G. Paolella Napoli, 18/12/ 2007 16 Genome search Identification of all family members by HMM Sequence alignment matches HMM New alignment Final elements HMM build Align & extend

17 G. Paolella Napoli, 18/12/ 2007 17 An example of elongation process: Myg-1 M. genitalium

18 G. Paolella Napoli, 18/12/ 2007 18 Pae-1 (P. aeuruginosa) Examples Complex structures Efa-1 (E. faecalis)

19 G. Paolella Napoli, 18/12/ 2007 19 Bacterial SLSs Pae-1 (Pseudomonas aeuruginosa)Eric (Escherichia coli)

20 G. Paolella Napoli, 18/12/ 2007 20 Known (5) Known (20) 010050 % of genic families Novel (37) Novel (30) RNAz test Contain known motifs (14) Predict to be structured (57) Predict to be not structured (35) Contain known motifs (12) Secondary structure prediction analysis of families

21 G. Paolella Napoli, 18/12/ 2007 21 4x14x2=112 procs 2.8 GHz 4x14x2=112 GB RAM 2 GB/s per scheda - 4 GB/s aggregata Cluster 2.8GHz biproc. node, 2GB RAM 160 GB HD

22 G. Paolella Napoli, 18/12/ 2007 22 Processing time

23 G. Paolella Napoli, 18/12/ 2007 23 The procedure requires high performance computing Blast + MCL Pcma HMMbuild HMMcalibrate HMMsearch Pcma n Identification Characterization Randfold RNAz Infernal SCoPE GRID computing

24 G. Paolella Napoli, 18/12/ 2007 24 Sito medicina HD attached to the system: 1 Cluster Element (CE) 5 Worker nodes (WN) biproc (expandable up to 40) 1 Storage Element (SE) with 50 Gb 1 User Interface (UI)

25 G. Paolella Napoli, 18/12/ 2007 25 BLAST Eseguibile submitted da un repository locale di programmi Librerie di dati genomici conservate su SE Esempio Blast delle 65597 CST contro genomi di cane, gallo, scimmia e ratto. Numero jobs sottomessi 67 Gruppo di sequenze di input: 1000 sequenze Tempo totale di esecuzione dei 67 jobs: 4 ore Tempo medio per job: 18 minuti (2 spesi per scaricare il dataset). Tempo CPU Ricerca di 1 sequenza nel genoma di topo => 5 sec. 64.495 sequenze => 3,75 giorni 10 genomi => 37,5 giorni

26 G. Paolella Napoli, 18/12/ 2007 26 Ricerca strutture secondarie Identificazione e caratterizzazione in genomi batterici di famiglie di sequenze ripetute che condividono una struttura secondaria conservata. Analisi da effettuare su oltre 300 genomi batterici Esempio Ricerca di una famiglia in un genoma =====> 6 ore. Ricerca di 50 famiglie in un genoma =====> 12,5 giorni Ricerca di 50 famiglie in 300 genomi =====> 10 anni

27 G. Paolella Napoli, 18/12/ 2007 27 RandFold Identificazione di sequenze potenzialmente strutturate nel trascrittoma umano. Analisi da effettuare mediante RANDFOLD sui geni frammentati a finestre di 50 basi in sequenze di 150 basi. Esempio Geni : 408 pari a circa 14 mln di basi Sequenze di 150 basi generate: 291.589 Analisi di 1 sequenza =====> 45 sec. Analisi di 291.589 sequenze =====> 152 giorni.

28 G. Paolella Napoli, 18/12/ 2007 28 What about more interactive uses ?

29 G. Paolella Napoli, 18/12/ 2007 29 CAPRI

30 DBs Private network Cluster Broker getNode Access server schedule r Access server schedule r Access server schedule r web requests http request for an available node rsh launch on the node web display of results Requests distribution on the cluster Cluster Status Cluster Status StatusDB sql Updates from node agents Cluster Manager Cluster Manager Display server sql... Cluster activity

31 G. Paolella Napoli, 18/12/ 2007 31 Broker virtual node virtual node DB Grid node Hierarchical node organization

32 G. Paolella Napoli, 18/12/ 2007 32 PROJECT -------------- *Cell line *Colture conditions *Fixation and inclusion methods, stainings, ecc *Objective *Focus Position *Stage position x/y *Project title *Experiment name, *Author, group, group leader, ecc. *Exposure time *Resolution, ecc. Digital images are produced by a variety of microscope devices. The management of large number of images requires the use of databases (DB), Processing of the acquired images is often necessary to enhance the visibility of cell features, that would otherwise be hidden Integrated image storage and processing environment

33 G. Paolella Napoli, 18/12/ 2007 33 IPROC The image processing system: IPROC

34 G. Paolella Napoli, 18/12/ 2007 34 Version number 1 features tab-delimited Name filename Depth size 16bit wdim size 4 where files cdim size 3 where files pdim size n where files tdim size n unit min scale 10 where files ldim size n unit µm scale 0.4 where layers Time 1Time 2Time n well1well2 well3 well4 Channel1 Channel 2 Channel 3 Position 1 Position n l1 ln File format Data input: text description

35 G. Paolella Napoli, 18/12/ 2007 35 Acquisition parameters Buttons to slide the acquisition Image processing menus Info panel for each frame hide/show control command IPROC Image processing

36 G. Paolella Napoli, 18/12/ 2007 36 image in iProcStep ImageMagick iProcStep PHP iProcStep Perl commandLine program Image Magick Package PHP Package PERL Package Command Line Packages adapter image out adapter Image processing modules

37 G. Paolella Napoli, 18/12/ 2007 37 HPC on Cluster nodes GatewayGateway iPage image area data + images page iPane proc- steps IPROC architecture

38 G. Paolella Napoli, 18/12/ 2007 38 Cluster Nodes Access Server Access Server Access Server CLUSTER IPROC Parallel processing

39 G. Paolella Napoli, 18/12/ 2007 39 The group Angelo Boccia Gianluca Busiello Mauro Petrillo Concita Cantarella Luca Cozzuto Leandra Sepe Vittorio Lucignano Marisa Passaro