Commissione Scientifica III stato e richieste finanziarie

Commissione Scientifica III stato e richieste finanziarie
Cagliari, 15 Settembre 2015 Calcolo ALICE: stato e richieste finanziarie Domenico Elia Domenico Elia Riunione CSN3 / Cagliari,

Riunione CSN3 / Cagliari, 15.9.2015
Outline ALICE Computing status: impiego delle risorse 2014 performance siti italiani, attività di R&D su VAF evoluzione CM per Run2, Computing TDR Run3  BACKUP Richieste finanziarie: situazione CPU e storage nei Tier-2, dismissioni richieste 2016 per Tier-1 e Tier-2, missioni residuo suppletive 2015 Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Resource usage in 2014 Main activity 2014 / mid 2015: Run1 data reprocessing and associated MC: pp 2010 (pass4), pp and pPb 2012, pPb 2013 (pass3) full detector recalibration + improved software, all with the same code pp 2011 reprocessing being evaluated (overlap with Run2) further MC productions (~120 cycles): requests from PWGs (68% pp, 18% pPb, 14% PbPb) first large-scale production for Run2 (new detector setup) ~4% generations dedicated to upgrade studies (Run3) analysis (user and organized trains) ALICE recommissioning for Run2: test of upgraded detector readout, trigger, DAQ, recording chain cosmics trigger data taking with Offline processing Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Resource usage in 2014 Main activity 2014 / mid 2015: Run1 data reprocessing and associated MC further MC productions (~120 cycles) analysis (user and organized trains) Average: ~45K concurrent jobs ~99.5% availability 85% CPU T0, T1 79% CPU T2 Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Resource usage in 2014 Main activity 2014 / mid 2015: Run1 data reprocessing and associated MC further MC productions (~120 cycles) analysis (user and organized trains) RAW data processing: 6% @ T0/T1 only User analysis: 11% @ all centres Organized analysis: 12% @ all centres individual analysis decreased by 50% in the period still ample room to increase the share of organized analysis reducing individual analysis by factor 2 could still give ~2-5% gain in efficiency MC productions: 71% @ all centres Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Evolution of CM for Run2 Basic assumptions for Run2 resource estimate: same CPU power needed for reconstruction 25% larger raw event size: additional detectors, detector coverage higher track multiplicity with increased beam energy and pileup MC productions: 100% pp, pPb % PbPb events T1/2 2016: +25% T1/2 2016: +17% Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Performance of the Italian sites ~15% Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Performance of the Italian sites Resource T1: CPU ~150% pledge (2015) DISK ~85% pledge 2014) TAPE largely underused (~700 TB) Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Performance of the Italian sites Resource T2: largely benefits from strict internal coordination monthly meetings (performance recording) + annual workshop overall ~35% increase in total WCT from 2013 to 2014 large upgrade in 2 sites (ReCaS): CATANIA (in production since April, ~1500 core, 1 PB: Catania-VF) BARI (in production for ALICE since mid-August): ~300 server, 105 kHS06 (~10000 core) - 25 kHS06 CMS pledge + 10 kHS06 ALICE pledge ~4 PB disk storage PB tape library - 900 TB CMS pledge TB ALICE pledge 20 Gbit/s network connection (ready for 40 Gbit/s) Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Nuova infrastruttura BA Official opening July 9, 2015: Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Performance of the Italian sites Bari (+ ReCaS) PD-LNL Catania-VF Torino Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Performance of the Italian sites Resource T2: largely benefits from strict internal coordination monthly meetings (performance recording) + annual workshop overall ~35% increase in total WCT from 2013 to 2014 large upgrade in 2 sites (ReCaS): CATANIA (in production since April, ~1500 core, 1 PB: Catania-VF) BARI (in production for ALICE since mid-August) monitoring T2 data from APEL (Andrea Guarise): 2014 e 2015 pledge values in place WCT  SI2K conversion factor from sites (BDII) checked/updated WCT cross-checked vs exp (MonALISA) and local monitorings Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Performance of the Italian sites WCT / Pledge ~ 99% WCT / Pledge ~ 53% WCT / Pledge ~ 183% TO CT T1 WCT / Pledge ~ 92% WCT / Pledge ~ 210% Total T2: (1/1  1/5) WCT / Pledge ~ 110% BA LNL (*) In Aprile Catania-VF monitorata solo attraverso MonAlisa, su EGI da Maggio Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status R&D activity on the VAF In the framework of the STOA-LHC PRIN: Torino VAF going to be accounted for ALICE similar (test) cloud infrastructures deployed in 2014: Bari, Cagliari, Legnaro, Trieste (OpenStack) Catania could join (new T2 infrastructure) many activities ongoing, reported to CHEP’15 (April): Interoperating Cloud-based Virtual Farms for the ALICE experiment at the LHC (Trieste) Monitoring of IaaS and scientific applications on the Cloud using Elasticsearch ecosystem (Torino) Managing competing elastic grid and cloud computing applications using OpenNebula (Torino) Local storage federation through XRootD architecture for interactive distributed analysis (Bari) white paper to be finalized by end of 2015 further (connected) activities: parallel computing (TS, BA), dashboard for the Italian sites (BA) Domenico Elia Riunione CSN3 / Cagliari,

e richieste finanziare
Situazione risorse e richieste finanziare Domenico Elia Riunione CSN3 / Cagliari,

Richieste finanziarie Situazione CPU/Storage Italia In produzione al Tier-1: CPU: HS06 (pledge 2015) DISK: 1920 TB (pledge 2014*) In produzione ai Tier-2 (+ Cagliari): A pledge 2015 (3380 TB) in Ottobre Pledge 2015: 38600 HS TB Disponibili (incluso obsoleti non ancora dismessi) Maggio 2015 Bari Catania Padova-LNL Torino Cagliari Totale HS06 8240 13147 8923 9954 1120 41384 TB 360 1204 677 844 70 3155 Risorse 2015: in produzione ReCaS CT, il resto tra Giugno e Settembre (prox slide) Domenico Elia Riunione CSN3 / Cagliari,

Richieste finanziarie Situazione CPU/Storage Tier-2 Assegnazione 2015 parte ReCaS: Bari (in produzione da metà Agosto): rimpiazzi BA: 1568 HS TB Catania (in produzione da inizio Aprile): rimpiazzi CT: 1075 HS06, rimpiazzi CA: 840 HS06 parte crescita netta totale ALICE: 1550 HS TB Domenico Elia Riunione CSN3 / Cagliari,

Richieste finanziarie Situazione CPU/Storage Tier-2 Assegnazione 2015 parte ReCaS: Bari (in produzione): HS TB Catania (in produzione): HS TB Assegnazione 2015 parte CSN3 (224.5 k€): quota CPU (32.5 k€), stornata su PD-LNL e TO: rimpiazzi PD-LNL (1280 HS06) e TO: 1400 HS06 (acquisizione in corso) quota Storage (192 k€) acquisita: completamento crescita netta totale + rimpiazzi PD-LNL e TO RDO gestite a Bari (BA, LNL) e TO in tempi record (sconti entro fine Luglio) esito ottimale: 6 x 180 TB (1 BA, 2 TO, 3 PD-LNL) = 1.08 PB consistente risparmio con sole espansioni (BA e PD-LNL) e con gli sconti “di fine quarto” intercettati in extremis! Domenico Elia Riunione CSN3 / Cagliari,

Richieste finanziarie Situazione CPU/Storage Tier-2 Aggiornata con risorse 2015: CPU: HS06  in eccesso al pledge (*): 616 HS06 DISK: TB  in eccesso al pledge (*): 42 TB Disponibili a fine 2015 (escluso tutte le dismissioni risorse 2015) Bari Catania Padova-LNL Torino Cagliari Totale HS06 8240 13147 7736 8973 1120 39216 TB 924 1204 1152 1123 20 4423 (*) Buon esito gara storage e rimpiazzi CPU LNL eTO Pledge 2015: 38600 HS TB Domenico Elia Riunione CSN3 / Cagliari,

Richieste finanziarie Dismissioni Anno di dismissione Bari Catania LNL-Padova Torino Cagliari Totale HS06 2015 1568 1075 1280 1400 840 6163 TB 360 65 81 50 556 2016 5496 1584 1120 9768 130 260 157 20 567 2017 114 117 231 Situazione complessiva Tier-2 nel 2016: CPU: – 9768 = HS06 DISK: 4423 – 567 = TB Domenico Elia Riunione CSN3 / Cagliari,

Richieste finanziarie Esito RRB Aprile 2015 Share INFN per 2016: CPU, DISK per Tier-1 e Tier-2: 18.5% (19.3% nel 2015) TAPE per Tier-1: 35.2% (41.1% nel 2015) Domenico Elia Riunione CSN3 / Cagliari,

Richieste finanziarie Richieste 2016: Tier-1 e Tier-2 CPU Tier-1 (HS06) DISK Tier-1 (TBn) CPU Tier-2 DISK Tier-2 Pledged T1 Disp. – dismiss. T2 22800 3382 29448 3856 Scrutinati ALICE 2016 29045 3885 43845 4829 Delta 6245 503 14397 973 Stima costo (k€) 87.4 120.7 172.7 214.0 Totale (k€) 208.1 386.7 Overhead T2 (k€) 48.1 Stima costi T2 (T1): 12 (14) € / HS06 e 220 (240) € / TBn T1: quota pledge da 4192 (2015) a 5491 TB (2016) Dismissioni Tier-1: non incluse Overhead Tier-2: 6% CPU + 5% DISCO (rete) + 7% totale (server aggiuntivi) Domenico Elia Riunione CSN3 / Cagliari,

Richieste finanziarie Richieste nel DB: inventario Domenico Elia Riunione CSN3 / Cagliari,

Richieste finanziarie Richieste nel DB: missioni Domenico Elia Riunione CSN3 / Cagliari,

Commenti finali e sommario In produzione risorse ReCaS 2014/15 (BA, CT) Finalizzata acquisizione storage 2015: costo atteso (DELL) confermato in fase di acquisto: 180 TB solo espansione: 31 k€ (172 € / TB) 180 TB con controller + 2 server: 39 k€ + 15 k€ = 54 k€ (300 € / TB) fondamentale tempistica e disponibilità quota straordinaria (15 k€)! Domenico Elia Riunione CSN3 / Cagliari,

Commenti finali e sommario In produzione risorse ReCaS 2014/15 (BA, CT) Finalizzata acquisizione storage 2015: costo atteso (DELL) confermato in fase di acquisto: 180 TB solo espansione: 31 k€ (172 € / TB) 180 TB con controller + 2 server: 39 k€ + 15 k€ = 54 k€ (300 € / TB) fondamentale tempistica e disponibilità quota straordinaria (15 k€)! Sommario richieste finanziarie: residuo suppletiva 2015 (overhead BA): k€ richieste ordinarie 2016: rimpiazzi e crescita Tier k€ (266 k€) overhead Tier k€ ( 34 k€) estensione garanzia storage ( 15 k€) 435 k€ (315 k€) Domenico Elia Riunione CSN3 / Cagliari,

BACKUP Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Resource usage in 2014 Overall CPU/DISK/TAPE usage: T1, T2 over pledge (opportunistic, extra-WLCG) DISK usage ~70% (87% full wherever good network connection) TAPE usage ~90% (but T1, will improve with Run2) CERN-RRB Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Resource usage in 2014 Main activity 2014 / May 2015: Run1 data reprocessing and associated MC further MC productions (~120 cycles) analysis (user and organized trains) ALICE recommissioning for Run2 New and upcoming WLCG sites: KR-KISTI (Korea), T1: in production in 2014 NRC-KI (Russia), T1: in production in 2014 UNAM (Mexico), T2: rumping up, MoU signed in Nov 2014 COMSATS (Pakistan), T2: MoU signed in March 2015 CHPC (South Africa), T2: MoU signed in April 2015 Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Evolution of CM for Run2 Targeting integrated luminosity 1 nb-1 for PbPb: by combination of Run1 and Run2 statistics consistent with the ALICE approved programme 4-fold increase in instant luminosity for PbPb Detector upgrades: complete TRD/PHOS, new DCAL Double event rate of TPC/TRD: consolidation of TPC and TRD readout electronics Increased capacity of HLT and DAQ: rate up to 8 GB/sec to T0 (for Heavy-Ion data taking) Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Evolution of CM for Run2 ALICE Grid model largely unchanged in Run2: integration of every new computing centre average 2 replicas of analysis objects: dependency on resource stability, 1 copy for least popular data low differentiation of tasks: T0/T1 still raw data keepers/producers all other tasks (MC + analysis) performed everywhere tasks generally sent to data, but data can go to tasks if needed: jobs go to data, in case of failure read from closest replica (<5%) ALICE global data distribution by exclusive use of xrootd protocol analysis input mostly on AODs (limited use of ESDs) push analyzers to organized trains (LEGO framework) Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Evolution of CM for Run2 Main software and process improvements: new version of the software framework (AliRoot 5.x): effort to improve performance of ALICE reconstruction software use TRD points in the fit (improve high-momentum resolution) reduce memory requirements during calibration and reconstruction use of HLT for online Raw data compression (factor 4): already tested in Run1, implies reduction of tape Tier-0/1 use of HLT for calibration: move first calibration iteration to online use of HLT track seeds for offline reconstruction improve performance of GEANT4 simulation for ALICE further development of fast and parametrized simulation Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Performance of the Italian sites Storage availability: Domenico Elia Riunione CSN3 / Cagliari,

Computing status: summary Run2: data volume in the period expected ~3x Run1 focus of the Grid development will be on improving the analysis efficiency and decreasing the turnaround time of organized trains several other software and process improvements site performance and stability will continue to be a key factor for success of the ALICE offline computing planned resource increase expected to meet the demands, working on data popularity monitoring and replica limitation Run3: TDR submitted to LHCC, final approval (+UCG) in September Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Nuova infrastruttura virtuale CT Nuova Isola RECAS: 34 compute node (64 Vcpu, 256 GB RAM, 10 Gbps) 20800 HS06 ● XEN server 6.5 in HA: – migrazione dei servizi centrali nell'infrastruttura (controller OPENSTACK, CE, VOBOX, site BDII, UI, ARGUS, APELDB e due SQUID per CVMFS) ● Openstack Juno – controller, nova network, block storage – 7 VM per ogni compute node, flavor da 9 a 10 core, 36GB di RAM e 100GB di disco – Lanciate 168 VM per un totale di 1512 core virtuali Vecchia Isola Entro Settembre: ● nuovo router HP10508 con nuovo link GARR a 10Gb ● 10 hypervisor (70 VM, 630 core virtuali) Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Performance of the Italian sites Coordinamento Tier-2 Conversione ore in Wall_h_kSi2k dei dati EGI (*) In Aprile Catania-VF monitorata solo attraverso MonAlisa, su EGI da Maggio Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Performance of the Italian sites Torino (-15%) Catania (+2%) Coordinamento Tier-2 Bari (-16%) PD-LNL (-7‰) (*) In Aprile Catania-VF monitorata solo attraverso MonAlisa, su EGI da Maggio Domenico Elia Riunione CSN3 / Cagliari,

ALICE CM: Focus on Run2 Physics programme, upgrades Targeting integrated luminosity 1 nb-1 for PbPb: by combination of Run1 and Run2 statistics consistent with the ALICE approved programme 4-fold increase in instant luminosity for PbPb Domenico Elia Riunione CSN3 / Cagliari,

ALICE Computing status Evolution of CM for Run2 Main software and process improvements Additional improvements: start adapting ALICE distributed computing to Cloud, using of HLT farm for offline processing corresponds to additional 3% CPU resources improving performance of the organized analysis trains speeding up and improving the efficiency of the analysis activity by active data management explore contributed resources: ie spare CPU cycles on supercomputers collaborating with other experiment on this issue Domenico Elia Riunione CSN3 / Cagliari,

ALICE CM: Focus on Run2 Infrastructure improvements Focus on SE stability: major factor for successful analysis and high CPU efficiency goal for all SEs: > 98% availability Domenico Elia Riunione CSN3 / Cagliari,

ALICE CM: Focus on Run2 Infrastructure improvements Focus on SE stability LHCone programme Network use will increase IPv6 adoption Refurbishment of SAM/SUM tests: WLCG monitoring consolidation projet, advanced status Site tests will reflect more and more the VO tests: in the ALICE case provided by MonALISA Domenico Elia Riunione CSN3 / Cagliari,

ALICE CM: Focus on Run2 Infrastructure improvements Focus on SE stability LHCone programme: brings substantial improvement in inter-site connectivity allows for further diluition of boundaries between sites and tasks Europe largely covered, focus on South America and Asia Network use will increase: large data volumes, more to transfer between sites remote access to storage Domenico Elia Riunione CSN3 / Cagliari,

ALICE CM: Focus on Run2 Infrastructure improvements Focus on SE stability LHCone programme Network use will increase IPv6 adoption: IPv4 address depletion is already a fact for new sites ALICE services are IPv6 ready xrootd v.4 should be IPv6 ready (release end of May) other sevices are being brought into compliance Domenico Elia Riunione CSN3 / Cagliari,

Richieste finanziarie Dismissioni Anno di dismissione Bari Catania LNL-Padova Torino Cagliari Totale HS06 2015 1568 1075 1280 1400 840 6163 TB 360 65 81 50 556 2016 5496 1584 1120 9768 130 260 157 20 567 2017 114 117 231 Domenico Elia Riunione CSN3 / Cagliari,

Richieste finanziarie Dismissioni Anno di dismissione Bari Catania LNL-Padova Torino Cagliari Totale HS06 2015 1568 1075 1280 1400 840 6163 TB 360 65 81 50 556 2016 5496 1584 1120 9768 130 260 157 20 567 2017 114 117 231 II semestre 2016  2017 Costo estensione garanzia dischi: dipende dal numero di meccaniche, stima ~5-7 kEuro per sito Domenico Elia Riunione CSN3 / Cagliari,

Richieste finanziarie Richieste 2016: Tier-1 CPU Tier-1 (HS06) DISK Tier-1 (TBn) Pledged T1 Disp. – dismiss. T2 22800 3382 Scrutinati ALICE 2016 29045 3885 Delta 6245 503 Stima costo (k€) 87.4 120.7 Totale (k€) 208.1 Stima costi T2 (T1): 12 (14) € / HS06 e 220 (240) € / TBn T1: quota pledge da 4192 (2015) a 5491 TB (2016) Dismissioni Tier-1: non incluse Domenico Elia Riunione CSN3 / Cagliari,

Dismissioni + crescita
Richieste finanziarie Richieste 2016: per sito Tier-2 Dismissioni HS06 / TB k€ Bari 1568 18,8 0,0 Catania 130 28,6 LNL-Padova 5496 66,0 260 57,2 123,2 Torino 1584 19,0 157 34,5 53,5 Cagliari 1120 13,4 20 4,4 17,8 Dismissioni totale 9768 117,2 567 124,7 242,0 Crescita netta 4629 55,5 406 89,2 144,8 Dismissioni + crescita 14397 172,8 973 214,0 386,7 Richiesta completa Domenico Elia Riunione CSN3 / Cagliari,

Dismissioni + crescita
Richieste finanziarie Richieste 2016: per sito Tier-2 Dismissioni HS06 / TB k€ Bari 1568 18,8 0,0 Catania 130 28,6 LNL-Padova 5496 66,0 260 57,2 123,2 Torino 1584 19,0 157 34,5 53,5 Cagliari 1120 13,4 20 4,4 17,8 Dismissioni totale 9768 117,2 567 124,7 242,0 Crescita netta 4629 55,5 406 89,2 144,8 Dismissioni + crescita 14397 172,8 973 214,0 386,7 HS06 / TB k€ 1568 18,8 0,0 5496 66,0 1584 19,0 1120 13,4 20 4,4 17,8 9768 117,2 121,6 4629 55,5 406 89,2 144,8 14397 172,8 426 93,6 266,4 Richiesta completa Con rinvio dismissioni storage Domenico Elia Riunione CSN3 / Cagliari,

Commenti finali e sommario Gara storage 2015: costo atteso (contatto DELL): 180 TB solo espansione: 31 k€ (172 € / TB) 180 TB con controller + 2 server: 39 k€ + 15 k€ = 54 k€ (300 € / TB) storage finanziato 2015 da CSN3 a 220 € / TB: - dovremmo farcela con 5 espansioni (BA e LNL) + 1 catena nuova (TO) - necessari altri 15 k€ per i 2 controller (unica soluzione per TO) - vantaggio anche per il prossimo anno (delta ~40 TB oltre il pledge) Domenico Elia Riunione CSN3 / Cagliari,

Commissione Scientifica III stato e richieste finanziarie

Presentazioni simili

Presentazione sul tema: "Commissione Scientifica III stato e richieste finanziarie"— Transcript della presentazione:

Presentazioni simili

Sul progetto

Feed-back

Entrare

Autorizzarsi attraverso i social network:

Commissione Scientifica III stato e richieste finanziarie

Presentazioni simili

Presentazione sul tema: "Commissione Scientifica III stato e richieste finanziarie"— Transcript della presentazione:

Presentazioni simili

Sul progetto

Feed-back