ISTITUTO DI SCIENZE E TECNOLOGIE DELLA COGNIZIONE Piero Cosi SEZIONE DI PADOVA - FONETICA E DIALETTOLOGIA Via Martiri della libertà, 2 – 35137 adova (Italy)

Presentazione sul tema: "ISTITUTO DI SCIENZE E TECNOLOGIE DELLA COGNIZIONE Piero Cosi SEZIONE DI PADOVA - FONETICA E DIALETTOLOGIA Via Martiri della libertà, 2 – 35137 adova (Italy)"— Transcript della presentazione:

1 ISTITUTO DI SCIENZE E TECNOLOGIE DELLA COGNIZIONE Piero Cosi SEZIONE DI PADOVA - FONETICA E DIALETTOLOGIA Via Martiri della libertà, 2 – 35137 adova (Italy) e-mail: cosi@pd.istc.cnr.it - www: http://www.pd.istc.cnr.itcosi@pd.istc.cnr.it Facial Animation Geometry Manipulation Based on a Pseudo Muscle Model Lucia an Italian Talking Head Copyright, 2009 © ISTC-SPFD-CNR Incontro con Frank H. Guenther Director of CNS Speech Lab, Boston University, Boston MA "Neurolinguistica: produzione e percezione del parlato e controllo senso motorio" Martedì 22 settembre 2009 - ore 10,30 Sala delle Statue, Palazzo Rospigliosi Via XXIV Maggio, 43 - Roma

2 Copyright, 2009 © ISTC-SPFD-CNR ISTC Applications SONIC SPHINX CLSU Toolkit ILT – Italian Literacy Tutor

3 Outline Motivation Who is working on similar … stuff? Movie Companies & Studios Animation Software Companies Research Institutes and Universities ISTC-SPFD – LUCIA & FESTIVAL Emotions (Audio & Video) and….what about the future!?

4 Motivation human-like conversational agents ( Virtual Characters, Computer Characters, Virtual Agents, Conversational Agents, Interface Agents…) human-like characters they interact naturally, using facial gestures, eye contact, speech patterns, posture and gesture, just like we might use them when conversing with other people one might see them in computer games or in the media users can interact and cooperate with them to complete a shared task

5 Soggetti Coinvolti RICERCA (modelli fisici) LUCIA GRETA BALDI ecc. PC, web, telefonia,... animazione Movie Companies & Studios Games ecc.

6 http://www2.pd.istc.cnr.it/LUCIA LUCIA a new emotive/expressive Italian talking head

7 ELITE System ELITE Video Processor (100Hz) A / D (16KHz) A/D Articulatory signals Acoustic signals

8 Track Animation example

9 Facial Animation Facial Modelling / Animation Geometry manipulations Parametrization Pseudo muscle model Wrinkle generation Free form deformation Spline model Pure vector based model

10 Facial Animation & TTS Input Text FESTIVAL Italian TTS segmental/lexical/semantic information AVengine ( TXT2Animation ) FAP WAV LUCIA http://www2.pd.istc.cnr.it/FESTIVAL http://www2.pd.istc.cnr.it/LUCIA

11 emotions and expressions universal expressions (fear)

12 Audiovisual Emotive/Expressive Speech Lucia neutraljoysadness disgustfear

13 Emotion Player Copyright, 2007 © ISTC-SPFD-CNR

14 ILT – Italian Literacy Tutor Interactive Books Video (7yrs) (13yrs)

15 WELCOME to INTERSPEECH 2011 Firenze 27-31 August 2011 MANY THANKS! and