Activities

Doctoral and scientific supervision

  • Guilhem Faure (2024–2027) – Project COLAF: End-to-end speech-to-sign language generation.
  • Mickaëlla Grondin-Verdon (2021–2025) – CNRS PRIME 80: Modeling gestures and speech in interaction.
  • Louis Abel, Université de Lorraine (2021–2025) – Audiovisual speech synthesis in interactive contexts.
  • Shakeel Ahmad Sheikh, Université de Lorraine (2019–2022) – ANR BENEPHIDIRE: Neural network-based detection and rehabilitation of speech disfluencies in stuttering.
  • Théo Biasutto, Université de Lorraine (2016–2021) – PIA2 e-Fran METAL: Multimodal coarticulation modeling for intelligible talking head animation.
  • Sara Dahmani, Université de Lorraine (2017–2020) – Audiovisual speech synthesis: Deep learning-based modeling of emotional expressions.
  • Utpala Musti, Université de Lorraine (2009–2013) – INRIA CORDI-S: Bimodal unit selection for audiovisual speech synthesis.
  • Imen Jemaa (2009–2013) – PHC UTIQUE (Cotutelle: Université de Lorraine – Université El Manar, Tunisia): Multi-resolution analysis for formant tracking.
  • Postdoctoral supervision: 1. Elodie Gauthier (2018 – 2020), Manfred Pastätter (2019 -2020), Asterios Toutios (2007-2009), Ingmar Steiner (2011-2012), Sébastien Demange (2009-2010).
  • Master students supervision: Several master students for the long final project (5-6 months period).
    These students are from Computer Science department, Cognitive sciences department, and Automatic Signal processing department.

Participation in PhD and HDR Defense Juries

  • Thesis Reviewer & Jury Member – Nezih Younsi (ISIR, defense scheduled for April 23, 2025).
  • HDR Examiner & Jury Member – Lina Rojas (Université de Lorraine, June 2024).
  • Jury President & Examiner – Hamza Bayd (IMT Mines Alès, 2024).
  • Jury President & Examiner – Evan Dufraisse (CEA-LIST, 2024).
  • Thesis Reviewer & Jury Member – Sanjana Sankar (Université Grenoble-Alpes, 2024).
  • Thesis Reviewer & Jury Member – Samir Sadok (CentraleSupélec Rennes, 2024).
  • Thesis Reviewer & Jury Member – Nicolas Olivier (Université de Rennes, 2022).
  • Thesis Reviewer & Jury Member – Meysam Shamsi (Université de Rennes, 2020).
  • Thesis Reviewer & Jury Member – Diandra Fabre (Université Grenoble-Alpes, 2016).
  • Thesis Examiner & Jury Member – Dodji Gbedahou (Université Paul-Valéry Montpellier 3, 2020).
  • Thesis Examiner & Jury Member – Adela Barbulescu (Université de Grenoble, 2015).

Conference Organization

  • JEP-TALN 2020 (Joint organization of the Journées d’Études sur la Parole and Traitement Automatique du Langage Naturel), Nancy, France
  • AVSP 2019 (Conference on Auditory-Visual Speech Processing), Melbourne, Australia
  • AVSP 2017, Stockholm, Sweden.
  • AVSP 2015 – Organized jointly with FAAVSP 2015 (The 1st Joint Conference on Facial Analysis, Animation, and Audio-Visual Speech Processing), Vienna, Austria.
  • AVSP 2013, Annecy, France.
  • Special Session Organizer – Interspeech 2013, Lyon, France: “Articulatory Data Acquisition and Processing” (25 presentations).
  • Chair of the Organizing Committee – International Seminar on Speech Production (ISSP’08), Strasbourg, France. Co-organized with the Institut de Phonétique de Strasbourg, ZAS/Phonetik Berlin, and LORIA Nancy – Managed review process, reviewer coordination, website development, and proceedings editing (150 participants).

Program Committee Member:

  • JEP: 2016, 2018, 2020, 2022 ; AVSP: 2011, 2013, 2015 (FAAVSP), 2017, 2019 ; ISSP 2008.
  • Reviewer for International Journals: Journal of the Acoustical Society of America, Speech Communication, Journal of Phonetics, IEEE Transactions on Speech and Audio Processing, Computer Speech and Language, Computer Assisted Language Learning, Logopedics Phoniatrics Vocology, JASA Express Letters, Journal of Speech, Language, and Hearing Research, Language Resources and Evaluation, etc.
  • Reviewer for International Conferences: ICASSP, EUSIPCO, INTERSPEECH, AVSP, FAAVSP, ISSP, ICMI, IVA, etc.

Software

  •  Visartico is an articulatory visualization that can be used with an articulograph.
  • Plavis: Multimodal data analysis, processing and visualization software.
  • MultiMod Platform: Multimodal data acquisition platform allowing recording motion capture data using Vicon, depth DRGB data using RealSense and electromagnetography (EMA) data using the articulograh AG501.
  • Talking head: a system animating a talking head with realistic rendering and dynamic articulation.

Scientific & teaching related activities

  • Coordinator of the recruitment committee for ATER (since 2016).
  • Representative of the University of Lorraine at AIDA – AI Doctoral Academy (since 2021).
  • Head of the Special Year Computer Science DUT Program (2016–2022).
  • Head of the MULTISPEECH research team (since 2022).
  • Co-responsible for a selection committee for the recruitment of a professor (2025).
  • Member of selection committees for the recruitment of faculty members.
  • Member of the executive board of the Computer Science division of the IAEM Doctoral School.
  • Member of CNU27 (2020–2023 mandate).
  • Member of HCERES committees.
  • Representative of LORIA in the CLAIRE network (now CAIRNE – Confederation of Laboratories for Artificial Intelligence Research in Europe).
  • Co-responsible for the “Application Development – Software Engineering” track (RA-IL), BUT2 and BUT3 (since 2023).
  • Vice President of the Association Française de la Communication Parlée (AFCP) (2021–2024).
  • Secretary and Treasurer of the Auditory-Visual Speech Association (AVISA) (since 2013).
  • Member of the Board of the Francophone Association of Spoken Communication (AFCP) (2017–2020).
  • Member of several scientific associations: ISCA, IEEE Signal Processing Society (IEEE SPS), ACM.
  • Member of the Charles Hermite Federation (2013–2017).
  • Elected board member of the LORIA researcher center (2011–2017).
  • Member of The Charles Hermite Federation (2013-2017)
  • Elected board member of the researcher center LORIA (2011-2017)

Invited Speaker

  • Artificial Companions, and Interactions (WACAI 2024)”, Bordeaux, 2024.
    • Presentation: “Multimodal Speech: Data and Models”, LISN Seminar, scheduled for March 3, 2025.
    • “Observing Humans to Animate an Expressive Talking Face”, SdL Day, University of Lorraine, Nancy, 2021.
    • “Multimodal Data Acquisition and Processing for Spoken Communication”, Technologies of Human Language and Multimodality, TLH-AFIA, Paris, 2020.
  • Language learning, 2nd D-TRANSFORM Leadership School Program. Nancy 19-23 May 2017.
  • Audiovisual speech: facilitating oral-based communication, Praxiling, University of Montpellier 3, October 2016, Montpellier, France.
  • Toward Realistic Expressive Audiovisual Speech Synthesis, Expressive Virtual Actors workshop, Nov 2015, Grenoble, France.
  • Production of articulatory speech, Conference on Corpus and Tools in Linguistics, Languages and Speech, Strasbourg, France, July 2013
  • Acquisition of articulatory data by an articulograph, Workshop on Typology of rhotics: phonetic manifestations and phonological issues, Paris, France, june 2011.
  • Tongue Control and its Implication in Pronunciation Training, Natural Language Processing and Language Learning Workshop (NaTAL’10), Nancy, june 2010.
  • Studying Pharyngealisation Using an Articulograph,Workshop Pharyngeal and Pharyngealisation, à Newcastle, Angleterre, March 2009.
  • Talking heads: A framework to study audiovisual speech, Institut de Phonétique de Strasbourg, France, May 2009.  

Reviewer

  • Reviewer for International Conferences: Interspeech, AVSP, IVA, ICASSP, ISSP, JEP, ..
  • Reviewer for Research Funding Agencies (Austrian Academy of Sciences, Research Foundation Flanders,..)