A04 - Dynamic modelling of prosodic prominence
In phase I, we modelled gradient and categorical aspects of prosodic prominence in dynamical systems that integrated intonational and articulatory modulations in unified systems. During phase II, we then extended our view on multidimensional prominence cuing by extending the speech parameters to measures of fundamental frequency, duration, intensity, spectral slope, voice quality, supra-laryngeal articulation and formant frequencies. In phase III, we expand our dynamical model of prosodic prominence to visual prosody and the accommodation of prominence strategies between speakers in a multidimensional space of speech production. We will explore the speaker-specific strategies of exploiting the phonetic space and the space of visual prosody. Within the framework of dynamical systems, we aim to implement multimodal prosody into a gestural model by connecting the coordination patterns of both motor domains, i.e., body gestures (visual prosody) and vocal tract gestures (speech gestures related to the acoustic output of speech).
Team
Dr. Tabea Thies
Associated Postdoc A04
Office: Phonetik, Herbert-Lewin-Straße 6E-Mail: tabea.thies(at)uni-koeln.dePhone: (+49) 221 470-7047
Lena Pagel
Associated Doctoral student A04
Office: Phonetik, Herbert-Lewin-Straße 6E-Mail: lena.pagel(at)uni-koeln.dePhone: (+49) 221 470-7047
Elisa Herbig
Student assistant A04
Office: Phonetik, Herbert-Lewin-Straße 6E-Mail: eherbig1(at)uni-koeln.dePhone: (+49) 221 470-7047
Publications
2024
- Herbig, Elisa, Tabea Thies, Michael T. Barbe & Doris Mücke. 2024. The role of cognitive efficiency and Levodopa on articulatory timing. In Proceedings of the 13th International Seminar on Speech Production (ISSP), 13-17 May, 2024, 125–128. Autrans, France.
- Jergas, Hannah, Jan Niklas Petry-Schmelzer, Jonathan Hannemann, Tabea Thies, Joshua N Strelow, Ilona Rubi-Fessen, Jana Quinting, et al. 2024. One side effect – two networks? Lateral and postero-medial stimulation spreads induce dysarthria in subthalamic deep brain stimulation for Parkinson’s Disease. Journal of Neurology, Neurosurgery and Psychiatrie.
- Lorenzen, Janne, Simon Roessig & Stefan Baumann. 2024. Paradigmatic and syntagmatic effects of information status on prosodic prominence – Evidence from an interactive web-based production experiment in German. Frontiers in Psychology 15. 1296933.
- Mertz, Justine, Lena Pagel, Pamela Perniss, Giuseppina Turco & Doris Mücke. 2024. Coarticulation in sign language: A kinematic study on French Sign Language (LSF) using Electromagnetic Articulography (EMA). In Proceedings of the 13th International Seminar on Speech Production (ISSP), 13-17 May, 2024, 51–54. Autrans en Vercors, France.
- Mertz, Justine, Lena Pagel, Giuseppina Turco & Doris Mücke. 2024. Gradiency and categoriality in the prosodic modulation of French Sign Language: A kinematic approach using Electromagnetic Articulography. In Proceedings of the International Conference on Speech Prosody, 2-5 July, 2024, 851–855. Leiden, the Netherlands.
- Mertz, Justine, Lena Pagel, Giuseppina Turco & Doris Mücke. 2024. Using electromagnetic articulography in LSF: A new approach to sign language kinematics. In 19th Conference on Laboratory Phonology, June 27-29, 2025. Seoul, Korea.
- Mücke, Doris, Simon Roessig, Antje Mefferd, Tabea Thies & Anne Hermes. 2024. Challenges with the kinematic analysis of neurotypical and impaired speech: measures and models. Journal of Phonetics 102. 101292.
- Pagel, Lena, Simon Roessig & Doris Mücke. 2024. An experimental setup for capturing multimodal accommodation using dual electromagnetic articulography, audio, and video. In Proceedings of the 13th International Seminar on Speech Production (ISSP), 13-17 May, 2024, 119–122. Autrans en Vercors, France.
- Pagel, Lena, Simon Roessig & Doris Mücke. 2024. The encoding of prominence relations in supra-laryngeal articulation across speaking styles. Journal of Laboratory Phonology. Journal of Laboratory Phonology 15(1). 1–55.
- Roessig, Simon, Mortaza Taheri-Ardali, Lena Pagel & Doris Mücke. 2024. Prosodic realization of different focus types in Persian. In Proceedings of the International Conference on Speech Prosody, 2-5 July, 2024, 762–766. Leiden, the Netherlands.
- Thies, Tabea, Michael T. Barbe & Doris Mücke. 2024. Prosody matters: Preserved prominence marking strategies in people with Parkinson’s disease independent of motor status. PLoS ONE.
2023
- Coretta, Stefano, Joseph V. Casillas, Simon Roessig, Michael Franke, [...], Timo B. Roettger. (with Francesco Cangemi, Martine Grice, Constantijn Kaland, Maria Lialiou, Malin Spaniol & Simon Wehrle). 2023. Multidimensional Signals and Analytic Flexibility: Estimating Degrees of Freedom in Human-Speech Analyses. Advances in Methods and Practices in Psychological Science 6(3). 1–29. pdf | A01, A02, A03, A04
- Mücke, Doris, Tabea Thies, Philipp Büch, Noemi Furlani, Janine Schreen & Anne Hermes. 2023. Variability in space, compensation in time: Effects of aging on tongue body kinematics with respect to prosodic focus marking. In Proceedings of the 20th International Congress of the Phonetic Sciences, 2035–2039. Prague, Czech Republic: Guarant International.
- Pagel, Lena, Márton Sóskuthy, Simon Roessig & Doris Mücke. 2023. A kinematic analysis of visual prosody: Head movements in habitual and loud speech. In Proceedings of the International Congress of Phonetic Sciences, 4130–4134. Prague, Czech Republic: Guarant International.
- Parrell, Benjamin, Antje Mefferd, Sarah Harper, Simon Roessig & Doris Mücke. 2023. Using computational models to characterize the role of motor noise in speech: The case of amyotrophic lateral sclerosis. In Proceedings of the 20th International Congress of the Phonetic Sciences, 878–882. Prague, Czech Republic: Guarant International.
- Thies, Tabea. 2023. Tongue Body Kinematics in Parkinson’s Disease: Effects of Levodopa and Deep Brain Stimulation. Berlin: Peter Lang Verlag.
- Thies, Tabea, Hannah Jergas, Doris Mücke, Gregor A. Brandt, Veerle Visser-Vandewalle, Serge Pinto & Michael T. Barbe. 2023. The effects of STN-DBS on motor speech: A longitudinal articulographic study. Brain Stimulation 16(6). 1598–1600.
- Thies, Tabea, Doris Mücke, Nuria Geerts, Aline Seger, Gereon R. Fink, Michael T. Barbe & Michael Sommerauer. 2023. Compensatory articulatory mechanisms preserve intelligibility in prodromal Parkinson’s disease. Parkinsonism & Related Disorders 112. 105487.
- Thies, Tabea, Doris Mücke & Antje Mefferd. 2023. Phase relations between the tongue body and the jaw across rate modifications in younger and older speakers. In Proceedings of the 20th International Congress of the Phonetic Sciences, 1057–1061. Prague, Czech Republic: Guarant International.
2022
- Buech, Philipp, Simon Roessig, Lena Pagel & Anne Hermes. 2022. Making articulation accessible in Praat. In Stem-, Spraak- en Taalpathologie, 8th International Conference on Speech Motor Control 2022, 289–290. Groningen, the Netherlands.
- Buech, Philipp, Simon Roessig, Lena Pagel, Anne Hermes & Doris Mücke. 2022. ema2wav: doing articulation by Praat. In Proceedings of Interspeech 2022, 1352–1356. Incheon, Korea. pdf
- Lorenzen, Janne, Simon Roessig & Stefan Baumann. 2022. Information status and tonal context jointly modulate prosodic prominence relations in German. In Proceedings of Speech Prosody 2022, 7-11. Lisbon, Portugal.
- Mücke, Doris, Antje Mefferd, Tabea Thies, Simon Roessig & Anne Hermes. 2022. Analysis and Modelling of Impaired Speech Movements: Challenges and Future Directions. In Stem-, Spraak- en Taalpathologie, 8th International Conference on Speech Motor Control 2022, 239–240. Groningen, the Netherlands.
- Pagel, Lena, Simon Roessig & Doris Mücke. 2022. How to achieve a prominence GOAL! in different speaking styles. In Chiara Gianollo, Łukasz Jędrzejowski & Sofiana I. Lindemann (eds.), Festschrift offered to Klaus von Heusinger on the occasion of his 60th birthday, 200–204. Köln: Universitäts- und Stadtbibliothek Köln.
- Pagel, Lena, Simon Roessig & Doris Mücke. 2022. Supra-laryngeal articulation under vocal effort variation. In Stem-, Spraak- en Taalpathologie, 8th International Conference on Speech Motor Control 2022, 241–242. Groningen, the Netherlands.
- Roessig, Simon, Lena Pagel & Doris Mücke. 2022. Speaking loudly reduces flexibility and variability in the prosodic marking of focus types. In Proceedings of Speech Prosody 2022, 500-504. Lisbon, Portugal.
- Roessig, Simon, Bodo Winter & Doris Mücke. 2022. Tracing the phonetic space of prosodic focus marking. Frontiers in Artificial Intelligence 5.
- Schreen, Janine, Tabea Thies, Anne Hermes & Doris Mücke. 2022. Age-related changes on tongue body movements. In Stem-, Spraak- en Taalpathologie, 8th International Conference on Speech Motor Control 2022, 247–248. Groningen, the Netherlands.
- Thies, Tabea, Michael T. Barbe, Veerle Visser-Vandewalle & Doris Mücke. 2022. Disease- and treatment-related changes on tongue body movements in Parkinson‘s disease. An electromagnetic articulography study. In Stem-, Spraak- en Taalpathologie, 8th International Conference on Speech Motor Control 2022, 11–12. Groningen, the Netherlands.
- Thies, Tabea, Nuria Geerts, Doris Mücke, Aline Seeger, Michael T. Barbe & Michael Sommerauer. 2022. Affected tongue body movements in idiopathic REM sleep behavior disorder. In Stem-, Spraak- en Taalpathologie, 8th International Conference on Speech Motor Control 2022, 191–192. Groningen, the Netherlands.
- Thies, Tabea, Anne Hermes & Doris Mücke. 2022. Compensation in Time and Space: Prominence Marking in Aging and Disease. Languages 7(1). 21. pdf
2021
- Mücke, Doris, Tabea Thies, Jane Mertens & Anne Hermes. 2021. Age-related effects of prosodic prominence in vowel articulation. In Proceedings of the 12th International Seminar on Speech Production, 126–129. Providence, Rhode Island, USA. pdf
- Pagel, Lena, Simon Roessig & Doris Mücke. 2021. Modifications of tongue body kinematics as a focus marking strategy in German. In Proceedings of the 12th International Seminar on Speech Production, 21–24. Providence, Rhode Island, USA. pdf
- Roessig, Simon. 2021. Categoriality and continuity in prosodic prominence. Berlin: Language Science Press. pdf
- Thies, Tabea, Doris Mücke, Ricard Dano & Michael T. Barbe. 2021. Correlation between levodopa response and acoustic parameters of prominence marking as well as tongue body movements in patients with Parkinson’s disease. In Proceedings of the 12th International Seminar on Speech Production, 122–125. Providence, Rhode Island, USA. pdf
- Thies, Tabea, Doris Mücke, Ricard Dano & Michael T. Barbe. 2021. Levodopa-Based Changes on Vocalic Speech Movements during Prosodic Prominence Marking. Brain Sciences 11(5). 594.
2020
- Cho, Taehong & Doris Mücke. 2020. Articulatory measures of prosody. In Carlos Gussenhoven & Aouju Chen (eds.), The Oxford Handbook of Language Prosody, 15–21. Oxford: Oxford University Press.
- Mücke, Doris, Anne Hermes & Sam Tilsen. 2020. Incongruencies between phonological theory and phonetic measurement. Phonology, 37(1). 133-170.
- Thies, Tabea, Doris Mücke, Anja Lowit, Elke Kalbe, Julia Steffen & Michael T. Barbe. 2020. Prominence marking in Parkinsonian speech and its correlation with motor abilities and cognition. Neuropsychologica 137.
2019
- Hermes, Anne, Doris Mücke, Tabea Thies & Michael T. Barbe. 2019. Coordination patterns in Essential Tremor patients with Deep Brain Stimulation: Syllables with low and high complexity. Laboratory Phonology: Journal of the Association for Laboratory Phonology 10(1). 1–20.
- Hermes, Anne, Doris Mücke, Tabea Thies & Michael T. Barbe. 2019. Intragestural variation in natural sentence production: Essential Tremor Patients treated with DBS. Proceedings of Interspeech 2019. Graz, Austria.
- Mücke, Doris, Anne Hermes & Sam Tilsen. 2019. Strength and structure: Coupling tones with oral constriction gestures. Proceedings of Interspeech 2019. Graz, Austria.
- Roessig Simon & Doris Mücke. 2019. Modeling Dimensions of Prosodic Prominence. Frontiers in Communication 4. 44. pdf
- Roessig (Ritter), Simon, Doris Mücke & Martine Grice. 2019. The dynamics of intonation: Categorical and continuous variation in an attractor-based model. PLoS ONE 14(5). pdf
- Roessig, Simon, Doris Mücke & Lena Pagel. 2019. Dimensions of prosodic prominence in an attractor model. Proceedings of Interspeech 2019. Graz, Austria.
2018
- Hermes, Anne, Jane Mertens & Doris Mücke. 2018. Age-related effects on sensorimotor control of speech production. Proceedings of Interspeech 2018, 1526-1530. Hyderabad, India.
- Mücke, Doris. 2018. Dynamische Modellierung von Artikulation und prosodischer Struktur: Eine Einführung in die Artikulatorische Phonologie. Language Science Press.
- Mücke, Doris, Anne Hermes, Timo B. Roettger, Johannes Becker, Henrik Niemann, Till A. Dembek, et al. 2018. The effects of Thalamic Deep Brain Stimulation on speech dynamics in patients with Essential Tremor: An articulographic study. PLoS ONE 13(1).
2017
- Grice, Martine, Simon Ritter, Henrik Niemann & Timo B. Roettger. 2017. Integrating the discreteness and continuity of intonational categories. Journal of Phonetics 64. 90-107.
- Hermes, Anne, Doris Mücke & Jane Mertens. 2017. Ageing effect on speech motor control. Stem-, Spraak- en Taalpathologie 22 (Supplement 52).
- Mücke, Doris, Anne Hermes & Taehong Cho (eds.). 2017. Mechanisms of regulation in speech. Special Issue of Journal of Phonetics 64.
- Mücke, Doris, Anne Hermes & Taehong Cho. 2017. Mechanisms of regulation in speech. Linguistic structure and physical control system. Special Issue in Journal of Phonetics 64. 1-7.
- Mücke, Doris, Anne Hermes, Tabea Thies, J. Becker & Michael Barbe. 2017. The loss of complex coupling modes in speech dynamics: An EMA study on Essential Tremor patients. Stem-, Spraak- en Taalpathologie 22 (Supplement 108).
Awards
- Pagel, Lena: IPA Student Award (A kinematic analysis of visual prosody: Head movements in habitual and loud speech), ICPhS 2023 in Prague.
- Mücke, Doris: LABEX EFL International Chair 2023 (Laboratories of Excellence, Université Sorbonne Nouvelle, Paris).
- Roessig, Simon: Walter Benjamin fellowship (2021) of the German Research Foundation (DFG).
- Roessig, Simon: Offermann-Hergarten Prize of the University of Cologne 2021 (Categoriality and continuity in prosodic prominence).
- Pagel, Lena: Student Award "Special Mention for Best Oral Presentation” (Prominence relations and articulatory modifications in habitual and loud speech), 4th Phonetics and Phonology in Europe 2021 in Barcelona (virtual conference).
- Pagel, Lena: Best Poster Award (Modifications of Tongue Body Kinematics as a Prominence Marking Strategy), Interspeech 2019 / Young Female Researchers in Speech Workshop 2019 in Graz.
- Pagel, Lena: Faculty Prize of the Faculty of Arts and Humanities of the University of Cologne 2019 (Eine artikulatoische Studie zur Prominenzmarkierung im Deutschen: Die Kinematik des Zungenrückens; Bachelorthesis).
- Mertens, Jane: Faculty Prize of the Faculty of Arts and Humanities of the University of Cologne 2018 (Alter und Sprechmotorik: Eine akustische und artikulatorische Analyse; Masterthesis).
- Roessig, Simon: Best Student Paper Award (The phonetics and phonology of focus marking - an integrated perspective), 16th Conference on Laboratory Phonology 2018 in Lissabon.