A01 - Intonation and attention orienting: Neurophysiological and behavioural correlates
In this project, we aim to refine our model of prosodic prominence by providing more elaborate and complete characterisations of signal prominence (highlighting a universal bottom-up approach) and code prominence (highlighting a language-specific top-down approach). We plan behavioural and neurological perception studies to examine the prominence-cueing role that periodic energy plays in the acoustic signal, and we will use digital signal processing to continue the development and evaluation of our related open-source toolbox, ProPer (PROsodic Analysis with PERiodic Energy). We will also curate video corpora of natural speech and gesture from online repositories, focusing on German and Maltese English, in order to characterise the contribution of speech accompanying gestures to the perception of prominence. These studies are designed to provide new insights into the timing relationships between the beat components of hand gestures and prominent positions in the corresponding speech signal, with the additional aim of informing prosodic theory through an analysis of these relationships.
Team
Prof. Dr. Petra Schumacher
Project Leader A01, C07, C09 and Z
Office: Philosophikum, room 2.124 and SFB, Luxemburger Str. 299, room 1.09E-Mail: petra.schumacher(at)uni-koeln.dePhone: (+49) 221 470-2696 (Philosophikum) and -89900 (SFB)
Dr. Aviad Albert
Postdoc A01
Office: Luxemburger Straße 299, room 3.12E-Mail: a.albert(at)uni-koeln.dePhone: 0221-470-89926
Maria Lialiou
Deputy Representative Doctoral StudentsDoctoral Student A01
Office: Luxemburger Straße 299, room 3.10E-Mail:mlialiou(at)uni-koeln.dePhone: (+49) 221 470-89914
Solveigh Janzen
Student Assistant A01
Office: Luxemburger Straße 299, room 3.13E-Mail: sjanzen2(at)uni-koeln.de
Nadezda Pelageina
Student Assistant A01
Office: Luxemburger Straße 299, room 3.13E-Mail: npelage1(at)uni-koeln.de
Publications
To appear
- Albert, Aviad & Martine Grice. To appear. Rhythm is a timescale. In Lars Meyer & Antje Strauss (eds.), Rhythms of Speech and Language: Culture, Cognition, and the Brain. Cambridge University Press.
- Grice, Martine, Michelina Savino, Petra B. Schumacher, Christine T. Röhr & T. Mark Ellison. To appear. Rises on Pitch Accents and Edge Tones Affect Serial Recall Performance at Item and Domain levels. Laboratory Phonology. pdf
- Kaland, Constantijn, Katharina Gayler, Nikolaus P. Himmelmann & Martine Grice. To appear. A first exploration of word- and phrase-final f0 movements in spontaneous Yali. Phonological Data and Analysis.
- Patterson, Clare, Umesh Patil, Caterina Ventura, Maria Lialiou, Petra Schumacher & Stefan Hinterwimmer. To appear. Why register might be more important than modality for the choice of demonstrative pronouns. Linguistische Berichte.
- Vella, Alexandra & Martine Grice. To appear. Association of tones in Maltese. In Sun-Ah Jun (ed.), Prosodic Typology III. Oxford: Oxford University Press.
2024
- Jeon, Hae-Sung, Constantijn Kaland & Martine Grice. 2024. Cluster analysis of Korean IP-final intonation. In Proceedings of Speech Prosody 2024, 1025–1029. Leiden. pdf
- Kaland, Constantijn & Martine Grice. 2024. Exploring and explaining variation in phrase-final f0 movements in spontaneous Papuan Malay. Phonetica. pdf
- Kaland, Constantijn & Maria Lialiou. 2024. Quantity-sensitivity affects recall performance of word stress. In Proceedings of the 25th Interspeech Conference, 4238–4242. pdf
- Lialiou, Maria, Martine Grice, Christine T. Röhr & Petra B. Schumacher. 2024. Auditory processing of intonational rises and falls in German: Rises are special in attention orienting. Journal of Cognitive Neuroscience 36(6). 1099–1122.
- Lialiou, Maria, Jesse Harris, Martine Grice & Petra B. Schumacher. 2024. Attention allocation to deviants with intonational rises and falls: Evidence from pupillometry. In Proceedings of the 46th Annual Conference of Cognitive Science Society, vol. 46.
- Möking, Eduardo, Simona Sbranna, Aviad Albert & Martine Grice. 2024. Monitoring and assessing L2 prosodic competence. In Giampiero De Cristofaro, Fátima Silva & Borbála Samu (eds.), Language MOOCs and OERs: new trends and challenges, 159–184. Perugia Stranieri University Press.
- Savino, Michelina, Simon Wehrle & Martine Grice. 2024. The prosody of Italian newsreading: a diachronic analysis. In Proceedings of Speech Prosody 2024. Leiden.
2023
- Albert, Aviad. 2023. A model of sonority based on pitch intelligibility (Studies in Laboratory Phonology 13). Berlin: Language Science Press.
- Coretta, Stefano, Joseph V. Casillas, Simon Roessig, Michael Franke, [...], Timo B. Roettger. (with Francesco Cangemi, Martine Grice, Constantijn Kaland, Maria Lialiou, Malin Spaniol & Simon Wehrle). 2023. Multidimensional Signals and Analytic Flexibility: Estimating Degrees of Freedom in Human-Speech Analyses. Advances in Methods and Practices in Psychological Science 6(3). 1–29. pdf | A01, A02, A03, A04
- Kretzschmar, Franziska, Phillip M. Alday, Martine Grice & Ingmar Brilmayer. 2023. Editorial: Variability in language predictions: assessing the influence of speaker, text and experimental method. Frontiers in Communication 8.
- Lialiou, Maria, Anna Bruggeman, Alexandra Vella, Sarah Grech, Petra Schumacher & Martine Grice. 2023. Word-level prominence and “stress deafness” in Maltese-English bilinguals. In Radek Skarnitzl & Jan Volín (eds.), Proceedings of the 20th International Congress of Phonetic Sciences, 132–136. Prague, Czech Republic: Guarant International.
- Röhr, Christine, Stefan Baumann & Martine Grice. 2023. Intonational preferences for lexical contrast and verum focus. In Radek Skarnitzl & Jan Volín (eds.), Proceedings of the 20th International Congress of Phonetic Sciences, 1578–1582. Prague, Czech Republic: Guarant International.
- Savino, Michelina, Francisco Torreira & Martine Grice. 2023. Prosodic convergence across varieties of Italian. In Radek Skarnitzl & Jan Volín (eds.), Proceedings of the 20th International Congress of Phonetic Sciences, 1310–1314. Prague, Czech Republic: Guarant International.
- Sbranna, Simona, Caterina Ventura, Aviad Albert & Martine Grice. 2023. Prosodic marking of information status in Italian. Journal of Phonetics 97. 101212. preprint: pdf
2022
- Grice, Martine. 2022. Autosegmental-Metrical Phonology - Unpacking the Boxes. Zeitschrift für Sprachwissenschaft 41(2). 393–411.
- Grice, Martine. 2022. Commentary: Introducing Flexibility into Autosegmental-Metrical Phonology. In Stefanie Shattuck-Hufnagel & Jonathan Barnes (eds.), Prosodic Theory and Practice, 64–75. The MIT Press.
- Kügler, Frank, Stefan Baumann & Christine T. Röhr. 2022. Deutsche Intonation, Modellierung und Annotation (DIMA) – Richtlinien zur prosodischen Annotation des Deutschen. In Cordula Schwarze & Sven Grawunder (eds.), Transkription und Annotation gesprochener Sprache und multimodaler Interaktion, 23–54. Tübingen: Narr.
- Röhr, Christine T., Stefan Baumann & Martine Grice. 2022. The Influence of Expectations on Tonal Cues to Prominence. Journal of Phonetics 94. 101174.
- Röhr, Christine T., Michelina Savino & Martine Grice. 2022. The effect of intonational rises on serial recall in German. In Proceedings of the 11th International Conference on Speech Prosody 2022, 759–763. Lisbon, Portugal.
- Savino, Michelina, Simona Sbranna, Caterina Ventura, Aviad Albert & Martine Grice. 2022. Imitating intonation in a non-native variety: the influence of the native repertoire. In Proceedings of the 11th International Conference on Speech Prosody 2022, 739–743. Lisbon, Portugal.
- Sbranna, Simona, Eduardo Möking, Simon Wehrle & Martine Grice. 2022. Backchannelling across Languages: Rate, Lexical Choice and Intonation in L1 Italian, L1 German and L2 German. In Proceedings of the 11th International Conference on Speech Prosody 2022, 734–738. Lisbon, Portugal.
- Wehrle, Simon, Francesco Cangemi, Kai Vogeley & Martine Grice. 2022. New evidence for melodic speech in Autism Spectrum Disorder. In Proceedings of the 11th International Conference on Speech Prosody 2022, 37-41. Lisbon, Portugal.
2021
- Grice, Martine. 2021. Commentary: The autosegmental-metrical model of intonational phonology. In Stefanie Shattuck-Hufnagel & Jonathan Barnes (eds.), Prosodic Theory and Practice. The MIT Press.
- Grice, Martine & Frank Kügler (eds.). 2021. Prosodic prominence – a cross-linguistic perspective. Special Issue of Language and Speech 64(2).
- Grice, Martine & Frank Kügler. 2021. Prosodic prominence – a cross-linguistic perspective. Language and Speech 64(2), 253–260.
- Lialiou, Maria, Aviad Albert, Alexandra Vella & Martine Grice. 2021. Periodic energy mass on head and edge tones in Maltese wh-constructions. In Proceedings of the 1st International Conference on Tone and Intonation (TAI), 161–165. Sonderborg, Denmark.
2020
- Baumann, Stefan & Francesco Cangemi (eds.). 2020. Integrating phonetics and phonology in the study of linguistic prominence. Special Issue Journal of Phonetics.
- Baumann, Stefan, Janina Kalbertodt & Jane Mertens. 2020. The appropriateness of prenuclear accent types - Evidence for information structural effects. Proceedings of the 10th International Conference on Speech Prosody 2020 (online conference). Tokyo, Japan. pdf | video
- Baumann, Stefan & Petra B. Schumacher. 2020. The incremental processing of focus, givenness and prosodic prominence. Glossa: A Journal of General Linguistics 5(1). 1–30.
- Cangemi, Francesco & Stefan Baumann. 2020. Integrating phonetics and phonology in the study of linguistic prominence [introduction to the Special Issue of the same name, eds. Baumann & Cangemi]. Journal of Phonetics 81, 100993.
- Im, Suyeon & Stefan Baumann. 2020. Probabilistic relation between co-speech gestures, pitch accents and information status. Proceedings of the Linguistic Society of America 5(1), 685-697.
- Kaland, Constantijn & Stefan Baumann. 2020. Demarcating and highlighting in Papuan Malay phrase prosody. The Journal of Acoustic Society of America 147(4). 2974–2988. pdf
- Riesberg, Sonja, Janina Kalbertodt, Stefan Baumann & Nikolaus P. Himmelmann. 2020. Using Rapid Prosody Transcription to probe little-known prosodic systems: The case of Papuan Malay. Laboratory Phonology: Journal of the Association for Laboratory Phonology 11(1): 8. 1–35.
- Riester, Arndt, Tobias Schröer & Stefan Baumann. 2020. On the prosody of contrastive topics in German interviews. Proceedings of the 10th International Conference on Speech Prosody (Online Conference). Tokyo, Japan. 280-284. pdf | video
- Röhr, Christine T., Stefan Baumann, Petra B. Schumacher & Martine Grice. 2020. Perceptual prominence of accent types and the role of expectations. Proceedings of the 10th International Conference on Speech Prosody 2020 (online conference). Tokyo, Japan. pdf | video
- Röhr, Christine T., Ingmar Brilmayer, Stefan Baumann, Martine Grice & Petra B. Schumacher. 2020. Signal-Driven and Expectation-Driven Processing of Accent Types. Language, Cognition & Neuroscience 36(1). 33-59.
- Savino, Michelina, Bodo Winter, Andrea Bosco & Martine Grice. 2020. Intonation does aid serial recall after all. Psychonomic Bulletin and Review 27(2). 366-372. pdf
- Ventura, Caterina, Martine Grice, Michelina Savino, Diana Kolev, Ingmar Brilmayer & Petra B. Schumacher. 2020. Attention allocation in a language with post-focal prominences. NeuroReport 31(8). 624–628. pdf
2019
- Baumann, Stefan, Jane Mertens & Janina Kalbertodt. 2019. Informativeness and speaking style affect the realization of nuclear and prenuclear accents in German. In Sasha Calhoun, Paola Escudero, Marija Tabain & Paul Warren (eds.), Proceedings of the 19th International Congress of Phonetic Sciences (ICPhS), 1580-1584. Melbourne, Australia. pdf
- Cangemi, Francesco, Aviad Albert & Martine Grice. 2019. Modelling intonation: Beyond segments and tonal targets. Proceedings of the 19th International Congress of Phonetic Sciences (ICPhS), 572-576. Melbourne, Australien. pdf
- Grice, Martine, Alexandra Vella & Anna Bruggeman. 2019. Stress, pitch accent, and beyond: Intonation in Maltese questions. Journal of Phonetics 76. 100913.
- von Heusinger, Klaus & Petra B. Schumacher. 2019. Discourse prominence: Definition and application. Journal of Pragmatics 154. 117-127.
- Kaland, Constantijn & Stefan Baumann. 2019. Different functions of phrase-final F0 movements in spontaneous Papuan Malay. Proceedings of the 19th International Congress of Phonetic Sciences (ICPhS). Melbourne, Australia. pdf
- Kügler, Frank, Stefan Baumann, Bistra Andreeva, Bettina Braun, Martine Grice, Jana Neitsch, Oliver Niebuhr, Jörg Peters, Christine T. Röhr, Antje Schweitzer & Petra Wagner. 2019. Annotation of German intonation: DIMA compared with other annotation systems. In Sasha Calhoun, Paola Escudero, Marija Tabain & Paul Warren (eds.), Proceedings of the 19th International Congress of Phonetic Sciences (ICPhS), 1297-1301. Melbourne, Australia. pdf
- Roessig, Simon, Doris Mücke & Martine Grice. 2019. The dynamics of intonation: Cateogrical and continuous variation in an attractor-based model. PLoS ONE 14(5). pdf
- Schumacher, Petra B. & Klaus von Heusinger. 2019. Special Issue: Prominence in Discourse. Journal of Pragmatics 154. pdf
2018
- Baumann, Stefan & Bodo Winter. 2018. What makes a word prominent? Predicting untrained German listeners' perceptual judgments. Journal of Phonetics 70. 20-38. pdf
- Grice, Martine, Michelina Savino & Timo B. Roettger. 2018. Word final schwa is driven by intonation - the case of Bari Italian. The Journal of the Acoustical Society of America (JASA) 143(4). 2474-2486. pdf
- Im, Suyeon, Jennifer Cole & Stefan Baumann. 2018. Probabilistic relationship between pitch accents and information status in public speech. Proceedings of the 9th International Conference on Speech Prosody 2018, 508-511. Poznań, Poland. pdf
- Riesberg, Sonja, Janina Kalbertodt, Stefan Baumann & Nikolaus P. Himmelmann. 2018. On the perception of prosodic prominences and boundaries in Papuan Malay. In Sonja Riesberg, Asako Shiohara & Atsuko Utsumi (eds.), Perspectives on information structure in Austronesian languages, 389-414. Berlin: Language Science Press. pdf
- Thies, Tabea, Christine T. Röhr, Stefan Baumann & Martine Grice. 2018. Prosodic marking of information status in picture story descriptions. Proceedings of Phonetik und Phonologie im deutschsprachigen Raum (P&P) 13, 193-196. Berlin, Germany. pdf
- Torreira, Francisco & Martine Grice. 2018. Melodic constructions in Spanish: Metrical structure determines the association properties of intonational tones. Journal of the International Phonetic Association (JIPA) 48(1). 9-32. pdf
2017
- Grice, Martine, Simon Ritter, Henrik Niemann & Timo B. Roettger. 2017. Integrating the discreteness and continuity of intonational categories. Journal of Phonetics 64. 90-107. preprint: pdf
- Hinterwimmer, Stefan & Petra B. Schumacher (eds.). 2017. Special Collection: Perspective Taking. Glossa 2(1).
- Riester, Arndt & Stefan Baumann. 2017. The RefLex Scheme – Annotation Guidelines. Vol. 14 of SinSpeC. Working Papers of the SFB 732, 1-31. University of Stuttgart. pdf