Skip to Main content Skip to Navigation
Journal articles

The Role of the Auditory and Visual Modalities in the Perceptual Identification of Brazilian Portuguese Statements and Echo Questions

Luma Miranda Marc Swerts 1 João Antônio de Moraes 2 Albert Rilliard 3 
3 TLP - Traitement du Langage Parlé
LISN - Laboratoire Interdisciplinaire des Sciences du Numérique, STL - Sciences et Technologies des Langues
Abstract : This paper presents the results of three perceptual experiments investigating the role of auditory and visual channels for the identification of statements and echo questions in Brazilian Portuguese. Ten Brazilian speakers (five male) were video-recorded (frontal view of the face) while they produced a sentence ("Como você sabe"), either as a statement (meaning "As you know.") or as an echo question (meaning "As you know?"). Experiments were set up with the two different intonation contours. Stimuli were presented in conditions with clear and degraded audio as well as congruent and incongruent information from both channels. Results show that Brazilian listeners were able to distinguish statements and questions prosodically and visually, with auditory performances being dominant over visual ones. In noisy conditions, the visual channel improved the interpretation of prosodic cues robustly, while it degraded them in conditions where the visual information is incongruent with the auditory information. This study confirms the previous findings on auditory and visual integration within speech perception, also when applied to prosodic patterns.
Document type :
Journal articles
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-02456308
Contributor : Albert Rilliard Connect in order to contact the contributor
Submitted on : Friday, August 27, 2021 - 4:28:52 PM
Last modification on : Sunday, June 26, 2022 - 3:12:39 AM
Long-term archiving on: : Sunday, November 28, 2021 - 6:48:55 PM

File

The role of the auditory and v...
Files produced by the author(s)

Identifiers

Citation

Luma Miranda, Marc Swerts, João Antônio de Moraes, Albert Rilliard. The Role of the Auditory and Visual Modalities in the Perceptual Identification of Brazilian Portuguese Statements and Echo Questions. Language and Speech, SAGE Publications (UK and US), 2021, 64 (1), pp.3-23. ⟨10.1177/0023830919898886⟩. ⟨hal-02456308⟩

Share

Metrics

Record views

136

Files downloads

34