Curtin University Homepage
  • Library
  • Help
    • Admin

    espace - Curtin’s institutional repository

    JavaScript is disabled for your browser. Some features of this site may not work without it.
    View Item 
    • espace Home
    • espace
    • Curtin Research Publications
    • View Item
    • espace Home
    • espace
    • Curtin Research Publications
    • View Item

    Message vs. messenger effects on cross-modal matching for spoken phrases

    Access Status
    Fulltext not available
    Authors
    Best, C.
    Kroos, Christian
    Mulak, K.
    Halovic, S.
    Fort, M.
    Kitamura, C.
    Date
    2015
    Type
    Conference Paper
    
    Metadata
    Show full item record
    Citation
    Best, C. and Kroos, C. and Mulak, K. and Halovic, S. and Fort, M. and Kitamura, C. 2015. Message vs. messenger effects on cross-modal matching for spoken phrases, in The 1st Joint Conference on Facial Analysis, Animation, and Auditory-Visual Speech Processing (FAAVSP), Sep 11 2015, pp. 28-33. Vienna, Austria: ISCA.
    Source Title
    FAAVSP-2015
    Source Conference
    FAAVSP - The 1st Joint Conference on Facial Analysis, Animation, and Auditory-Visual Speech Processing
    School
    School of Design and Art
    URI
    http://hdl.handle.net/20.500.11937/45277
    Collection
    • Curtin Research Publications
    Abstract

    A core issue in speech perception and word recognition research is the nature of information perceivers use to identify spoken utterances across indexical variations in their phonetic details, such as talker and accent differences. Separately, a crucial question in audio-visual research is the nature of information perceivers use to recognize phonetic congruency between the audio and visual (talking face) signals that arise from speaking. We combined these issues in a study examining how differences between connected speech utterances (messages) versus between talkers and accents (messenger characteristics) contribute to recognition of crossmodal articulatory congruence between audio-only (AO) and video-only (VO) components of spoken utterances. Participants heard AO phrases in their native regional English accent or another English accent, and then saw two synchronous VO displays of point-light talking faces from which they had to select the one that corresponded to the audio target. The incorrect video in each pair was either the same or a different phrase as the audio target, produced by the same or a different talker, who spoke in either the same or a different English accent. Results indicate that cross-modal articulatory correspondence is more accurately and quickly detected for message content than for messenger details, suggesting that recognising the linguistic message is more fundamental than messenger features is to cross-modal detection of audio-visual articulatory congruency. Nonetheless, messenger characteristics, especially accent, affected performance to some degree, analogous to recent findings in AO speech research.

    Related items

    Showing items related by title, author, creator and subject.

    • I can see what you said: Infant sensitivity to articulator congruency between audio-only and silent-video presentations of native and nonnative consonants
      Best, C.; Kroos, Christian; Irwin, J. (2010)
      We examined infants’ sensitivity to articulatory organ congruency between audio-only and silent-video consonants (lip vs. tongue tip closure) to evaluate three theoretical accounts of audio-visual perceptual development ...
    • Hearing a point-light talker: An auditory influence on a visual detection task
      Kim, J.; Kroos, Christian; Davis, C. (2010)
      Parsing of information from the world into objects and events occurs in both the visual and auditory modalities. It has been suggested that visual and auditory scene perceptions involve similar principles of perceptual ...
    • Do infants detect A→V articulator congruency for non-native click consonants?
      Best, C.; Kroos, Christian; Irwin, J. (2011)
      In a prior study infants habituated to an audio-only labial or alveolar, native English voiceless or non-native ejective stop, then saw silent videos of stops at each place [1]. 4-month-olds gazed more at congruent videos ...
    Advanced search

    Browse

    Communities & CollectionsIssue DateAuthorTitleSubjectDocument TypeThis CollectionIssue DateAuthorTitleSubjectDocument Type

    My Account

    Admin

    Statistics

    Most Popular ItemsStatistics by CountryMost Popular Authors

    Follow Curtin

    • 
    • 
    • 
    • 
    • 

    CRICOS Provider Code: 00301JABN: 99 143 842 569TEQSA: PRV12158

    Copyright | Disclaimer | Privacy statement | Accessibility

    Curtin would like to pay respect to the Aboriginal and Torres Strait Islander members of our community by acknowledging the traditional owners of the land on which the Perth campus is located, the Whadjuk people of the Nyungar Nation; and on our Kalgoorlie campus, the Wongutha people of the North-Eastern Goldfields.