Curtin University Homepage
  • Library
  • Help
    • Admin

    espace - Curtin’s institutional repository

    JavaScript is disabled for your browser. Some features of this site may not work without it.
    View Item 
    • espace Home
    • espace
    • Curtin Research Publications
    • View Item
    • espace Home
    • espace
    • Curtin Research Publications
    • View Item

    Representing emotive meaning in visual images: A social semiotic approach

    Access Status
    Fulltext not available
    Authors
    Feng, D.
    O'Halloran, Kay
    Date
    2012
    Type
    Journal Article
    
    Metadata
    Show full item record
    Citation
    Feng, D. and O'Halloran, K. 2012. Representing emotive meaning in visual images: A social semiotic approach. Journal of Pragmatics. 44: pp. 2067-2084.
    Source Title
    Journal of Pragmatics
    DOI
    10.1016/j.pragma.2012.10.003
    ISSN
    03782166
    URI
    http://hdl.handle.net/20.500.11937/35200
    Collection
    • Curtin Research Publications
    Abstract

    This study examines how emotive meaning is represented in visual images using the semiotic resources of facial expression, touch and body orientation. Complementing the cognitive metaphorical interpretation, the visually represented emotive behaviors are theorized as partial iconic representations of real life behaviors, which are in turn indexes of emotion. Adopting a social semiotic approach, this paper formulates facial expression, touch, and body orientation as inter-related systems of meaning, the selection and combination of which constitutes a systemic functional “lexico-grammar” for analyzing and interpreting meaning making in visual imagery. The systems are then used to explain how emotive meanings are represented in comic books. The analysis shows that cartoonists’ systemic choices for representing emotions are largely consistent with the coding accuracy of facial behaviors on the one hand, and style guidelines advocated in comic handbooks on the other. Through the examination of both American and Japanese comics, it is demonstrated that the social semiotic lexico-grammatical approach is not only effective in explaining the emotion resources in nonverbal behavior, but also useful for investigating cultural differences in the visual depiction of emotion. The systemic choices also provide artists with a framework to “design” emotion in creative visual media such as comics, and possibly in computer vision, game design and related domains.

    Related items

    Showing items related by title, author, creator and subject.

    • The multimodal representation of emotion in film: Integrating cognitive and semiotic approaches
      Feng, D.; O'Halloran, Kay (2013)
      This study provides a semiotic theorization of how emotion is represented in film to complement the cognitive approach, which focuses on how film elicits emotion from viewers. Drawing upon social semiotic theories and ...
    • A multimodal approach to visual thinking: the scientific sketchnote
      Fernández-Fontecha, A.; O halloran, K.; Tan, Sabine; Wignell, Peter (2018)
      © 2018, The Author(s) 2018. There is a growing interest in the use of visual thinking techniques for promoting conceptual thinking in problem solving tasks as well as for reducing the complexity of ideas expressed in ...
    • Intersemiotic Translation as Resemiotisation: A Multimodal Perspective
      Wignell, Peter; O'Halloran, K.; Tan, S. (2016)
      Intersemiotic translation is viewed as the basis of cultural communication through which ideas are circulated, translated and explained using language, images and other semiotic resources. From this perspective, intersemiotic ...
    Advanced search

    Browse

    Communities & CollectionsIssue DateAuthorTitleSubjectDocument TypeThis CollectionIssue DateAuthorTitleSubjectDocument Type

    My Account

    Admin

    Statistics

    Most Popular ItemsStatistics by CountryMost Popular Authors

    Follow Curtin

    • 
    • 
    • 
    • 
    • 

    CRICOS Provider Code: 00301JABN: 99 143 842 569TEQSA: PRV12158

    Copyright | Disclaimer | Privacy statement | Accessibility

    Curtin would like to pay respect to the Aboriginal and Torres Strait Islander members of our community by acknowledging the traditional owners of the land on which the Perth campus is located, the Whadjuk people of the Nyungar Nation; and on our Kalgoorlie campus, the Wongutha people of the North-Eastern Goldfields.