Curtin University Homepage
  • Library
  • Help
    • Admin

    espace - Curtin’s institutional repository

    JavaScript is disabled for your browser. Some features of this site may not work without it.
    View Item 
    • espace Home
    • espace
    • Curtin Research Publications
    • View Item
    • espace Home
    • espace
    • Curtin Research Publications
    • View Item

    A multimodal approach to visual thinking: the scientific sketchnote

    Access Status
    Fulltext not available
    Authors
    Fernández-Fontecha, A.
    O halloran, K.
    Tan, Sabine
    Wignell, Peter
    Date
    2018
    Type
    Journal Article
    
    Metadata
    Show full item record
    Citation
    Fernández-Fontecha, A. and O halloran, K. and Tan, S. and Wignell, P. 2018. A multimodal approach to visual thinking: the scientific sketchnote. Visual Communication.
    Source Title
    Visual Communication
    DOI
    10.1177/1470357218759808
    ISSN
    1470-3572
    School
    School of Education
    URI
    http://hdl.handle.net/20.500.11937/67055
    Collection
    • Curtin Research Publications
    Abstract

    © 2018, The Author(s) 2018. There is a growing interest in the use of visual thinking techniques for promoting conceptual thinking in problem solving tasks as well as for reducing the complexity of ideas expressed in scientific and technical formats. The products of visual thinking, such as sketchnotes, graphics and diagrams, consist of ‘multimodal complexes’ that combine language, images, mathematical symbolism and various other semiotic resources. This article adopts a social semiotic perspective, more specifically a Systemic Functional Multimodal Discourse Analysis approach, to study the underlying semiotic mechanisms through which visual thinking makes complex scientific content accessible. To illustrate the approach, the authors analyse the roles of language, images, and mathematical graphs and symbolism in four sketchnotes based on scientific literature in physics. The analysis reveals that through the process of resemiotization, where meanings are transformed from one semiotic system to another, the abstractness of specialized discourses such as physics and mathematics is reduced by multimodal strategies which include reformulating the content in terms of entities which participate in observable (i.e. tangible) processes and enhancing the reader/viewer’s engagement with the text. Moreover, the compositional arrangement creates clear stages in the development of the ideas and arguments that are presented. In this regard, visual thinking is a form of cultural communication through which abstract ideas are translated and explained using a multimodal outline or summary of essential parts by adapting resources (e.g. linguistic resources and mathematical graphs), using new resources (e.g. stick figures and other simple schematic drawings) and maintaining others from the original text (e.g. mathematical symbolic notation), resulting in a congruent (or concrete) depiction of abstract concepts and ideas for a non-specialist audience.

    Related items

    Showing items related by title, author, creator and subject.

    • Intersemiotic Translation as Resemiotisation: A Multimodal Perspective
      Wignell, Peter; O'Halloran, K.; Tan, S. (2016)
      Intersemiotic translation is viewed as the basis of cultural communication through which ideas are circulated, translated and explained using language, images and other semiotic resources. From this perspective, intersemiotic ...
    • The Language of Learning Mathematics: A Multimodal Perspective
      O'Halloran, Kay (2015)
      The aim is to develop a multimodal (i.e. multisemiotic) approach to the mathematics register, where language is considered as one resource, often a secondary one, which operates in conjunction with mathematical symbolism ...
    • ELL’s science meaning making in multimodal inquiry: a case-study in a Hong Kong bilingual school
      Williams, Melanie; Tang, Kok-Sing; Won, Mihye (2019)
      This paper reports on a multimodal teaching approach delivered to grade 5 elementary students in a bilingual school in Hong Kong, as part of a larger research study aimed at supporting English Language Learners (ELLs) in ...
    Advanced search

    Browse

    Communities & CollectionsIssue DateAuthorTitleSubjectDocument TypeThis CollectionIssue DateAuthorTitleSubjectDocument Type

    My Account

    Admin

    Statistics

    Most Popular ItemsStatistics by CountryMost Popular Authors

    Follow Curtin

    • 
    • 
    • 
    • 
    • 

    CRICOS Provider Code: 00301JABN: 99 143 842 569TEQSA: PRV12158

    Copyright | Disclaimer | Privacy statement | Accessibility

    Curtin would like to pay respect to the Aboriginal and Torres Strait Islander members of our community by acknowledging the traditional owners of the land on which the Perth campus is located, the Whadjuk people of the Nyungar Nation; and on our Kalgoorlie campus, the Wongutha people of the North-Eastern Goldfields.