Curtin University Homepage
  • Library
  • Help
    • Admin

    espace - Curtin’s institutional repository

    JavaScript is disabled for your browser. Some features of this site may not work without it.
    View Item 
    • espace Home
    • espace
    • Curtin Research Publications
    • View Item
    • espace Home
    • espace
    • Curtin Research Publications
    • View Item

    Learning Clip Representations for Skeleton-Based 3D Action Recognition

    Access Status
    Fulltext not available
    Authors
    Ke, Q.
    Bennamoun, M.
    An, Senjian
    Sohel, F.
    Boussaid, F.
    Date
    2018
    Type
    Journal Article
    
    Metadata
    Show full item record
    Citation
    Ke, Q. and Bennamoun, M. and An, S. and Sohel, F. and Boussaid, F. 2018. Learning Clip Representations for Skeleton-Based 3D Action Recognition. IEEE Transactions on Image Processing. 27 (6): pp. 2842-2855.
    Source Title
    IEEE Transactions on Image Processing
    DOI
    10.1109/TIP.2018.2812099
    ISSN
    1057-7149
    School
    School of Electrical Engineering, Computing and Mathematical Science (EECMS)
    URI
    http://hdl.handle.net/20.500.11937/70054
    Collection
    • Curtin Research Publications
    Abstract

    This paper presents a new representation of skeleton sequences for 3D action recognition. Existing methods based on hand-crafted features or recurrent neural networks cannot adequately capture the complex spatial structures and the long-term temporal dynamics of the skeleton sequences, which are very important to recognize the actions. In this paper, we propose to transform each channel of the 3D coordinates of a skeleton sequence into a clip. Each frame of the generated clip represents the temporal information of the entire skeleton sequence and one particular spatial relationship between the skeleton joints. The entire clip incorporates multiple frames with different spatial relationships, which provide useful spatial structural information of the human skeleton. We also propose a multitask convolutional neural network (MTCNN) to learn the generated clips for action recognition. The proposed MTCNN processes all the frames of the generated clips in parallel to explore the spatial and temporal information of the skeleton sequences. The proposed method has been extensively tested on six challenging benchmark datasets. Experimental results consistently demonstrate the superiority of the proposed clip representation and the feature learning method for 3D action recognition compared to the existing techniques.

    Related items

    Showing items related by title, author, creator and subject.

    • A new representation of skeleton sequences for 3D action recognition
      Ke, Q.; Bennamoun, M.; An, Senjian; Sohel, F.; Boussaid, F. (2017)
      © 2017 IEEE. This paper presents a new method for 3D action recognition with skeleton sequences (i.e., 3D trajectories of human skeleton joints). The proposed method first transforms each skeleton sequence into three clips ...
    • SkeletonNet: Mining Deep Part Features for 3-D Action Recognition
      Ke, Q.; An, Senjian; Bennamoun, M.; Sohel, F.; Boussaid, F. (2017)
      This letter presents SkeletonNet, a deep learning framework for skeleton-based 3-D action recognition. Given a skeleton sequence, the spatial structure of the skeleton joints in each frame and the temporal information ...
    • A smith-waterman local sequence alignment approach to spatial activity recognition
      Riedel, Daniel; Venkatesh, Svetha; Liu, Wan-Quan (2006)
      In this paper we address the spatial activity recognition problem with an algorithm based on Smith-Waterman (SW) local alignment. The proposed SW approach utilises dynamic programming with two dimensional spatial data to ...
    Advanced search

    Browse

    Communities & CollectionsIssue DateAuthorTitleSubjectDocument TypeThis CollectionIssue DateAuthorTitleSubjectDocument Type

    My Account

    Admin

    Statistics

    Most Popular ItemsStatistics by CountryMost Popular Authors

    Follow Curtin

    • 
    • 
    • 
    • 
    • 

    CRICOS Provider Code: 00301JABN: 99 143 842 569TEQSA: PRV12158

    Copyright | Disclaimer | Privacy statement | Accessibility

    Curtin would like to pay respect to the Aboriginal and Torres Strait Islander members of our community by acknowledging the traditional owners of the land on which the Perth campus is located, the Whadjuk people of the Nyungar Nation; and on our Kalgoorlie campus, the Wongutha people of the North-Eastern Goldfields.