Curtin University Homepage
  • Library
  • Help
    • Admin

    espace - Curtin’s institutional repository

    JavaScript is disabled for your browser. Some features of this site may not work without it.
    View Item 
    • espace Home
    • espace
    • Curtin Research Publications
    • View Item
    • espace Home
    • espace
    • Curtin Research Publications
    • View Item

    RS-YABI: A workflow system for Remote Sensing Processing in AusCover

    Access Status
    Fulltext not available
    Authors
    Wang, Z.
    King, E.
    Smith, G.
    Bellgard, M.
    Broomhall, M.
    Chedzey, H.
    Fearns, P.
    Garcia, R.
    Hunter, A.
    Lynch, Mervyn
    Shibeci, D.
    Date
    2011
    Type
    Conference Paper
    
    Metadata
    Show full item record
    Citation
    Wang, Z. and King, E. and Smith, G. and Bellgard, M. and Broomhall, M. and Chedzey, H. and Fearns, P. et al. 2011. RS-YABI: A workflow system for Remote Sensing Processing in AusCover, in Proceedings of the 19th International Congress on Modelling and Simulation, Dec 12-16 2011, pp. 1167-1173. Perth, WA. MODISM.
    Source Title
    MODSIM 2011 - 19th International Congress on Modelling and Simulation - Sustaining Our Future: Understanding and Living with Uncertainty
    ISBN
    9780987214317
    School
    Department of Physics and Astronomy
    URI
    http://hdl.handle.net/20.500.11937/37974
    Collection
    • Curtin Research Publications
    Abstract

    Earth observation from space involves accessing, sharing, and processing huge volumes of data collected from satellite sensors. It is crucial for users to easily analyze and process the datasets, which may require complex computation on very high volume datasets, particularly for large-scale spatio-temporal analysis. Generation of data products, access to, analysis and visualization of these large datasets is often perceived as a highly technical and daunting set of complex steps. In this context, a workflow application can help users to manage and process large volumes of satellite data and execute scientific experiments on distributed resources. This paper reports our work on utilizing a workflow engine (RS-YABI) that works with data from Moderate Resolution Imaging Spectroradiometer (MODIS) sensors and enables researchers to process datasets using High Performance Computing (HPC) resources. The benefits of this approach include abstracting the complexity of the underlying processing environment and easy processing of raw satellite data to generate derived data products in standard formats. We start with providing an overview of AusCover, a facility of the Terrestrial Ecosystem Research Network (TERN), as the application context of our work. It provides a national expert network and a data delivery service for provision of Australian biophysical remote sensing data time-series, continental-scale map products, and selected high-resolution datasets over Terrestrial sites. AusCover supports a nationally consistent approach to the delivery and calibration/validation of key current and future core satellite-derived datasets. Some background of workflows and remote sensing data processing is described next. In our context, using a workflow for processing remote sensing data offers several advantages, such as (a) the ability to design an operational process by leveraging existing application modules, (d) utilizing distributed resources to increase throughput or reduce execution costs, (c) obtaining specific processing capabilities as required by users, and (d) hiding technical complexity behind a straightforward user interface. It is followed by the description of YABI, a workflow engine developed at Murdoch University, Australia, originally for use in a bio-informatics context supporting linear workflows similar to those used in remote sensing processing. It provides a flexible mechanism for joining independent executables through wrappers that can be implemented in virtually any language. Examples of ongoing work on the development of wrapping scripts for customizing specific remote sensing operations, orchestrating multiple modules and simplifying user input choices are described. One of YABI's key features is its abstraction of the backend HPC resources such as file stores and execution engines which makes it ideal for use in a distributed data system such as that developed by AusCover. YABI has been deployed as RS-YABI (for Remote Sensing) on HPC resources in the National Computational Infrastructure (NCI). The RS-YABI instance is deployed on a Virtual Machine (VM), which provides a self-contained environment independent of the HPC system. Multiple workflows for processing MODIS sensor data have already been successfully developed. We also present two brief case studies to demonstrate the applicability of RS-YABI in practical application areas such as dust detection, surface temperatures (land and ocean) monitoring, and smoke plume detection. We conclude the paper with a list of future research directions.

    Related items

    Showing items related by title, author, creator and subject.

    • Multiscale remote sensing for assessment of environmental change in the rural-urban fringe.
      Wright, Graeme L. (2000)
      The objective of this study was to investigate the application of multiscale satellite remote sensing data for assessment of land cover change in the rural-urban fringe. Inherent in this assessment process was the ...
    • Environmental Monitoring using GNSS - Global Navigation Satellite Systems
      Awange, Joseph (2012)
      Global Navigation Satellite Systems (GNSS) are revolutionizing the world in a way their original developers never envisaged. From being military “war” tools, GNSS satellites are rapidly becoming “peace” tools that play ...
    • Fractals and fuzzy sets for modelling the heterogenity and spatial complexity of urban landscapes using multiscale remote sensing data
      Islam, Zahurul (2004)
      This research presents models for the analysis of textural and contextual information content of multiscale remote sensing to select an appropriate scale for the correct interpretation and mapping of heterogeneous urban ...
    Advanced search

    Browse

    Communities & CollectionsIssue DateAuthorTitleSubjectDocument TypeThis CollectionIssue DateAuthorTitleSubjectDocument Type

    My Account

    Admin

    Statistics

    Most Popular ItemsStatistics by CountryMost Popular Authors

    Follow Curtin

    • 
    • 
    • 
    • 
    • 

    CRICOS Provider Code: 00301JABN: 99 143 842 569TEQSA: PRV12158

    Copyright | Disclaimer | Privacy statement | Accessibility

    Curtin would like to pay respect to the Aboriginal and Torres Strait Islander members of our community by acknowledging the traditional owners of the land on which the Perth campus is located, the Whadjuk people of the Nyungar Nation; and on our Kalgoorlie campus, the Wongutha people of the North-Eastern Goldfields.