Curtin University Homepage
  • Library
  • Help
    • Admin

    espace - Curtin’s institutional repository

    JavaScript is disabled for your browser. Some features of this site may not work without it.
    View Item 
    • espace Home
    • espace
    • Curtin Research Publications
    • View Item
    • espace Home
    • espace
    • Curtin Research Publications
    • View Item

    Inter-rater Agreement Between Exposure Assessment Using Automatic Algorithms and Using Experts.

    Access Status
    Fulltext not available
    Authors
    Florath, I.
    Glass, D.
    Rhazi, M.
    Parent, M.
    Fritschi, Lin
    Date
    2018
    Type
    Journal Article
    
    Metadata
    Show full item record
    Citation
    Florath, I. and Glass, D. and Rhazi, M. and Parent, M. and Fritschi, L. 2018. Inter-rater Agreement Between Exposure Assessment Using Automatic Algorithms and Using Experts.. Annals of work exposures and health.
    Source Title
    Annals of work exposures and health
    DOI
    10.1093/annweh/wxy084
    ISSN
    2398-7316
    School
    School of Public Health
    URI
    http://hdl.handle.net/20.500.11937/70956
    Collection
    • Curtin Research Publications
    Abstract

    Objectives: To estimate the inter-rater agreement between exposure assessment to asthmagens in current jobs by algorithms based on task-based questionnaires (OccIDEAS) and by experts. Methods: Participants in a cross-sectional national survey of exposure to asthmagens (AWES-Asthma) were randomly split into two subcohorts of equal size. Subcohort 1 was used to determine the most common asthmagen groups and occupational groups. From subcohort 2, a random sample of 200 participants was drawn and current occupational exposure (yes/no) was assessed in these by OccIDEAS and by two experts independently and then as a consensus. Inter-rater agreement was estimated using Cohen's Kappa coefficient. The null hypothesis was set at 0.4, because both the experts and the automatic algorithm assessed the exposure using the same task-based questionnaires and therefore an agreement better than by chance would be expected. Results: The Kappa coefficients for the agreement between the experts and the algorithm-based assessments ranged from 0.37 to 1, while the agreement between the two experts ranged from 0.29 to 0.94, depending on the agent being assessed. After discussion by both experts the Kappa coefficients for the consensus decision and OccIDEAS were significantly larger than 0.4 for 7 of the 10 asthmagen groups, while overall the inter-rater agreement was greater than by chance (P < 0.0001). Conclusions: The web-based application OccIDEAS is an appropriate tool for automated assessment of current exposure to asthmagens (yes/no), and requires less time-consuming work by highly-qualified research personnel than the traditional expert-based method. Further, it can learn and reuse expert determinations in future studies.

    Related items

    Showing items related by title, author, creator and subject.

    • Validity of an automated algorithm to identify waking and in-bed wear time in hip-worn accelerometer data collected with a 24 h wear protocol in young adults
      McVeigh, Joanne; Winkler, E.; Healy, Genevieve; Slater, J.; Eastwood, Peter; Straker, Leon (2016)
      Researchers are increasingly using 24 h accelerometer wear protocols. No automated method has been published that accurately distinguishes 'waking' wear time from other data ('in-bed', non-wear, invalid days) in young ...
    • Low back related leg pain: development and preliminary validation of a new classification system
      Schäfer, Axel (2009)
      Background summary. Leg pain is a common complaint in relation to low back pain (LBP), present in up to 65% of all patients with LBP. Radiating leg pain is an important predictor for chronicity of LBP and an indicator of ...
    • The clinical utility of pain classification in non-specific arm pain
      Moloney, N.; Hall, Toby; Leaver, A.; Doody, C. (2015)
      Mechanisms-based pain classification has received considerable attention recently for its potential use in clinical decision making. A number of algorithms for pain classification have been proposed. Non-specific arm pain ...
    Advanced search

    Browse

    Communities & CollectionsIssue DateAuthorTitleSubjectDocument TypeThis CollectionIssue DateAuthorTitleSubjectDocument Type

    My Account

    Admin

    Statistics

    Most Popular ItemsStatistics by CountryMost Popular Authors

    Follow Curtin

    • 
    • 
    • 
    • 
    • 

    CRICOS Provider Code: 00301JABN: 99 143 842 569TEQSA: PRV12158

    Copyright | Disclaimer | Privacy statement | Accessibility

    Curtin would like to pay respect to the Aboriginal and Torres Strait Islander members of our community by acknowledging the traditional owners of the land on which the Perth campus is located, the Whadjuk people of the Nyungar Nation; and on our Kalgoorlie campus, the Wongutha people of the North-Eastern Goldfields.