Investigating retesting effects in a personnel selection context

Abstract

Repeat applicants to a fire-fighter position undertook the same cognitive ability and situational judgment tests on multiple occasions and the resultant practice effects were investigated. Practice effects of approximately two fifths of a standard deviation were observed between Times 1 and 2 on timed tests of Abstract Reasoning and Mechanical Comprehension. Smaller practice effects were observed, however, on a timed test of numerical comprehension ability and the untimed Teamwork Knowledge Skills and Abilities situational judgment test. For all four tests, the additional practice effect observed at Time 3 were smaller and nonsignificant; a result supplemented by latent growth curve analyses.