The ASKAP/EMU Source Finding Data Challenge

Abstract

The Evolutionary Map of the Universe (EMU) is a proposed radio continuum survey of the Southern Hemisphere up to declination + 30°, with the Australian Square Kilometre Array Pathfinder (ASKAP). EMU will use an automated source identification and measurement approach that is demonstrably optimal, to maximise the reliability and robustness of the resulting radio source catalogues. As a step toward this goal we conducted a “Data Challenge” to test a variety of source finders on simulated images. The aim is to quantify the accuracy and limitations of existing automated source finding and measurement approaches. The Challenge initiators also tested the current ASKAPsoft source-finding tool to establish how it could benefit from incorporating successful features of the other tools. As expected, most finders show completeness around 100% at ≈ 10σ dropping to about 10% by ≈ 5σ. Reliability is typically close to 100% at ≈ 10σ, with performance to lower sensitivities varying between finders. All finders show the expected trade-off, where a high completeness at low signal-to-noise gives a corresponding reduction in reliability, and vice versa. We conclude with a series of recommendations for improving the performance of the ASKAPsoft source-finding tool.