Layered evaluation in recommender systems: A retrospective assessment
MetadataShow full item record
Evaluation of recommender systems has only lately started to become more systematic, since the emphasis has long been on the experimental evaluation of algorithmic performance. Recent studies have proposed adopting a layered evaluation approach, according to which recommender systems may be decomposed into several components, evaluating each of them separately. Nevertheless, there are still no evaluation studies of recommender systems that apply a layered evaluation framework to explore how all the different components or layers of such a system may be assessed. This paper introduces layered evaluation and examines how a previously proposed layered evaluation framework for adaptive systems can be applied in the case of recommender systems. It presents the possible adaptation of this layered framework that may fit the interaction components of recommender systems. Then, it focuses on a specific recommender system and carries out a retrospective analysis of its past evaluation results under the new prism that the layered evaluation approach brings. Our analysis indicates that implementing a layeredbased evaluation of recommender systems has the potential to facilitate a more detailed and informed evaluation of such systems, allowing researchers and developers to better understand how to improve them.
Showing items related by title, author, creator and subject.
Determining the effectiveness of inelastic short stretch bandages in sustaining sub-bandage graduated compressionHowse, Elizabeth (2011)The aim of this study was to determine whether sub-bandage graduated compression of 30-40mmHg at the ankle was sustained and comfortable when wearing inelastic short stretch bandage systems over a 72 hour bandage wear ...
Shiyab, Adnan M S H (2007)This study aimed at investigating the current practices and methods adopted by roads agencies around the world with regard to collection, analysis and utilization of the data elements pertaining to the main pavement ...
Manouselis, N.; Karagiannidis, C.; Sampson, Demetrios (2014)© 2014 IEEE. This paper examines how a layered evaluation framework proposed for adaptive systems (AS) can be applied in the case of recommender systems (RecSys). Our analysis indicates that implementing a layered-based ...