EEMCS

Home > Publications
Home University of Twente
Education
Research
Prospective Students
Jobs
Publications
Intranet (internal)
 
 Nederlands
 Contact
 Search
 Organisation

EEMCS EPrints Service


25893 Average Precision: Good Guide or False Friend to Multimedia Search Effectiveness?
Home Policy Brochure Browse Search User Area Contact Help

Aly, R.B.N. and Trieschnigg, R.B. and McGuinness, K. and O' Connor, N.E. and de Jong, F.M.G. (2014) Average Precision: Good Guide or False Friend to Multimedia Search Effectiveness? In: Proceedings of the 20th Anniversary International Conference on MultiMedia Modelling, MMM 2014, Part II, 6-10 Jan 2014, Dublin, Ireland. pp. 239-250. Lecture Notes in Computer Science 8326. Springer Verlag. ISSN 0302-9743 ISBN 978-3-319-04116-2

Full text available as:

PDF

339 Kb
Open Access



Official URL: http://dx.doi.org/10.1007/978-3-319-04117-9_22

Exported to Metis

Abstract

Approaches to multimedia search often evolve from existing approaches with strong average precision. However, work on search evaluation shows that average precision does not always capture effectiveness in terms of satisfying user needs because it ignores the diversity of search results. This paper investigates whether search approaches with diverse results have been neglected within the multimedia retrieval research agenda due the fact that they are overshadowed by search approaches with strong average precision. To this end, we compare 361 search approaches applied on the TrecVid benchmarks between 2005 and 2007. We motivate two criteria based on measure correlation and statistical equivalence to estimate whether search approaches with diverse results have been neglected. We show that hypothesized effect indeed occurs in the above examined collections. As a consequence, the research community would benefit from reconsidering existing approaches in the light of diversity.

Item Type:Conference or Workshop Paper (Full Paper, Talk)
Research Group:EWI-DB: Databases, EWI-HMI: Human Media Interaction
Research Program:CTIT-NICE: Natural Interaction in Computer-mediated Environments
Research Project:AXES: Acces To Audiovisual Archives, FACT: Folktales As Classifiable Texts
ID Code:25893
Status:Published
Deposited On:19 March 2015
Refereed:Yes
International:Yes
More Information:statisticsmetis

Export this item as:

To correct this item please ask your editor

Repository Staff Only: edit this item