Aly, R.B.N. and Hiemstra, D. and de Vries, A.P. and de Jong, F.M.G.
A Probabilistic Ranking Framework using Unobservable Binary Events for Video Search.
In: Proceedings of the 7th ACM International Conference on Content-based Image and Video Retrieval, 7-9 July 2008, Niagara Falls.
Full text available as:
PDF - Univ. of Twente only
Official URL: http://doi.acm.org/10.1145/1386352.1386398
Recent content-based video retrieval systems combine output of
concept detectors (also known as high-level features) with text
obtained through automatic speech recognition. This paper concerns
the problem of search using the noisy concept detector output only.
Unlike term occurrence in text documents, the event of the
occurrence of an audiovisual concept is only indirectly observable.
We develop a probabilistic ranking framework for unobservable binary
events to search in videos, called PR-FUBE. The framework
explicitly models the probability of relevance of a video shot
through the presence and absence of concepts. From our
framework, we derive a ranking formula and show its relationship to
previously proposed formulas. We evaluate our framework against two
other retrieval approaches using the TRECVID 2005 and 2007 datasets.
Especially using large numbers of concepts in retrieval results in
good performance. We attribute the observed robustness against the
noise introduced by less related concepts to the effective
combination of concept presence and absence in our method. The
experiments show that an accurate estimate for the probability of
occurrence of a particular concept in relevant shots is crucial to
obtain effective retrieval results.
|Item Type:||Conference or Workshop Paper (Full Paper, Poster)|
|Research Group:||EWI-DB: Databases, EWI-HMI: Human Media Interaction|
|Research Program:||CTIT-NICE: Natural Interaction in Computer-mediated Environments|
|Additional Information:||accepted for publication.|
|Deposited On:||20 July 2008|
Export this item as:
To request a copy of the PDF please email us request copy
To correct this item please ask your editor
Repository Staff Only: edit this item