Over, Paul, Smeaton, Alan F. and Awad, George M. (2008) The TRECVid 2008 BBC rushes summarization evaluation. In: TVS 2008 - TRECVID BBC Rushes Summarization Workshop, Oct 27 - Nov 1 2008, Vancouver, BC, Canada. ISBN 978-1-60558-303-7
Abstract
This paper describes an evaluation of automatic video summarization systems run on rushes from several BBC dramatic series. It was carried out under the auspices of the TREC Video Retrieval Evaluation (TRECVid) as a followup to the 2007 video summarization workshop held at ACM Multimedia 2007. 31 research teams submitted video summaries of 40 individual rushes video files, aiming to compress out redundant and insignificant material. Each summary had a duration of at most 2% of the original. The output of a baseline system, which simply presented
each full video at 50 times normal speed was contributed by Carnegie Mellon University (CMU) as a control. The 2007 procedures for developing ground truth lists of important segments from each video were applied at the National Institute of Standards and Technology (NIST) to the BBC videos. At Dublin City University (DCU) each summary
was judged by 3 humans with respect to how much of the ground truth was included and how well-formed the summary was. Additional objective measures included: how long it took the system to create the summary, how long it took the assessor to judge it against the ground truth, and what the summary's duration was. Assessor agreement on finding
desired segments averaged 81%. Results indicated that while it was still difficult to exceed the performance of the baseline on including ground truth, the baseline was outperformed by most other systems with respect to avoiding redundancy/junk and presenting the summary with a
pleasant tempo/rhythm.
Footnote{Certain commercial entities, equipment, or materials may be identified in this document in order to describe an experimental procedure or concept adequately. Such identification is not intended to imply recommendation or endorsement by the National Institute of Standards, nor is it intended to imply that the entities, materials, or equipment are necessarily the best available for the purpose.}
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Workshop |
Refereed: | Yes |
Additional Information: | Workshop held in conjunction with ACM Multimedia '08 |
Subjects: | Computer Science > Multimedia systems Computer Science > Image processing Computer Science > Digital video |
DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing Research Initiatives and Centres > CLARITY: The Centre for Sensor Web Technologies |
Publisher: | Association for Computing Machinery |
Official URL: | http://www-nlpir.nist.gov/projects/tv8.acmmm/ |
Copyright Information: | © ACM, (2008). This is the author’s version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in Proceedings of Multimedia 2008, Vancouver, BC, Canada, 31 October 2008. ISBN: 978-1-60558-303-7 |
Funders: | Science Foundation Ireland, European Commission under contract FP6-027026 (K-Space) |
ID Code: | 703 |
Deposited On: | 31 Oct 2008 19:10 by Alan Smeaton . Last Modified 19 Jul 2018 14:42 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
319kB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record