| 1 |
Multimedia event detection using a classifier-specific intermediate representation
|
|
|
|
Abstract:
Multimedia event detection (MED) plays an important role in many applications such as video indexing and retrieval. Current event detection works mainly focus on sports and news event detection or abnormality detection in surveillance videos. Differently, our research aims to detect more complicated and generic events within a longer video sequence. In the past, researchers have proposed using intermediate concept classifiers with concept lexica to help understand the videos. Yet it is difficult to judge how many and what concepts would be sufficient for the particular video analysis task. Additionally, obtaining robust semantic concept classifiers requires a large number of positive training examples, which in turn has high human annotation cost. In this paper, we propose an approach that exploits the external concepts-based videos and event-based videos simultaneously to learn an intermediate representation from video features. Our algorithm integrates the classifier inference and latent intermediate representation into a joint framework. The joint optimization of the intermediate representation and the classifier makes them mutually beneficial and reciprocal. Effectively, the intermediate representation and the classifier are tightly correlated. The classifier dependent intermediate representation not only accurately reflects the task semantics but is also more suitable for the specific classifier. Thus we have created a discriminative semantic analysis framework based on a tightly coupled intermediate representation. Extensive experiments on multimedia event detection using real-world videos demonstrate the effectiveness of the proposed approach.
|
|
Keyword:
1706 Computer Science Applications; 1711 Signal Processing; 2208 Electrical and Electronic Engineering; 2214 Media Technology; Features; Framework; Intermediate representation; Multimedia event detection; p-norm; Video Retrieval
|
|
URL: https://espace.library.uq.edu.au/view/UQ:315397
|
|
BASE
|
|
Hide details
|
|
|
| 4 |
Learning to Identify TV News Monologues by Style and Context
|
|
|
|
In: DTIC (2003)
|
|
BASE
|
|
Show details
|
|
|
| 5 |
Improving Acoustic Models by Watching Television
|
|
|
|
In: DTIC AND NTIS (1998)
|
|
BASE
|
|
Show details
|
|
|
|
|
