2 |
Rethinking summarization and storytelling for modern social multimedia
|
|
|
|
In: Rudinac, Stevan, Chua, Tat-Seng, Diaz-Ferreyra, Nicolas, Friedland, Gerald, Gornostaja, Tatjana, Huet, Benoit, Kaptein, Rianne, Lindén, Krister, Moens, Marie-Francine, Peltonen, Jaakko, Redi, Miriam, Schedl, Markus, Shamma, David A, Smeaton, Alan F. orcid:0000-0003-1028-8389 and Xie, Lexing (2018) Rethinking summarization and storytelling for modern social multimedia. In: The 24th International Conference on Multimedia Modeling (MMM2018), 5-7 Feb, 2018, Bangkok, Thailand. ISBN 978-3-319-73599-3 (2018)
|
|
BASE
|
|
Show details
|
|
4 |
SemStyle: Learning to Generate Stylised Image Captions using Unaligned Text ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
An interactive spiral tape video summarization
|
|
|
|
In: IEEE Transactions on Multimedia (2017)
|
|
BASE
|
|
Show details
|
|
6 |
Studying Object Naming with Online Photos and Caption
|
|
|
|
In: Studying Object Naming with Online Photos and Caption (2016)
|
|
BASE
|
|
Show details
|
|
7 |
Studying Object Naming with Online Photos and Caption
|
|
|
|
In: Studying Object Naming with Online Photos and Caption (2016)
|
|
BASE
|
|
Show details
|
|
8 |
Multi-Concept Learning With Large-Scale Multimedia Lexicons
|
|
|
|
In: Proceedings of 2nd International Conference on Information Processing (ICIP 2008) (2015)
|
|
BASE
|
|
Show details
|
|
9 |
Multi-Concept Learning With Large-Scale Multimedia Lexicons
|
|
|
|
In: Proceedings of 2nd International Conference on Information Processing (ICIP 2008) (2015)
|
|
BASE
|
|
Show details
|
|
10 |
Bilateral correspondence model for words-and-pictures association in multimedia-rich microblogs
|
|
|
|
In: ACM Transactions on Multimedia Computing, Communications and Applications (2015)
|
|
Abstract:
Nowadays, the amount of multimedia contents in microblogs is growing significantly. More than 20% of microblogs link to a picture or video in certain large systems. The rich semantics in microblogs provides an opportunity to endow images with higher-level semantics beyond object labels. However, this raises new challenges for understanding the association between multimodal multimedia contents in multimedia-rich microblogs. Disobeying the fundamental assumptions of traditional annotation, tagging, and retrieval systems, pictures and words in multimedia-rich microblogs are loosely associated and a correspondence between pictures and words cannot be established. To address the aforementioned challenges, we present the first study analyzing and modeling the associations between multimodal contents in microblog streams, aiming to discover multimodal topics from microblogs by establishing correspondences between pictures and words in microblogs. We first use a data-driven approach to analyze the new characteristics of the words, pictures, and their association types in microblogs. We then propose a novel generative model called the Bilateral Correspondence Latent Dirichlet Allocation (BC-LDA) model. Our BC-LDA model can assign flexible associations between pictures and words and is able to not only allow picture-word co-occurrence with bilateral directions, but also single modal association. This flexible association can best fit the data distribution, so that the model can discover various types of joint topics and generate pictures and words with the topics accordingly. We evaluate this model extensively on a large-scale real multimedia-rich microblogs dataset.We demonstrate the advantages of the proposed model in several application scenarios, including image tagging, text illustration, and topic discovery. The experimental results demonstrate that our.
|
|
URL: https://doi.org/10.1145/2611388 http://hdl.handle.net/1885/74937
|
|
BASE
|
|
Hide details
|
|
11 |
Bilateral correspondence model for words-and-pictures association in multimedia-rich microblogs
|
|
|
|
In: ACM Transactions on Multimedia Computing, Communications and Applications (2015)
|
|
BASE
|
|
Show details
|
|
|
|