Semantic Representation of Multimedia Content - Knowledge Representation and Semantic Indexing

[journal]

Full reference

Ph. Mylonas, Th. Athanasiadis, M. Wallace, Y. Avrithis and S. Kollias, Semantic Representation of Multimedia Content - Knowledge Representation and Semantic Indexing, Multimedia Tools and Applications, Springer, Vol. 39, Num. 3, pp. 293-327, 2008

Abstract

In this paper we present a framework for unified, personalized access to heterogeneous multimedia content in distributed repositories. Focusing on semantic analysis of multimedia documents, metadata, user queries and user profiles, it contributes to the bridging of the gap between the semantic nature of user queries and raw multimedia documents. The proposed approach utilizes as input visual content analysis results, as well as analyzes and exploits associated textual annotation, in order to extract the underlying semantics, construct a semantic index and classify documents to topics, based on a unified knowledge and semantics representation model. It may then accept user queries, and, carrying out semantic interpretation and expansion, retrieve documents from the index and rank them according to user preferences, similarly to text retrieval. All processes are based on a novel semantic processing methodology, employing fuzzy algebra and principles of taxonomic knowledge representation. Part I of this work presented in this paper deals with data and knowledge models, manipulation of multimedia content annotations and semantic indexing, while Part II will continue on the use of the extracted semantic information for personalized retrieval.

9 known citations

1. F. Bobillo, Managing Vagueness in Ontologies, PhD Dissertation, Universidad de Granada, 2008
2. Y. Xiaogang, T. Ye, P. Tao, Ch. Canfeng, M. Jian, Semantic-Based Graph Index for Mobile Photo Search, Second International Workshop on Education Technology and Computer Science, vol. 3, pp.193-197, 2010
3. D. Liu, M.-L. Shyu, Ch. Chen, Sh.-Ch. Chen, Integration of global and local information in videos for key frame extraction, IEEE International Conference on Information Reuse and Integration, pp.171-176, 4-6 Aug. 2010
4. D. Beneventano, S. Bergamaschi, C. Gennaro, F. Rabitti, A mediator-based approach for integrating heterogeneous multimedia sources, Multimedia Tools and Applications, vol 55, pp. 1-24, 2011
5. R. Walsh, A. Issa, M. Helpingstine, E-reader Semantic Text Manipulation, Patent US 8365059 B2, 29 Jan. 2013
6. N. Elleuch, A.B. Ammar, A. Alimi, A generic framework for semantic video indexing based on visual concepts/contexts detection, Multimedia Tools and Applications, pp. 1-25, 2014
7. E. Hyvonen, Publishing and Using Cultural Heritage Linked Data on the Semantic Web, in J. Hendler, Y. Ding (eds.) Synthesis Lectures on the Semantic Web: Theory and Technology, Morgan & Claypool, Palo Alto, CA, USA, October 2012
8. Q. Zuo, Y. Wang, Z. Cao, G3M-based multimedia query framework with personalization, Journal of Huazhong University of Science and Technology (Natural Science Edition), vol 38(4), pp. 34-37, 2010
9. Q. Zuo, Z.-S. Cao, Y.-Z. Wang, Q. Zhou, An ontology-based strategy to enhance G3M semantics, Journal of Central South University (Natural Science Edition), vol 41(4), 2010