Photo
Video Semantic Summarization Systems

An MPEG system layer compressed-domain editing technique is proposed to facilitate the delivery and integration of multiple segments of MPEG files, residing on remote databases.  Various multimedia applications, including retrieval and summarization, split MPEG files into small segments along shot boundaries and store them separately. This traditional method requires extra management and storage payload, provides only fixed segmentations, and may not be play smoothly. In order to solve this problem, our MPEG system-domain editing tool   directly extracts video-audio information from the original MPEG sources and combines them to generate a single MPEG file. Manipulated wholly in the system bitstream domain, this method does not require decoding, re-encoding, and re-synchronization of audio and video data. Thus, it operates in real-time and provides great flexibility.  This composite MPEG file can be transmitted and displayed through general Web interfaces. The proposed method is applied to our video retrieval, video summarization, and video editing systems, and has shown its great advantages. 

 

VideoEd

Figure 1: A basic structure of the system compressed -domain editing tool.


Our contribution in this paper is the new method for accessing sub-contents of remote multimedia databases. It solved many practical application problems by using a novel MPEG system layer compressed-domain editing tool. It has been deployed in many of our multimedia application system.
Preliminary results have shown the effectiveness and great advantages of the proposed method. Our future direction will focus more on the mathematical analysis of the system.

VideoEd VideoEd

Figure 2: Application of compressed-domain editing tool for video semantic summarization
(a) User Interface; (b) Retrieval Result