TRL
TOP PAGETokyo Research LaboratoryEmploymentProjectsRelated InformationIBM Research
Japanese page is here.

Personalized video digest


Overview

In recent years, network-based music and video streaming content are becoming popular, using broadband Internet connections as ADSL and CATV become widespread. Video streaming is expected to be one of the killer applications in this broadband era. At the same time, due to the spread of portable devices such as PDAs and especially cellular phones, Internet use with cellular phones rather than computers is increasing. The next-generation of cellular phone will be supported video streaming services and the distribution of video content, based on the demands or profiles of users. Therefore, it is desirable to create a system that can generate and distribute video digests according to each user's profile. In this project, we are studying an authoring system which adds metadata indexes describing the content to the original video, along with a digest generation system to create video digests from this metadata and the users' profiles.

Research items

The following figure shows the flow of the video digest generation using the user profiles. The original video source, such as an MPEG or AVI file, will be prepared for distribution to portable devices. In order to generate the video digests, MPEG-7 metadata describing the original video source is created for the MPEG-4/7 authoring system. This metadata is used as an index to the content of the original video. At the same time as the metadata is prepared, an MPEG-4 video file for video digest distribution is generated. At the other end, in the digest generation part of the system, the importance of each scene is calculated using the metadata. The relative importance is affected by the user profile stored on the user's portable device. The final output is a personalized video digest reflecting each user's preferences.

Video Digest Delivery System

Publications
  • Journals and Conferences
    1. T. Echigo, K. Masumitsu, M. Teraguchi, M. Etoh, and S. Sekiguchi, "Personalized Delivery of Digest Video Managed on MPEG-7," IEEE CS, ITCC-2001, pp. 216-220, 2001.
    2. R. Radke, P. Ramadge, S. Kulkarni, and T. Echigo, "Using View Interpolation for Low Bit-rate Video," IEEE ICIP-2001, Vol. I, pp. 453-456, 2001.
    3. K. Masumitsu and T. Echigo, "Meta-data Framework for Constructing Individualized Video Digest," IEEE ICIP-2001, vol. I, pp. 390-393, 2001.
    4. Ken Masumitsu and Tomio Echigo, "Personalized Video Summarization using Importance Score," Trans. of IEICE, Vol. J84-D-II, No. 8, pp. 1848-1855, 2001, Aug. in Japanese.
    5. Masayoshi Teraguchi, Ken Masumitsu, Tomio Echigo, Shun-ichi Sekiguchi, and Minoru Etoh, "Personalized Video Digest from Temporal Weight Generation for Event-based Indexes," IEICE, PRMU2001-91, Vol. 101, No. 302, pp. 43-50, 2001, in Japanese.
    6. Shun-ichi Sekiguchi, Minoru Etoh, Koh-ichi Emura, Wataru Fujikawa, Ken Masumitsu, and Tomio Echigo, "Video Digest Viewing and Authoring Systems based on MPEG-7 Multimedia Representation" IEICE, PRMU2001-92, Vol. 101, No. 302, pp. 51-58, 2001, in Japanese.
    7. Tomio Echigo, "Applications of Video Processing Technologies for Sports," IEICE, Vol. 85, No. 1, pp. 6-9, Jan, 2002, in Japanese.

  • Newspaper articles (in Japanese)
    1. Nihon Keizai Shinbum, Sep. 19, 2001
    2. Nihon Sangyo Shinbum, Sep. 19, 2001
    3. Nikkan Kougyo Shinbum, Sep. 19, 2001
    4. Dempa Shinbum, Sep. 19, 2001
    5. Sankei Shinbum, Oct. 12, 2001
    6. ASCII, Oct. 2001

  • Press Releases (in Japanese)
Related information


Research home IBM home Order Privacy Legal Contact IBM
Last modified 26 Feb. 2002