Overview
In recent years, network-based music and video streaming content are becoming
popular, using broadband Internet connections as ADSL and CATV become widespread.
Video streaming is expected to be one of the killer applications in this
broadband era. At the same time, due to the spread of portable devices
such as PDAs and especially cellular phones, Internet use with cellular
phones rather than computers is increasing. The next-generation of cellular
phone will be supported video streaming services and the distribution of
video content, based on the demands or profiles of users. Therefore, it
is desirable to create a system that can generate and distribute video
digests according to each user's profile. In this project, we are studying
an authoring system which adds metadata indexes describing the content
to the original video, along with a digest generation system to create
video digests from this metadata and the users' profiles.
Research items
The following figure shows the flow of the video digest generation using
the user profiles. The original video source, such as an MPEG or AVI file,
will be prepared for distribution to portable devices. In order to generate
the video digests, MPEG-7 metadata describing the original video source
is created for the MPEG-4/7 authoring system. This metadata is used as
an index to the content of the original video. At the same time as the
metadata is prepared, an MPEG-4 video file for video digest distribution
is generated. At the other end, in the digest generation part of the system,
the importance of each scene is calculated using the metadata. The relative
importance is affected by the user profile stored on the user's portable
device. The final output is a personalized video digest reflecting each
user's preferences.
Publications
- Journals and Conferences
- T. Echigo, K. Masumitsu, M. Teraguchi, M.
Etoh, and S. Sekiguchi, "Personalized
Delivery of Digest Video Managed on MPEG-7,"
IEEE CS, ITCC-2001, pp. 216-220, 2001.
- R. Radke, P. Ramadge, S. Kulkarni, and T.
Echigo, "Using View Interpolation for
Low Bit-rate Video," IEEE ICIP-2001, Vol. I, pp. 453-456, 2001.
- K. Masumitsu and T. Echigo, "Meta-data Framework for Constructing
Individualized Video Digest," IEEE ICIP-2001, vol. I, pp. 390-393,
2001.
- Ken Masumitsu and Tomio Echigo, "Personalized
Video Summarization using Importance Score,"
Trans. of IEICE, Vol. J84-D-II, No. 8, pp. 1848-1855, 2001,
Aug. in Japanese.
- Masayoshi Teraguchi, Ken Masumitsu, Tomio
Echigo, Shun-ichi Sekiguchi, and Minoru Etoh,
"Personalized Video Digest from Temporal
Weight Generation for Event-based Indexes,"
IEICE, PRMU2001-91, Vol. 101, No. 302, pp. 43-50,
2001, in Japanese.
- Shun-ichi Sekiguchi, Minoru Etoh, Koh-ichi
Emura, Wataru Fujikawa, Ken Masumitsu, and
Tomio Echigo, "Video Digest Viewing
and Authoring Systems based on MPEG-7 Multimedia
Representation" IEICE, PRMU2001-92, Vol. 101, No. 302, pp. 51-58, 2001, in
Japanese.
- Tomio Echigo, "Applications of Video
Processing Technologies for Sports,"
IEICE, Vol. 85, No. 1, pp. 6-9, Jan, 2002, in
Japanese.
- Newspaper articles (in Japanese)
- Nihon Keizai Shinbum, Sep. 19, 2001
- Nihon Sangyo Shinbum, Sep. 19, 2001
- Nikkan Kougyo Shinbum, Sep. 19, 2001
- Dempa Shinbum, Sep. 19, 2001
- Sankei Shinbum, Oct. 12, 2001
- ASCII, Oct. 2001
- Press Releases (in Japanese)
Related information
|