return to curriculum vitae
  

Multimodal Surrogates for Video Browsing

[Full Text PDF]

Wei Ding
College of Info. Studies
University of Maryland
College Park, MD 20742
1-202-623-7038
weid@glue.umd.edu
Gary Marchionini
School of Info. & Library Science
University of North Carolina
Chapel Hill, NC 27599-3360
1-919-966-3611
march@ils.unc.edu
Dagobert Soergel
College of Info. Studies
University of Maryland
College Park, MD 20742
1-301-405-2037
ds52@umail.umd.edu
Abstract
Three types of video surrogates - visual (key-frames), verbal (keywords/phrases), and visual and verbal - were designed and studied in a qualitative investigation of user cognitive processes. The results favor the combined surrogates in which verbal information and images reinforce each other, lead to better comprehension, and may actually require less processing time. The results also highlight image features users found most helpful. These findings will inform the interface design and video representation for video retrieval and browsing.

Keywords: Multimedia information systems, abstracting methods, multimodal video surrogates, browsing, cognitive processes
top of page