Vidmento: Creating Video Stories through Context-Aware Expansion with Generative Video
Catherine Yeha, Anh Truongb, Mira Dontchevac, Bryan K. Wangc
- aHarvard University, Boston, MA, USA
- bAdobe Research, New York, NY, USA
- cAdobe Research, Seattle, WA, USA
Papers open inside SciRah from the original publisher or repository; SciRah never hosts them.
Abstract
Video storytelling is often constrained by available material, limiting creative expression and leaving undesired narrative gaps. Generative video offers a new way to address these limitations by augmenting captured media with tailored visuals. To explore this potential, we interviewed eight video creators to identify opportunities and challenges in integrating generative video into their workflows. Building on these insights and established filmmaking principles, we developed Vidmento, a tool for authoring hybrid video stories that combine captured and generated media through context-aware expansion. Vidmento surfaces opportunities for story development, generates clips that blend stylistically and narratively with surrounding media, and provides controls for refinement. In a study with 12 creators, Vidmento supported narrative development and exploration by systematically expanding initial materials with generative media, enabling expressive video storytelling aligned with creative intent. We highlight how creators bridge story gaps with generative content and where they find this blending capability most valuable.
TL;DRVidmento supported narrative development and exploration by systematically expanding initial materials with generative media, enabling expressive video storytelling aligned with creative intent. (Semantic Scholar)