[MS] From Noisy Queries to Precise Frames: Query Decomposition for Media Asset Search - devamazonaws.blogspot.com
Introduction: The Problem Media and entertainment teams work with massive asset catalogs for films and TV series. Each asset often includes structured metadata such as episode ID, scene ID, and shot ID, along with the visual content itself. Teams want a unified search experience that understands both metadata constraints and natural language intent. The problem appears when users provide both types of information in one query, for example: Two soldiers facing off across a battlefield in episode 20, scene 5, shot 2 If we embed this raw query directly for semantic retrieval, two issues appear: Metadata tokens dilute visual intent in the embedding representation. Retrieval can return visually similar assets from the wrong episode, scene, or shot. This gap is common in real workflows. Editors, archivists, and production teams often know part of the context, but they still describe the visual moment in natural language. Query decomposition solves this by splitting one noisy que...