Skip to Main content Skip to Navigation
Conference papers

Is There a "Language of Music-Video Clips" ? A Qualitative and Quantitative Study

Laure Prétet 1, 2, 3 Gaël Richard 1, 2 Geoffroy Peeters 1, 2 
Abstract : Recommending automatically a video given a music or a music given a video has become an important asset for the audiovisual industry-with user-generated or professional content. While both music and video have specific temporal organizations, most current works do not consider those and only focus on globally recommending a media. As a first step toward the improvement of these recommendation systems, we study in this paper the relationship between music and video temporal organization. We do this for the case of official music videos, with a quantitative and a qualitative approach. Our assumption is that the movement in the music are correlated to the ones in the video. To validate this, we first interview a set of internationally recognized music video experts. We then perform a largescale analysis of official music-video clips (which we manually annotated into video genres) using MIR description tools (downbeats and functional segments estimation) and Computer Vision tools (shot detection). Our study confirms that a "language of music-video clips" exists; i.e. editors favor the co-occurrence of music and video events using strategies such as anticipation. It also highlights that the amount of co-occurrence depends on the music and video genres.
Complete list of metadata
Contributor : Laure Prétet Connect in order to contact the contributor
Submitted on : Wednesday, September 1, 2021 - 11:33:25 AM
Last modification on : Monday, February 7, 2022 - 3:13:13 PM
Long-term archiving on: : Thursday, December 2, 2021 - 6:52:15 PM


Files produced by the author(s)


  • HAL Id : hal-03330800, version 1



Laure Prétet, Gaël Richard, Geoffroy Peeters. Is There a "Language of Music-Video Clips" ? A Qualitative and Quantitative Study. ISMIR, Nov 2021, Virtual Event, France. ⟨hal-03330800⟩



Record views


Files downloads