- checkpoints/ - audio-cond_animation/ - avsync15_audio-cond_cfg/ - landscapes_audio-cond_cfg/ - thegreatesthits_audio-cond_cfg/ - avsync/ - vggss_sync_contrast ...

Abstract: The aim of the violent recognition task is to determine whether a video contains violent behaviors. Given that violent behavior often comes with visual and audio anomalies, multimodal ...

In this paper, we propose a new multi-modal task, termed audio-visual instance segmentation (AVIS), which aims to simultaneously identify, segment and track individual sounding object instances in ...

SAM Audio is the first unified AI model that can segment sound from complex audio mixtures using text, visual, and time span prompts. This technology has the potential to transform audio and video ...

Abstract: Weakly-supervised audio-visual video parsing (WS-AVVP) aims to localize the temporal extents of audio, visual and audio-visual event instances as well as identify the corresponding event ...