Video-to-audio research uses video pixels and text prompts to generate rich soundtracks

Source: https://deepmind.google/discover/blog/generating-audio-for-video/