This AI-powered application allows blind people to ‘watch’ any music video for the first time. Just because the blind can’t see doesn’t mean they can’t enjoy music, dialogue, and sound effects in films such as movies and YouTube videos, which serve to construct a picture in their brains.
However, there is one thing that those who are blind have never experienced before: music videos. Because most music videos consist mostly of music and visuals that create a story, those who are blind can only listen to the music track while watching a music video. Until now, that is.
BBDO Bangkok has established Visible-Track.com, the first online service that allows blind people to watch millions of music videos available online, in collaboration with Kunana, Facebook Thailand, and the TAB Foundation.
By simply entering the website with accessibility features, then copying and pasting any music video link from YouTube or Facebook Watch, the website uses AI to intelligently add sound effects to each scene automatically, assisting the user in mentally painting the scene.
To do this, the service employs up to six AIs, such as scene splitting, scene categorization, action classification, and object classification, which collaborate on various duties to make music videos more visible and globally accessible.
The program also generates audio descriptions using image captioning and text-to-speech AI to describe what’s going on in the scene. Blind people can also access the Visible Track service through a Facebook messaging bot on the TAB Foundation’s page (@TNIBinfo).
Napapatch K.Creative StrategistatFacebook Creative Shop Thailand said that They are pleased that the Facebook platform can change the world of the blind for the better, making it more vibrant.
Kunat Pipatanakul, Chief Technology Officer at Kunana said that, Because the problem of visualizing music videos for blind people is unprecedented, there is no established method to use as a model. They need to design a revolutionary solution that is generic enough to handle any music video on the market.
As a result, they’ve created a cluster of different AIs. Each AI is skilled in a specific subtask, and when combined, they can deliver a comprehensive answer.
Before this project, the art of music videos was never accessible to the blind, but today’s technology allows us to lessen inequality and improve the quality of life for the blind, according to BBDO Bangkok’s CCO Anuwat Nitipanont.
Visible Track was not designed to assist blind individuals in viewing music videos in the same manner that sighted people do. However, it is intended to provide them with the same level of enjoyment from music videos as any other person. Music videos, like music, are an art form that everyone should be able to enjoy equally.
Follow and connect with us on Facebook, LinkedIn & Twitter
