Spotify, the popular music streaming platform, is taking its foray into artificial intelligence (AI) a step further with its latest feature: AI voice clones of podcasters. By tapping into the power of AI, Spotify aims to translate podcasts into other languages while maintaining the authenticity and naturalness of the original presenters' voices.
The process involves cloning the voices of top podcasters, such as Lex Fridman and Kristen Bell, and using AI technologies to create a seamless match of their voices. These cloned voices are then used to read translated versions of the podcasts, resulting in an interview that sounds as if it were spoken by the actual presenters, despite the conversation never actually happening.
This innovation opens up a world of possibilities for listeners who do not speak the language in which the podcasts were originally recorded. Spotify believes that by offering natural-sounding podcasts in multiple languages, it can bridge the gap between different cultures and enable people from around the world to discover and be inspired by new podcasters in a more authentic way.
Spotify has already made this technology available for a limited number of podcasts in Spanish. These podcasts will be collected in a dedicated section of the app, making it easier for users to access them. Additionally, the translated podcasts will also appear as suggestions when someone starts listening to a relevant podcast. The company plans to expand this feature to include other languages like French and German in the near future, with the goal of applying it to more podcasts across various genres.
Ziad Sultan, Spotify’s vice president of personalisation, expressed the company’s excitement about the potential of this technology. “By matching the creator’s own voice, Voice Translation gives listeners around the world the power to discover and be inspired by new podcasters in a more authentic way than ever before,” Sultan said in a statement. He believes that AI, when approached thoughtfully, can facilitate deeper connections between listeners and creators, which aligns with Spotify’s mission to unlock the potential of human creativity.
It’s worth noting that Spotify has been actively exploring the integration of AI in its platform. The AI DJ feature, for example, not only curates playlists but also uses an artificial voice to introduce songs. Similar to this AI DJ, the translation technology is built on tools provided by OpenAI, the creators of ChatGPT. Spotify views these current technologies as just the beginning, with plans to gather feedback from creators and audiences to drive future expansion, iterations, and innovations.
Spotify’s venture into AI voice clones of podcasters raises questions about the ethics and implications of using AI to mimic human voices. While it presents exciting possibilities for language accessibility and global connections, it also poses challenges regarding consent, authenticity, and the future of human storytelling. As Spotify continues to explore the potential of AI, it will be interesting to see how these concerns are addressed, and how this technology shapes the future of podcasting and audio content consumption.
Use the share button below if you liked it.