TikTok Developing AI Voice Cloning Feature, Raising Concerns Over Potential Misuse

TikTok, the popular short-form video platform, is reportedly developing an AI-powered text-to-speech voice cloning feature that would allow users to replicate voices, as of April 23, 2024. The feature, which may be called 'TikTok Voice Library,' will enable users to create an AI version of their voice in just 10 seconds by recording themselves reading text provided by the app.

Once the AI processes the recording, users can utilize the cloned voice with TikTok's text-to-speech feature, adding voice to their videos without having to record it each time. While users will have the option to remove the AI voice from their library to maintain privacy, the development of this technology has raised concerns about its potential for misuse.

Major AI companies have agreed to implement new safety measures to protect children from exploitation and prevent the proliferation of tools that can be used to create harmful content. The voice cloning feature could potentially be misused to generate exploitative content involving children, highlighting the need for robust safeguards and responsible deployment of such technologies.

Why this matters: The development of AI voice cloning technology on a platform as widely used as TikTok underscores the rapid advancements in AI and their potential implications for society. As these technologies become more accessible, it is critical to address the ethical challenges and establish guidelines to prevent misuse and protect vulnerable populations.

TikTok's Chinese version, Douyin, is also developing a similar AI-powered text-to-speech voice cloning feature. In China, the rise of audiobooks and AI-generated audio content is transforming reading habits, with the audiobook user base reaching 420 million in 2022. Content creators are leveraging AI technology to produce engaging audio content, including radio dramas and audiobooks, with AI-generated voices becoming increasingly realistic and capable of conveying human emotions.

Despite the potential benefits of AI voice cloning in the entertainment industry, such as enabling the integration of deceased actors into new productions and democratizing the filmmaking process for independent creators, the technology also raises significant ethical concerns. As TikTok continues to develop this feature, it is essential for the company to prioritize user safety, implement robust safeguards, and work closely with regulators and industry partners to address the challenges associated with synthetic media.

Key Takeaways

• TikTok developing AI-powered text-to-speech voice cloning feature in 2024.
• Feature allows users to create AI version of their voice in 10 seconds.
• Raises concerns about potential misuse, especially for exploiting children.
• AI companies agree to new safety measures to prevent harmful content.
• Douyin, TikTok's Chinese version, also developing similar AI voice cloning.