TikTok’s AI tool accidentally allowed you to put Hitler’s words into the mouth of a paid actor

TikTok mistakenly posted a link to an internal version of its up-to-date barrier-free AI digital avatar tool, allowing users to create videos that say almost anything. The the hiccup was first spotted by CNN and enabled the facility to generate videos containing, among other things, quotes from Hitler and a message recommending drinking bleach. TikTok has since discontinued this version of the tool, while the version TikTok was supposed to launch remains available.

TikTok launched earlier this week Symphony digital avatars let companies generate ads based on the likenesses of paid actors. It also uses AI-powered dubbing, which allows advertisers to input a script that will make avatars say what they want, according to TikTok’s guidelines. While only users with a TikTok Ads Manager account can access the tool, the version found by CNN allows anyone with a personal account to try it out.

In a statement to EdgeTikTok spokeswoman Laura Perez says TikTok has resolved a “technical bug” that “allowed an extremely small number of users to create content using an internal test version of the tool for several days.”

When CNN discovered an internal tool, it allowed the station to generate videos reciting Osama bin Laden’s “Letter to America,” a white supremacist slogan, and a video encouraging people to vote on the wrong day. None of the videos produced by CNN had a watermark indicating that they were generated by artificial intelligence, which is the case with the proper version of Symphony TikTok’s digital avatars.

CNN did not post the videos it created on TikTok, but Perez notes that if it did, the content “would be disapproved for violating our policies.” Even though TikTok has retired this version of its tool, the question is whether people will find other ways to abuse the digital avatar creator and whether TikTok is ready for it.