Kate Ruane, director of the Center for Democracy and Technology’s Freedom of Expression Project, says most major tech platforms now have policies prohibiting the wanton distribution of intimate photos, and many of the largest agreeing on rules for combating deepfakes. “I would say it’s not really clear that creating or distributing an intimate image without consent is prohibited on the platform,” Ruane says of Telegram Terms of Usewhich are less detailed than other major technology platforms.
Telegram’s approach to removing harmful content has long been criticized by civil society groups, with the platform long hosting scammers, far-right groups and terrorism-related content. Since Telegram’s CEO and founder, Pavel Durov, was arrested in France and indicted on a number of potential crimes in August, Telegram has begun making some changes to its terms of service and sharing data with law enforcement agencies. The company did not respond to WIRED’s questions about whether it explicitly prohibits explicit deepfakes.
Do harm
Ajder, a researcher who discovered deepfake bots on Telegram four years ago, says the app is extremely vulnerable to deepfake abuse. “Telegram provides a search function so it can identify communities, chats and bots,” says Ajder. “It provides bot hosting functionality, so it’s a place that provides effective tools. This is also a place where you can share it and actually make a difference in terms of the end result.
In late September, several deepfake channels began posting information that Telegram had removed its bots. It is unclear what prompted the removal. On September 30, the channel with 295,000 subscribers posted that Telegram had “banned” its bots but provided users with a new link to the bot. (The channel was deleted after WIRED sent questions to Telegram.)
“One of the things that’s really concerning about apps like Telegram is that they’re so hard to track and monitor, especially from a survivors’ perspective,” says Elena Michael, co-founder and director of #NotYourPorn, a conservation campaign group people from image-based sexual exploitation.
Michael says Telegram is “extremely difficult” to discuss security issues with, but notes that the company has made some progress in recent years. However, he believes that the company should be more lively in moderating and filtering content.
“Imagine you are a survivor who has to do this on your own, certainly the burden shouldn’t fall on one person,” Michael says. “Certainly the onus should be on the company to put something in place that is proactive rather than reactive.”