A security firm called Sensity says it recently discovered a network of deepfake bots on chat app Telegram creating computer-generated naked images of women on request. As of July 2020, the firm found that the bots have generated deepfakes of approximately 104,000 women.
In the last three months, its output has increased by nearly 200 percent. You might expect the software spent most of its time processing images of celebrities, but it seems most people used it to create naked photos of women they know in real life. In either case, most victims likely don’t know fake images of them are floating around on the internet. The firm also found that a “limited number” of the photos feature underage children.
The bot is free to use, but users can buy “premium coins” that remove a watermark generated by the software and speed up processing. A set of 12 coins costs the equivalent of USD 1.30. Sensity says the software underpinning the bot’s capabilities is likely an open-source version of DeepNude. The machine learning algorithm gained notoriety last year when its creator briefly sold it online.
The software has since made its way to open source repositories and torrent websites. Typically, the DeepNude algorithm requires a PC with a dedicated GPU to work. However, the entire Telegram ecosystem of bots runs off of online servers, allowing anyone with a phone to access the software. That’s one of the main reasons the bot has seen so much use in such a short time. It also underscores just how difficult it will be to contain the software.
Discussion about this post