A YouTube advertisement for an AI-powered content tool has been outlawed by the British advertising regulator after it gave the impression users could erase the attire of a woman.
The Controversial Promo
The ad in question, seen in January, showcased a 'before and after' image of a young woman. The 'before' shot had a red overlay over her torso, while the latter showed exposed flesh. Accompanying text read: "Erase anything" paired with a heart-eyes emoji.
"Given that the ad implied that viewers could use an app to erase a person's attire, we deemed it endorsed digitally altering and revealing women's bodies non-consensually," announced the authority.
User Reports and Ruling
Eight individuals lodged objections to the watchdog, claiming it was harmful, sexualised women, and reinforced problematic tropes.
The regulatory body concluded that while the company behind the tool, Saeta Tech, bans users from creating sexually explicit content, the advertisement's implication was misleading. The promotion was subsequently outlawed for being "harmful" and likely to cause "widespread offense".
Developer's Stance
Saeta Tech stated it recognized why the ad was offensive, but attributed the issue its "presentation and messaging", not the tool's design. The firm emphasized it employs automated detection to block the generation of explicit content.
The company has agreed not to display the offensive commercial and has temporarily stopped all advertising while it carries out an internal review.
Broader Context
This incident highlights a global discussion about non-consensual image manipulation apps. In January of this year, comparable problems made headlines when the AI tool Grok was reportedly used to flood social media platform X with AI-generated nudes.
Subsequently, British authorities announced in December to create new offences to develop or distribute AI tools that allow the 'digital stripping'. These new rules will strengthen existing legislation against sexually explicit deepfakes.
Key Takeaways
- An AI editing app ad has been banned for implying it could create nude images.
- The watchdog ruled it was irresponsible and offensive.
- The company apologized for the marketing but stated the app's policies.
- This incident occurs against a backdrop of increasing scrutiny targeting AI-powered image abuse.