Recent investigations have revealed that Meta’s advertising systems failed to detect hundreds of AI-generated child abuse ads, many linked to developers based in China. According to reporting by Wired, these ads directed users to nearly 50 applications available on both Google’s Play Store and Apple’s App Store.
Out of approximately 350 ads identified, around 300 were found to promote AI image or video generator applications. Some of these applications had already been removed by the time the investigation began. Among the problematic apps were eight identical listings on Apple’s App Store, which displayed explicit AI-generated content, including disturbing scenarios.
Response from Tech Giants
In response to the findings, Apple stated that it maintains a zero-tolerance policy for developers who attempt to circumvent its app review process. An Apple spokesperson noted that 17 of the 20 apps highlighted in the research had already been removed, with actions taken against the remaining three.
Google also emphasized its commitment to removing harmful content, stating that it does not permit apps containing sexual content or the ability to create explicit imagery. The company reported that it had removed all apps mentioned in the investigation and had taken steps to suspend hundreds of violating applications.
Challenges in Detection
David Pham, a former Meta employee, highlighted the ongoing challenges in detecting such harmful content. He noted that developers of these ads frequently adapt their strategies to evade detection, often changing domains and obscuring their identities. Pham expressed concern over the prevalence of these ads, stating that more than 11,000 undress ads have appeared on Meta’s platforms since February of this year.
Despite the resources available to Meta, the effectiveness of its current protections against child sexual abuse material (CSAM) and non-consensual intimate imagery (NCII) has come under scrutiny. A recent report indicated that many of the ads were posted by repeat offenders, raising questions about the robustness of Meta’s moderation systems.
As investigations continue, the need for more effective measures to combat the proliferation of harmful content on major platforms remains critical.
Follow Cyber Warriors Middle East for further global cybersecurity developments.
