Apple's App Store and Google Play are both hosting deepfake AI apps that allow users to create “kissing” videos or pictures of anyone—whether celebrities, classmates, or personal “crushes.” These apps are being aggressively advertised on platforms like Instagram and Facebook, often targeting younger users.
Equally concerning is the growing availability of unvetted AI "girlfriend" chatbots, some of which are accessible to kids. These bots can quickly escalate into increasingly sexualized conversations, posing serious risks to both minors and adults. The psychological impact—ranging from warped perceptions of relationships to mental health strain—is deeply troubling.
Apple's App Store and Google Play must do more to investigate, vet, and regulate the AI apps they host, especially those that could be accessed by children. This issue underscores the dangers of democratizing deepfake and generative AI technologies without safeguards for consent, digital identity, and user safety. It also highlights a troubling lack of oversight in both app store moderation and advertising approval processes.
Using the action below, call on the teams at Google & Apple to investigate these apps and to implement stronger policies.
