Meta Contractors Posed as Teens to Prompt Rival Chatbots About Suicide, Sex, and Drugs

Meta conducted a large-scale, undisclosed competitive intelligence project called 'Cannes' where hundreds of contractors posed as minors to probe safety vulnerabilities in OpenAI's ChatGPT, Google's Gemini, and Character.AI, generating over 45,000 prompts involving high-risk content like suicide, self-harm, and child exploitation scenarios. This raises significant legal, ethical, and reputational risks for technology organizations, including potential exposure to regulatory scrutiny, child safety liability, and erosion of industry trust around AI safety practices and responsible competitor benchmarking. For IT leaders, this incident underscores the critical importance of implementing transparent AI governance policies, documented consent processes for third-party testing, and clear ethical guardrails to prevent corporate security and competitive practices from crossing into legally or ethically problematic territory.