Meta Faces Scrutiny Over Delayed Safety Tools on Instagram
Meta is under increasing pressure as a lawsuit reveals the company was aware of risks associated with explicit content shared via Instagram Direct Messages (DMs) for years before implementing safety features like a nudity filter. The case, along with several others, aims to hold big tech companies accountable for potential harm to teen users, alleging platforms prioritize engagement over safety.
Delayed Implementation of Nudity Filter
During a deposition, Instagram head Adam Mosseri was questioned about an August 2018 email chain with Meta VP and Chief Information Security Officer Guy Rosen. The email highlighted the potential for “horrible” things, including unsolicited explicit images, being sent through Instagram DMs. Despite this awareness, a feature to automatically blur explicit images in DMs wasn’t introduced until April 2024 [1].
Mosseri defended the company’s approach, stating that balancing user privacy with safety was a key consideration. He too noted that problematic content could be shared on any messaging app, not just Instagram.
Revealed Data on Harmful Content
The testimony also revealed data from surveys indicating the prevalence of harmful content on Instagram. Specifically, 19.2% of respondents aged 13 to 15 reported seeing unwanted nudity or sexual images, and 8.4% had witnessed self-harm or threats of self-harm within the past seven days of app usage.
Focus on Addiction and Engagement
The lawsuit alleges that Meta, along with Snap, TikTok, and YouTube (Google), designed their platforms to maximize screen time and encourage addictive behavior in teens. Lawyers are attempting to demonstrate that these companies prioritized user growth and engagement over the well-being of their youngest users.
Broader Legal Challenges and Regulatory Shifts
This case is one of several ongoing lawsuits targeting big tech companies over the impact of social media on youth mental health. Similar legal challenges are underway in Los Angeles County Superior Court and Modern Mexico. These trials coincide with a growing movement to restrict social media access for teens, with new laws being enacted in various U.S. States and internationally.
Meta’s Response
In a statement, Meta spokesperson Liza Crenshaw highlighted the company’s long-term efforts to enhance teen safety. She pointed to initiatives like Teen Accounts with built-in protections and tools for parental management, stating, “We’re proud of the progress we’ve made, and we’re always working to do better.” [2]
Instagram’s Revenue Contribution
Instagram is a significant revenue driver for Meta, generating an estimated $66.9 billion in advertising revenue in 2024, representing a substantial portion of Meta’s total $160 billion in advertising revenue. [3]
The outcome of these lawsuits could have significant implications for the legal defenses of big tech companies against claims of user harm, as highlighted by recent testimony from Meta CEO Mark Zuckerberg regarding the company’s shift away from designing apps to maximize screen time. [4]