Jen Weedon, Former Meta Trust and Safety Executive, Discusses AI Content Moderation and Online Speech Regulation in New Podcast Episode

Jen Weedon, a former Trust and Safety executive at Meta and Niantic, explored the evolving landscape of AI content moderation and online speech regulation in the latest episode of Ctrl-Alt-Speech, a podcast hosted by Mike Masnick and Ben Whitelaw. The discussion, which included insights from Weedon’s current role as a consultant and instructor at Columbia University’s School of International and Public Affairs, highlighted growing concerns around AI’s role in moderating digital platforms.

What’s New in AI Content Moderation?

Weedon emphasized the challenges of balancing automated systems with human oversight in content moderation. “AI tools can flag harmful content at scale, but they often struggle with context,” she said. “This is where human reviewers—especially those trained in cultural and linguistic nuances—remain critical.” According to a 2023 report by the AI Now Institute, 70% of content moderation decisions by major platforms still rely on human reviewers, despite increased investment in AI tools.

The conversation also touched on recent developments in AI-generated misinformation. Weedon noted that platforms like Meta and TikTok are experimenting with “AI sleuthing” tools to detect deepfakes and synthetic media. However, she cautioned that these systems are still in early stages. “We’re seeing progress, but the technology isn’t foolproof yet,” she said.

How Are Governments Regulating Online Speech?

The episode examined global regulatory efforts, including the UK’s proposed age verification rules for social media platforms. Under the Online Safety Act 2023, platforms face fines of up to 4% of global revenue if they fail to implement effective age checks. “This is a significant shift,” Weedon said. “It places more responsibility on tech companies to protect younger users, but enforcement remains a challenge.”

In contrast, the European Union’s Digital Services Act (DSA) focuses on transparency and accountability. A 2024 study by the European Commission found that 60% of users reported greater trust in platforms that provided clear explanations for content removals. “Transparency isn’t just a regulatory requirement—it’s a user expectation,” Weedon added.

Why Does Trust and Safety Matter in AI Development?

Weedon stressed that Trust and Safety (T&S) teams are increasingly involved in the early stages of AI development. “We’re no longer just reacting to problems—we’re proactively designing systems that prioritize user safety,” she said. This approach aligns with guidelines from the Partnership on AI, a coalition of tech companies and civil society groups that advocates for ethical AI practices.

However, challenges persist. A 2024 survey by the Pew Research Center found that 58% of users feel “overlooked” by automated moderation systems, particularly in niche communities. “AI can’t replace the need for human-centered design,” Weedon concluded. “The goal should always be to empower users, not alienate them.”

What’s Next for AI and Online Speech?

Looking ahead, Weedon predicted increased collaboration between tech companies, regulators, and civil society. “We need frameworks that adapt to new risks without stifling innovation,” she said. She also highlighted the importance of global standards, noting that 80% of internet users live outside the U.S., yet many regulations are shaped by Western perspectives.

As platforms like Telegram and Anthropic continue to refine their moderation policies, the role of experts like Weedon will remain pivotal. “The stakes are high,” she said. “We’re not just building tools—we’re shaping the future of digital interaction.”