Meta Commercial Terms Empower Automated Web Scraping for AI Training
“This is a remarkable provision to bury in [the] terms of service, given that this would give Meta access to material that would likely cost many millions of dollars in a licensing market,” said Matt Topic, a media and intellectual property attorney at Loevy & Loevy. Fresh commercial terms of use reported by Nieman Lab permit Meta to deploy web scrapers for crawling and gathering material from sites “associated with” corporate accounts on its networks.
The update goes into effect on October 30 and includes news publishers with business accounts. These accounts let companies or public figures manage Facebook pages, Messenger accounts, Instagram profiles, or WhatsApp channels from one place. While journalism is not the only industry affected, virtually every news organization maintains at least one Meta business account.
Legal Experts Warn of Comprehensive Content Harvesting
The updated terms explicitly state that Meta can use content collected from associated websites to “train” Meta products, which includes the company’s AI products. Legal experts who reviewed the policy at the request of Nieman Lab said the language permits Meta to scrape content from news sites and feed it into AI development pipelines.
“For news publishers, this clearly represents permission to Meta to train AI on any content from their sites and possibly to deploy some of that content, even in competition with the publishers themselves,” said James Grimmelmann, a professor of digital and information law at Cornell Law School. According to Grimmelmann’s observation, the broadest reading of the policy permits building a complete repository of all material that Meta could subsequently distribute however it chose, either independently or through artificial intelligence.
Business accounts currently have no option to opt out of the new terms ahead of the October 30 deadline. Business or commercial access and use of our Products must be completely halted if you reject the revised terms, according to the update’s explicit instructions.
Platform Integration and Test Credentials
A public affairs spokesperson at the company stated that crawling language was previously scattered across different terms of use, including terms about using generative AI in ads, and the update consolidates them in one place. Regarding future publisher crawling practices, the representative noted that the updated conditions will leave them unaltered and emphasized that content creators can still regulate site access via robots.txt.
However, the new terms also authorize Meta to create “test credentials” to access domains and web pages. Grimmelmann pointed out that this would technically allow Meta to “sign up as a fake user” to bypass registration walls on a publisher’s site to access content. Meta declined to answer Nieman Lab’s questions regarding whether the “test credentials” would bypass paywalls or paid content.
An antitrust law principle known as “tying” was used by University of Wisconsin law professor Benjamin Sobel to describe the mandate. Acceptance of the commercial terms’ scraping and crawling permissions becomes mandatory if someone wishes to utilize Meta products that make those terms a prerequisite.
Publisher Reactions and Immediate Business Choices
Stephen Beale, the founder and editor of The Steampunk Explorer, learned of the upcoming changes through his Meta Business Suite dashboard. Beale relies on Facebook to connect with an audience that is heavily entrenched on the platform, but he is seriously considering shutting down his accounts before October 30.
“I know my site has been scraped to death,” Beale said. “But it just seems like such an arrogant, in-your-face move on [Meta’s] part… It just makes me angry and I don’t want them to get away with it.”
Frequently Asked Questions About the Meta Commercial Terms
Can business accounts opt out of the new scraping terms?
No option exists for business accounts to opt out ahead of the October 30 implementation date. Publishers and commercial users must either accept the updated terms or cease using Meta products for business purposes.
How does Meta plan to gather content from restricted web pages?
The updated commercial terms permit Meta to create “test credentials” and use automated software like web scrapers and crawlers to access, index, and retrieve content from URLs associated with business accounts.
What impact does this update have on news publishers?
Attorneys and policy specialists caution that the guidelines empower Meta to extract editorial material from publisher web pages for artificial intelligence training, pointing out that the provisions could support arguments that Meta is entitled to collect news site content and utilize it in developing its own AI systems.
Related reading