Policy & Regulation

Meta Delays Controversial Commercial Terms to November 20

Meta moved the start of its updated Commercial Terms and Self-Serve Ad Terms from October 30 to November 20, intensifying a dispute over crawling, AI training and publisher compensation.

Meta is delaying its controversial new business terms amid scraping concerns
Meta is delaying its controversial new business terms amid scraping concernsDidgeman / pixabay
By Sophie Lindqvist5 min read

Why it matters

  • Meta moved the updated Commercial Terms and Self-Serve Ad Terms from October 30 to November 20.
  • The earlier language covered automated access to domains, web pages, URLs and content linked to business accounts.
  • Meta removed an explicit AI-training reference after objections from publishers and other businesses.
  • Potentially affected entities have submitted complaints about the revised terms to antitrust authorities.
  • The News Media Alliance represents thousands of news media organizations in the United States and Canada.

By Sophie Lindqvist

Meta has postponed the start of its updated Commercial Terms and Self-Serve Ad Terms from October 30 to November 20, according to an email the company sent to Reuters and Fast Company.

The extension covers two documents at the center of a dispute over automated crawling and the use of content linked to business accounts. Meta had already faced objections from publishers and other businesses after it proposed giving itself broad rights to collect and use web content.

A Meta spokesperson said in the email that the company was “extending the effective date of [its] updated Commercial Terms and Self-Serve Ad Terms to 20 November to allow more time... to explain to [its] partners and stakeholders what's changing and what's not.”

Meta’s stated reason focuses on communication rather than resolution. It did not announce that it would withdraw the revised terms, answer the antitrust complaints or accept the News Media Alliance’s demand.

For publishers, the stakes are commercial. They fear that Meta will use their journalism to develop products that compete for the same readers and advertisers without compensating them, according to the News Media Alliance.

What did Meta’s planned terms allow?

Meta’s earlier planned update said the company would have the right to use web scrapers and automated tools “to access, index, cache, analyze, collect, retrieve, or crawl the domains, web pages, or URLs (and any content available through them)” associated with business accounts on the platform.

The language covered several stages of automated collection. It went beyond retrieving a page to include indexing, caching, analysis and repeated crawling of domains, web pages, URLs and the content available through them.

The proposed terms would also have stated that Meta “may use any content from such domains, web pages, or URLs to provide, develop, improve, research, train, and maintain the integrity of, the Meta Company Products, services, and features.”

That sentence connected the collection of content with product development, research and training. In practical terms, the terms gave Meta a contractual basis to argue that content obtained through automated crawling could feed into a wide range of company work.

After publishers and other businesses raised concerns, Meta changed the language to remove its reference to AI training. The company did not reproduce the revised wording in its postponement email, but the announcement described an effort to explain which parts of the terms remain unchanged.

The change was narrower than the publishers’ request. The News Media Alliance wanted Meta to withdraw the revised terms entirely, while Meta’s response focused on giving partners more time to understand the update.

In plain terms, Meta softened one explicit phrase but still faces questions about the uses its commercial terms permit.

Why did publishers object?

The News Media Alliance represents thousands of news media organizations in the United States and Canada. Before October 30, the group sent Meta an open letter demanding that the company withdraw its revised terms of use.

In the letter, the News Media Alliance wrote:

“News publishers will be forced into providing their valuable journalism to support the development of products that may be used to compete with them for readers and advertisers, under duress and without compensation,”

That warning contained three connected economic claims:

  • Publishers would have to provide their journalism under duress.
  • Products developed with that content could compete for the same readers and advertisers.
  • Publishers would supply that journalism without compensation.

Since Meta revised the language, potentially affected entities have submitted complaints to antitrust authorities about the updated terms. That step adds a regulatory track to the dispute alongside the alliance’s open letter and Meta’s direct outreach to partners.

Meta’s response was procedural: extend the effective date and promise a clearer explanation. It did not announce an agreement with the News Media Alliance or a resolution to the antitrust complaints.

The underlying issue is consent and money. Publishers do not want their reporting to help build competing products without a way to say no or receive payment.

Can robots.txt solve the dispute?

Meta added that it will explain to partners how it uses its web crawlers. The company also said it will make clear that content owners and publishers can use robots.txt to control that activity.

According to Meta, robots.txt is a plain-text file that can signal a content owner’s preferences to crawlers and AI bots. When those systems follow the file, the instructions can stop them from indexing the protected content.

That makes robots.txt a recognizable control for publishers. It gives them a common way to state that certain pages should not be collected, rather than relying only on negotiations with Meta.

But the control depends on compliance. Reuters previously reported that multiple AI companies’ crawlers regularly ignore robots.txt instructions. A crawler can read a publisher’s request and proceed anyway.

The gap between a published preference and actual enforcement matters. Robots.txt can communicate a choice, but the file cannot compel the software receiving it to obey. Meta’s terms address the permission Meta claims for crawling and use; robots.txt addresses the behavior Meta says crawlers should follow.

That leaves two separate questions for publishers: what Meta’s terms allow and what a crawler actually respects. A clear robots.txt policy cannot settle the second question when a bot disregards the file.

Robots.txt can express a publisher’s choice, but it cannot guarantee that a crawler will obey it.

What happens before November 20?

Meta says it will use the added time to explain what is changing and what is not. For the company, that means providing more detail about crawler use and the role of publishers’ robots.txt files.

Several practical details remain unclear in the company’s announcement:

  • Which crawler operations fall within the updated Commercial Terms and Self-Serve Ad Terms.
  • What uses remain available after Meta removed the explicit reference to AI training.
  • What control publishers retain when third-party AI crawlers ignore robots.txt.

The News Media Alliance’s open letter asks for withdrawal, while the antitrust complaints raise a separate policy concern. More explanation could address confusion about the terms, but it would not by itself answer the alliance’s demand or determine how regulators will treat the complaints.

Meta now faces November 20 with those questions unresolved. Its next explanation must cover both what its crawler takes and what publishers can stop, because robots.txt can state a preference but cannot protect reporting from crawlers that ignore it.

Original: reuters.com

Share this article:

More from Sophie Lindqvist

Sophie Lindqvist

Show full bio

Staff writer covering regulation, policy and their impact on artificial intelligence and machine learning at AI In Context.

352 articles

Related articles

  1. Meta's October 30 Terms Could Let It Skip Millions in AI Licensing Fees
  2. Meta pulls crawling clause from commercial terms after backlash
  3. Meta drops the word 'train' from commercial terms before Oct 30 rollout
  4. Meta's New Terms Let Its AI Scrapers Crawl Publishers' Sites
  5. Meta Saved $3.9 Billion in 2025 by Calling AI Data Centers Experiments

« Previous articleNext article »