UK forces Google to open AI search exit door, publishers can instantly block content from being scraped by AI

UK regulators have recently set clear boundaries for Google's AI search business. This Wednesday, Google announced that it has complied with the UK Competition and Markets Authority (CMA)'s regulatory requirements, providing publishers with a one-click option to opt out of AI search aggregation, so their content will no longer be included in Google's generative AI search features.

Under the new rules, publishers can choose to opt out through a new switch in Google Search Console. This free tool was originally designed to help website owners manage how their sites appear in Google search results. Once the opt-out option is enabled, the website will no longer appear in Google's AI Overviews, AI Mode, or AI Overviews in Discover, which are generative AI search features. Notably, Google specifically highlighted in the same announcement that its AI Overviews has exceeded 2.5 billion monthly active users, and AI Mode has also surpassed 1 billion monthly active users.

Google said this opt-out feature will first be tested with some publishers in the UK before being rolled out globally. The CMA called this move "world-first," believing it puts publishers—including news organizations—in a stronger position when negotiating commercially with Google on the use of their content for AI features.

This regulatory framework can be traced back to last October. At that time, the CMA first designated Google as having a "strategic market position," laying the groundwork for subsequent regulatory measures. In January of this year, the CMA further required Google to grant website publishers the right to decide whether their content can be aggregated into AI search features or used to train independent AI models.

In addition to the opt-out switch, Google must also ensure that content from publishers in AI features is clearly attributed, meaning it should be marked with clear links. Google said it has made adjustments in this regard, recently increasing the number of embedded links in AI responses and adding a website preview feature to encourage users to click through.

Google also clearly stated that if a website opts out of generative AI search features, it will not affect its ranking in traditional Google search. However, Google will introduce new data metrics in Search Console to try to retain publishers who may consider opting out, including showing their page exposure data in AI responses and the countries where this content appears. Google said it will continue to add more dimensions of data metrics in the future.