Google and Bing to Support Unified Robots.txt Rule for AI Training Opt-Out
· 18d ago · Originally reported by PPC Land
Google and Bing announced they will respect a common robots.txt directive allowing website owners to block their content from being used to train AI models. This comes as studies show low click-through rates for AI Overviews and Bing experiments with ad formats.
Why it matters
This move could impact the volume and quality of content available for AI-powered search features, which may affect search ad revenue and the dynamics of search arbitrage, especially as AI-driven results change user click behavior.
Explain it like I’m new here
It's like giving website owners a new 'do not copy' sign so big tech can't use their stuff to teach robots, which could change how search ads work.
Terms in this story
AI Overviews
AI Overviews are AI-written summaries that Google shows at the top of some search results, answering the question directly with links to sources.
Click
A click is one person tapping or clicking on an ad or link and being taken to another page.
CTR (click-through rate)
CTR is the percentage of people who click something after seeing it, calculated as clicks divided by impressions.
Go deeper
Related stories
Field test finds Google AI Mode cuts website clicks by 18.8 percentage points
A March field test of 1,100 US users measured how Google's AI Mode changes search behaviour. Users shown AI Mode were 18.8 percentage points less likely to click through to websites, and 11.2 points more likely to switch to rival engines…
Bing's -ai query toggle hides AI answers but leaves ad behavior unclear
Microsoft added a '-ai' parameter to Bing queries that suppresses AI-generated answers, but the same feature reportedly also sets Bing as Chrome's default search engine. Advertisers have not been told whether search ads appear differently…
Network Settings in Google and Microsoft Ads Control Search Partner Traffic
Network settings in Google Ads and Microsoft Advertising allow advertisers to choose which inventory pools, including search partners, display their ads. These controls directly affect where ads appear and which types of traffic are…
Broad Match Remains Default Keyword Setting in Google and Microsoft Ads
Broad match continues as the default keyword match type in both Google Ads and Microsoft Advertising, allowing ads to show for searches deemed related to chosen keywords. This setting can influence which queries trigger ads and the volume…
Google AI Overviews Now Show Citation Cards Fully Visible Without Fading
Google appears to have updated AI Overviews so the citation blocks on the right side are fully displayed rather than faded out, removing the need to click into the AI Overview to see the sources. The change was spotted on the Google Search…
Google Ads surcharges rise to 3% in France and Italy, can hit US advertisers
Google Ads surcharges in France and Italy have increased to 3%, and default location settings can cause local US advertisers to be billed for serving ads in those countries. Advertisers are advised to check where their campaigns actually…