New Google Site Verifier User Agent

Sep 20, 2022 - 7:31 am 5 by

Googlebot

Google has added a new Google crawler, a new user agent, to the Google spider list. Its name is Google Site Verifier User Agent. This user agent ignores robots.txt rules, by the way, and I assume it is used for verifying sites with Search Console and other Google tools and services.

Google posted the new user agent over here in the Google Crawlers help documentation.

The user agent token is: Google-Site-Verification

The full user agent string is: Mozilla/5.0 (compatible; Google-Site-Verification/1.0)

And Google noted with a "caution" that the "Google Site Verifier ignores robots.txt rules."

So keep an eye out for it in a very limited basis.

Forum discussion at Twitter.

Update: My assumption that this was for Search Console verification was correct but John Mueller of Google said the user agent is not new, the new part is that it was added to the docs:

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google Rank Data Leak, Google Volatility, Search Console Link Decline & Google On AI Overviews - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: May 31, 2024

May 31, 2024 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Rank Data Leak, Google Volatility, Search Console Link Decline & Google On AI Overviews

May 31, 2024 - 8:01 am
Google

Google AI Overviews Are Here To Stay With Improvements - The Ray AIO Update

May 31, 2024 - 7:51 am
Google

Google News Tab, Discover & Google News Not Returning Results

May 31, 2024 - 7:45 am
Google

Google Shopping Ideas Search Carousel

May 31, 2024 - 7:41 am
Google

Google Knowledge Panels "See Also"

May 31, 2024 - 7:31 am
Previous Story: Bing Tests New Video Length Filter In Web Search