Google Says Cache-Control Headers Aren't Used For Crawling & Indexing Unless It's Embedded Content

Dec 27, 2022 - 7:51 am 0 by

Google Cache

In 2018, John Mueller of Google said Google does not use cache-control headers when crawling. He said then that the has no impact on GoogleBot and how it crawls your web pages. He said that again today, at the end of 2022, but added, "at most, they might be used in rendering for embedded content."

John wrote on Mastodon, "Cache control headers don't apply to Google's crawling & indexing, they're for browsers." But then he added that "at most, they might be used in rendering for embedded content."

The Cache-Control HTTP header field holds directives, in both requests and responses, that control caching in browsers and shared caches (e.g. Proxies, CDNs). It is an HTTP header used to specify browser caching policies in both client requests and server responses.

Forum discussion at Mastodon.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
Google March Core Update Done, HCU Recoveries, Site Reputation Abuse & AI Topics - YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Search Forum Recap

Daily Search Forum Recap: May 3, 2024

May 3, 2024 - 4:00 pm
Search News

The Industry Mourns The Loss Of Mark Irvine - Brilliant & Giving Search Marketer

May 3, 2024 - 1:10 pm
Search Video Recaps

Search News Buzz Video Recap: Google March Core Update Done, HCU Recoveries, Site Reputation Abuse & AI Topics

May 3, 2024 - 8:01 am
Google

Google SGE AI Answers Now Cost 80% Less To Generate

May 3, 2024 - 7:51 am
Google Search Engine Optimization

Google Open To Alternative Ideas For Hreflang

May 3, 2024 - 7:41 am
Google Search Engine Optimization

Google Recrawls URLs At Different Rates: Multiple Times Per Day To Every Few Months

May 3, 2024 - 7:31 am
Previous Story: Most SEOs Aren't Concerned About ChatGPT Threatening The SEO Industry