Preview Mode Links will not work in preview mode

Search Off the Record takes you behind the scenes of Google Search and its inner workings! In each episode, the folks from the Search Relations team will give you background info on the decision-making behind launches, feature prioritization in Search Console, and the projects Google Search teams are working on. They will share fun stories from the many conferences they attend as well as from their day-to-day working life at Google. They will also dive into the currently trending conversations in the SEO community at large. Have a listen!

  1. All Episodes
  2. Crawling smarter, not harder

Crawling smarter, not harder

Aug 8, 2024

In this episode of SOTR, John Mueller, Lizzi Sassman, and Gary Illyes talk about misconceptions around crawl frequency and site quality, what's challenging about crawling the web nowadays, and how search engines could crawl more efficiently. 

Resources:
Episode transcript → https://goo.gle/sotr079-transcript
Gary's post on LinkedIn  → https://goo.gle/3YAT55q 
Crawling episode with Dave Smart → https://goo.gle/3WShUsf 
If-Modified-Since  → https://goo.gle/3ywXvja 
About the IETF → https://goo.gle/3SGVVlo 
Robots Exclusion Protocol → https://goo.gle/4dgmBSg 
Proposal for new kind of chunked transfer  → https://goo.gle/3AgMF1c 

Listen to more Search Off the Record → https://goo.gle/sotr-yt
Subscribe to Google Search Channel → https://goo.gle/SearchCentral

Search Off the Record is a podcast series that takes you behind the scenes of Google Search with the Search Relations team.

#SOTRpodcast