just caught the latest search off the record episode where they broke down how googlebot actually handles crawling and fetching. its interesting to see the distinction between fetching and processing bytes, especially since we usually just focus on
crawl budget via
ahrefs or similar.
>the inner workings of googlebotmakes me wonder if spoenterjavascript execution is still the biggest bottleneck for indexation/spoiler in this current era.
full read:
https://developers.google.com/search/blog/2026/03/crawler-blog-post