Google up to date its Googlebot documentation to make clear information about file measurement limits.
The change includes shifting information about default file measurement limits from the Googlebot web page to Google’s broader crawler documentation. Google additionally up to date the Googlebot web page to be extra particular about Googlebot’s personal limits.
What’s New
Google’s documentation changelog describes the replace as a two-part clarification.
The default file measurement limits that beforehand lived on the Googlebot web page now seem in the crawler documentation. Google mentioned the authentic location wasn’t the most rational place as a result of the limits apply to all of Google’s crawlers and fetchers, not simply Googlebot.
With the defaults now housed in the crawler documentation, Google up to date the Googlebot web page to describe Googlebot’s particular file measurement limits extra exactly.
The crawling infrastructure docs record a 15 MB default for Google’s crawlers and fetchers, whereas the Googlebot web page now lists 2 MB for supported file sorts and 64 MB for PDFs when crawling for Google Search.
The crawler overview describes a default restrict throughout Google’s crawling infrastructure, whereas the Googlebot web page describes Google Search–particular limits for Googlebot. Every useful resource referenced in the HTML, corresponding to CSS and JavaScript, is fetched individually.
Why This Issues
This suits a sample Google has been working since late 2025. In November, Google migrated its core crawling documentation to a standalone web site, separating it from Search Central. The reasoning was that Google’s crawling infrastructure serves merchandise past Search, together with Purchasing, Information, Gemini, and AdSense.
In December, more documentation followed, together with faceted navigation steering and crawl finances optimization.
The most recent replace continues that reorganization. The 15 MB file measurement restrict was first documented in 2022, when Google added it to the Googlebot assist web page. Mueller confirmed at the time that the restrict wasn’t new. It had been in impact for years. Google was simply placing it on the document.
When managing crawl budgets or troubleshooting indexing on content-heavy pages, Google’s docs now describe the limits otherwise relying on the place you look.
The crawling infrastructure overview lists 15 MB as the default for all crawlers and fetchers. The Googlebot web page lists 2 MB for HTML and supported text-based information, and 64 MB for PDFs. Google’s changelog does not clarify how these figures relate to each other.
Default limits now dwell in the crawler overview documentation, whereas Googlebot-specific limits are on the Googlebot page.
Trying Forward
Google’s documentation reorganization suggests there’ll possible be extra updates to the crawling infrastructure web site in the coming months. By separating crawler-wide defaults from product-specific documentation, Google can extra simply doc new crawlers and fetchers as they are launched.
Disclaimer: This article is sourced from external platforms. OverBeta has not independently verified the information. Readers are advised to verify details before relying on them.
