Google clarifies Googlebot's 2 MB HTML limit per URL

Google confirmed that Googlebot processes up to 2 MB of HTML per URL; larger pages are only partially fetched and content beyond that point is ignored. PDFs have a separate 64 MB limit. Slow server responses can also reduce crawl frequency.

• Googlebot's limit is 2 MB of HTML per URL, 64 MB for PDFs
• Oversized pages are partially fetched, the rest is ignored
• Slow servers cause Googlebot to crawl a site less often
• Critical content should appear early in the HTML document