Google Crawl Limit Checker

Check if Your HTML Content Exceeds Google's 2MB Limit

Google has specified that its crawl limit for HTML and supported text-based files is 2MB. Any content beyond this cutoff is simply ignored by Googlebot and won't be indexed. Use this free tool to check if your pages are within the limit.

Why Does This Matter?

Content May Be Invisible: If your HTML exceeds 2MB, Googlebot stops crawling and any content after the cutoff is not indexed. Important text, links, or structured data at the bottom of large pages may never appear in search results.
SEO Impact: Pages with bloated HTML (inline styles, excessive JavaScript, or large DOM trees) risk losing valuable content from Google's index, directly affecting rankings.
Resource Limits Apply Separately: Each resource referenced in your HTML (CSS, JavaScript) is fetched separately and each is subject to the same 2MB limit.
PDF Files Have a Higher Limit: Google is more generous with PDFs, crawling the first 64MB.

Source: Google Search Central Documentation

Page URL

Analysis Breakdown

Crawled (First 2MB)

ℹ️

Visual Distribution

Crawled (First 2MB)

Ignored (Over Limit)

Safe Zone

Ignored Zone

Googlebot Visualization (Rendered)

Here is what Googlebot "sees" before cutting the connection at 2MB.

▶ About the 2MB Limit

HTML Files: Googlebot stops crawling an HTML file after the first 2 MB. Any content after this cutoff is not indexed. This limit applies to the uncompressed data.

Resources: Each resource referenced in the HTML (CSS, JavaScript) is fetched separately and is subject to the same 2 MB limit.

PDF Files: Googlebot is more generous with PDFs, crawling the first 64 MB.

"Once the limit is reached, Googlebot interrupts the retrieval and sends only the downloaded part for indexing." — Google Search Central