Googlebot crawl limit analyzer
Googlebot only processes the first 2 MB of uncompressed content from each file it crawls. If your HTML, CSS, or JavaScript exceeds that limit, the remaining content is ignored and not indexed. This tool measures the actual weight of your page and every resource it loads, including images and videos as a reference for Core Web Vitals.
HTML and resources (CSS, JS): 2 MB per file, uncompressed. Each resource has its own independent 2 MB limit.
PDF files: 64 MB per file.
Images and videos: have their own crawlers (Googlebot-Image, Googlebot-Video) with different limits. They are measured here as a reference for Core Web Vitals.
Compression: the limit applies to uncompressed data, i.e. the actual content after decompressing gzip or brotli. Having compression enabled on your server does not bypass this limit.
What happens if it is exceeded? Googlebot stops at 2 MB and sends only what it has downloaded up to that point for indexing. Any content beyond that cut-off simply will not exist for Google. In practice this mainly affects pages with a lot of inline content (page builders, huge product listings, very large tables) or sites loading unoptimized JavaScript and CSS.
What are Core Web Vitals? These are the performance metrics Google uses as a ranking factor: LCP (loading of the largest element), INP (responsiveness), and CLS (visual stability). Image and video weight directly affects LCP.