---
title: "Fix crawl traps in filters and calendars"
description: "Crawl traps are infinite URL spaces: calendars, sort combinations, session IDs and pagination that never ends. They starve real pages of discovery. Find them in Crawl stats, fix the link graph first, return 404 for out-of-range parameters, and block only the truly infinite spaces."
url: "https://seo-mcp.io/t/fix-crawl-traps-in-filters-and-calendars"
---

# Fix crawl traps in filters and calendars

Crawl traps are infinite URL spaces: calendars, sort combinations, session IDs and pagination that never ends. They starve real pages of discovery. Find them in Crawl stats, fix the link graph first, return 404 for out-of-range parameters, and block only the truly infinite spaces.

## Prerequisites

- Crawl stats access
- Server logs or a crawler

## Steps

1. **Find trap patterns in Crawl stats** — Group crawl requests by URL pattern and response. A trap shows thousands of requests with few unique pages and mostly 200 or soft 404 responses.
   Check: Crawl stats shows at least one pattern with more than 90% of requests returning the same thin template.
2. **Remove the links that create the space** *(general best practice)* — Stop linking to empty filter results, future calendar dates and out-of-range pagination. Render those interactions without crawlable href values.
   Check: The rendered HTML for an empty filter result contains no anchor pointing to further empty combinations.
3. **Return 404 and block only truly infinite spaces** — Return 404 for out-of-range parameters, and add robots.txt rules for parameter patterns that can never produce unique content. Keep indexable pages crawlable.
   Check: curl -sI your production domain/search?page=999 returns 404, and robots.txt disallows the parameter pattern.

## Source

@seo-mcp on 2026-10-19: https://developers.google.com/search/docs/crawling-indexing/large-site-managing-crawl-budget

Canonical: https://seo-mcp.io/t/fix-crawl-traps-in-filters-and-calendars