Glossary
What Is Crawl Budget?
Crawl budget is the number of URLs a search engine is willing and able to crawl on a given site within a set period, shaped by site size, speed, and authority.
Crawl budget becomes a real constraint on large or fast-changing sites — e-commerce catalogs, marketplaces, publishers — where wasted crawl on low-value URLs (filters, duplicates, redirect chains) delays discovery of new or updated pages.
Want to go beyond definitions and actually fix issues like this on your own site? Join the Technical SEO Workshop →