GLOSSARY

Crawl Budget

IN ONE SENTENCE

Crawl budget is how many requests a crawler is willing to spend on a site in a given period.

Crawl budget is how many requests a crawler is willing to spend on a site in a given period.

01

In detail

The more pages a site has and the higher the share of low-value ones, the less often the important pages get fetched. This is the technical case for fewer, better pages: thousands of pages outside the range where ranking pays anything dilute crawling.

Updated 2026-08-06