Glossary / SEOJune 18, 2026

Krawling budget

Crowling budget is the number of pages the robot crawls over a period. How to save it on a large site and speed up indexing important pages.

Section: SEOUpdated: June 18, 2026

Crowling budget – the number of pages of the site that the search engine is ready to bypass for a certain period. Depends on domain authority, server response speed, and content update frequency.

The problem is relevant for large sites with thousands of pages. If the robot spends crawls on duplicates, junk options in URLs, and redirects, important pages are indexed slowly. The budget is saved through setting up robots.txt, removing duplicates, cleaning broken links and competent linking so that the robot reaches priority sections.

Related terms

More on this topic

All terms in category →

Did not find a term?

Need an answer for your website?

Describe the task and we will suggest what to check first.