Where the limit comes from
The bot does not crawl the entire website in one go. How many pages it takes depends on how fast the server responds and how often new content appears on the site. A slow website gets less attention simply because the bot manages to do less in the same amount of time.
When it becomes a problem
On a thirty-page website, the budget is unnoticeable. The difference begins on catalogs with thousands of URLs, especially if filters generate endless parameter combinations.
- New products appear in search after weeks, not days
- The bot crawls filters instead of product pages
- Updated prices in search results remain old
How to check it yourself
Open Yandex Webmaster, section «Indexing – Crawl statistics». If URLs with parameters prevail among the crawled pages, and product pages are rare, the budget is going to the wrong place.