---
metadata:
- name: generator
content: Diplodoc Platform v5.50.6
alternate:
- https://yandex.com/support/webmaster/en/service/crawl-rate.md
- https://yandex.com/support/webmaster/tr/service/crawl-rate.md
---
> **Documentation Index:** Fetch the complete configuration index at https://yandex.com/support/webmaster/en/llms.txt
# The site crawl rate
Yandex robots constantly [index](https://yandex.com/support/webmaster/en/robot-workings/robot.md) sites by crawling them and downloading pages to the search database.
The site crawl rate is the number of requests per second that the robot sends to your site.
{% note info %}
You must configure the crawl rate for the site's primary domain and each subdomain separately.
{% endnote %}
## Default setting {#base}
The optimal crawl rate is calculated using algorithms so that the robot can load the maximum number of pages without overloading the server. This is why the **Optimize automatically** option on the **Indexing** → **Crawl rate** page in Yandex Webmaster is enabled by default.
## Changing the crawl rate {#settings}
{% list tabs %}
- Speed reduction
You may need to reduce the crawl speed if you notice a large number of robot requests to the server where your site is located. This can increase the server response time and, as a result, reduce the loading speed of site pages. You can check these metrics using the [Yandex Metrica report](https://yandex.com/support/metrica/reports/timing.html).
Before changing the crawl rate for your site, find out what pages the robot requests more often.
- Analyze the server logs. Contact the person responsible for the site or the hosting provider.
- View the list of URLs on the **Indexing** → **Crawl statistics** page in Yandex Webmaster (set the option to **All pages**). Check if the list contains service pages or duplicate pages, for example, with GET parameters.
If you find that the robot accesses service pages or duplicate pages, prohibit their indexing in the `robots.txt` file using the [Disallow directive](https://yandex.com/support/webmaster/en/robot-workings/allow-disallow.md). This will help reduce the number of unnecessary robot requests.
To check if the rules are correct, use the [Robots.txt analysis tool](https://webmaster.yandex.com/tools/robotstxt/).
- Increasing the rate
You can increase the site crawl rate. The value you set is considered as a recommended rate for the robot. The actual crawl rate may differ from the one you set taking into account the site information Yandex has.
{% endlist %}
1. In Yandex Webmaster, go to **Indexing** → **Crawl rate**.
1. Turn on the **Set manually** option.
1. Move the slider to the desired position. By default, it is set to the optimal crawl rate calculated for your site.
1. Save your changes.