How Yandex indexes sites
A site on search results page

Context-sensitive help

The service lets you get information about pages in the Yandex search database, inform Yandex of new and removed pages, configure indexing, and improve your site's representation in search results

Add a site

Site data may contain confidential information. For this reason, Yandex must verify that you have rights to manage the site. More information

The service promptly warns you if malware or spam is detected on your site. If your site has been infected, review the recommendations for finding and removing malicious code

Enter the site's region or lack of a region, and the address and phone number of your organization. This will improve the search for your site in various regions

In order to add a site to Yandex.Webmaster, the server the site resides on must transmit Yandex robots the "200 OK" HTTP status or redirect to a page corresponding to this status

List of Yandex bots

My sites

Site information is only accessible to users who have confirmed their site management rights.

Registering a site in the service doesn't affect indexing in any way.

General information

TIC determines the site's “credibility” by evaluating the quality of links to it from other sites.


A dramatic change in the number of pages loaded or participating in search might be related to changes on the site. For example, the site structure or robots.txt file changed.

How to speed up indexing of site pages

How to exclude a page or section of the site from search

What is an HTTP code?

Site structure

This page shows sections of the site that make up more than 1% of the total number of pages loaded to the Search database.

When you remove a user section from the site structure, information about it remains in the Search database.

How to prevent the Yandex bot from visiting pages in a particular section

Check URL

You can only check a page on a site that you have confirmed rights to.

In the field marked URL you can enter the full page URL or just the relative path from the site root beginning with “/”.

It takes 1-2 minutes to collect and process information. As soon as the system is done processing data, the report status switches to “Ready”.

What is the HTTP status?

Inbound links

Internal link — A link that is located on a page on your site and leads to another page on the same site.

Broken internal links negatively affect the site's usability — if such links are discovered, you need to fix them.

Broken links might be excluded from the index. For more information, see “Indexing”.

If you set or removed link from a page, changes will be reflected in the service after this page is reindexed by the bot.

External link — A link on another site that leads to pages on your site.

If you set or removed link from a page, changes will be reflected in the service after this page is reindexed by the bot.

Sitemap files

A Sitemap is a file with information about website pages that are available for indexing. More information.

Before adding a new Sitemap file, check it using our validator.

If the Sitemap file was changed after it was added to the service, you don't need to remove it and re-add it, since the Yandex bot regularly checks files for changes.

The bot processes Sitemap files once every two weeks.

Relocate site

Mirrors are sites that return the same content when accessed. More information.

The main mirror is the site's domain name that is used for indexing and displaying in search results if the site can be accessed at multiple addresses.

How to specify the main mirror

Relocation reccomendations


How to correctly set the region

Changes to the region will be checked and will take effect after the search database is updated.

Site in search

Search queries

Letter case of site name

The letter case of site name doesn't affect its ranking in Search.

Which changes to the letter case of site name are allowed

Changes will be checked and will take effect after the search database is updated.


Sitelinks are generated automatically. In order for the bot to identify them correctly, the site must meet the requirements.

What are sitelinks?

Analysis of robots.txt

The Results of analyzing robots.txt section lists all the directives that the bot will follow when indexing the site.

To check whether specific pages are allowed or disallowed for indexing, enter these pages to the URL list.

Checking the server response

Yandex bots use various User-agents. To determine which bot accesses your site, check its User-agent in the server logs.

List of Yandex bots


Recommendations for adapting a site to mobile devices


How did malware get on my site?

Where exactly is this malicious code?

What are infection chains?


Low-quality sites according to Yandex

Use of SEO links (“Minusinsk”)

Pages available on search

This section shows the pages visited by the Yandex indexing bot. A page might not be used in search results if it duplicates the content of another page, contains spam or viruses, redirects to another URL, or an error occurred when loading it.

How to remove certain pages from Search

How to speed up indexing of site pages

Excluded pages

Why does the bot exclude pages?

If a page becomes available for indexing, it appears in Search after the bot re-indexes it and the search database is updated.

How to remove pages from the list of exclusions

Pages visited

This section shows pages that the Yandex bot visited.

Rate this article
Thank you for your feedback!